-- Logs begin at Sat 2021-12-25 20:01:33 UTC, end at Sat 2021-12-25 22:38:42 UTC. -- Dec 25 20:56:08.917145 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Dec 25 20:56:08.925693 ncdv-master-1 devstack@n-api.service[120865]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 25 20:56:08 2021] *** Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: nodename: ncdv-master-1 Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: machine: x86_64 Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: clock source: unix Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: pcre jit disabled Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: detected number of CPU cores: 4 Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: current working directory: / Dec 25 20:56:08.927676 ncdv-master-1 devstack@n-api.service[120865]: detected binary path: /usr/bin/uwsgi-core Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: your processes number limit is 47680 Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: your memory page size is 4096 bytes Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: detected max file descriptor number: 2048 Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: lock engine: pthread robust mutexes Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: thunder lock: enabled Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 25 20:56:08.929017 ncdv-master-1 devstack@n-api.service[120865]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 25 20:56:08.976891 ncdv-master-1 devstack@n-api.service[120865]: Python main interpreter initialized at 0x55e6dc5e49c0 Dec 25 20:56:08.976891 ncdv-master-1 devstack@n-api.service[120865]: python threads support enabled Dec 25 20:56:08.977123 ncdv-master-1 devstack@n-api.service[120865]: your server socket listen backlog is limited to 100 connections Dec 25 20:56:08.977123 ncdv-master-1 devstack@n-api.service[120865]: your mercy for graceful operations on workers is 90 seconds Dec 25 20:56:08.977266 ncdv-master-1 devstack@n-api.service[120865]: mapped 403077 bytes (393 KB) for 2 cores Dec 25 20:56:08.977351 ncdv-master-1 devstack@n-api.service[120865]: *** Operational MODE: preforking *** Dec 25 20:56:08.977554 ncdv-master-1 devstack@n-api.service[120865]: *** uWSGI is running in multiple interpreter mode *** Dec 25 20:56:08.977554 ncdv-master-1 devstack@n-api.service[120865]: spawned uWSGI master process (pid: 120865) Dec 25 20:56:08.977743 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Dec 25 20:56:08.979737 ncdv-master-1 devstack@n-api.service[120865]: spawned uWSGI worker 1 (pid: 120866, cores: 1) Dec 25 20:56:08.979737 ncdv-master-1 devstack@n-api.service[120865]: spawned uWSGI worker 2 (pid: 120867, cores: 1) Dec 25 20:56:08.979737 ncdv-master-1 devstack@n-api.service[120865]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 25 20:56:10.757912 ncdv-master-1 devstack@n-api.service[120867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:56:10.757912 ncdv-master-1 devstack@n-api.service[120867]: from cryptography.utils import int_from_bytes Dec 25 20:56:10.758605 ncdv-master-1 devstack@n-api.service[120867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:56:10.758605 ncdv-master-1 devstack@n-api.service[120867]: from cryptography.utils import int_from_bytes Dec 25 20:56:10.762157 ncdv-master-1 devstack@n-api.service[120866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:56:10.762157 ncdv-master-1 devstack@n-api.service[120866]: from cryptography.utils import int_from_bytes Dec 25 20:56:10.762630 ncdv-master-1 devstack@n-api.service[120866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 20:56:10.762630 ncdv-master-1 devstack@n-api.service[120866]: from cryptography.utils import int_from_bytes Dec 25 20:56:13.315329 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 20:56:13.315840 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 20:56:13.316051 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 20:56:13.316405 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 20:56:13.316657 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 20:56:13.317062 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.317385 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.317539 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 20:56:13.317889 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.317970 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 20:56:13.318062 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.318778 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 20:56:13.318872 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.319128 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.319214 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 20:56:13.319382 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 20:56:13.319476 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.319747 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.319841 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320074 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320167 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320332 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320433 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320642 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320729 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.320988 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.321077 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.321310 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.321404 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.321615 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.321726 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.321923 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322025 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322236 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322328 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322536 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322625 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322855 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.322949 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.323156 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.323249 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.323537 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.323653 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.323851 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.324091 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.324217 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.324396 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.324491 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.324703 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.324808 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325061 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325163 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325372 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325477 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325678 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325887 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.325987 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.326201 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.326322 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.326518 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.326621 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.326812 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.326905 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.327150 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.327271 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.327465 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.327566 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.327771 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.327865 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.328093 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.328194 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.328406 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.328545 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.328728 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.328852 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.329063 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.329167 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.329465 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.329560 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.329781 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.329880 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.330084 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.330171 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.330397 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.330499 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.330711 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.330803 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331027 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331113 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331343 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331430 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331642 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331728 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.331947 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.332035 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.332257 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.332367 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.332574 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.332763 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.332929 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333033 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333192 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333332 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333469 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333603 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333741 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.333909 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.334573 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.334687 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.334894 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.334988 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.335214 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.335370 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.335456 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.335591 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.335678 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.335900 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336003 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336146 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336303 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336447 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336606 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336769 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.336934 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337121 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337240 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337442 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337541 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337694 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337832 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.337944 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.338134 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.338263 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.338436 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.338584 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.338739 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.338891 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339058 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339200 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339369 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339508 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339686 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339814 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.339991 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.340119 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.340305 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.340426 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.340696 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.340788 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.340965 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.341065 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.341273 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.341373 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.341609 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.341694 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.341939 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342077 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342228 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342316 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342542 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342627 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342859 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.342946 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.343163 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.343252 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.343718 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.343817 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.344021 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.344109 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.344337 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.344424 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.344663 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.344754 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345007 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345098 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345286 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345373 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345585 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345670 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345885 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.345983 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.346199 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.346285 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.346500 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.346594 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.346800 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.346894 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347100 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347198 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347363 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347460 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347661 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347761 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.347969 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348054 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348266 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348352 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348568 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348663 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348869 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.348972 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.349194 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.349279 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.349514 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.349604 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.349817 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.349908 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.350117 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.350202 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.350422 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.350508 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.350729 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.350845 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351027 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351112 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351326 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351412 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351624 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351715 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.351924 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352019 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352230 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352319 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352525 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352610 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352826 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.352955 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.353168 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.353256 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.353469 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.353561 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.353769 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.353899 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354085 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354175 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354385 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354491 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354685 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354771 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.354999 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355095 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355294 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355381 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355595 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355681 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355899 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.355991 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.356198 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.356290 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.356500 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.356642 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.356799 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.356931 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.357124 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.357212 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.357431 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.357557 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.357728 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.357835 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358027 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358124 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358326 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358437 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358621 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358716 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.358923 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359020 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359230 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359337 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359530 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359625 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359831 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.359934 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.360131 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.360236 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.360431 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.360526 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.360732 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.360829 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.361075 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.361171 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.361397 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.361489 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.361707 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.361793 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.362016 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.362104 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.362324 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.362424 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.362640 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 20:56:13.362734 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.362945 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363032 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363254 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363346 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363576 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363670 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363886 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.363972 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.364197 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.364304 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.364501 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.364597 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.364813 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.364921 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.365173 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.365260 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.365500 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.365599 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.365813 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.365900 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.366123 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.366217 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.366435 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.366522 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.366745 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.366862 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367053 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367140 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367367 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367461 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367678 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367774 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.367985 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.368071 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.368301 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.368396 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.368620 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.368706 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.368952 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369044 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369269 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369358 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369577 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369669 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369895 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.369980 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.370204 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.370290 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.370508 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.370593 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.370815 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.370901 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.371141 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.371235 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.371451 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.371538 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.371758 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.371850 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.372086 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.372173 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.372397 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.372483 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.372707 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.372804 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373041 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373128 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373346 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373433 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373647 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373746 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.373954 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374047 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374254 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374347 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374569 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374668 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374892 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.374984 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.375193 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.375278 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.375496 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.375589 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.375803 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.375897 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.376111 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.376203 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.376413 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.376499 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.376711 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.376797 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377042 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377142 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377350 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377444 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377653 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377749 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.377973 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378059 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378281 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378368 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378581 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378673 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378887 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.378973 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.379191 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.379278 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.379491 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.379576 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.379794 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.379888 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.380100 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.380185 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.380406 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.380491 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.381209 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.381323 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.381552 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.381637 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.381860 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.381946 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.382164 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.382262 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.382482 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.382575 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.382795 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.382882 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.383097 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.383194 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.383404 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.383490 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.383724 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.383816 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384035 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384122 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384335 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384427 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384643 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384730 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.384967 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385058 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385271 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385357 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385574 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385658 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385879 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.385966 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.386178 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.386264 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.386483 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.386568 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.386783 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.386870 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387081 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387167 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387381 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387474 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387685 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387808 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.387989 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388088 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388289 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388388 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388590 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388683 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388909 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.388998 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.389215 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.389318 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.389524 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.389610 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.389849 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.389942 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.390163 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.390258 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.390467 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.390554 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.390772 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.390858 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.391077 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.391206 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.391391 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.391478 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.391700 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.391785 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392008 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392102 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392315 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392424 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392633 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392730 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.392962 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393056 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393270 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393357 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393584 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393670 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393890 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.393978 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.394200 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.394294 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.394506 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.394591 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.394815 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.394901 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.395113 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.395198 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.395425 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.395523 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.395741 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.395834 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.396053 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.396147 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.396413 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397043 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397241 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397329 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397550 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397636 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397855 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.397949 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.398162 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.398247 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.398469 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.398563 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.398775 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.398875 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.399079 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.399166 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.399393 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.399487 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.399703 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.399791 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400015 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400101 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400323 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400407 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400632 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400720 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.400957 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.401047 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.401269 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.401365 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.401567 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.401654 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.401877 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402008 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402191 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402276 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402501 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402589 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402808 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.402901 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.403115 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.403246 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.403429 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.403515 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.403731 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.403817 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404034 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404127 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404341 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404426 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404641 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404734 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.404965 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405068 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405275 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405362 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405584 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405677 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405892 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.405993 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.406199 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.406285 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.406499 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.406586 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.406803 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.406897 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.407106 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.407192 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.407405 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.407490 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.407705 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.407792 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408011 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408096 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408319 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408410 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408621 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408708 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.408960 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409051 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409272 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409356 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409574 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409661 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409872 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.409959 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.410180 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.410265 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.410482 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.410569 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.410779 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.410872 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.411079 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.411174 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.411379 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.411464 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.411705 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.411789 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.412516 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.412655 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.412827 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.412928 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.413167 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.413261 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.413485 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.413580 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.413794 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.413888 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.414103 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.414189 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.414410 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.414506 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.414718 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.414803 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415034 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415127 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415343 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415430 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415649 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415734 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.415954 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416108 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416262 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416357 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416567 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416661 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416903 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.416991 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.417219 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.417306 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.417528 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.417614 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.417835 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.417920 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.418140 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.418228 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.418440 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.418526 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.418747 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.418845 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.419056 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.419142 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.419385 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.419625 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.419711 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.419952 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420040 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420264 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420351 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420578 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420673 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420901 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.420990 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.421223 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.421308 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.421550 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.421789 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.421888 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.422127 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.422212 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.422446 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.422533 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.422750 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.422839 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423052 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423190 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423336 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423478 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423646 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423796 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.423933 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.424110 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.424253 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.424433 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.424578 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.424744 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.424902 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.425088 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.425227 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.425402 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.425546 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.425709 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.425851 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426027 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426159 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426336 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426483 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426627 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426763 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.426929 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.427062 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.427228 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.427359 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.427540 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.427701 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.428399 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.428491 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.428702 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.428801 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429026 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429116 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429329 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429432 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429675 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429763 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.429979 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.430068 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.430286 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.430373 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.430618 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.430713 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.430933 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431022 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431243 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431338 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431546 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431690 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431834 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.431974 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.432155 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.432296 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.432440 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.432575 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.432743 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.432897 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433076 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433164 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433385 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433486 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433685 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433771 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.433991 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.434084 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.434297 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.434392 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.434603 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.434702 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.434911 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435004 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435210 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435305 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435514 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435602 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435813 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.435906 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.436124 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.436277 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.436414 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.436550 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.436714 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.436850 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437046 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437137 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437354 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437449 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437659 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437753 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.437957 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438044 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438262 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438350 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438562 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438648 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438871 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.438958 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.439169 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.439254 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.439473 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.439559 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.439770 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.439857 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.440075 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.440162 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.440378 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.440473 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.440675 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.440761 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441004 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441105 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441311 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441410 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441611 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441743 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441910 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.441996 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.442213 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.442307 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.442511 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.442596 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.442810 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.442933 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.443113 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.443253 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.443465 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.443551 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.443775 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.443868 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.444074 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.444162 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.444379 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.444491 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.444676 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.444787 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.445475 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.445633 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.445723 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.445803 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.445882 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.445960 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446049 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446129 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446215 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446295 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446454 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446548 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446753 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.446841 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447051 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447136 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447368 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447469 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447674 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447767 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.447974 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.448060 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.448275 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.448368 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.448570 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.448655 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.448939 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449031 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449198 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449299 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449503 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449596 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449829 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.449922 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.450142 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.450240 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.450448 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.450541 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.450752 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.450837 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451056 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451147 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451363 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451502 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451663 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451766 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.451974 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452108 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452279 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452416 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452584 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452722 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452902 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.452993 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.453205 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.453341 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.453524 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.453611 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.453831 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.453921 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.454137 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.454223 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.454453 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.454556 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.454767 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.454854 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455083 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455171 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455384 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455484 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455687 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455772 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.455990 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.456075 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.456295 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.456399 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.456600 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.456687 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.456925 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457016 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457233 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457485 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457581 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457663 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457834 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.457922 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.458139 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.458234 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.458444 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.458537 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.458745 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.459325 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.459578 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.459666 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.459894 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.459981 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.460206 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.460292 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.460520 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.460609 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.460833 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.460970 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.461158 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.461255 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.461466 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.461555 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.461767 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.461854 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.462075 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.462227 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.462373 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.462509 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.462676 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.462813 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463007 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463103 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463321 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463455 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463628 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463717 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.463942 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.464042 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.464244 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.464330 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.464554 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.464646 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.464864 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.465092 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.465203 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.465318 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.465578 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.465742 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.465886 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466021 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466192 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466284 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466499 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466585 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466800 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.466897 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.467101 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.467188 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.467406 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.467504 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.467726 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.467824 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.468026 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.468140 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.468325 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.468706 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.468910 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469046 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469223 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469361 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469527 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469669 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469851 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.469976 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.470261 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.470358 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.470570 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.470673 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.470872 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.470959 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.471186 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.471271 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.471492 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.471592 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.471821 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.471915 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.472130 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.472219 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.472454 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.472626 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.472791 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.472897 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.473134 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.473270 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.473446 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.473543 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.473753 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.473889 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.474072 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.474206 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.474391 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.475068 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.475275 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.475399 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.475591 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.475728 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.475891 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.476056 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.476212 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.476368 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.476531 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.476686 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.476840 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.477024 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.477183 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.477353 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.477591 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.477687 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.477914 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478012 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478222 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478316 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478538 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478633 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478860 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.478956 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.479162 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.479274 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.479461 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.479558 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.479769 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.479864 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.480075 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.480214 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.480377 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.480541 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.480695 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.480857 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481030 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481203 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481338 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481535 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481644 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481844 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.481933 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.482153 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.482241 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.482465 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.482552 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.482772 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.482861 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.483080 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.483169 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.483405 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.483565 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.483710 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.483796 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484020 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484109 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484332 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484427 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484631 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484718 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.484955 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485061 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485268 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485378 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485571 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485671 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485867 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.485954 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.486167 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.486270 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.486491 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.486578 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.486792 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.486878 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.487108 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.487209 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.487414 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.487500 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.487738 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.487825 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488041 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488136 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488343 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488437 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488648 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488742 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.488975 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.489085 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.489308 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.489394 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.489614 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.489708 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.489921 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490008 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490245 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490331 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490555 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490650 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490855 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.490942 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.491157 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.491245 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.491456 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.491552 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.491760 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.491850 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492059 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492147 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492360 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492509 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492666 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492800 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.492989 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.493080 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.493294 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.493384 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.493612 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.493749 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.493918 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494005 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494218 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494307 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494516 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494611 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494817 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.494903 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.495119 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.495207 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.495429 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.495516 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.495756 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.495854 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.496060 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.496147 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.496375 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.496461 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.496686 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.496782 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497016 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497119 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497326 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497420 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497631 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497727 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.497940 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498038 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498253 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498341 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498564 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498668 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498874 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.498968 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.499186 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.499274 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.499496 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.499592 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.499802 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.499890 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.500115 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.500217 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.500425 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.500522 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.500737 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.500825 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.501076 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.501280 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.501377 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.501611 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.501699 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.501926 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502012 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502240 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502375 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502553 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502641 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502864 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.502950 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.503174 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.503267 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.503485 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.503616 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.503799 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.504087 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.504202 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.504406 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.504505 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.504727 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.504827 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.505114 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.505216 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.505376 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.505476 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.505692 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.505787 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506025 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506133 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506335 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506423 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506649 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506738 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.506959 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.507048 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.507270 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.507357 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.507599 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.507694 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.507904 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508000 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508217 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508305 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508531 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508631 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508845 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.508958 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.509179 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.509267 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.509487 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.509585 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.509802 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.509889 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.510116 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.510202 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.510428 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.510525 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.510738 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.510825 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511049 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511136 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511359 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511458 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511674 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511760 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.511989 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.512077 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.512306 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.512411 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.512618 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.512724 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.512950 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.513043 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.513265 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.513363 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.513592 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.513777 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514009 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514161 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514300 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514435 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514577 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514728 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.514877 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515027 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515165 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515321 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515469 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515633 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515770 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.515990 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.516155 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.516289 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.516531 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.516618 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.516841 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517021 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517173 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517262 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517473 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517560 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517793 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.517882 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.518099 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.518213 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.518402 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.518498 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.518720 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.518818 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519029 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519116 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519366 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519557 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519682 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519905 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.519997 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.520218 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.520305 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.520541 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.520629 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.520863 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.520982 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.521200 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.521287 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.522038 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.522128 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.522351 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.522437 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.522652 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.522889 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523031 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523255 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523343 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523562 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523656 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523866 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.523965 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.524166 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.524257 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.524476 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.524587 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.524782 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.524927 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.525109 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.525260 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.525420 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.525570 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.525724 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.525886 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526051 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526208 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526355 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526523 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526658 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526833 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.526960 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.527142 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.527267 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.527457 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.527554 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.527771 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.527913 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.528078 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.528216 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.528391 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.528536 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.528700 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.528839 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529036 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529168 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529346 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529499 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529636 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529773 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.529944 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530082 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530229 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530364 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530543 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530688 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530844 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.530982 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.531151 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.531287 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.531433 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.531567 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.531737 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.531882 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532048 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532184 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532356 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532492 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532659 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532757 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.532993 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.533128 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.533301 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.533456 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.533615 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.533763 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.533925 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.534060 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.534234 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.534450 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.534584 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.534827 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.534964 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.535143 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.535279 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.535459 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.535604 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.535789 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.535927 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.536080 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.536242 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.536383 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.536486 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.536684 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.536771 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.537073 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.537166 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.537386 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.537635 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.537725 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.537987 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538073 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538295 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538382 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538603 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538692 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538910 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.538996 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.539218 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.539314 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.539524 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.539620 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.539831 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.539919 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.540143 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.540239 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.540484 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.540571 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.540795 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.540896 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.541133 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.541232 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.541444 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.541538 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.541753 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.541848 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542058 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542148 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542365 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542460 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542671 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542766 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.542979 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.543102 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.543289 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.543380 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.543610 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.543706 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.543921 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.544067 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.544224 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.544358 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.544545 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.544676 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.544864 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545050 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545186 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545322 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545480 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545624 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545801 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.545938 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.546115 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.546253 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.546436 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.546578 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.546756 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.546893 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.547072 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.547207 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.547380 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.547525 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.547706 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.547844 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.548040 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.548184 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.548365 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.548503 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.548688 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.548826 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549017 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549152 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549324 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549479 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549623 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549762 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.549906 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550048 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550233 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550325 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550561 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550647 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550872 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.550966 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.551194 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.551282 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.551502 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.551590 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.551822 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.551919 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.552130 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.552224 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.552436 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.552530 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.553283 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.553432 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.553709 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.553884 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554028 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554137 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554234 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554317 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554522 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554620 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554829 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.554918 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.555138 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.555227 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.555446 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.555534 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.555756 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.555843 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.556065 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.556154 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.556385 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.556484 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.556698 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.556794 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557025 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557116 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557347 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557444 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557659 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557754 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.557974 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558062 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558283 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558369 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558591 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558688 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558899 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.558990 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.559208 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.559302 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.559517 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.559618 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.559824 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.559913 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.560131 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.560220 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.560443 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.560532 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.560758 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.560854 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.561105 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.561194 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.561425 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.561522 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.561737 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.561825 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562057 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562151 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562368 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562456 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562683 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562771 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.562996 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.563093 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.563310 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.563399 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.563626 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.563714 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.563931 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.564025 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.564237 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.564333 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.564507 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 20:56:13.564647 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.564908 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.565232 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.565624 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.565899 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.566249 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.566581 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.566900 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.567216 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.567526 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 20:56:13.567772 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 20:56:13.587729 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_db.sqlalchemy.engines [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.589990 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_db.sqlalchemy.engines [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.654097 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.context [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=120867) load_cells /opt/stack/nova/nova/context.py:464}} Dec 25 20:56:13.656505 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.context [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=120866) load_cells /opt/stack/nova/nova/context.py:464}} Dec 25 20:56:13.658270 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 20:56:13.659830 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 20:56:13.660609 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 20:56:13.660717 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_concurrency.lockutils [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 20:56:13.662807 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_concurrency.lockutils [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 20:56:13.663105 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 20:56:13.663608 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_concurrency.lockutils [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 20:56:13.665561 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_concurrency.lockutils [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 20:56:13.674910 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_db.sqlalchemy.engines [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.675701 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_db.sqlalchemy.engines [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.677923 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_db.sqlalchemy.engines [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.680312 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_db.sqlalchemy.engines [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.839607 ncdv-master-1 devstack@n-api.service[120866]: DEBUG oslo_db.sqlalchemy.engines [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:13.842354 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_db.sqlalchemy.engines [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 20:56:14.337734 ncdv-master-1 devstack@n-api.service[120866]: WARNING keystonemiddleware.auth_token [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 20:56:14.344541 ncdv-master-1 devstack@n-api.service[120866]: WARNING keystonemiddleware.auth_token [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 20:56:14.455683 ncdv-master-1 devstack@n-api.service[120867]: WARNING keystonemiddleware.auth_token [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 20:56:14.463048 ncdv-master-1 devstack@n-api.service[120867]: WARNING keystonemiddleware.auth_token [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 20:56:14.684675 ncdv-master-1 devstack@n-api.service[120866]: WARNING keystonemiddleware.auth_token [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 20:56:14.689936 ncdv-master-1 devstack@n-api.service[120866]: WARNING keystonemiddleware.auth_token [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 20:56:14.695244 ncdv-master-1 devstack@n-api.service[120866]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6dc5e49c0 pid: 120866 (default app) Dec 25 20:56:14.697465 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:56:14.698658 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001867 Dec 25 20:56:14.699067 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 788 bytes} [Sat Dec 25 20:56:14 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:56:14.801450 ncdv-master-1 devstack@n-api.service[120867]: WARNING keystonemiddleware.auth_token [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 20:56:14.807322 ncdv-master-1 devstack@n-api.service[120867]: WARNING keystonemiddleware.auth_token [None req-801be79f-065e-4ae1-8a18-2d12a9d93882 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 20:56:14.812426 ncdv-master-1 devstack@n-api.service[120867]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6dc5e49c0 pid: 120867 (default app) Dec 25 20:57:45.405816 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:57:45.406787 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Dec 25 20:57:45.407704 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 2/2] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:57:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:57:45.849391 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-9c302bc1-a86a-4e42-880f-44739de0b388 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:57:45.879772 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-9c302bc1-a86a-4e42-880f-44739de0b388 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464758 Dec 25 20:57:45.880804 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 20:57:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:57:48.351121 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:57:48.352628 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-068a2f9a-d500-4df3-a31e-78383fae9ef4 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002169 Dec 25 20:57:48.353135 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 3/4] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:57:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:57:48.418684 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-7e858f45-f6f5-44aa-8db1-85611f92bc8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:48.436332 ncdv-master-1 devstack@n-api.service[120867]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:57:48.436332 ncdv-master-1 devstack@n-api.service[120867]: warnings.warn(msg) Dec 25 20:57:48.554402 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-7e858f45-f6f5-44aa-8db1-85611f92bc8e admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.194104 Dec 25 20:57:48.556919 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 2/5] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:57:48 2021] POST /compute/v2.1/flavors => generated 407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:57:48.784990 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-2c156000-d7ac-42e8-9a48-42bcfaf920a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:48.787329 ncdv-master-1 devstack@n-api.service[120866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:57:48.787329 ncdv-master-1 devstack@n-api.service[120866]: warnings.warn(msg) Dec 25 20:57:48.925319 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-2c156000-d7ac-42e8-9a48-42bcfaf920a6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.361341 Dec 25 20:57:48.935193 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 4/6] 10.222.0.32 () {64 vars in 1335 bytes} [Sat Dec 25 20:57:48 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:57:51.396075 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-7e858f45-f6f5-44aa-8db1-85611f92bc8e admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:57:51.397214 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-7e858f45-f6f5-44aa-8db1-85611f92bc8e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Dec 25 20:57:51.397774 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 3/7] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:57:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:57:51.523328 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-6f65de2f-75c1-4fd6-9df5-fb4788622678 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds512M"}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:51.544546 ncdv-master-1 devstack@n-api.service[120866]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:57:51.544546 ncdv-master-1 devstack@n-api.service[120866]: warnings.warn(msg) Dec 25 20:57:51.697347 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-6f65de2f-75c1-4fd6-9df5-fb4788622678 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.292803 Dec 25 20:57:51.698587 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 5/8] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:57:51 2021] POST /compute/v2.1/flavors => generated 404 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:57:51.712921 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-42219564-ccfb-4605-aca9-4f65e078f477 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:51.712921 ncdv-master-1 devstack@n-api.service[120867]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 20:57:51.712921 ncdv-master-1 devstack@n-api.service[120867]: warnings.warn(msg) Dec 25 20:57:51.884045 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-42219564-ccfb-4605-aca9-4f65e078f477 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.176198 Dec 25 20:57:51.884598 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 4/9] 10.222.0.32 () {64 vars in 1335 bytes} [Sat Dec 25 20:57:51 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 20:57:54.525352 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-6f65de2f-75c1-4fd6-9df5-fb4788622678 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:57:54.526887 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-6f65de2f-75c1-4fd6-9df5-fb4788622678 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002002 Dec 25 20:57:54.527695 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 6/10] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:57:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:57:54.589209 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-2401d5a3-ddf0-4a3f-be8c-a6ec8c941ef6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds1G"}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:54.681327 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-2401d5a3-ddf0-4a3f-be8c-a6ec8c941ef6 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.146323 Dec 25 20:57:54.696404 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-823600a6-89f6-4da5-96cc-5568d2aa9f85 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:54.703408 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 5/11] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:57:54 2021] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 20:57:54.776671 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-823600a6-89f6-4da5-96cc-5568d2aa9f85 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079619 Dec 25 20:57:54.776671 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 7/12] 10.222.0.32 () {64 vars in 1335 bytes} [Sat Dec 25 20:57:54 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:57:57.507181 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-2401d5a3-ddf0-4a3f-be8c-a6ec8c941ef6 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:57:57.508195 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-2401d5a3-ddf0-4a3f-be8c-a6ec8c941ef6 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Dec 25 20:57:57.509021 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 6/13] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:57:57 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:57:57.573417 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-a518159e-bf72-44c4-8a39-1ec4648aede5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:57.657169 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-a518159e-bf72-44c4-8a39-1ec4648aede5 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141222 Dec 25 20:57:57.657921 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 8/14] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:57:57 2021] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:57:57.670462 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-28ce557b-f6bf-4dc5-a6c3-52a00d8b5c1b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:57:57.769460 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-28ce557b-f6bf-4dc5-a6c3-52a00d8b5c1b admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102702 Dec 25 20:57:57.770043 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 7/15] 10.222.0.32 () {64 vars in 1335 bytes} [Sat Dec 25 20:57:57 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:58:00.266662 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-a518159e-bf72-44c4-8a39-1ec4648aede5 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:00.267655 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-a518159e-bf72-44c4-8a39-1ec4648aede5 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Dec 25 20:58:00.268195 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 9/16] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:00.325882 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-cd2aeab4-4be5-4f1e-8a90-d80598f9a09d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:00.458976 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-cd2aeab4-4be5-4f1e-8a90-d80598f9a09d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.184719 Dec 25 20:58:00.459543 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 8/17] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:58:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 20:58:00.472334 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-4e51cdc6-5a49-4654-9321-a9b1ba73df79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:00.605804 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-4e51cdc6-5a49-4654-9321-a9b1ba73df79 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137464 Dec 25 20:58:00.607078 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 10/18] 10.222.0.32 () {64 vars in 1335 bytes} [Sat Dec 25 20:58:00 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 20:58:03.127496 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-cd2aeab4-4be5-4f1e-8a90-d80598f9a09d admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:03.129524 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-cd2aeab4-4be5-4f1e-8a90-d80598f9a09d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002536 Dec 25 20:58:03.130127 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 9/19] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:03.196655 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-ca230621-964a-4aa1-b3f5-cbe036380245 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:03.223642 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-ca230621-964a-4aa1-b3f5-cbe036380245 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087004 Dec 25 20:58:03.224414 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 11/20] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 20:58:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:05.823676 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-cd2aeab4-4be5-4f1e-8a90-d80598f9a09d admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:05.825116 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-cd2aeab4-4be5-4f1e-8a90-d80598f9a09d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002030 Dec 25 20:58:05.825836 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 10/21] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:05.889075 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-c796f988-21a1-46b9-adaf-a425250f0c64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "os-flavor-access:is_public": true, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:05.950735 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-c796f988-21a1-46b9-adaf-a425250f0c64 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.117044 Dec 25 20:58:05.951782 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 12/22] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:58:05 2021] POST /compute/v2.1/flavors => generated 402 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:58:05.972165 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-5d5fd0a6-79d8-4f9c-a5ff-48b83f9cad62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:06.255735 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-5d5fd0a6-79d8-4f9c-a5ff-48b83f9cad62 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287736 Dec 25 20:58:06.270226 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 11/23] 10.222.0.32 () {64 vars in 1332 bytes} [Sat Dec 25 20:58:05 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:58:09.663412 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-c796f988-21a1-46b9-adaf-a425250f0c64 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:09.664536 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-c796f988-21a1-46b9-adaf-a425250f0c64 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Dec 25 20:58:09.664977 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 13/24] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:09 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:09.728346 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-fca1b33f-f884-4272-b6cf-241179e47799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "ram": 2048, "disk": 20, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:09.829800 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-fca1b33f-f884-4272-b6cf-241179e47799 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.157395 Dec 25 20:58:09.830478 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 12/25] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:58:09 2021] POST /compute/v2.1/flavors => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 20:58:09.846165 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-91c7c138-d8cf-4dd8-9f5f-3dd841455a5a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:09.979978 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-91c7c138-d8cf-4dd8-9f5f-3dd841455a5a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138939 Dec 25 20:58:09.980561 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 14/26] 10.222.0.32 () {64 vars in 1332 bytes} [Sat Dec 25 20:58:09 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:58:12.594480 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-fca1b33f-f884-4272-b6cf-241179e47799 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:12.595488 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-fca1b33f-f884-4272-b6cf-241179e47799 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Dec 25 20:58:12.595888 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 13/27] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:12 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:12.656744 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-21c20e97-fae2-4e8c-9b95-dc68eacb1301 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "disk": 40}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:12.741431 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-21c20e97-fae2-4e8c-9b95-dc68eacb1301 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.139023 Dec 25 20:58:12.741982 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 15/28] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:58:12 2021] POST /compute/v2.1/flavors => generated 406 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 20:58:12.754035 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-7adb9dd2-c6e6-4ba8-8aac-b74067cd67e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:12.824529 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-7adb9dd2-c6e6-4ba8-8aac-b74067cd67e8 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073854 Dec 25 20:58:12.825031 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 14/29] 10.222.0.32 () {64 vars in 1332 bytes} [Sat Dec 25 20:58:12 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:58:15.372241 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-21c20e97-fae2-4e8c-9b95-dc68eacb1301 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:15.373275 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-21c20e97-fae2-4e8c-9b95-dc68eacb1301 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 25 20:58:15.373671 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 16/30] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:15.436824 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-8bd6ec71-7649-41a0-bdcc-10e686d7fa5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:15.509206 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-8bd6ec71-7649-41a0-bdcc-10e686d7fa5f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.128641 Dec 25 20:58:15.510070 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 15/31] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:58:15 2021] POST /compute/v2.1/flavors => generated 405 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 20:58:15.526206 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-d82c0639-cbb9-46fc-82d7-9baa6249ebcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:15.636897 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-d82c0639-cbb9-46fc-82d7-9baa6249ebcc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118007 Dec 25 20:58:15.637409 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 17/32] 10.222.0.32 () {64 vars in 1332 bytes} [Sat Dec 25 20:58:15 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:58:18.292299 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-8bd6ec71-7649-41a0-bdcc-10e686d7fa5f admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:18.293348 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-8bd6ec71-7649-41a0-bdcc-10e686d7fa5f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Dec 25 20:58:18.293956 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 16/33] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 20:58:18.359701 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-4458514d-55c5-4f46-8c5a-21be6f5cdfba admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "vcpus": 8, "swap": 0}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:18.438419 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-4458514d-55c5-4f46-8c5a-21be6f5cdfba admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.137222 Dec 25 20:58:18.439425 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 18/34] 10.222.0.32 () {64 vars in 1282 bytes} [Sat Dec 25 20:58:18 2021] POST /compute/v2.1/flavors => generated 408 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:58:18.451229 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-e13094af-0204-4d37-b761-157242bb7438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:18.536975 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-e13094af-0204-4d37-b761-157242bb7438 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089310 Dec 25 20:58:18.537856 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 17/35] 10.222.0.32 () {64 vars in 1332 bytes} [Sat Dec 25 20:58:18 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:58:43.463217 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-4458514d-55c5-4f46-8c5a-21be6f5cdfba admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:43.464240 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-4458514d-55c5-4f46-8c5a-21be6f5cdfba admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Dec 25 20:58:43.464630 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 19/36] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:58:43 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:43.522477 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-d0d55d37-1a29-4237-915f-5623233ba22d admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:43.539580 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-d0d55d37-1a29-4237-915f-5623233ba22d admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067806 Dec 25 20:58:43.540128 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 18/37] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 20:58:43 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:45.207371 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-4458514d-55c5-4f46-8c5a-21be6f5cdfba admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:45.208345 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-4458514d-55c5-4f46-8c5a-21be6f5cdfba admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001372 Dec 25 20:58:45.208728 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 20/38] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:45 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:45.428549 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-3edfd3e6-0134-45e1-9ebd-71d36adf590a admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:45.434009 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.wsgi [None req-3edfd3e6-0134-45e1-9ebd-71d36adf590a admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 25 20:58:45.434568 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-3edfd3e6-0134-45e1-9ebd-71d36adf590a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 20:58:45.435866 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-3edfd3e6-0134-45e1-9ebd-71d36adf590a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058193 Dec 25 20:58:45.436366 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 19/39] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 20:58:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:45.445997 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-17eec1d7-5949-4360-8174-b6dad1d44e18 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:45.466910 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-17eec1d7-5949-4360-8174-b6dad1d44e18 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024480 Dec 25 20:58:45.467455 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 21/40] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 20:58:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:45.477859 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-255bdc5d-7972-4d76-abf5-c0c3d9fea62f admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:45.499916 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-255bdc5d-7972-4d76-abf5-c0c3d9fea62f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025545 Dec 25 20:58:45.500442 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 20/41] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 20:58:45 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:45.510164 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-e8b4d5aa-04eb-4cc6-854b-652c53f41b60 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:45.516285 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.wsgi [None req-e8b4d5aa-04eb-4cc6-854b-652c53f41b60 admin admin] HTTP exception thrown: Flavor 42 could not be found. Dec 25 20:58:45.516974 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-e8b4d5aa-04eb-4cc6-854b-652c53f41b60 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=120866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 20:58:45.517788 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-e8b4d5aa-04eb-4cc6-854b-652c53f41b60 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011156 Dec 25 20:58:45.518815 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 22/42] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 20:58:45 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:47.053299 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-255bdc5d-7972-4d76-abf5-c0c3d9fea62f admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:47.054298 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-255bdc5d-7972-4d76-abf5-c0c3d9fea62f admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Dec 25 20:58:47.054687 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 21/43] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:47.255290 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-ebeb6897-5a53-4102-82bb-0ace36bb99f2 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:47.260390 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.wsgi [None req-ebeb6897-5a53-4102-82bb-0ace36bb99f2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 25 20:58:47.260965 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-ebeb6897-5a53-4102-82bb-0ace36bb99f2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 20:58:47.261734 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-ebeb6897-5a53-4102-82bb-0ace36bb99f2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059624 Dec 25 20:58:47.262232 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 23/44] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 20:58:47 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:47.271712 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-c8266bc3-1d3d-4bf3-ad8e-8e65b3b4a245 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:47.284774 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-c8266bc3-1d3d-4bf3-ad8e-8e65b3b4a245 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016494 Dec 25 20:58:47.285303 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 22/45] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 20:58:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 20:58:47.295347 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-0b270113-60e5-45aa-a76d-225d2f05815d admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:47.308202 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-0b270113-60e5-45aa-a76d-225d2f05815d admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016775 Dec 25 20:58:47.308705 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 24/46] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 20:58:47 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:47.318393 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-870dffb3-a487-4d42-b0eb-1fe6d57377f4 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:47.323245 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.wsgi [None req-870dffb3-a487-4d42-b0eb-1fe6d57377f4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Dec 25 20:58:47.323792 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-870dffb3-a487-4d42-b0eb-1fe6d57377f4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=120867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 20:58:47.324546 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-870dffb3-a487-4d42-b0eb-1fe6d57377f4 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009458 Dec 25 20:58:47.325047 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 23/47] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 20:58:47 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:48.871974 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-0b270113-60e5-45aa-a76d-225d2f05815d admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:48.873660 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-0b270113-60e5-45aa-a76d-225d2f05815d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Dec 25 20:58:48.874046 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 25/48] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:48 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:49.071955 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-e4e030a5-899e-4091-bebe-8d5b6b97d3de admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:49.077349 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.wsgi [None req-e4e030a5-899e-4091-bebe-8d5b6b97d3de admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 25 20:58:49.077900 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-e4e030a5-899e-4091-bebe-8d5b6b97d3de admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 20:58:49.078694 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-e4e030a5-899e-4091-bebe-8d5b6b97d3de admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057944 Dec 25 20:58:49.079213 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 24/49] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 20:58:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:49.089352 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-d0ab67fc-4d5f-47cd-ac06-097c7ce161c1 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:49.102964 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-d0ab67fc-4d5f-47cd-ac06-097c7ce161c1 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017475 Dec 25 20:58:49.103492 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 26/50] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 20:58:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:49.114383 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:49.127110 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016607 Dec 25 20:58:49.127624 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 25/51] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 20:58:49 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:58:49.136993 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-f19dc26b-416e-499a-9976-20bc67b0ec23 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:49.142030 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.wsgi [None req-f19dc26b-416e-499a-9976-20bc67b0ec23 admin admin] HTTP exception thrown: Flavor 451 could not be found. Dec 25 20:58:49.142559 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-f19dc26b-416e-499a-9976-20bc67b0ec23 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=120866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 20:58:49.143325 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-f19dc26b-416e-499a-9976-20bc67b0ec23 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.009759 Dec 25 20:58:49.143844 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 27/52] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 20:58:49 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Dec 25 20:58:50.680705 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:50.681725 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Dec 25 20:58:50.682114 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 26/53] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:50 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:50.879685 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-94875ba9-5fe5-4671-adb0-d5c23077d667 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:50.970132 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-94875ba9-5fe5-4671-adb0-d5c23077d667 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.140854 Dec 25 20:58:50.970676 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 28/54] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Dec 25 20:58:50 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:58:52.511655 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:52.512643 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Dec 25 20:58:52.513574 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 27/55] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:52 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:52.712024 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-2e45b128-1fc8-4274-bd89-3ad17ba00ccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:52.807935 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-2e45b128-1fc8-4274-bd89-3ad17ba00ccf admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.146565 Dec 25 20:58:52.808404 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 29/56] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Dec 25 20:58:52 2021] POST /compute/v2.1/flavors => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:58:54.339458 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:54.340458 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Dec 25 20:58:54.341407 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 28/57] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:54 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:54.539322 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-14a79668-cdcd-4312-b3f9-e9f17ed9e339 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:54.615501 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-14a79668-cdcd-4312-b3f9-e9f17ed9e339 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.126863 Dec 25 20:58:54.616042 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 30/58] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Dec 25 20:58:54 2021] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:58:56.164196 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:56.165245 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Dec 25 20:58:56.165633 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 29/59] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:56.364263 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-6904504d-0db8-4205-a825-5800b5982a90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 20:58:56.448513 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-6904504d-0db8-4205-a825-5800b5982a90 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.136162 Dec 25 20:58:56.449064 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 31/60] 10.222.0.32 () {64 vars in 1235 bytes} [Sat Dec 25 20:58:56 2021] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 20:58:58.018388 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:58.019377 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001392 Dec 25 20:58:58.019762 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 30/61] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 20:58:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:58:58.221011 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-b7111e19-992f-4bbb-9d05-e1a474e62bc5 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:58:58.241473 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-b7111e19-992f-4bbb-9d05-e1a474e62bc5 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073099 Dec 25 20:58:58.242002 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 32/62] 10.222.0.32 () {60 vars in 1202 bytes} [Sat Dec 25 20:58:58 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:59:47.680775 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:59:47.682351 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-37993b86-cf44-40c8-9c2d-0b487eb3e243 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Dec 25 20:59:47.682743 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 31/63] 10.222.0.32 () {54 vars in 930 bytes} [Sat Dec 25 20:59:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 20:59:47.741309 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-90d2e42f-5bb7-4745-8eeb-dfaeffb3ae72 admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:59:47.760989 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-90d2e42f-5bb7-4745-8eeb-dfaeffb3ae72 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.071782 Dec 25 20:59:47.761517 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 33/64] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 20:59:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 20:59:47.783303 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-79d44c9e-ae18-4a16-ac20-87c031384ee6 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:59:47.790868 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-79d44c9e-ae18-4a16-ac20-87c031384ee6 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011176 Dec 25 20:59:47.791447 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 32/65] 10.222.0.32 () {60 vars in 1282 bytes} [Sat Dec 25 20:59:47 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 20:59:47.802920 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-1c20dd51-105e-4211-9b39-e5f5aec386ea admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:59:47.810817 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-1c20dd51-105e-4211-9b39-e5f5aec386ea admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011338 Dec 25 20:59:47.815849 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 34/66] 10.222.0.32 () {60 vars in 1285 bytes} [Sat Dec 25 20:59:47 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:59:47.823233 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-a00b7c68-fa24-456f-aec6-34e7de48eb98 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:59:47.830518 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-a00b7c68-fa24-456f-aec6-34e7de48eb98 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011364 Dec 25 20:59:47.831026 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 33/67] 10.222.0.32 () {60 vars in 1285 bytes} [Sat Dec 25 20:59:47 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 20:59:47.842666 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-35cef537-ade1-4960-88b0-5be64dd1741e admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 20:59:47.850204 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-35cef537-ade1-4960-88b0-5be64dd1741e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011036 Dec 25 20:59:47.850723 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 35/68] 10.222.0.32 () {60 vars in 1282 bytes} [Sat Dec 25 20:59:47 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:01:21.383599 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-07588d6f-aac2-4565-88e3-d81174789abf tempest-verify_tempest_config-1491818354 tempest-verify_tempest_config-1491818354-project] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:01:21.385556 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-07588d6f-aac2-4565-88e3-d81174789abf tempest-verify_tempest_config-1491818354 tempest-verify_tempest_config-1491818354-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107493 Dec 25 21:01:21.386298 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 34/69] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:01:21 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:05:19.433744 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-35cef537-ade1-4960-88b0-5be64dd1741e admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:05:19.434740 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-35cef537-ade1-4960-88b0-5be64dd1741e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Dec 25 21:05:19.435129 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 36/70] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 21:05:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:05:19.698916 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-b077703d-df7d-4710-9f23-ea0bc817c88b admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:05:19.700061 ncdv-master-1 devstack@n-api.service[120867]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:05:19.700061 ncdv-master-1 devstack@n-api.service[120867]: warnings.warn(msg) Dec 25 21:05:19.701631 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-b077703d-df7d-4710-9f23-ea0bc817c88b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:05:19.702320 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-b077703d-df7d-4710-9f23-ea0bc817c88b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:05:19.703107 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-b077703d-df7d-4710-9f23-ea0bc817c88b admin admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:05:19.703529 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-b077703d-df7d-4710-9f23-ea0bc817c88b admin admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:05:19.742356 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-b077703d-df7d-4710-9f23-ea0bc817c88b admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.155219 Dec 25 21:05:19.742914 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 35/71] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:05:19 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:05:21.285664 ncdv-master-1 devstack@n-api.service[120866]: DEBUG nova.api.openstack.wsgi [None req-35cef537-ade1-4960-88b0-5be64dd1741e admin admin] Calling method '>' {{(pid=120866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:05:21.286657 ncdv-master-1 devstack@n-api.service[120866]: INFO nova.api.openstack.requestlog [None req-35cef537-ade1-4960-88b0-5be64dd1741e admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Dec 25 21:05:21.287188 ncdv-master-1 devstack@n-api.service[120866]: [pid: 120866|app: 0|req: 37/72] 10.222.0.32 () {56 vars in 1074 bytes} [Sat Dec 25 21:05:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:05:21.484341 ncdv-master-1 devstack@n-api.service[120867]: DEBUG nova.api.openstack.wsgi [None req-5a7cffc7-0a8a-4fb3-86bb-210100a1cce2 admin admin] Calling method '>' {{(pid=120867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:05:21.485523 ncdv-master-1 devstack@n-api.service[120867]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:05:21.485523 ncdv-master-1 devstack@n-api.service[120867]: warnings.warn(msg) Dec 25 21:05:21.487063 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-5a7cffc7-0a8a-4fb3-86bb-210100a1cce2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:05:21.487488 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-5a7cffc7-0a8a-4fb3-86bb-210100a1cce2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:05:21.488264 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-5a7cffc7-0a8a-4fb3-86bb-210100a1cce2 admin admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:05:21.488678 ncdv-master-1 devstack@n-api.service[120867]: DEBUG oslo_concurrency.lockutils [None req-5a7cffc7-0a8a-4fb3-86bb-210100a1cce2 admin admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:05:21.510802 ncdv-master-1 devstack@n-api.service[120867]: INFO nova.api.openstack.requestlog [None req-5a7cffc7-0a8a-4fb3-86bb-210100a1cce2 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.078538 Dec 25 21:05:21.511273 ncdv-master-1 devstack@n-api.service[120867]: [pid: 120867|app: 0|req: 36/73] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:05:21 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:06:08.609202 ncdv-master-1 devstack@n-api.service[120865]: Sat Dec 25 21:06:08 2021 - graceful shutdown triggered... Dec 25 21:06:08.609058 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Dec 25 21:06:08.610127 ncdv-master-1 devstack@n-api.service[120867]: Gracefully killing worker 2 (pid: 120867)... Dec 25 21:06:08.610538 ncdv-master-1 devstack@n-api.service[120866]: Gracefully killing worker 1 (pid: 120866)... Dec 25 21:06:09.610129 ncdv-master-1 devstack@n-api.service[120865]: worker 1 buried after 1 seconds Dec 25 21:06:09.610129 ncdv-master-1 devstack@n-api.service[120865]: worker 2 buried after 1 seconds Dec 25 21:06:09.610129 ncdv-master-1 devstack@n-api.service[120865]: goodbye to uWSGI. Dec 25 21:06:09.615217 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Dec 25 21:06:09.617061 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Dec 25 21:06:09.620080 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Dec 25 21:06:09.663519 ncdv-master-1 devstack@n-api.service[136537]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Dec 25 21:06:09 2021] *** Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: nodename: ncdv-master-1 Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: machine: x86_64 Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: clock source: unix Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: pcre jit disabled Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: detected number of CPU cores: 4 Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: current working directory: / Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: detected binary path: /usr/bin/uwsgi-core Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: your processes number limit is 47680 Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: your memory page size is 4096 bytes Dec 25 21:06:09.683656 ncdv-master-1 devstack@n-api.service[136537]: detected max file descriptor number: 2048 Dec 25 21:06:09.684691 ncdv-master-1 devstack@n-api.service[136537]: lock engine: pthread robust mutexes Dec 25 21:06:09.684691 ncdv-master-1 devstack@n-api.service[136537]: thunder lock: enabled Dec 25 21:06:09.684691 ncdv-master-1 devstack@n-api.service[136537]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Dec 25 21:06:09.684691 ncdv-master-1 devstack@n-api.service[136537]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Dec 25 21:06:09.734132 ncdv-master-1 devstack@n-api.service[136537]: Python main interpreter initialized at 0x55b9b6d969c0 Dec 25 21:06:09.734132 ncdv-master-1 devstack@n-api.service[136537]: python threads support enabled Dec 25 21:06:09.734132 ncdv-master-1 devstack@n-api.service[136537]: your server socket listen backlog is limited to 100 connections Dec 25 21:06:09.734132 ncdv-master-1 devstack@n-api.service[136537]: your mercy for graceful operations on workers is 90 seconds Dec 25 21:06:09.734643 ncdv-master-1 devstack@n-api.service[136537]: mapped 403077 bytes (393 KB) for 2 cores Dec 25 21:06:09.734643 ncdv-master-1 devstack@n-api.service[136537]: *** Operational MODE: preforking *** Dec 25 21:06:09.734834 ncdv-master-1 devstack@n-api.service[136537]: *** uWSGI is running in multiple interpreter mode *** Dec 25 21:06:09.734834 ncdv-master-1 devstack@n-api.service[136537]: spawned uWSGI master process (pid: 136537) Dec 25 21:06:09.735037 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Dec 25 21:06:09.735736 ncdv-master-1 devstack@n-api.service[136537]: spawned uWSGI worker 1 (pid: 136547, cores: 1) Dec 25 21:06:09.736047 ncdv-master-1 devstack@n-api.service[136537]: spawned uWSGI worker 2 (pid: 136548, cores: 1) Dec 25 21:06:09.736216 ncdv-master-1 devstack@n-api.service[136537]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Dec 25 21:06:11.787920 ncdv-master-1 devstack@n-api.service[136548]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 21:06:11.787920 ncdv-master-1 devstack@n-api.service[136548]: from cryptography.utils import int_from_bytes Dec 25 21:06:11.788599 ncdv-master-1 devstack@n-api.service[136548]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 21:06:11.788599 ncdv-master-1 devstack@n-api.service[136548]: from cryptography.utils import int_from_bytes Dec 25 21:06:11.884485 ncdv-master-1 devstack@n-api.service[136547]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 21:06:11.884485 ncdv-master-1 devstack@n-api.service[136547]: from cryptography.utils import int_from_bytes Dec 25 21:06:11.885195 ncdv-master-1 devstack@n-api.service[136547]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Dec 25 21:06:11.885195 ncdv-master-1 devstack@n-api.service[136547]: from cryptography.utils import int_from_bytes Dec 25 21:06:14.239348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 21:06:14.239887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 21:06:14.240378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 21:06:14.240751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 21:06:14.241049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 21:06:14.241445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.241778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.242103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.242433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.242768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.243082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.243407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.243732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.244064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.244330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.244652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.245008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.245336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.245647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.246484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.246809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.247118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.247446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.247756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.248256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.248700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.249044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.249361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.249704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.250021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.250335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.250660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.251007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.251331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.251672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.252051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.252378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.252707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.253065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.253461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.253775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.254089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.254413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.254742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.255061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.255407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.255731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.256052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.256378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.256683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.257019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.257332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.257655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.257963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.258274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.258525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.258836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.259161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.259484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.259807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.260064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.260316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.260637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.260984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.261352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.262179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.262490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.262834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.263144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.263459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.263769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.264080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.264403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.264724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.265079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.265392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.265717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.266119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.266378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.266690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.267034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.267359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.267671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.267994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.268324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.268637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.268968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.269281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.269607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.269742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Dec 25 21:06:14.270120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.270214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Dec 25 21:06:14.270307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.270485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.270590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Dec 25 21:06:14.270789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.270886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Dec 25 21:06:14.271088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Dec 25 21:06:14.271204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.271408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.271511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.271718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.271816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.272974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.273106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.273291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.273408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.273599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.273706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.273909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.274919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.275139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.275236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.275440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.275538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.275750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.275849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.276071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.276161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.276374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.276468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.276681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.276780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.277035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.277131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.277384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.277535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.277710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.277845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.278968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.279096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.279278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.279404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.279722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.279916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.280029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.280238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.280335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.280551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.280647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.280902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.281963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.282153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.282382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.282506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.282694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.282814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.283950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.284062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.284258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.284350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.284563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.284667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.284910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.285932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.286142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.286240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.286458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.286556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.286760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.286851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.287064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.287162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.287313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.287456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.287619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.287778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.287940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.288119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.288260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.288459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.288564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.288786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.288920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.289086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.289189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.289405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.289496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.289724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.289897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.290032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.290132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.290338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.290429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.290642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.290742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.290947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.291045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.291251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.291351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.291556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.291654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.291857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.291953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.292164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.292262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.292496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.293165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.293354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.293468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.293675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.293783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.293980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.294094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.294298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.294411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.294649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.294740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.294929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.295019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.295234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.295331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.295570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.295675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.295888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.295992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.296201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.296309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.296513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.296621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.296830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.296955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.297161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.297258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.297465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.297564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.297770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.297861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.298087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.298187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.298419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.298518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.298723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.298828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.298976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.299112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.299274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.299435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.299577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.299752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.299897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.300065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.300201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.300378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.300506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.300696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.300797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.301029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.301144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.301357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.301448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.301691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.301781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.301997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.302101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.302301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.302391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.302606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.302704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.302911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.303016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.303214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.303311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.303521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.303628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.303825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.303933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.304139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.304245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.304450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.304558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.304752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.304854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.305082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.305186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.305388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.305486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.305694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.305786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.306012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.306117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.306319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.306411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.306622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.306720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.306943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.307033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.307248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.307340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.307553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.307651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.307870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.307967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.308230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.308839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.309074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.309181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.309430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.309582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.316551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.316656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.316742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.316825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.316952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.317054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.317140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.317230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.317381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.317381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.317566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.317651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.317733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.317823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.317906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.317997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.318092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.318182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.318275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.318365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.318447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.318530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.318711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.318798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.318880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.318961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.319050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.319150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.319249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.319340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.319434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.319517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.319648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.319753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Dec 25 21:06:14.320010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.320951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.321949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.322935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.323931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.324989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.325911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.326975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.327924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.328934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.329164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.329279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.329533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.329660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.329829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.329940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.330152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.330277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.330465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.330599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.330711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.330825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.331517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.331692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.331844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.332005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.332163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.332317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.332530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.332694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.332844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.333041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.333199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.333354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.333511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.333665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.333813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.334985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.335985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.336982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.337947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.338134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.338256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.338445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.338569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.338756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.338877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.339067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.339186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.339436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.339545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.339760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.339853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.340076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.340197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.340401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.340529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.340705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.341957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.342973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.343203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.343302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.343520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.343611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.343863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.344093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.344186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.344283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.344505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.344604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.344829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.353968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.354940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.355545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.355545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.355702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.355787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.355866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.355936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.356817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.357967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.358824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.359897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.360957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.361993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.362930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.363971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.364988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.365897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.366998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.367926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.368992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.369125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.369274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.369438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.369593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.369773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.369906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.370082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.370223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.370399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.370537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.370759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.371646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.371747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.371833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.371960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.372067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.372272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.372420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.372891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.373385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.373504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.373713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.373857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.374033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.374267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.374409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.374717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.375022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.375124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.375334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.375436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.375652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.375753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.376924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.381946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.382999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.383955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.384989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.385853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.386978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.387190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.387301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.387498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.387603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.387810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.387915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.388117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.388211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.388431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.388538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.388743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.388836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.389079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.389174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.389401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.389502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.389718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.389810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.390995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.391103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.391301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.391394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.391611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.391703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.391925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.392028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.392231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.392330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.392553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.392674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.392869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.393008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.393203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.393326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.393513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.393682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.393828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.394975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.395108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.395286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.395426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.395625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.395755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.395938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.396070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.396247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.396379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.396574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.396720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.397989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.398162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.398299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.398474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.398618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.398782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.398914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.399091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.399229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.399413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.399555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.399722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.399854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.400042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.400187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.400380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.400512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.400673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.400811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.401109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.401308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.401453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.401628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.401768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.401947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.402080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.402284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.402422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.402611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.402751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.402943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.403066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.403254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.403381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.403573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.403746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.403891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.404147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.404284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.404459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.404585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.404770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.404915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.405168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.405330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.405580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.405717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.405902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.406022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.406214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.406341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.406535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.406654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.406860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.407004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.407259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.407385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.407604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.407926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.408115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.408255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.408441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.408590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.408754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.408934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.409101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.409232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.409419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.409538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.409832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.409951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.410143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.410245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.410474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.410582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.410785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.410904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.411108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.411257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.411424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.411622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.411743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.411952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.412051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.412281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.412427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.412610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.412739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.412996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.413184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.413309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.413449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.413624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.413756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.414002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.414333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.414646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.414973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.415290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.415601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.415911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.416229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.416584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.416854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.417012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.417366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.417510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.418185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.418442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.418737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.418879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.419867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.420069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.420217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.420402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.420665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.420788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.421955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.422292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.422549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.422678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.422885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.422998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.423197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.423375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.423509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.423795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.423900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.424137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.424238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.424467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.424559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.424784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.424911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.425121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.425339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.425440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.425729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.425817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.426082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.426267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.426395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.426488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.426742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.426841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.427067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.427171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.427392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.427520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.427720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.427813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.428116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.428217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.428510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.428602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.428837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.428994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.429183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.429287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.429502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.429594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.429851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.430848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.431068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.431169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.431381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.431527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.431692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.431791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.432012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.432113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.432321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.432580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.432681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.432938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.433082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.433793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.433960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.434129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.434273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.434452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.434700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.434802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.435052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.435152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.435370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.435472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.435700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.435792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.436038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.436231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.436362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.436489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.436659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.436784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.437009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.439802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.440990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.441920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.442110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.442207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.442438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.442543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.442761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.442868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.443080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.443179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.443387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.443478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.443710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.443825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.444980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.445077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.445290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.445391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.445657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.445757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.445987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.446202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.446301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.446533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.446639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.446879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.446971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.447216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.447308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.447550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.447651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.447883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.448006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.448210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.448324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.448546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.452917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.453998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.454909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.455912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.456957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.457934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.458945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.459883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.460001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.460263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.460364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.460575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.460746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.460915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.461110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.461231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.461429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.461533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.461761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.461854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.462086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.462199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.462408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.462515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.462728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.462825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.463982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.464109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.464326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.464643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.464740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.465001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.465101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.465345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.465455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.465668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.465903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.466976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.467199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.467306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.467512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.467615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.467829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.467923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.468194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.468310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.468456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.468770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.468865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.469109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.469213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.469469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.469564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.469802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.469897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.470138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.470259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.470480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.470583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.470803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.470910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.471119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.471227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.471437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.471531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.471754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.471860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.472094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.472216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.472417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.472536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.472725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.472820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.473539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.473635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.473708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.473787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.473859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.473929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.474009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.474128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.474404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.474564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.474707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.474853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.475915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.476056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.476230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.476382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.476561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.476708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.476937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.477070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.477244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.477389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.477562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.477708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.477954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.478079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.478744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.478823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.478823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.478966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.479038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.479386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.479509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.479733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.479849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.480596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.480698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.480977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.481077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.481252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.481347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.481644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.481843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.481930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.482004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.482211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.482408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.482537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.482664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.483031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.483311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.483411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.483581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.483746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.483935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.484276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.484613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.484852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.485133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.485320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.485483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.485641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.485790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.485939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.486095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.486250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.486405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.486562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.486763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.486928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.487122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.487290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.487438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.487587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.487811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.487979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.488239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.488481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.488643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.488793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.488987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.489150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.489309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.489503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.489672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.489821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.489968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.490131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.490289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.490437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.490584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.490827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.491301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.491475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.491664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.491816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.491816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.492118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.492276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.492504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.492759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.492937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.493107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.493258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.493580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.493737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.493887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.494044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.494196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.494363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.494662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.494819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.494977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.495144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.495332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.495490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.495674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.496357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.496510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.496659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.496807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.497969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.498130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.498367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.498367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.498367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.498367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.498367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.499182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.499341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.499490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.499637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.499784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.499941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.500238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.500238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.500553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.500703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.507973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.508243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.508493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.508756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.508961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136548) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.509448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.510569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.511952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.513288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.514620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.514620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.514620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.514620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.514620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.514620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.515564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.515564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.515564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.515991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.516138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.517035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.517374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.517694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.518136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.518537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.518930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.520521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.520521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.520521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.520521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.521857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.521857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.521857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.521857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.524862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.526204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.526204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.526662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_db.sqlalchemy.engines [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.526838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.526838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.528647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.528647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.528647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.528647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.528647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.529619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.529619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.529619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.531626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.532972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.532972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.532972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.533592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.533984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.534154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.534639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.534807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.535243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.535522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.535844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.536398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.536737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.537089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.537409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.537722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Dec 25 21:06:14.537971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=136547) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Dec 25 21:06:14.562093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_db.sqlalchemy.engines [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.598743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.context [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=136548) load_cells /opt/stack/nova/nova/context.py:464}} Dec 25 21:06:14.603157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:14.604738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:14.606122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:14.608084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:14.621519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_db.sqlalchemy.engines [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.623331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_db.sqlalchemy.engines [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.632600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.context [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=136547) load_cells /opt/stack/nova/nova/context.py:464}} Dec 25 21:06:14.637024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:14.638609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:14.639422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:14.641747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:14.654236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_db.sqlalchemy.engines [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.655619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_db.sqlalchemy.engines [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.786052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_db.sqlalchemy.engines [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136548) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:14.820857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_db.sqlalchemy.engines [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=136547) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Dec 25 21:06:15.116319 ncdv-master-1 devstack@n-api.service[136548]: WARNING keystonemiddleware.auth_token [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 21:06:15.123158 ncdv-master-1 devstack@n-api.service[136548]: WARNING keystonemiddleware.auth_token [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 21:06:15.159336 ncdv-master-1 devstack@n-api.service[136547]: WARNING keystonemiddleware.auth_token [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 21:06:15.166240 ncdv-master-1 devstack@n-api.service[136547]: WARNING keystonemiddleware.auth_token [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 21:06:15.473077 ncdv-master-1 devstack@n-api.service[136548]: WARNING keystonemiddleware.auth_token [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 21:06:15.478254 ncdv-master-1 devstack@n-api.service[136548]: WARNING keystonemiddleware.auth_token [None req-84b6bd80-a16a-43bf-b6cf-de2b5714091b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 21:06:15.483763 ncdv-master-1 devstack@n-api.service[136548]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9b6d969c0 pid: 136548 (default app) Dec 25 21:06:15.516421 ncdv-master-1 devstack@n-api.service[136547]: WARNING keystonemiddleware.auth_token [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Dec 25 21:06:15.521705 ncdv-master-1 devstack@n-api.service[136547]: WARNING keystonemiddleware.auth_token [None req-23c995bf-111c-48ba-a3ac-432baaacbb8c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Dec 25 21:06:15.527133 ncdv-master-1 devstack@n-api.service[136547]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b9b6d969c0 pid: 136547 (default app) Dec 25 21:06:56.601759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5e444d1-4fa1-4c4f-b62c-4fa7b1f5ec4b tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:56.603761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5e444d1-4fa1-4c4f-b62c-4fa7b1f5ec4b tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:56.604570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5e444d1-4fa1-4c4f-b62c-4fa7b1f5ec4b tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:56.605191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5e444d1-4fa1-4c4f-b62c-4fa7b1f5ec4b tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:56.605698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5e444d1-4fa1-4c4f-b62c-4fa7b1f5ec4b tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:56.649103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5e444d1-4fa1-4c4f-b62c-4fa7b1f5ec4b tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] 10.222.0.32 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.422661 Dec 25 21:06:56.649697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1/1] 10.222.0.32 () {58 vars in 1163 bytes} [Sat Dec 25 21:06:55 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:56.661536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-862c0da0-ba85-4b7a-81ab-bad8d6b7b8f3 tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:56.663011 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:56.663011 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:56.664562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-862c0da0-ba85-4b7a-81ab-bad8d6b7b8f3 tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:56.665043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-862c0da0-ba85-4b7a-81ab-bad8d6b7b8f3 tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:56.666004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-862c0da0-ba85-4b7a-81ab-bad8d6b7b8f3 tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:56.666497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-862c0da0-ba85-4b7a-81ab-bad8d6b7b8f3 tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:56.689723 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-862c0da0-ba85-4b7a-81ab-bad8d6b7b8f3 tempest-AZAdminV2TestJSON-371413876 tempest-AZAdminV2TestJSON-371413876-project-admin] 10.222.0.32 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.031943 Dec 25 21:06:56.690319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2/2] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:06:56 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:06:56.999292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4f93614-a45c-4200-9d46-c548a7e306a3 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-878611887", "ram": 512, "vcpus": 1, "disk": 10, "id": 278915203, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:57.017996 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:57.017996 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:57.122352 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4f93614-a45c-4200-9d46-c548a7e306a3 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 1.565424 Dec 25 21:06:57.122973 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1/3] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:06:55 2021] POST /compute/v2.1/flavors => generated 412 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:06:57.205875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4d2a6f4-8f99-440e-933d-349d2d3db987 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:57.207426 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:57.207426 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:57.208999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4d2a6f4-8f99-440e-933d-349d2d3db987 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.209511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4d2a6f4-8f99-440e-933d-349d2d3db987 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.210335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4d2a6f4-8f99-440e-933d-349d2d3db987 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.210884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4d2a6f4-8f99-440e-933d-349d2d3db987 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.233722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4d2a6f4-8f99-440e-933d-349d2d3db987 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.482286 Dec 25 21:06:57.234302 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3/4] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:06:56 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:06:57.492958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-df3db1ce-d3d4-4c27-833f-a65282086fa2 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1545872943", "ram": 512, "vcpus": 1, "disk": 10, "id": 2037896927, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:57.575612 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-df3db1ce-d3d4-4c27-833f-a65282086fa2 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.451501 Dec 25 21:06:57.576641 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2/5] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:06:57 2021] POST /compute/v2.1/flavors => generated 416 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:57.638871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '.version_select at 0x7fa4fd68b700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:57.640329 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:57.640329 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:57.650263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=136548) load_cells /opt/stack/nova/nova/compute/api.py:302}} Dec 25 21:06:57.650263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.650263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.678361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.681585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.691950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.692631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.699123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-46c77fb1-2e99-41d4-b56e-ed67d70877b1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.456188 Dec 25 21:06:57.700212 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4/6] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:06:57 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:06:57.759192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Calling method '.version_select at 0x7fa4fd68fdc0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:57.760023 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:57.760023 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:57.766274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=136547) load_cells /opt/stack/nova/nova/compute/api.py:302}} Dec 25 21:06:57.767100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.767542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.794017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.794457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.809942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.810398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.811256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abbcd125-620d-4ffe-9d46-532b31e5c354 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:57.816391 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e9b47e2-cb11-4ba9-827e-3618bd4b7351 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.238569 Dec 25 21:06:57.817201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3/7] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:06:57 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:57.821280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8cbfd93f-51c9-4b19-8726-ded2ed75589d tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1601812493"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:57.823085 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:57.823085 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:57.824423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-8cbfd93f-51c9-4b19-8726-ded2ed75589d tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid b30e43c7-5862-442b-a6d9-dff45f0a5684 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:06:57.840466 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-abbcd125-620d-4ffe-9d46-532b31e5c354 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] HTTP exception thrown: Flavor 278915203 has no extra specs with key hw:cpu_thread_policy. Dec 25 21:06:57.841123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abbcd125-620d-4ffe-9d46-532b31e5c354 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Returning 404 to user: Flavor 278915203 has no extra specs with key hw:cpu_thread_policy. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:57.842227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abbcd125-620d-4ffe-9d46-532b31e5c354 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] 10.222.0.32 "GET /compute/v2.1/flavors/278915203/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.140716 Dec 25 21:06:57.842851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 5/8] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:06:57 2021] GET /compute/v2.1/flavors/278915203/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:06:57.958855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Calling method '.version_select at 0x7fa4fd647d30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:57.960190 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:57.960190 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:57.961792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.962563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.978977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.979433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.989381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:57.989828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:57.996624 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1625acb0-8472-449e-a869-f21178e000fe tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.152578 Dec 25 21:06:57.997436 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 6/9] 10.222.0.32 () {60 vars in 1207 bytes} [Sat Dec 25 21:06:57 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:06:58.023530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8cbfd93f-51c9-4b19-8726-ded2ed75589d tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.205470 Dec 25 21:06:58.025208 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4/10] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:06:57 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:58.034781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56f74220-3554-40b0-955f-823480018aef tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.036363 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.036363 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:58.108351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-613aa377-3145-41f7-b0c4-959a37a0177b tempest-AZAdminNegativeTestJSON-863498220 tempest-AZAdminNegativeTestJSON-863498220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.109152 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.109152 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.110252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-613aa377-3145-41f7-b0c4-959a37a0177b tempest-AZAdminNegativeTestJSON-863498220 tempest-AZAdminNegativeTestJSON-863498220-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '0885953ad3984efaa5557eab321ed6f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ca49aabf0d9478bac3dd6b25768e759', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:06:58.110912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-613aa377-3145-41f7-b0c4-959a37a0177b tempest-AZAdminNegativeTestJSON-863498220 tempest-AZAdminNegativeTestJSON-863498220-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:58.111690 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-613aa377-3145-41f7-b0c4-959a37a0177b tempest-AZAdminNegativeTestJSON-863498220 tempest-AZAdminNegativeTestJSON-863498220-project] 10.222.0.32 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.113161 Dec 25 21:06:58.112262 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 7/11] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:06:57 2021] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 114 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:06:58.116597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Calling method '.version_select at 0x7fa4fd647af0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.117414 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.117414 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.118834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.119318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.138016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.138617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.177147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.177794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.185280 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f4d1d15-32fb-46e6-b2ec-48e107c38fa4 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.071946 Dec 25 21:06:58.186248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 8/12] 10.222.0.32 () {58 vars in 1211 bytes} [Sat Dec 25 21:06:58 2021] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 104 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:58.195167 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56f74220-3554-40b0-955f-823480018aef tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.167464 Dec 25 21:06:58.196044 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 5/13] 10.222.0.32 () {60 vars in 1223 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/flavors/2037896927/os-extra_specs => generated 66 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:58.196226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8334780-3624-4c60-889f-dce6e42a3ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.199022 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.199022 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.200482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c8334780-3624-4c60-889f-dce6e42a3ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c885c1e9e3a449ba9971e3ef91e71150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bf792f42c4ef18599568f8f685bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:06:58.201287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8334780-3624-4c60-889f-dce6e42a3ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:58.202729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8dd63cb-3de1-4687-9e60-646b83e5a7ff tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.204578 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.204578 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:58.207418 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8334780-3624-4c60-889f-dce6e42a3ee7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] 10.222.0.32 "POST /compute/v2.1/flavors/278915203/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.014744 Dec 25 21:06:58.212319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 9/14] 10.222.0.32 () {60 vars in 1220 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/flavors/278915203/os-extra_specs => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:06:58.215900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Calling method '.version_select at 0x7fa4fd552dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.216701 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.216701 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.219208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.219934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.229407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8dd63cb-3de1-4687-9e60-646b83e5a7ff tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.229899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8dd63cb-3de1-4687-9e60-646b83e5a7ff tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.236349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.236795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.247447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.247895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.253753 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-630c49fb-36d2-4ae9-b3a7-27444a6f0002 tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.044463 Dec 25 21:06:58.254355 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 10/15] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:06:58 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:58.677913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03c1bda7-c95d-4a6e-b3a7-3ad325cac1d1 tempest-FlavorsExtraSpecsTestJSON-634073686 tempest-FlavorsExtraSpecsTestJSON-634073686-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.689266 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03c1bda7-c95d-4a6e-b3a7-3ad325cac1d1 tempest-FlavorsExtraSpecsTestJSON-634073686 tempest-FlavorsExtraSpecsTestJSON-634073686-project] 10.222.0.32 "GET /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.433666 Dec 25 21:06:58.695057 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 11/16] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:06:58 2021] GET /compute/v2.1/flavors/2037896927/os-extra_specs => generated 66 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:58.695057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b06d2c6-ae08-408f-ba2a-7bc0bf8c95a7 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.695359 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.695359 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.841482 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b06d2c6-ae08-408f-ba2a-7bc0bf8c95a7 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/278915203/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.150616 Dec 25 21:06:58.842071 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 12/17] 10.222.0.32 () {60 vars in 1220 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/flavors/278915203/os-extra_specs => generated 66 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:58.849794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86f659a8-1f94-4bf0-82e0-a5d66f38925b tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Calling method '.version_select at 0x7fa4fd552ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.850716 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.850716 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.852105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f659a8-1f94-4bf0-82e0-a5d66f38925b tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.852550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f659a8-1f94-4bf0-82e0-a5d66f38925b tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.864420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f659a8-1f94-4bf0-82e0-a5d66f38925b tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:58.864912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f659a8-1f94-4bf0-82e0-a5d66f38925b tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:58.871158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86f659a8-1f94-4bf0-82e0-a5d66f38925b tempest-HypervisorAdminUnderV252Test-185213358 tempest-HypervisorAdminUnderV252Test-185213358-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.028005 Dec 25 21:06:58.871726 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 13/18] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:06:58 2021] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:58.876102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0470407-aa5e-43ce-9f33-e6edf23cd1d2 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.877379 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.877379 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.897679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0470407-aa5e-43ce-9f33-e6edf23cd1d2 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.024839 Dec 25 21:06:58.898368 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 14/19] 10.222.0.32 () {60 vars in 1223 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/flavors/2037896927/os-extra_specs => generated 66 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:58.902504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40df944e-c388-4160-ad16-fa87cfeb1fe4 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.903280 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:58.903280 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:58.904401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40df944e-c388-4160-ad16-fa87cfeb1fe4 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c885c1e9e3a449ba9971e3ef91e71150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bf792f42c4ef18599568f8f685bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:06:58.905078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40df944e-c388-4160-ad16-fa87cfeb1fe4 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:58.905929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40df944e-c388-4160-ad16-fa87cfeb1fe4 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] 10.222.0.32 "DELETE /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.006874 Dec 25 21:06:58.906722 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 15/20] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:06:58 2021] DELETE /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes => generated 124 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:06:58.911405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a54d6dea-e0e7-4de4-8d37-218d7ca8c8e9 tempest-FlavorsExtraSpecsTestJSON-634073686 tempest-FlavorsExtraSpecsTestJSON-634073686-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:58.921700 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a54d6dea-e0e7-4de4-8d37-218d7ca8c8e9 tempest-FlavorsExtraSpecsTestJSON-634073686 tempest-FlavorsExtraSpecsTestJSON-634073686-project] 10.222.0.32 "GET /compute/v2.1/flavors/2037896927/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.013922 Dec 25 21:06:58.922834 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 16/21] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:06:58 2021] GET /compute/v2.1/flavors/2037896927/os-extra_specs/hw:numa_nodes => generated 22 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:58.928010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73a223a6-0639-4456-a13e-7dc9c4baebcd tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.957709 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-73a223a6-0639-4456-a13e-7dc9c4baebcd tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/278915203/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.033338 Dec 25 21:06:58.958920 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 17/22] 10.222.0.32 () {60 vars in 1220 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/flavors/278915203/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:58.968172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2da62e1f-d167-4229-b696-3fa36504efbb tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:58.995836 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2da62e1f-d167-4229-b696-3fa36504efbb tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.035585 Dec 25 21:06:58.996526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 18/23] 10.222.0.32 () {60 vars in 1223 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/flavors/2037896927/os-extra_specs => generated 66 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:59.027229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18e915cc-4584-4f84-9610-86138eaf2ec7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:59.027229 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.027229 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:59.027229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18e915cc-4584-4f84-9610-86138eaf2ec7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c885c1e9e3a449ba9971e3ef91e71150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '185bf792f42c4ef18599568f8f685bab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:06:59.027896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18e915cc-4584-4f84-9610-86138eaf2ec7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:59.027896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18e915cc-4584-4f84-9610-86138eaf2ec7 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650 tempest-FlavorsExtraSpecsNegativeTestJSON-686366650-project] 10.222.0.32 "PUT /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.007266 Dec 25 21:06:59.027896 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 19/24] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:06:58 2021] PUT /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes => generated 124 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:06:59.031077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2bf74e1b-387f-4141-810c-ee63d9d4823c tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.039500 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2bf74e1b-387f-4141-810c-ee63d9d4823c tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.014199 Dec 25 21:06:59.040048 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 20/25] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:06:59 2021] GET /compute/v2.1/flavors/2037896927/os-extra_specs => generated 66 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:59.045036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a451392-5f29-4f2d-90fd-b530cbfe9722 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.052230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2a451392-5f29-4f2d-90fd-b530cbfe9722 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] HTTP exception thrown: Flavor 278915203 has no extra specs with key hw:cpu_thread_policy. Dec 25 21:06:59.052800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a451392-5f29-4f2d-90fd-b530cbfe9722 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Returning 404 to user: Flavor 278915203 has no extra specs with key hw:cpu_thread_policy. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:59.053639 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a451392-5f29-4f2d-90fd-b530cbfe9722 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/278915203/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.012717 Dec 25 21:06:59.054151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 21/26] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:06:59 2021] DELETE /compute/v2.1/flavors/278915203/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:06:59.058447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18e06cd3-7ee2-49ed-9371-6ba02c6e6580 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:59.145625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8dd63cb-3de1-4687-9e60-646b83e5a7ff tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 0.947705 Dec 25 21:06:59.146646 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 6/27] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:06:58 2021] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:06:59.152932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d5b0200-80c1-4f1e-8595-af92a0da9fbd tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:59.154748 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.154748 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:59.158832 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-8d5b0200-80c1-4f1e-8595-af92a0da9fbd tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] HTTP exception thrown: Request body and URI mismatch Dec 25 21:06:59.158832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d5b0200-80c1-4f1e-8595-af92a0da9fbd tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:59.158832 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d5b0200-80c1-4f1e-8595-af92a0da9fbd tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.009425 Dec 25 21:06:59.162760 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 7/28] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:06:59 2021] PUT /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes => generated 73 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:06:59.168143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc8ef366-a4de-4b76-b900-ea7c246d2c8f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:59.169421 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.169421 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:59.179204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc8ef366-a4de-4b76-b900-ea7c246d2c8f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:59.179592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc8ef366-a4de-4b76-b900-ea7c246d2c8f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:59.183985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18e06cd3-7ee2-49ed-9371-6ba02c6e6580 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/2037896927/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.128679 Dec 25 21:06:59.184584 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 22/29] 10.222.0.32 () {60 vars in 1264 bytes} [Sat Dec 25 21:06:59 2021] PUT /compute/v2.1/flavors/2037896927/os-extra_specs/hw:numa_nodes => generated 22 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:59.188937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b38bdd75-25a9-42e1-a057-85a60628e142 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:59.190095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b38bdd75-25a9-42e1-a057-85a60628e142 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:59.190884 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b38bdd75-25a9-42e1-a057-85a60628e142 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.005359 Dec 25 21:06:59.191395 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 23/30] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:06:59 2021] PUT /compute/v2.1/flavors/278915203/os-extra_specs/hw:numa_nodes => generated 117 bytes in 6 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:06:59.204688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-753f7a47-9cac-4855-ba67-71900022d2f6 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.227573 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-753f7a47-9cac-4855-ba67-71900022d2f6 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031859 Dec 25 21:06:59.228329 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 24/31] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:06:59 2021] GET /compute/v2.1/flavors/2037896927/os-extra_specs => generated 66 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:06:59.233386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51c824d4-716e-4d5e-8b7a-edb7a3daf2b7 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.234155 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.234155 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:59.287686 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-bc8ef366-a4de-4b76-b900-ea7c246d2c8f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. Dec 25 21:06:59.288290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc8ef366-a4de-4b76-b900-ea7c246d2c8f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:06:59.289154 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc8ef366-a4de-4b76-b900-ea7c246d2c8f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.125343 Dec 25 21:06:59.293703 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 8/32] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:06:59 2021] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Dec 25 21:06:59.296123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae02cf47-ccdb-4147-9062-355263b9eb9e tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.297004 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.297004 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:59.409020 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51c824d4-716e-4d5e-8b7a-edb7a3daf2b7 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/278915203" status: 202 len: 0 microversion: 2.1 time: 0.179656 Dec 25 21:06:59.409913 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 25/33] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:06:59 2021] DELETE /compute/v2.1/flavors/278915203 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:06:59.422725 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae02cf47-ccdb-4147-9062-355263b9eb9e tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2037896927/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.131495 Dec 25 21:06:59.428044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a0e44ba-648d-411f-a8e7-3d623772f87f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:06:59.429740 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.429740 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:06:59.431459 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 9/34] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:06:59 2021] DELETE /compute/v2.1/flavors/2037896927/os-extra_specs/hw:numa_nodes => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:06:59.438663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad24f6a2-51f2-47a3-a8d7-371e35b4bc93 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.474193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad24f6a2-51f2-47a3-a8d7-371e35b4bc93 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575 tempest-FlavorsExtraSpecsNegativeTestJSON-951446575-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.041783 Dec 25 21:06:59.484737 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 10/35] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:06:59 2021] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:06:59.492484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a0e44ba-648d-411f-a8e7-3d623772f87f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:06:59.492966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a0e44ba-648d-411f-a8e7-3d623772f87f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:06:59.501204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74a46014-a373-4a9e-bca7-1ae79cc8b5b8 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.597562 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74a46014-a373-4a9e-bca7-1ae79cc8b5b8 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2037896927/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.103233 Dec 25 21:06:59.598158 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 11/36] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:06:59 2021] DELETE /compute/v2.1/flavors/2037896927/os-extra_specs/hw:cpu_policy => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:06:59.605604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62aabc68-4ba4-4be8-bd61-e5cec14a6d73 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.613831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62aabc68-4ba4-4be8-bd61-e5cec14a6d73 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/2037896927/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011698 Dec 25 21:06:59.614540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 12/37] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:06:59 2021] GET /compute/v2.1/flavors/2037896927/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:06:59.624092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c81b1fb0-11e8-4e7f-ac42-0ff85c497086 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.637936 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:06:59.637936 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:06:59.762048 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c81b1fb0-11e8-4e7f-ac42-0ff85c497086 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2037896927" status: 202 len: 0 microversion: 2.1 time: 0.141329 Dec 25 21:06:59.762643 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 13/38] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:06:59 2021] DELETE /compute/v2.1/flavors/2037896927 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:06:59.770326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12c861f7-f56c-41d0-af09-f39387d9a859 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:06:59.788188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12c861f7-f56c-41d0-af09-f39387d9a859 tempest-FlavorsExtraSpecsTestJSON-1614803771 tempest-FlavorsExtraSpecsTestJSON-1614803771-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.021386 Dec 25 21:06:59.788735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 14/39] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:06:59 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:01.393058 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a0e44ba-648d-411f-a8e7-3d623772f87f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 1.979667 Dec 25 21:07:01.394858 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 26/40] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:06:59 2021] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:01.404490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c468741-410a-4ab1-92ec-cc3630a6a4e6 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:01.412368 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:01.412368 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:01.506204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c468741-410a-4ab1-92ec-cc3630a6a4e6 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.105235 Dec 25 21:07:01.506965 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 15/41] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:01 2021] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:01.524156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a06b8bc-acc9-48f3-aca7-d7890a51c938 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1087641525"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:01.552671 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:01.552671 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:01.554235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-4a06b8bc-acc9-48f3-aca7-d7890a51c938 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid a134ff5b-fe80-48cd-8ee8-649e456779ce for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:01.575462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e388081-3366-40d5-be4e-9f27da027686 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1048147619", "name": "tempest-test_aggregate-2106996353"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:01.597128 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:01.597128 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:01.598602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-9e388081-3366-40d5-be4e-9f27da027686 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid 1e2cf672-b448-45e3-ac53-03f5cfb8982b for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:01.733346 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e388081-3366-40d5-be4e-9f27da027686 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.163000 Dec 25 21:07:01.734736 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 16/42] 10.222.0.32 () {60 vars in 1164 bytes} [Sat Dec 25 21:07:01 2021] POST /compute/v2.1/os-aggregates => generated 222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:01.737859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a06b8bc-acc9-48f3-aca7-d7890a51c938 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.222810 Dec 25 21:07:01.740133 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 27/43] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:01 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:01.751105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad3a37eb-1969-4241-bb38-c03109ad9bcc tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:01.752272 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:01.752272 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:01.771769 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad3a37eb-1969-4241-bb38-c03109ad9bcc tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 517 microversion: 2.1 time: 0.022074 Dec 25 21:07:01.772116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 17/44] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:07:01 2021] GET /compute/v2.1/os-aggregates => generated 517 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:01.784909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52660b66-08a3-4adb-be2a-2fdbff541b0a tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:01.786421 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:01.786421 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:01.799914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52660b66-08a3-4adb-be2a-2fdbff541b0a tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:01.800205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52660b66-08a3-4adb-be2a-2fdbff541b0a tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:02.119845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52660b66-08a3-4adb-be2a-2fdbff541b0a tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.1 time: 0.341663 Dec 25 21:07:02.120455 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 18/45] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:01 2021] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:02.316166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2b7e8b3-068d-406e-bda4-32c6b30fbc3f tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.317580 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.317580 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:02.318606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2b7e8b3-068d-406e-bda4-32c6b30fbc3f tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'cadb0831770246a49a9aac30067fa14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c9d7948afa49e5bc0261e1f17180f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:02.319328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2b7e8b3-068d-406e-bda4-32c6b30fbc3f tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:02.320247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2b7e8b3-068d-406e-bda4-32c6b30fbc3f tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] 10.222.0.32 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.573098 Dec 25 21:07:02.321033 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 28/46] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:01 2021] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 574 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:02.330202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-190d0293-dd4f-4b2e-806f-557fa29c5651 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:02.331029 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.331029 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:02.438676 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-190d0293-dd4f-4b2e-806f-557fa29c5651 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.112456 Dec 25 21:07:02.439288 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 19/47] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:02 2021] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:02.448895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e816bf15-101c-4d6b-abac-13145fde84d6 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2099208856"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.450987 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.450987 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:02.452216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-e816bf15-101c-4d6b-abac-13145fde84d6 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid 5533a440-2b2f-4b0c-a92c-29744316fb26 for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:02.590230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e816bf15-101c-4d6b-abac-13145fde84d6 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.145426 Dec 25 21:07:02.591057 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 29/48] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:02.600723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-671769229"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.602020 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.602020 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:02.610567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:02.611022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:02.619527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:02.619988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:02.627851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-671769229 could not be found. Dec 25 21:07:02.628452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-671769229 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:02.629311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6036c64d-4941-473d-9403-49e6bb527ee4 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.032345 Dec 25 21:07:02.629875 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 20/49] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:02.638462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e3eeb10-400c-47fa-aa38-34e8a7adaad7 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:02.639286 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.639286 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:02.737101 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e3eeb10-400c-47fa-aa38-34e8a7adaad7 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.102798 Dec 25 21:07:02.737965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 30/50] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:02 2021] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:02.757983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca1a9625-b6d3-4758-a6a9-1efc61a99eca tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.759433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca1a9625-b6d3-4758-a6a9-1efc61a99eca tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:02.761097 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca1a9625-b6d3-4758-a6a9-1efc61a99eca tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.007055 Dec 25 21:07:02.767799 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 31/51] 10.222.0.32 () {60 vars in 1164 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates => generated 619 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:07:02.773369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-853e4888-2070-46ab-b01d-f86175b66f3e tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.774842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-853e4888-2070-46ab-b01d-f86175b66f3e tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:02.775871 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-853e4888-2070-46ab-b01d-f86175b66f3e tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.006865 Dec 25 21:07:02.781551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 32/52] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:07:02.787744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ea5297f-252d-4f11-b0e9-672c524196ad tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-197261794"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.789846 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.789846 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:02.791274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ea5297f-252d-4f11-b0e9-672c524196ad tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'cadb0831770246a49a9aac30067fa14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c9d7948afa49e5bc0261e1f17180f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:02.792122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ea5297f-252d-4f11-b0e9-672c524196ad tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:02.793025 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ea5297f-252d-4f11-b0e9-672c524196ad tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010009 Dec 25 21:07:02.799043 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 33/53] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:02.804522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfa83f33-f91c-4446-ae63-eabc6402a1da tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-212756899"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.810168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-bfa83f33-f91c-4446-ae63-eabc6402a1da tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid aa1d6b3e-e17e-4ca8-b58d-a25d22140a09 for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:02.920714 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfa83f33-f91c-4446-ae63-eabc6402a1da tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.119929 Dec 25 21:07:02.927767 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 34/54] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:02.934023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36c5c55c-9397-471b-91ee-c0d0ce055944 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-212756899"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:02.935635 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.935635 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:02.937013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-36c5c55c-9397-471b-91ee-c0d0ce055944 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid 884ee002-e9a7-467c-be7b-8f0da1b2a156 for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:02.954239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-36c5c55c-9397-471b-91ee-c0d0ce055944 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-212756899 already exists. Dec 25 21:07:02.955091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36c5c55c-9397-471b-91ee-c0d0ce055944 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-212756899 already exists. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:02.955997 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36c5c55c-9397-471b-91ee-c0d0ce055944 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.026984 Dec 25 21:07:02.956575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 35/55] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/os-aggregates => generated 110 bytes in 28 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:02.972037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f04ed013-327d-465d-9764-bdd9155f6c02 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:02.972813 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:02.972813 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.141277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f04ed013-327d-465d-9764-bdd9155f6c02 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.173261 Dec 25 21:07:03.148930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 36/56] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:02 2021] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Dec 25 21:07:03.167583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d89b180-3150-40f8-b255-3b986535f5b3 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-450056904"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:03.173189 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.173189 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.175706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-6d89b180-3150-40f8-b255-3b986535f5b3 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid d0f81858-28bf-4b3e-9882-43c000b41620 for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:03.248422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1368129372", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "availability_zone": "tempest-test_az-1048147619"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:03.272445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:03.273067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:03.276789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:03.276789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:03.277856 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d89b180-3150-40f8-b255-3b986535f5b3 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.121077 Dec 25 21:07:03.278831 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 37/57] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:03 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:03.289526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95de504d-f1f5-4fc3-b52d-eabf038b75e8 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.290484 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.290484 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.291997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95de504d-f1f5-4fc3-b52d-eabf038b75e8 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'cadb0831770246a49a9aac30067fa14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c9d7948afa49e5bc0261e1f17180f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:03.292851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95de504d-f1f5-4fc3-b52d-eabf038b75e8 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:03.293628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95de504d-f1f5-4fc3-b52d-eabf038b75e8 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.008954 Dec 25 21:07:03.294563 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 38/58] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:03 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:07:03.304270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd3a53fe-d1f7-418c-b501-18e4b62fca34 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.387708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd3a53fe-d1f7-418c-b501-18e4b62fca34 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.088670 Dec 25 21:07:03.388312 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 39/59] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:03 2021] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:03.398338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35ec81aa-c8be-4376-aff1-a26490c0ea56 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.399247 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.399247 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.411143 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-35ec81aa-c8be-4376-aff1-a26490c0ea56 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Dec 25 21:07:03.411731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35ec81aa-c8be-4376-aff1-a26490c0ea56 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:03.412716 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35ec81aa-c8be-4376-aff1-a26490c0ea56 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.018900 Dec 25 21:07:03.418612 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 40/60] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:03 2021] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 25 21:07:03.423257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd3d5fc4-abbb-4ccc-baa5-ad6d33da354f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-8378928"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:03.424539 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.424539 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.426328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-dd3d5fc4-abbb-4ccc-baa5-ad6d33da354f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid 4e03696a-7ffd-49b7-b7a7-7453b44de327 for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:03.549242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd3d5fc4-abbb-4ccc-baa5-ad6d33da354f tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 195 microversion: 2.1 time: 0.129351 Dec 25 21:07:03.550245 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 41/61] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:03 2021] POST /compute/v2.1/os-aggregates => generated 195 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:03.559924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89d0f749-1283-4f8b-9b9e-e871a3a21154 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.560793 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.560793 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.562098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-89d0f749-1283-4f8b-9b9e-e871a3a21154 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'cadb0831770246a49a9aac30067fa14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c9d7948afa49e5bc0261e1f17180f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:03.562725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89d0f749-1283-4f8b-9b9e-e871a3a21154 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:03.563549 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89d0f749-1283-4f8b-9b9e-e871a3a21154 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] 10.222.0.32 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.007357 Dec 25 21:07:03.564261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 42/62] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:07:03 2021] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:07:03.571394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a839073d-017d-443c-b04b-e56145db5b59 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.572151 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.572151 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.691605 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a839073d-017d-443c-b04b-e56145db5b59 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.120011 Dec 25 21:07:03.691605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 43/63] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:03 2021] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:03.698924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5d3ea56d-ce46-4ade-8d9b-8f88c06842cd tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.699976 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.699976 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.706514 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5d3ea56d-ce46-4ade-8d9b-8f88c06842cd tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Dec 25 21:07:03.707094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5d3ea56d-ce46-4ade-8d9b-8f88c06842cd tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:03.707907 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5d3ea56d-ce46-4ade-8d9b-8f88c06842cd tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.012824 Dec 25 21:07:03.708431 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 44/64] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:03 2021] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:03.717655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14a6d93d-6eee-4de5-b329-3702a2a8a0e6 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:03.718424 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:03.718424 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:03.719637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-14a6d93d-6eee-4de5-b329-3702a2a8a0e6 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'cadb0831770246a49a9aac30067fa14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c9d7948afa49e5bc0261e1f17180f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:03.721057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14a6d93d-6eee-4de5-b329-3702a2a8a0e6 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:03.721418 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-14a6d93d-6eee-4de5-b329-3702a2a8a0e6 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.007103 Dec 25 21:07:03.722317 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 45/65] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:07:03 2021] GET /compute/v2.1/os-aggregates => generated 115 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:07:04.286551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:04.691992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:04.692507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:04.693273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:04.693759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:04.694259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:04.707830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:04.708374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:04.709298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:04.709837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:04.748580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Getting quotas for project 82cb1dfb58a1493b8193ad0024840486. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:04.755468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Getting quotas for user d98ab3d372a343daaeef8435bdba83c0 and project 82cb1dfb58a1493b8193ad0024840486. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:04.768211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:07:04.771187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:07:04.887025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fac37406-cce4-47dd-a105-5cf515213bb8 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.175686 Dec 25 21:07:04.887681 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 21/66] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:07:04.898210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a6e8d0c-3baa-49a7-87af-8ef1984c3eba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:04.899588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a6e8d0c-3baa-49a7-87af-8ef1984c3eba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:05.827896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16b15c15-4faa-4f70-a5d1-2405eb907660 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:05.829359 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:05.829359 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:05.831802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-16b15c15-4faa-4f70-a5d1-2405eb907660 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Dec 25 21:07:05.832372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16b15c15-4faa-4f70-a5d1-2405eb907660 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:05.833210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16b15c15-4faa-4f70-a5d1-2405eb907660 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439 tempest-InstanceUsageAuditLogNegativeTestJSON-2096287439-project-admin] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.309257 Dec 25 21:07:05.833969 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 22/67] 10.222.0.32 () {58 vars in 1223 bytes} [Sat Dec 25 21:07:05 2021] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 311 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:07:05.928315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4a6e8d0c-3baa-49a7-87af-8ef1984c3eba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:05.945173 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a6e8d0c-3baa-49a7-87af-8ef1984c3eba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1243 microversion: 2.1 time: 1.051330 Dec 25 21:07:05.956054 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 46/68] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:04 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1243 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:06.113482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c586986-e6c9-488a-b756-ba4437683974 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:06.114422 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:06.114422 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:06.116862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c586986-e6c9-488a-b756-ba4437683974 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'fff29e4bfbf645a5a5e572bcca7ab123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78470108d2d148278d770784261a48cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:06.117008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c586986-e6c9-488a-b756-ba4437683974 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:06.117739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c586986-e6c9-488a-b756-ba4437683974 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.277677 Dec 25 21:07:06.118259 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 23/69] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:07:05 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 279 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:06.127692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d70746d8-e2d3-4027-ae43-5574aacdf323 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:06.128828 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:06.128828 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:06.130382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d70746d8-e2d3-4027-ae43-5574aacdf323 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'fff29e4bfbf645a5a5e572bcca7ab123', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78470108d2d148278d770784261a48cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:06.133363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d70746d8-e2d3-4027-ae43-5574aacdf323 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:06.133363 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d70746d8-e2d3-4027-ae43-5574aacdf323 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194 tempest-InstanceUsageAuditLogNegativeTestJSON-188462194-project] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log/2021-12-25 21:07:06" status: 403 len: 128 microversion: 2.1 time: 0.008096 Dec 25 21:07:06.133363 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 47/70] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:07:06 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-12-25%2021%3A07%3A06 => generated 128 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:06.973206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:06.973206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:06.983803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:06.984641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:06.986606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:06.987269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:07.129356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:07.145262 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca9b572b-e716-4d1f-9307-fab90c0c5d4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1243 microversion: 2.1 time: 0.185609 Dec 25 21:07:07.146069 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 24/71] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:06 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1243 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:07.797210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e42c93a1-8c57-4bcf-94e2-e2ac7a1f0a85 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc41a700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:07.829331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-413444ac-77c6-4174-8f75-0a40212db7be tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-760182310", "id": 177391482, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:07.831342 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:07.831342 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:07.878711 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e42c93a1-8c57-4bcf-94e2-e2ac7a1f0a85 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010" status: 200 len: 637 microversion: 2.1 time: 0.085066 Dec 25 21:07:07.879291 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 25/72] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:07 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010 => generated 637 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:07.894734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c12c94c4-c96c-4077-9933-d6a1d1183301 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fc3523a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:07.945469 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-413444ac-77c6-4174-8f75-0a40212db7be tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.380768 Dec 25 21:07:07.946461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 48/73] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:07 2021] POST /compute/v2.1/flavors => generated 427 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:07.957892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c12c94c4-c96c-4077-9933-d6a1d1183301 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:07.958612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-843247fb-10b7-406f-bf4c-edf2e211b1ff tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "01f0a5964e27483495133541ea779fe8"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:07.963242 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:07.963242 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:07.963775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c12c94c4-c96c-4077-9933-d6a1d1183301 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:08.379584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c12c94c4-c96c-4077-9933-d6a1d1183301 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.488735 Dec 25 21:07:08.381306 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 26/74] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:07 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:07:08.386241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:08.386862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:08.393122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:08.393585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:08.394411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:08.394858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:08.463558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:08.471275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-161abcc6-2c05-488e-9d65-f6710de80eee tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1291 microversion: 2.1 time: 0.089063 Dec 25 21:07:08.481021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 27/75] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:08 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1291 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:08.619324 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-843247fb-10b7-406f-bf4c-edf2e211b1ff tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/177391482/action" status: 200 len: 96 microversion: 2.1 time: 0.664271 Dec 25 21:07:08.624867 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 49/76] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:07:07 2021] POST /compute/v2.1/flavors/177391482/action => generated 96 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:08.631364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88465653-440d-49b8-a3f7-281d490a6b0c tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc418670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:08.744826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8e78428-a101-4c7c-a4ae-322c0746b168 tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1801194331", "id": 956676948, "os-flavor-access:is_public": "True"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:08.746486 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:08.746486 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:08.851937 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8e78428-a101-4c7c-a4ae-322c0746b168 tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.378162 Dec 25 21:07:08.853421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 28/77] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:07:08 2021] POST /compute/v2.1/flavors => generated 465 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:09.074938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88465653-440d-49b8-a3f7-281d490a6b0c tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "DELETE /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.447436 Dec 25 21:07:09.076345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 50/78] 10.222.0.32 () {58 vars in 1295 bytes} [Sat Dec 25 21:07:08 2021] DELETE /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata/os_version => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:07:09.095891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99b182d0-917c-48d8-9b05-269fbadbaac1 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Calling method '.version_select at 0x7fa4fc3488b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:09.097244 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:09.097244 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:09.098994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b182d0-917c-48d8-9b05-269fbadbaac1 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:09.099621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b182d0-917c-48d8-9b05-269fbadbaac1 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:09.100614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b182d0-917c-48d8-9b05-269fbadbaac1 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:09.101294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b182d0-917c-48d8-9b05-269fbadbaac1 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:09.132227 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99b182d0-917c-48d8-9b05-269fbadbaac1 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 401 microversion: 2.1 time: 0.276988 Dec 25 21:07:09.139464 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 29/79] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:07:08 2021] GET /compute/v2.1/os-hosts => generated 401 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:09.238306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a100ff7-b2a5-48b4-9646-03941dc0219f tempest-FlavorsAccessTestJSON-389715725 tempest-FlavorsAccessTestJSON-389715725-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:09.273360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a100ff7-b2a5-48b4-9646-03941dc0219f tempest-FlavorsAccessTestJSON-389715725 tempest-FlavorsAccessTestJSON-389715725-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5823 microversion: 2.1 time: 0.195758 Dec 25 21:07:09.274137 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 51/80] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:09 2021] GET /compute/v2.1/flavors/detail => generated 5823 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:09.289034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12388f8b-79dd-47d1-86b0-ab25cf44f011 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc420310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:09.305171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9943adb8-1e60-4d6e-83e5-a95ddead5025 tempest-FlavorsV261TestJSON-849447549 tempest-FlavorsV261TestJSON-849447549-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:09.318374 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9943adb8-1e60-4d6e-83e5-a95ddead5025 tempest-FlavorsV261TestJSON-849447549 tempest-FlavorsV261TestJSON-849447549-project] 10.222.0.32 "GET /compute/v2.1/flavors/956676948" status: 200 len: 465 microversion: 2.61 time: 0.177348 Dec 25 21:07:09.319309 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 30/81] 10.222.0.32 () {60 vars in 1195 bytes} [Sat Dec 25 21:07:09 2021] GET /compute/v2.1/flavors/956676948 => generated 465 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:09.340171 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12388f8b-79dd-47d1-86b0-ab25cf44f011 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 37 microversion: 2.1 time: 0.064244 Dec 25 21:07:09.341564 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 52/82] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:07:09 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 37 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:09.349149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9282365d-bd8d-4861-836e-8f55085491b9 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01f0a5964e27483495133541ea779fe8"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:09.350424 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:09.350424 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:09.556972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee618bce-01c7-4ef1-abf3-728a270c0fc6 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Calling method '.version_select at 0x7fa4fc348280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:09.558171 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:09.558171 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:09.559740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee618bce-01c7-4ef1-abf3-728a270c0fc6 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '6d7e69ccbe614802b71c01c999f47f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ddee7278a14ed4bfb3b116a63b9901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:09.560614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee618bce-01c7-4ef1-abf3-728a270c0fc6 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:09.561740 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee618bce-01c7-4ef1-abf3-728a270c0fc6 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.241214 Dec 25 21:07:09.562393 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 31/83] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:07:09 2021] GET /compute/v2.1/os-hosts => generated 109 bytes in 243 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:09.569435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b9e47cf-c192-435d-98f8-10fc0cc757c3 tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fdbd2700>, body: {"flavor": {"description": "new"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:09.582310 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:09.582310 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:09.671509 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9282365d-bd8d-4861-836e-8f55085491b9 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/177391482/action" status: 200 len: 21 microversion: 2.1 time: 0.328486 Dec 25 21:07:09.672188 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 53/84] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:07:09 2021] POST /compute/v2.1/flavors/177391482/action => generated 21 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:09.679888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6fcb57d7-7742-46ac-af2c-85879ccfa825 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fccd0430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:09.798875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-6fcb57d7-7742-46ac-af2c-85879ccfa825 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:09.814482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-6fcb57d7-7742-46ac-af2c-85879ccfa825 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:09.937171 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b9e47cf-c192-435d-98f8-10fc0cc757c3 tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/956676948" status: 200 len: 466 microversion: 2.61 time: 0.373638 Dec 25 21:07:09.967243 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 32/85] 10.222.0.32 () {62 vars in 1215 bytes} [Sat Dec 25 21:07:09 2021] PUT /compute/v2.1/flavors/956676948 => generated 466 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:09.972273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:09.973551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:09.981185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:09.982088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:09.983123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:09.983770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:10.070364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:10.079592 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50ab7f9c-5eef-4b3f-9cf0-b485610e28c1 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1297 microversion: 2.1 time: 0.111302 Dec 25 21:07:10.080611 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 33/86] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:09 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1297 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:10.094669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4890daa6-d887-4c31-8490-12fffcea8aff tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Calling method '.version_select at 0x7fa4fc38fee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.096969 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:10.096969 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:10.101191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4890daa6-d887-4c31-8490-12fffcea8aff tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '6d7e69ccbe614802b71c01c999f47f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ddee7278a14ed4bfb3b116a63b9901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:10.102302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4890daa6-d887-4c31-8490-12fffcea8aff tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:10.108711 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4890daa6-d887-4c31-8490-12fffcea8aff tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.026609 Dec 25 21:07:10.110932 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 34/87] 10.222.0.32 () {58 vars in 1190 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:10.121172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1502aa8-cd63-419e-85a6-9595c729c42d tempest-FlavorsAccessTestJSON-389715725 tempest-FlavorsAccessTestJSON-389715725-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.175146 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1502aa8-cd63-419e-85a6-9595c729c42d tempest-FlavorsAccessTestJSON-389715725 tempest-FlavorsAccessTestJSON-389715725-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.062940 Dec 25 21:07:10.195163 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 35/88] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:10.195163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4597c60d-d6ff-4787-9c88-9d3f5df30856 tempest-FlavorsV261TestJSON-849447549 tempest-FlavorsV261TestJSON-849447549-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.225767 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4597c60d-d6ff-4787-9c88-9d3f5df30856 tempest-FlavorsV261TestJSON-849447549 tempest-FlavorsV261TestJSON-849447549-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 6247 microversion: 2.61 time: 0.038601 Dec 25 21:07:10.237535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 36/89] 10.222.0.32 () {60 vars in 1186 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/flavors/detail => generated 6247 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:10.237535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9039e134-01e6-4f20-b26c-a79813e71703 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Calling method '.version_select at 0x7fa4fc38fe50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.243071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9039e134-01e6-4f20-b26c-a79813e71703 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 25 21:07:10.243732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9039e134-01e6-4f20-b26c-a79813e71703 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:10.244737 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9039e134-01e6-4f20-b26c-a79813e71703 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.017041 Dec 25 21:07:10.251307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 37/90] 10.222.0.32 () {58 vars in 1211 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:10.251307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0eaf7ef6-7a0f-46df-b419-a7e0ee99da00 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.251307 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:10.251307 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:10.518349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6fcb57d7-7742-46ac-af2c-85879ccfa825 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.671195 Dec 25 21:07:10.518349 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 54/91] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:09 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:10.518349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6130bdf9-a4da-4ded-bda2-be1e3f37bfae tempest-FlavorsV261TestJSON-849447549 tempest-FlavorsV261TestJSON-849447549-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.518349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6130bdf9-a4da-4ded-bda2-be1e3f37bfae tempest-FlavorsV261TestJSON-849447549 tempest-FlavorsV261TestJSON-849447549-project] 10.222.0.32 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.61 time: 0.024399 Dec 25 21:07:10.518349 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 55/92] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/flavors => generated 3154 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:10.518349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e28d6e95-2429-48aa-9259-49d5e11f4195 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Calling method '.version_select at 0x7fa4fc3baa60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.519841 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:10.519841 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:10.519841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e28d6e95-2429-48aa-9259-49d5e11f4195 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '6d7e69ccbe614802b71c01c999f47f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ddee7278a14ed4bfb3b116a63b9901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:10.519841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e28d6e95-2429-48aa-9259-49d5e11f4195 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:10.519841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e28d6e95-2429-48aa-9259-49d5e11f4195 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.007152 Dec 25 21:07:10.520422 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 56/93] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:10.520422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-445af6bc-e068-4f79-8ec2-699d95a96db6 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc391f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.580118 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-445af6bc-e068-4f79-8ec2-699d95a96db6 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.078616 Dec 25 21:07:10.580443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 57/94] 10.222.0.32 () {58 vars in 1289 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata/os_distro => generated 33 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:10.586625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-639248cf-ad35-4f59-9545-1df526004386 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Calling method '.version_select at 0x7fa4fc3ba3a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.606979 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-639248cf-ad35-4f59-9545-1df526004386 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 25 21:07:10.607995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-639248cf-ad35-4f59-9545-1df526004386 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:10.608937 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-639248cf-ad35-4f59-9545-1df526004386 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027238 Dec 25 21:07:10.613642 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 58/95] 10.222.0.32 () {58 vars in 1190 bytes} [Sat Dec 25 21:07:10 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:10.614909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43cc2a47-56ff-434e-96b9-fb5bf10aca99 tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:10.615759 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:10.615759 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:10.942553 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0eaf7ef6-7a0f-46df-b419-a7e0ee99da00 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/177391482" status: 202 len: 0 microversion: 2.1 time: 0.696118 Dec 25 21:07:10.953090 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 38/96] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:07:10 2021] DELETE /compute/v2.1/flavors/177391482 => generated 0 bytes in 697 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:07:10.953090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8013120c-011a-45b4-af79-c2755e575b5a tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fc33f040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.009208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8013120c-011a-45b4-af79-c2755e575b5a tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:11.014923 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43cc2a47-56ff-434e-96b9-fb5bf10aca99 tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/956676948" status: 202 len: 0 microversion: 2.61 time: 0.401968 Dec 25 21:07:11.015020 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 59/97] 10.222.0.32 () {60 vars in 1198 bytes} [Sat Dec 25 21:07:10 2021] DELETE /compute/v2.1/flavors/956676948 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:07:11.021328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-134c95b0-5967-43fc-9c84-4a2b77c3f768 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Calling method '.version_select at 0x7fa4fc418700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.022846 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:11.022846 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:11.024367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-134c95b0-5967-43fc-9c84-4a2b77c3f768 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '6d7e69ccbe614802b71c01c999f47f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ddee7278a14ed4bfb3b116a63b9901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:11.026280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-134c95b0-5967-43fc-9c84-4a2b77c3f768 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.027462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-134c95b0-5967-43fc-9c84-4a2b77c3f768 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009953 Dec 25 21:07:11.028222 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 60/98] 10.222.0.32 () {58 vars in 1196 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:11.032929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb0fb4e5-f537-4921-9be3-f8b50b8a65fa tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.036617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8013120c-011a-45b4-af79-c2755e575b5a tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:11.062602 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cb0fb4e5-f537-4921-9be3-f8b50b8a65fa tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032941 Dec 25 21:07:11.063925 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 61/99] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:11.070555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4218f2a-1b92-4ddb-a33f-9b895aa8744d tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.097717 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4218f2a-1b92-4ddb-a33f-9b895aa8744d tempest-FlavorsV261TestJSON-1100268295 tempest-FlavorsV261TestJSON-1100268295-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.032344 Dec 25 21:07:11.099056 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 62/100] 10.222.0.32 () {60 vars in 1186 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:11.126230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aac37e1c-53b0-4707-895e-ca191a5479be tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Calling method '.version_select at 0x7fa4fc3ba430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.153354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-aac37e1c-53b0-4707-895e-ca191a5479be tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 25 21:07:11.168203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aac37e1c-53b0-4707-895e-ca191a5479be tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.172792 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aac37e1c-53b0-4707-895e-ca191a5479be tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.068742 Dec 25 21:07:11.173342 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 63/101] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:11.181047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20a26194-ca28-4a15-a69b-5ea6df3f6f13 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1629525707", "id": 705266812, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.300707 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20a26194-ca28-4a15-a69b-5ea6df3f6f13 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.123834 Dec 25 21:07:11.301321 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 64/102] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:11 2021] POST /compute/v2.1/flavors => generated 428 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:11.315436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.321145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:11.344370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:11.344850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:11.349041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:11.349505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:11.433010 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8013120c-011a-45b4-af79-c2755e575b5a tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.488119 Dec 25 21:07:11.437658 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 39/103] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:10 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:11.443349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f30079d9-72c7-4235-81be-fde5cd3d316c tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Calling method '.version_select at 0x7fa4fc38fa60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.445038 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:11.445038 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:11.446809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f30079d9-72c7-4235-81be-fde5cd3d316c tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '6d7e69ccbe614802b71c01c999f47f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ddee7278a14ed4bfb3b116a63b9901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:11.448380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f30079d9-72c7-4235-81be-fde5cd3d316c tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.450017 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f30079d9-72c7-4235-81be-fde5cd3d316c tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] 10.222.0.32 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.011132 Dec 25 21:07:11.451182 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 40/104] 10.222.0.32 () {58 vars in 1193 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:11.462205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32eb7c01-b8a6-4393-95bd-b216784a678d tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.464533 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:11.464533 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:11.481462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32eb7c01-b8a6-4393-95bd-b216784a678d tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/705266812/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.028195 Dec 25 21:07:11.482688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 41/105] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/flavors/705266812/os-flavor-access => generated 21 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:11.493680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06ba39a6-489c-4784-b970-4d45278bdab9 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc2d1d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.604204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06ba39a6-489c-4784-b970-4d45278bdab9 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.120183 Dec 25 21:07:11.612637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 42/106] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:11.613075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-676847c4-049b-4a67-8f90-f6a1c46efef7 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Calling method '.version_select at 0x7fa4fc2d1790>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.623492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-676847c4-049b-4a67-8f90-f6a1c46efef7 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 25 21:07:11.624333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-676847c4-049b-4a67-8f90-f6a1c46efef7 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.625567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-676847c4-049b-4a67-8f90-f6a1c46efef7 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.018692 Dec 25 21:07:11.626813 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 43/107] 10.222.0.32 () {58 vars in 1214 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:11.643905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3d0233a-710c-40d3-b740-1d82839251ff tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.754007 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3d0233a-710c-40d3-b740-1d82839251ff tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/705266812" status: 202 len: 0 microversion: 2.1 time: 0.125300 Dec 25 21:07:11.755767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 44/108] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:07:11 2021] DELETE /compute/v2.1/flavors/705266812 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:07:11.764499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8e2bdb2-270c-467e-a4c6-874c34e18ac1 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fc3484c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.807620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:11.822861 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-10c5cac2-49df-4e36-bc19-e9cb9c665e1b tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.517113 Dec 25 21:07:11.831657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e8e2bdb2-270c-467e-a4c6-874c34e18ac1 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:11.833506 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 65/109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:11.836671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e8e2bdb2-270c-467e-a4c6-874c34e18ac1 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:11.840235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc3b195b-2d56-4fa4-b6f6-6047a9450a2c tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc420c10>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.842320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc3b195b-2d56-4fa4-b6f6-6047a9450a2c tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.850078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc3b195b-2d56-4fa4-b6f6-6047a9450a2c tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.008678 Dec 25 21:07:11.850078 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 66/110] 10.222.0.32 () {60 vars in 1189 bytes} [Sat Dec 25 21:07:11 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:07:11.851625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ffac8bf7-216b-4372-998b-b429352045c2 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:11.892796 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ffac8bf7-216b-4372-998b-b429352045c2 tempest-FlavorsAccessTestJSON-1784860166 tempest-FlavorsAccessTestJSON-1784860166-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046809 Dec 25 21:07:11.904314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 67/111] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:11 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:11.912095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f737fb4-d6e1-4b49-88c4-28b3f5c8ae42 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc418310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.917370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f737fb4-d6e1-4b49-88c4-28b3f5c8ae42 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.922847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f737fb4-d6e1-4b49-88c4-28b3f5c8ae42 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.023298 Dec 25 21:07:11.923481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 68/112] 10.222.0.32 () {60 vars in 1189 bytes} [Sat Dec 25 21:07:11 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:07:11.936185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-018f0b81-0b1d-423d-918e-576eb154e170 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Action: 'update', calling method: .version_select at 0x7fa4fc389f70>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.937580 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:11.937580 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:11.945052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-018f0b81-0b1d-423d-918e-576eb154e170 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '6d7e69ccbe614802b71c01c999f47f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86ddee7278a14ed4bfb3b116a63b9901', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:11.946234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-018f0b81-0b1d-423d-918e-576eb154e170 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.947246 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-018f0b81-0b1d-423d-918e-576eb154e170 tempest-HostsAdminNegativeTestJSON-1138857273 tempest-HostsAdminNegativeTestJSON-1138857273-project] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.017722 Dec 25 21:07:11.953435 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 69/113] 10.222.0.32 () {60 vars in 1189 bytes} [Sat Dec 25 21:07:11 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:11.959900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95835cf4-deab-4760-a96c-5177e65dd364 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc4208b0>, body: {"status": null, "maintenance_mode": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:11.985463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95835cf4-deab-4760-a96c-5177e65dd364 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:11.986265 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95835cf4-deab-4760-a96c-5177e65dd364 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.031092 Dec 25 21:07:11.986931 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 70/114] 10.222.0.32 () {60 vars in 1189 bytes} [Sat Dec 25 21:07:11 2021] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:07:12.001490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08260a63-9205-44ae-8112-29ba60c5f179 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc389b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:12.003874 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.hosts [None req-08260a63-9205-44ae-8112-29ba60c5f179 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Enabling host nonexistent_hostname. Dec 25 21:07:12.023251 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-08260a63-9205-44ae-8112-29ba60c5f179 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Dec 25 21:07:12.024107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08260a63-9205-44ae-8112-29ba60c5f179 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:12.024951 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08260a63-9205-44ae-8112-29ba60c5f179 tempest-HostsAdminNegativeTestJSON-846688183 tempest-HostsAdminNegativeTestJSON-846688183-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.032513 Dec 25 21:07:12.026041 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 71/115] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 21:07:11 2021] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:12.167195 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8e2bdb2-270c-467e-a4c6-874c34e18ac1 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.410045 Dec 25 21:07:12.167821 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 45/116] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:11 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:12.177166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0d7b42b-5188-449d-b41a-bba7b608c160 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fc391ee0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:12.226758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-b0d7b42b-5188-449d-b41a-bba7b608c160 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:12.231523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-b0d7b42b-5188-449d-b41a-bba7b608c160 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:12.659847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0d7b42b-5188-449d-b41a-bba7b608c160 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 64 microversion: 2.1 time: 0.486266 Dec 25 21:07:12.660432 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 72/117] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:12 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 64 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:12.676233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb406946-4098-4aab-952c-3f47e35a9319 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc2d1790>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:12.729583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb406946-4098-4aab-952c-3f47e35a9319 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 64 microversion: 2.1 time: 0.063953 Dec 25 21:07:12.735946 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 46/118] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:07:12 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 64 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:12.740134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e5ed6cec-4e01-4b09-a5fe-68b58a0ee01c tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fc3ba1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:12.788596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e5ed6cec-4e01-4b09-a5fe-68b58a0ee01c tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:12.799166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e5ed6cec-4e01-4b09-a5fe-68b58a0ee01c tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:12.843572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:12.853937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:12.868219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:12.868747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:12.873139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:12.873597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:13.221286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:13.234617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5aaa6407-c09f-4dca-a00a-519aeda3811c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.398906 Dec 25 21:07:13.243948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 47/119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:12 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:13.547233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e5ed6cec-4e01-4b09-a5fe-68b58a0ee01c tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.810557 Dec 25 21:07:13.548204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 73/120] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:12 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:13.563288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b5472c09-3afe-4c07-93dc-7782fa0f8113 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update', calling method: .version_select at 0x7fa4fc33fee0>, body: {"meta": {"os_version": "alt"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:13.669930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b5472c09-3afe-4c07-93dc-7782fa0f8113 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:13.673434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b5472c09-3afe-4c07-93dc-7782fa0f8113 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:14.099321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95562930-bb62-496e-a77a-dceb4f626b38 tempest-NetworksTest-866678606 tempest-NetworksTest-866678606-project-admin] Calling method '.version_select at 0x7fa4fc3275e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:14.208247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b5472c09-3afe-4c07-93dc-7782fa0f8113 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.648695 Dec 25 21:07:14.209229 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 48/121] 10.222.0.32 () {60 vars in 1312 bytes} [Sat Dec 25 21:07:13 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata/os_version => generated 31 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:14.220067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5630bc0-38f2-40f1-b36e-e252b9f22b17 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc2d1f70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:14.268451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5630bc0-38f2-40f1-b36e-e252b9f22b17 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 58 microversion: 2.1 time: 0.052953 Dec 25 21:07:14.269801 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 49/122] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:07:14 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 58 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:14.278419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:14.282278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:14.286831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:14.287543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:14.288588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:14.289360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:14.420932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95562930-bb62-496e-a77a-dceb4f626b38 tempest-NetworksTest-866678606 tempest-NetworksTest-866678606-project-admin] 10.222.0.32 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.710052 Dec 25 21:07:14.422370 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 74/123] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:13 2021] GET /compute/v2.1/os-networks => generated 1938 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:14.426994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8b7c7e5-b72f-45af-951c-e51e51d692ca tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'update_all', calling method: .version_select at 0x7fa4fc2ea3a0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:14.491364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c8b7c7e5-b72f-45af-951c-e51e51d692ca tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:14.498810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c8b7c7e5-b72f-45af-951c-e51e51d692ca tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:14.513173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:14.531219 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0061ee7-400e-48f8-aa28-342d46ffa16a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.251083 Dec 25 21:07:14.532996 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 50/124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:14 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:14.541706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0d74f5d-25e8-4d33-9c12-9e5cfe7b6d46 tempest-NetworksTest-866678606 tempest-NetworksTest-866678606-project-admin] Calling method '.version_select at 0x7fa4fc33f8b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:14.802842 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0d74f5d-25e8-4d33-9c12-9e5cfe7b6d46 tempest-NetworksTest-866678606 tempest-NetworksTest-866678606-project-admin] 10.222.0.32 "GET /compute/v2.1/os-networks/7201e55c-7c5f-41aa-a042-a363696539d0" status: 200 len: 652 microversion: 2.1 time: 0.267189 Dec 25 21:07:14.802842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 51/125] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:07:14 2021] GET /compute/v2.1/os-networks/7201e55c-7c5f-41aa-a042-a363696539d0 => generated 652 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:14.811340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ccef781a-ed6d-4fd7-bc57-018d52e4bb4c tempest-NetworksTest-866678606 tempest-NetworksTest-866678606-project-admin] Calling method '.version_select at 0x7fa4fc33f940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:14.943558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ccef781a-ed6d-4fd7-bc57-018d52e4bb4c tempest-NetworksTest-866678606 tempest-NetworksTest-866678606-project-admin] 10.222.0.32 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.135720 Dec 25 21:07:14.952033 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 52/126] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:14 2021] GET /compute/v2.1/os-networks => generated 1938 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:15.039141 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8b7c7e5-b72f-45af-951c-e51e51d692ca tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 61 microversion: 2.1 time: 0.615942 Dec 25 21:07:15.041167 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 75/127] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:07:14 2021] PUT /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 61 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:15.050507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-066f4ce3-3c1f-41d0-bba2-9ba3099fb81e tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Action: 'create', calling method: .version_select at 0x7fa4fc38f670>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:15.124472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-066f4ce3-3c1f-41d0-bba2-9ba3099fb81e tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:15.141245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-066f4ce3-3c1f-41d0-bba2-9ba3099fb81e tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Getting quotas for user c764a9e9aea0473f9033d69ddccec1db and project ea8fe0b0a0054e8a923f2f7833eb1b10. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:15.549833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:15.550457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:15.557648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:15.558301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:15.559287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:15.559885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:15.709069 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-066f4ce3-3c1f-41d0-bba2-9ba3099fb81e tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "POST /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 85 microversion: 2.1 time: 0.663034 Dec 25 21:07:15.711136 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 53/128] 10.222.0.32 () {60 vars in 1280 bytes} [Sat Dec 25 21:07:15 2021] POST /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 85 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:15.721381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f98bbe0-3a30-4a63-90db-9a7e10e4a724 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] Calling method '.version_select at 0x7fa4fc41a5e0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:15.782192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f98bbe0-3a30-4a63-90db-9a7e10e4a724 tempest-ImagesMetadataTestJSON-808194544 tempest-ImagesMetadataTestJSON-808194544-project] 10.222.0.32 "GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata" status: 200 len: 85 microversion: 2.1 time: 0.065372 Dec 25 21:07:15.782757 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 54/129] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:07:15 2021] GET /compute/v2.1/images/8b85e121-37a3-4c46-8b51-11734ab0f010/metadata => generated 85 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:07:15.858197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:15.881834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be1a9b22-4981-4765-9ffa-457369bfb751 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.327026 Dec 25 21:07:15.881834 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 76/130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:15 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:16.891622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:16.892237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:16.898394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:16.898852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:16.899635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:16.900104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:17.072078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:17.080500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfc384b7-977b-49e6-adb3-417490a8beeb tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.192449 Dec 25 21:07:17.081165 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 55/131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:16 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:18.104161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:18.104972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:18.111251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:18.111811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:18.112804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:18.121812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:18.321079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:18.328854 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-400ba9e2-32fc-4400-b567-a11cad46f86a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.228977 Dec 25 21:07:18.339434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 77/132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:18 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:19.349730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:19.349730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:19.352972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:19.353493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:19.354290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:19.354736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:19.491893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:19.501153 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.159735 Dec 25 21:07:19.501708 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 56/133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:19 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:20.518114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:20.518721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:20.525196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:20.527742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:20.527742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:20.527742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:20.808863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:20.816547 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c02a6a94-ba6e-440a-820b-b934f536ca4c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.302079 Dec 25 21:07:20.817154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 78/134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:20 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:20.897991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:20.898980 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e32a600-3e30-4645-82a9-d6cb963b5121 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001332 Dec 25 21:07:20.906651 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 57/135] 10.222.0.32 () {56 vars in 885 bytes} [Sat Dec 25 21:07:20 2021] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 25 21:07:21.834370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:21.835026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:21.850233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:21.850961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:21.857896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:21.858736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:21.933265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Calling method '.version_select at 0x7fa4fc389d30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:21.934779 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:21.934779 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:21.936645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:21.937349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:21.984966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:21.984966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.021039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.021584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.043894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-846e8fd8-1c63-4173-ae7e-f979a7e473c5 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.389984 Dec 25 21:07:22.043894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 79/136] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:21 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:22.133445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:22.141317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46c1a268-e6b8-4701-ab33-850fb8102e4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.311365 Dec 25 21:07:22.145497 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 58/137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:21 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:22.338685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad995f88-f207-4caa-b9ff-6cb0d3f6744a tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] Calling method '.version_select at 0x7fa4fc389700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.340155 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.340155 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:22.341574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad995f88-f207-4caa-b9ff-6cb0d3f6744a tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '2c849558feaf4cae8a7c5832e154809b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9010e8b2da054f6eaae106843dfdca7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:22.342457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad995f88-f207-4caa-b9ff-6cb0d3f6744a tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:22.343301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad995f88-f207-4caa-b9ff-6cb0d3f6744a tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.292369 Dec 25 21:07:22.351708 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 80/138] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 301 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:22.611098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1d0b9865-e8c7-4dc4-90f1-b648b30ae78a req-55459cfc-cf6f-451d-9ac6-2cdcce7afa22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c20c1ee-2eb6-4064-b36f-e99d867be09e", "tag": "4d3caa25-16de-49aa-aaa3-c1184d217368"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:22.612639 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.612639 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:22.623391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1d0b9865-e8c7-4dc4-90f1-b648b30ae78a req-55459cfc-cf6f-451d-9ac6-2cdcce7afa22 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.623931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1d0b9865-e8c7-4dc4-90f1-b648b30ae78a req-55459cfc-cf6f-451d-9ac6-2cdcce7afa22 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.651454 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1d0b9865-e8c7-4dc4-90f1-b648b30ae78a req-55459cfc-cf6f-451d-9ac6-2cdcce7afa22 service nova] Creating event network-changed:4d3caa25-16de-49aa-aaa3-c1184d217368 for instance 9c20c1ee-2eb6-4064-b36f-e99d867be09e on nch1-master-1 Dec 25 21:07:22.652917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1d0b9865-e8c7-4dc4-90f1-b648b30ae78a req-55459cfc-cf6f-451d-9ac6-2cdcce7afa22 service nova] Acquired lock "compute-rpcapi-router" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:07:22.654152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.654685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.655584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.656215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.665616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.rpcapi [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 25 21:07:22.666611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] Releasing lock "compute-rpcapi-router" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:07:22.675540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc316e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.676589 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.676589 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:22.678754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.679379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.683632 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47b7276b-d854-40a4-aca2-71523042a3b1 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.441928 Dec 25 21:07:22.684416 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 59/139] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:22.692073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc7519f7-c519-4abf-80f5-57f34cab3c3c tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Calling method '.version_select at 0x7fa4fc3480d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.693123 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.693123 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:22.694609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7519f7-c519-4abf-80f5-57f34cab3c3c tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.695856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7519f7-c519-4abf-80f5-57f34cab3c3c tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.710943 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-dc7519f7-c519-4abf-80f5-57f34cab3c3c tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Dec 25 21:07:22.711551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc7519f7-c519-4abf-80f5-57f34cab3c3c tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:22.712388 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc7519f7-c519-4abf-80f5-57f34cab3c3c tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.026690 Dec 25 21:07:22.712958 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 60/140] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:22.723016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Calling method '.version_select at 0x7fa4fc348040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.724276 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.724276 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:22.725038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.725607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.726268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.726797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.742009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.742538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.754647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.755249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.757508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.758653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.762411 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1994e2fa-8217-48be-a60c-20e103ecd352 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.043658 Dec 25 21:07:22.767502 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 61/141] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:22.771751 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-228c6da2-90ae-440b-873d-3e22f027977d tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.418876 Dec 25 21:07:22.773512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94507e36-793f-4d61-8fe7-fb9f1ac7110e tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] Calling method '.version_select at 0x7fa4fc352160>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.773690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 81/142] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:22.774372 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.774372 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:22.776348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94507e36-793f-4d61-8fe7-fb9f1ac7110e tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '2c849558feaf4cae8a7c5832e154809b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9010e8b2da054f6eaae106843dfdca7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:22.776348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94507e36-793f-4d61-8fe7-fb9f1ac7110e tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:22.779622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94507e36-793f-4d61-8fe7-fb9f1ac7110e tempest-HypervisorAdminNegativeUnderV252Test-1253252053 tempest-HypervisorAdminNegativeUnderV252Test-1253252053-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.010516 Dec 25 21:07:22.780838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 62/143] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:07:22.785743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc418310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.786596 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.786596 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:22.788167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.788625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.792305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0413103-5b73-48e7-9dd8-4387fcb021e7 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Calling method '.version_select at 0x7fa4fc29d820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.794623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0413103-5b73-48e7-9dd8-4387fcb021e7 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.795149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0413103-5b73-48e7-9dd8-4387fcb021e7 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.802712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.803518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.803995 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b0413103-5b73-48e7-9dd8-4387fcb021e7 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] HTTP exception thrown: No hypervisor matching 'e8f52b2f-784e-433f-8b3b-c8570c813ee9' could be found. Dec 25 21:07:22.804650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0413103-5b73-48e7-9dd8-4387fcb021e7 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] Returning 404 to user: No hypervisor matching 'e8f52b2f-784e-433f-8b3b-c8570c813ee9' could be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:22.805594 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b0413103-5b73-48e7-9dd8-4387fcb021e7 tempest-HypervisorAdminNegativeUnderV252Test-124559035 tempest-HypervisorAdminNegativeUnderV252Test-124559035-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/e8f52b2f-784e-433f-8b3b-c8570c813ee9/servers" status: 404 len: 123 microversion: 2.1 time: 0.018535 Dec 25 21:07:22.810422 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 63/144] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors/e8f52b2f-784e-433f-8b3b-c8570c813ee9/servers => generated 123 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:22.815840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.816373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:22.822802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5df0f4b-dd14-4d7d-af5b-f27b213b4982 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1504 microversion: 2.1 time: 0.042486 Dec 25 21:07:22.825272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 82/145] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors/detail => generated 1504 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:22.838472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc252d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:22.839306 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:22.839306 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:22.841640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:22.842092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.005169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.005625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.017567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.018035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.030105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2a29d4a-b194-4769-b790-a888bc94b7d8 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.195349 Dec 25 21:07:23.030992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 64/146] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:22 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:23.043264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abfdc6d0-4ea7-402e-a50d-5812baf37358 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc4185e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.044115 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:23.044115 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:23.046380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfdc6d0-4ea7-402e-a50d-5812baf37358 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.046834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfdc6d0-4ea7-402e-a50d-5812baf37358 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.063725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfdc6d0-4ea7-402e-a50d-5812baf37358 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.064249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfdc6d0-4ea7-402e-a50d-5812baf37358 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.070593 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abfdc6d0-4ea7-402e-a50d-5812baf37358 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.033588 Dec 25 21:07:23.079195 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 83/147] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:23.083698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-249d1049-c962-4998-b344-a000f4db00c2 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc252430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.084494 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:23.084494 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:23.085963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-249d1049-c962-4998-b344-a000f4db00c2 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.088600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-249d1049-c962-4998-b344-a000f4db00c2 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.104750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-249d1049-c962-4998-b344-a000f4db00c2 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.024520 Dec 25 21:07:23.106701 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 65/148] 10.222.0.32 () {58 vars in 1178 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:23.117155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc418ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.118218 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:23.118218 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:23.119923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.120391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.134548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.135028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.146296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.146912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.162510 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9070809-8f02-4a0d-aad2-040b890445e1 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.041163 Dec 25 21:07:23.162510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 84/149] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:23.162510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.162510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:23.167564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.168552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.169453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.169892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.305619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:23.313806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ebcd684-65f3-49ed-b28e-c142185c0003 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.156235 Dec 25 21:07:23.317525 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 85/150] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:23.323333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8516781-2cb7-41ea-b621-91c6dd2fc46c tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa5028f14c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.324704 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:23.324704 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:23.326255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8516781-2cb7-41ea-b621-91c6dd2fc46c tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.326710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8516781-2cb7-41ea-b621-91c6dd2fc46c tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.341523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8516781-2cb7-41ea-b621-91c6dd2fc46c tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.341523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8516781-2cb7-41ea-b621-91c6dd2fc46c tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.348114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8516781-2cb7-41ea-b621-91c6dd2fc46c tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.028200 Dec 25 21:07:23.348712 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 86/151] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:23.359988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc31700b-5f72-41de-a5f3-36ee73e88003 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc3ba1f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.360913 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:23.360913 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:23.362525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc31700b-5f72-41de-a5f3-36ee73e88003 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.363057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc31700b-5f72-41de-a5f3-36ee73e88003 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.376808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc31700b-5f72-41de-a5f3-36ee73e88003 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.377371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc31700b-5f72-41de-a5f3-36ee73e88003 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.383465 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc31700b-5f72-41de-a5f3-36ee73e88003 tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 757 microversion: 2.1 time: 0.027081 Dec 25 21:07:23.384040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 87/152] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/os-hypervisors/2 => generated 757 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:23.395519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Calling method '.version_select at 0x7fa4fc2f03a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:23.396313 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:23.396313 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:23.398097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.398650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.411821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.412275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.422158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.422598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.428409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85909822-d223-4e22-8c4c-8fce4bdea1dc tempest-HypervisorAdminTestJSON-1720360371 tempest-HypervisorAdminTestJSON-1720360371-project-admin] Acquired lock "compute-rpcapi-router" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:07:23.429694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50202657-251d-40b4-8b01-d8754a340369 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.430129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50202657-251d-40b4-8b01-d8754a340369 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.430957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50202657-251d-40b4-8b01-d8754a340369 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.431381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50202657-251d-40b4-8b01-d8754a340369 None None] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.439372 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.compute.rpcapi [None req-50202657-251d-40b4-8b01-d8754a340369 None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Dec 25 21:07:23.442167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50202657-251d-40b4-8b01-d8754a340369 None None] Releasing lock "compute-rpcapi-router" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:07:23.470388 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50202657-251d-40b4-8b01-d8754a340369 None None] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.077980 Dec 25 21:07:23.471287 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 88/153] 10.222.0.32 () {58 vars in 1172 bytes} [Sat Dec 25 21:07:23 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:23.589121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-222626767", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:23.644672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:23.852034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:23.852514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:23.853066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:23.853537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:23.853953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:23.868715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.869423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.870432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:23.871574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:23.893316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Getting quotas for project 1cbb59dcbd544ccfbcbb709c6fe1201a. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:23.898032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Getting quotas for user 90d14ca3dbcf46d799645c342fc39b0e and project 1cbb59dcbd544ccfbcbb709c6fe1201a. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:23.909910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:07:23.912370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:07:24.330825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:24.331523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:24.338649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:24.339104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:24.339889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:24.340327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:24.478596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:24.485931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-774ec3f9-4c93-4735-8822-cb3f1bc2158d tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.159244 Dec 25 21:07:24.486509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 89/154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:24 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:24.764445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8826185-5bb7-4172-8353-5414b3a10283 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.632287 Dec 25 21:07:24.765870 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 66/155] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:07:24.776037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c821ff73-3913-40a5-9f5f-c5cea3213572 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:24.776387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c821ff73-3913-40a5-9f5f-c5cea3213572 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:24.840590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c821ff73-3913-40a5-9f5f-c5cea3213572 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:24.848893 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c821ff73-3913-40a5-9f5f-c5cea3213572 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1216 microversion: 2.1 time: 0.077008 Dec 25 21:07:24.849739 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 90/156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:24 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1216 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:25.183400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29ad6fe4-2e21-4439-b5b0-e573b1010efa tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc252790>, body: {"quota_set": {"ram": "5120"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:25.185420 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:25.185420 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:25.502087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:25.503416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:25.509636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:25.510086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:25.513225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:25.513225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:25.718106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:25.725487 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb8c1c06-40b6-4c9d-81d3-a052e21785cc tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.227026 Dec 25 21:07:25.726058 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 91/157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:25 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:25.764307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ad6fe4-2e21-4439-b5b0-e573b1010efa tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:25.769908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ad6fe4-2e21-4439-b5b0-e573b1010efa tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:25.769908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ad6fe4-2e21-4439-b5b0-e573b1010efa tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:25.769908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ad6fe4-2e21-4439-b5b0-e573b1010efa tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:25.865928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cf041489-52a6-43a7-be17-130f4863d282 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:25.866843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cf041489-52a6-43a7-be17-130f4863d282 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:25.928709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cf041489-52a6-43a7-be17-130f4863d282 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:25.936084 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cf041489-52a6-43a7-be17-130f4863d282 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1216 microversion: 2.1 time: 0.074039 Dec 25 21:07:25.936669 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 92/158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:25 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:26.096766 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29ad6fe4-2e21-4439-b5b0-e573b1010efa tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8" status: 200 len: 240 microversion: 2.36 time: 1.157047 Dec 25 21:07:26.097717 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 67/159] 10.222.0.32 () {62 vars in 1302 bytes} [Sat Dec 25 21:07:24 2021] PUT /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8 => generated 240 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:26.108026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d79b6a6b-76ae-4902-907a-662a606215ec tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Calling method '.version_select at 0x7fa4fc295a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:26.598422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d79b6a6b-76ae-4902-907a-662a606215ec tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:26.599082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d79b6a6b-76ae-4902-907a-662a606215ec tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:26.599797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d79b6a6b-76ae-4902-907a-662a606215ec tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:26.600239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d79b6a6b-76ae-4902-907a-662a606215ec tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:26.630324 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d79b6a6b-76ae-4902-907a-662a606215ec tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8/detail" status: 200 len: 672 microversion: 2.36 time: 0.526422 Dec 25 21:07:26.638672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 93/160] 10.222.0.32 () {60 vars in 1303 bytes} [Sat Dec 25 21:07:26 2021] GET /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8/detail => generated 672 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:26.743035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:26.743666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:26.751424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:26.751880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:26.752698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:26.753130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:26.890280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:26.897836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e90e557-7f04-4b16-aac7-0937b01c68ba tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.159775 Dec 25 21:07:26.898412 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 68/161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:26 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:26.953523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:26.954177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:26.960450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:26.961127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:26.962113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:26.963005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:27.027673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:27.035785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13173113-7eeb-4845-80e5-18bfb1354ee2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1220 microversion: 2.1 time: 0.087574 Dec 25 21:07:27.045755 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 94/162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:26 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:27.316725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc2d1a60>, body: {"quota_set": {"ram": "2048"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:27.318429 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:27.318429 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:27.618618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:27.619556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:27.621818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:27.622901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:27.680818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:27.681831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:27.683987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:27.684749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:27.883130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d307f67-136e-464a-818c-4f8c10566a18 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8?user_id=ce0644480d484e74943f963b68f17773" status: 200 len: 240 microversion: 2.36 time: 0.570462 Dec 25 21:07:27.883770 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 69/163] 10.222.0.32 () {62 vars in 1383 bytes} [Sat Dec 25 21:07:27 2021] PUT /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8?user_id=ce0644480d484e74943f963b68f17773 => generated 240 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:27.895360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b73eab9-c422-4f0b-a783-7152f66687b2 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] Calling method '.version_select at 0x7fa4fc292790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:27.913855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:27.914480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:27.921777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:27.922234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:27.923029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:27.923468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:28.120771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:28.130889 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22a077d2-5e29-49aa-bfd6-b1b5c1189b4a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.220363 Dec 25 21:07:28.132614 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 70/164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:27 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:28.138279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:28.160784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:28.160784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:28.160784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:28.160784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:28.161175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:28.236361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b73eab9-c422-4f0b-a783-7152f66687b2 tempest-QuotasAdminTestV236-932731645 tempest-QuotasAdminTestV236-932731645-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8?user_id=ce0644480d484e74943f963b68f17773" status: 200 len: 282 microversion: 2.36 time: 0.346047 Dec 25 21:07:28.237207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 95/165] 10.222.0.32 () {60 vars in 1363 bytes} [Sat Dec 25 21:07:27 2021] GET /compute/v2.1/os-quota-sets/97a893144c7741b1b5fc3cf85aba03f8?user_id=ce0644480d484e74943f963b68f17773 => generated 282 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:28.251444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:28.260831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e469a32-17a1-477d-aec9-6486f8309819 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1276 microversion: 2.1 time: 0.126892 Dec 25 21:07:28.263747 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 71/166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:28 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:29.149176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:29.149877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:29.160059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:29.160535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:29.161393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:29.161836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:29.284010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:29.286277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:29.306091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:29.307003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:29.309623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:29.311920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:29.478936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:29.500690 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4073433-f840-42f0-938d-92fb90292566 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1274 microversion: 2.1 time: 0.217267 Dec 25 21:07:29.503826 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 72/167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:29 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1274 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:29.535582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:29.548603 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b947edc-d9b2-49dc-bce4-cd45b7cab8c6 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.400986 Dec 25 21:07:29.569293 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 96/168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:29 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:30.402760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-686aa0a4-654a-4fbf-87e8-10f7ca1c44c2 req-aca9152a-a85b-4706-9308-bfd42288a2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c20c1ee-2eb6-4064-b36f-e99d867be09e", "name": "network-vif-plugged", "status": "completed", "tag": "4d3caa25-16de-49aa-aaa3-c1184d217368"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:30.404371 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:30.404371 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:30.411537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-686aa0a4-654a-4fbf-87e8-10f7ca1c44c2 req-aca9152a-a85b-4706-9308-bfd42288a2ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:30.411983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-686aa0a4-654a-4fbf-87e8-10f7ca1c44c2 req-aca9152a-a85b-4706-9308-bfd42288a2ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:30.424931 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-686aa0a4-654a-4fbf-87e8-10f7ca1c44c2 req-aca9152a-a85b-4706-9308-bfd42288a2ad service nova] Creating event network-vif-plugged:4d3caa25-16de-49aa-aaa3-c1184d217368 for instance 9c20c1ee-2eb6-4064-b36f-e99d867be09e on nch1-master-1 Dec 25 21:07:30.432235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-686aa0a4-654a-4fbf-87e8-10f7ca1c44c2 req-aca9152a-a85b-4706-9308-bfd42288a2ad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365977 Dec 25 21:07:30.432838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 73/169] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:30.523944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:30.524714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:30.532251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:30.532890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:30.533816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:30.535112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:30.578490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:30.579284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:30.586712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:30.587161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:30.588125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:30.588713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:30.781674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:30.789444 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de21310e-0c7f-42c8-9a9f-0a1815ea3a02 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.269206 Dec 25 21:07:30.799676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 97/170] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:30 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:30.846583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:30.854067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-086834ac-2686-4f01-953f-31d63b428558 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.280185 Dec 25 21:07:30.856916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 74/171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:30 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:31.146071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1351635840", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:31.199660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:31.426336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:31.426761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:31.427276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:31.427686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:31.428098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:31.437357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:31.437811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:31.438687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:31.439131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:31.457179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:31.462009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:31.472954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:07:31.475737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:07:31.645291 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8728160a-c5fa-4ed0-bc7e-d60e5431b4e0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723257 Dec 25 21:07:31.646700 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 98/172] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:07:31.657458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c7991341-8b67-4564-ba76-8661d4a8f500 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:31.658696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c7991341-8b67-4564-ba76-8661d4a8f500 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:31.770165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c7991341-8b67-4564-ba76-8661d4a8f500 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:31.781935 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c7991341-8b67-4564-ba76-8661d4a8f500 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1217 microversion: 2.1 time: 0.128223 Dec 25 21:07:31.782725 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 75/173] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:31 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:31.806971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:31.807596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:31.813965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:31.814418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:31.815214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:31.815826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:31.873065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:31.873910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:31.880997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:31.881787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:31.882850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:31.883504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:32.050640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:32.060418 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd8e9568-093e-4b6f-93be-7babf650ddc6 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.257388 Dec 25 21:07:32.061952 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 99/174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:31 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:32.105995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:32.115641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19f44793-bff7-4bd8-a951-ac66b36b972c tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1339 microversion: 2.1 time: 0.248083 Dec 25 21:07:32.116221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 76/175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:31 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1339 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:32.348826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Calling method '.version_select at 0x7fa4fc2959d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:32.350037 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:32.350037 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:32.351806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:32.352255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:32.366435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:32.366885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:32.378307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:32.379142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:32.387032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1453cb39-585c-481e-a27e-51cd8e573c98 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.223893 Dec 25 21:07:32.387934 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 100/176] 10.222.0.32 () {60 vars in 1186 bytes} [Sat Dec 25 21:07:32 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:32.403322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd735af1-a675-426e-974a-a50f42e548f8 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Calling method '.version_select at 0x7fa4fc26bee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:32.403322 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:32.403322 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:32.403322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd735af1-a675-426e-974a-a50f42e548f8 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:32.403322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd735af1-a675-426e-974a-a50f42e548f8 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:32.433241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd735af1-a675-426e-974a-a50f42e548f8 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:32.434940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd735af1-a675-426e-974a-a50f42e548f8 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:32.442160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd735af1-a675-426e-974a-a50f42e548f8 tempest-HypervisorAdminV228Test-968523014 tempest-HypervisorAdminV228Test-968523014-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.048608 Dec 25 21:07:32.443241 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 77/177] 10.222.0.32 () {60 vars in 1192 bytes} [Sat Dec 25 21:07:32 2021] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:32.798769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bce73f05-f941-495a-bc7a-3b28e5d641bb tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:32.799440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bce73f05-f941-495a-bc7a-3b28e5d641bb tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:32.851716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bce73f05-f941-495a-bc7a-3b28e5d641bb tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:32.859223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bce73f05-f941-495a-bc7a-3b28e5d641bb tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1217 microversion: 2.1 time: 0.063980 Dec 25 21:07:32.859894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 101/178] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:32 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1217 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:33.080016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:33.080800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:33.087214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.087761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.088563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.091305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.132598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:33.139158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:33.140037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.140703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.141595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.142146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.295193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:33.310838 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a78fe752-0912-4109-8240-2673f2679558 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.235075 Dec 25 21:07:33.312627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 78/179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:33 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:33.348028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:33.358309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa0e5223-4553-4b48-892d-3936b6872c76 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1489 microversion: 2.1 time: 0.230213 Dec 25 21:07:33.358980 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 102/180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:33 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1489 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:33.386514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:33.387119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:33.399709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.400214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.401109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.402402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.820259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1456597357", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "1e137e86-76be-493f-9b25-1d17756925b5"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:33.874628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] validate_networks() for [('1e137e86-76be-493f-9b25-1d17756925b5', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:33.917886 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-686a645f-49d5-4a49-84d7-641ce1e6b87c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1640 microversion: 2.1 time: 0.534675 Dec 25 21:07:33.919646 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 79/181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:33 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1640 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:33.924647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:33.925273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:33.932894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.934030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:33.934956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:33.935277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.053016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:34.063748 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d2f2e7a-29ea-477d-b2b1-86a4b0f40524 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1221 microversion: 2.1 time: 0.142738 Dec 25 21:07:34.079602 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 80/182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:33 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1221 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:34.084430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa572cf8-8556-4f80-aeb6-475cbd720801 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:34.086360 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:34.086360 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:34.100406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa572cf8-8556-4f80-aeb6-475cbd720801 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:34.101620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa572cf8-8556-4f80-aeb6-475cbd720801 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.422550 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa572cf8-8556-4f80-aeb6-475cbd720801 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 300 microversion: 2.1 time: 0.341647 Dec 25 21:07:34.423528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 81/183] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:34 2021] POST /compute/v2.1/os-aggregates/3/action => generated 300 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:34.430599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:34.431216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:34.437561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:34.438180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.439354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:34.440278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.584249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:34.592337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d45ad860-134b-42cc-837e-856d025d1b2a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.167614 Dec 25 21:07:34.592924 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 82/184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:34 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:34.597562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a442cb38-e122-4fe3-acc7-6d3bbf70886e tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:34.598677 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:34.598677 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:34.703036 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a442cb38-e122-4fe3-acc7-6d3bbf70886e tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.109032 Dec 25 21:07:34.705483 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 83/185] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:34 2021] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:34.718068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04333e59-1a2f-4dc1-96b1-187e5ad0e13d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-825976701"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:34.719723 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:34.719723 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:34.721925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-04333e59-1a2f-4dc1-96b1-187e5ad0e13d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid 283f3ad5-7b04-4bd8-8d87-9b9b526119a8 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:34.889127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:34.889654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:34.890175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:34.890653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:34.891084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:34.901315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:34.901764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.902596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:34.903035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.912178 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04333e59-1a2f-4dc1-96b1-187e5ad0e13d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.198740 Dec 25 21:07:34.912973 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 84/186] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:34 2021] POST /compute/v2.1/os-aggregates => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:34.920623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:34.923043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e77fe80-dee0-446a-833e-8f05c7508a4b tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:34.924418 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:34.924418 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:34.924828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for user 2cb2a59c7c9b4a13964c78ff0fb1a8f4 and project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:34.932997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e77fe80-dee0-446a-833e-8f05c7508a4b tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:34.933958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e77fe80-dee0-446a-833e-8f05c7508a4b tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:34.937899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:07:34.940793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:07:35.052573 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-16c0abe5-3ae4-4835-b207-fcb687272981 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.405440 Dec 25 21:07:35.053690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 103/187] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:07:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 25 21:07:35.065661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2eabf217-f9b7-4c60-9f49-47eddc4cafaf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:35.066383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2eabf217-f9b7-4c60-9f49-47eddc4cafaf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:35.145841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2eabf217-f9b7-4c60-9f49-47eddc4cafaf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:35.156804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2eabf217-f9b7-4c60-9f49-47eddc4cafaf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:35.158950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2eabf217-f9b7-4c60-9f49-47eddc4cafaf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:35.160983 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2eabf217-f9b7-4c60-9f49-47eddc4cafaf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1262 microversion: 2.25 time: 0.100384 Dec 25 21:07:35.161984 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 104/188] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:35 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1262 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:35.180240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:35.180864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:35.188357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:35.189073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:35.190173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:35.190775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:35.259864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:35.267758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5edca5ba-2159-47ba-9730-a2da29542ede tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1221 microversion: 2.1 time: 0.104262 Dec 25 21:07:35.268387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 105/189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:35 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:35.307857 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e77fe80-dee0-446a-833e-8f05c7508a4b tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 241 microversion: 2.1 time: 0.388513 Dec 25 21:07:35.308522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 85/190] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:34 2021] POST /compute/v2.1/os-aggregates/8/action => generated 241 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:35.318838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1dca1f21-6d79-4e8c-9d91-d53945b9144d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:35.320346 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:35.320346 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:35.338842 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1dca1f21-6d79-4e8c-9d91-d53945b9144d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.014459 Dec 25 21:07:35.338842 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 106/191] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:07:35 2021] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:35.347923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6b3b126-2b29-4ac6-818e-0d2c0979c82f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:35.349783 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:35.349783 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:35.358096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6b3b126-2b29-4ac6-818e-0d2c0979c82f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:35.358543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6b3b126-2b29-4ac6-818e-0d2c0979c82f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:35.607855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:35.608463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:35.614510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:35.614966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:35.615761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:35.616155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:35.740675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6b3b126-2b29-4ac6-818e-0d2c0979c82f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 226 microversion: 2.1 time: 0.394924 Dec 25 21:07:35.749118 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 86/192] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:35 2021] POST /compute/v2.1/os-aggregates/8/action => generated 226 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:35.753987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86650ecc-50a0-45d6-85f8-c748e4d1c10d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:35.754877 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:35.754877 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:35.818030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:35.826353 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e25f570-c889-4a3a-9f41-ab0cf95de170 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.222014 Dec 25 21:07:35.827131 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 107/193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:35 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:35.918231 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86650ecc-50a0-45d6-85f8-c748e4d1c10d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.167837 Dec 25 21:07:35.919650 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 87/194] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:35 2021] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:35.934129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c16c9882-a380-4f55-84a5-ca16bbbaca46 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1737953232"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:35.940611 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:35.940611 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:35.945967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-c16c9882-a380-4f55-84a5-ca16bbbaca46 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid e09fb8a4-0b18-40f1-950e-00ceded31e4b for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:35.993750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9af231e-bc9f-4345-9421-e1293e34028d tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc292c10>, body: {"quota_set": {"ram": "5120"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:35.995719 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:35.995719 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:36.060348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9af231e-bc9f-4345-9421-e1293e34028d tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.060794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9af231e-bc9f-4345-9421-e1293e34028d tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.061646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9af231e-bc9f-4345-9421-e1293e34028d tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.062065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9af231e-bc9f-4345-9421-e1293e34028d tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.098965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c16c9882-a380-4f55-84a5-ca16bbbaca46 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.168127 Dec 25 21:07:36.101951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 88/195] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:35 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:36.119892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-60f061f7-8aae-473b-92db-192fb28f4a29 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:36.122169 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:36.122169 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:36.133931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60f061f7-8aae-473b-92db-192fb28f4a29 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.134582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60f061f7-8aae-473b-92db-192fb28f4a29 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.333674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9af231e-bc9f-4345-9421-e1293e34028d tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320" status: 200 len: 148 microversion: 2.57 time: 0.505214 Dec 25 21:07:36.334768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 108/196] 10.222.0.32 () {62 vars in 1302 bytes} [Sat Dec 25 21:07:35 2021] PUT /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320 => generated 148 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:36.341068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c16c25de-6ef6-4220-a160-beaacb0a7a8a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:36.342075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c16c25de-6ef6-4220-a160-beaacb0a7a8a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:36.439359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c16c25de-6ef6-4220-a160-beaacb0a7a8a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:36.445882 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-60f061f7-8aae-473b-92db-192fb28f4a29 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.331708 Dec 25 21:07:36.451918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c16c25de-6ef6-4220-a160-beaacb0a7a8a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:36.452178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 89/197] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:36 2021] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:36.454000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c16c25de-6ef6-4220-a160-beaacb0a7a8a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:36.455301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c16c25de-6ef6-4220-a160-beaacb0a7a8a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1262 microversion: 2.25 time: 0.119376 Dec 25 21:07:36.455841 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 109/198] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:36 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1262 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:36.456763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:36.457410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:36.467489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.469513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.470549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.470668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0347f88e-a905-4873-8acb-78cb838faf68 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Calling method '.version_select at 0x7fa4fc3054c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:36.471123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.542160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:36.551532 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e74c2e34-3c10-4de3-aab7-420df8dd7ee3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1269 microversion: 2.1 time: 0.098404 Dec 25 21:07:36.552282 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 90/199] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:36 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1269 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:36.557712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a2556dd5-645e-4ddf-9be7-4473ddd5dbe5 req-d4476197-c5ff-4e3c-9779-c819d47e3d24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:36.559698 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:36.559698 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:36.567698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2556dd5-645e-4ddf-9be7-4473ddd5dbe5 req-d4476197-c5ff-4e3c-9779-c819d47e3d24 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.568137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2556dd5-645e-4ddf-9be7-4473ddd5dbe5 req-d4476197-c5ff-4e3c-9779-c819d47e3d24 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.579578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a2556dd5-645e-4ddf-9be7-4473ddd5dbe5 req-d4476197-c5ff-4e3c-9779-c819d47e3d24 service nova] Creating event network-changed:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:07:36.585222 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a2556dd5-645e-4ddf-9be7-4473ddd5dbe5 req-d4476197-c5ff-4e3c-9779-c819d47e3d24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031555 Dec 25 21:07:36.585880 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 91/200] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:36.592246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea2abe33-e1b7-4cb3-bad9-d5d18aa197df tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:36.593511 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:36.593511 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:36.607002 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea2abe33-e1b7-4cb3-bad9-d5d18aa197df tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.019768 Dec 25 21:07:36.607593 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 92/201] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:07:36 2021] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:36.619162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-261b2fd4-89fd-483c-8f5a-af92ce62e83f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:36.621012 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:36.621012 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:36.630618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-261b2fd4-89fd-483c-8f5a-af92ce62e83f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.631466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-261b2fd4-89fd-483c-8f5a-af92ce62e83f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.860483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347f88e-a905-4873-8acb-78cb838faf68 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.861288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347f88e-a905-4873-8acb-78cb838faf68 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.863720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347f88e-a905-4873-8acb-78cb838faf68 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.864412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347f88e-a905-4873-8acb-78cb838faf68 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.905324 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0347f88e-a905-4873-8acb-78cb838faf68 tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320/detail" status: 200 len: 463 microversion: 2.57 time: 0.447043 Dec 25 21:07:36.906545 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 110/202] 10.222.0.32 () {60 vars in 1303 bytes} [Sat Dec 25 21:07:36 2021] GET /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320/detail => generated 463 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:36.919173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:36.920302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:36.929180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.929829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:36.930858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:36.931297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.014008 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-261b2fd4-89fd-483c-8f5a-af92ce62e83f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.398341 Dec 25 21:07:37.014590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 93/203] 10.222.0.32 () {60 vars in 1190 bytes} [Sat Dec 25 21:07:36 2021] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:37.027871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3166801-4561-49ea-9738-4628fcb75a22 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:37.029583 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:37.029583 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:37.185443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3166801-4561-49ea-9738-4628fcb75a22 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.161413 Dec 25 21:07:37.186269 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 94/204] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:37 2021] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:37.202626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-016d92ee-4129-4ad8-86f1-a8a534532f28 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1912497881"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:37.209631 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:37.209631 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:37.209631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-016d92ee-4129-4ad8-86f1-a8a534532f28 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid f87c697e-f356-46d7-9dd3-c390d59ffcdb for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:37.331763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-016d92ee-4129-4ad8-86f1-a8a534532f28 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.136984 Dec 25 21:07:37.332374 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 95/205] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:37 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:37.332602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:37.341328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ae21e59-0be3-43b7-b556-d2ac11dfed3d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.426699 Dec 25 21:07:37.341730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc24dc10>, body: {"quota_set": {"ram": "2048"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:37.351011 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:37.351011 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:37.351750 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 111/206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:36 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:37.357548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-563173ec-d3d3-4b2c-a7e1-e3b144bd1b07 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:37.359357 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:37.359357 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:37.369117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-563173ec-d3d3-4b2c-a7e1-e3b144bd1b07 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.370189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-563173ec-d3d3-4b2c-a7e1-e3b144bd1b07 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.498629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.499094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.500511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.501080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.608854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.609329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.612826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.612826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.767697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-563173ec-d3d3-4b2c-a7e1-e3b144bd1b07 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.414634 Dec 25 21:07:37.768301 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 112/207] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:37 2021] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:37.780095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:37.781358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:37.788341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.789088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.790059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.790556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.800479 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-63b8cd1d-639b-4c97-9bb4-d1da58c3a9ea tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320?user_id=98f0ed9507fe4086aeb305c6222fa588" status: 200 len: 148 microversion: 2.57 time: 0.466822 Dec 25 21:07:37.801512 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 96/208] 10.222.0.32 () {62 vars in 1383 bytes} [Sat Dec 25 21:07:37 2021] PUT /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320?user_id=98f0ed9507fe4086aeb305c6222fa588 => generated 148 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:37.807639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:37.810116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:37.818661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.819332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.820693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:37.821322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:37.967842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:37.985320 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd785e89-2e90-433a-a8e6-e6a74b138761 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1275 microversion: 2.1 time: 0.182487 Dec 25 21:07:37.985938 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 97/209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:37 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1275 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:37.998678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-724d56e3-21d9-4acb-8a5c-cfcac3132553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:38.000045 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.000045 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:38.009173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-724d56e3-21d9-4acb-8a5c-cfcac3132553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.009829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-724d56e3-21d9-4acb-8a5c-cfcac3132553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.041432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:38.052712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:38.054995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:38.057376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cc553b3-d8d4-4529-b96e-41b4724462af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1314 microversion: 2.25 time: 0.286686 Dec 25 21:07:38.057939 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 113/210] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:37 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:38.062725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08f4e73e-f8e0-4e24-bea7-8755147b709f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] Calling method '.version_select at 0x7fa4fc2bcf70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.268497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-724d56e3-21d9-4acb-8a5c-cfcac3132553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.281451 Dec 25 21:07:38.269137 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 98/211] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:37 2021] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:38.316913 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08f4e73e-f8e0-4e24-bea7-8755147b709f tempest-QuotasAdminTestV257-1296223942 tempest-QuotasAdminTestV257-1296223942-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320?user_id=98f0ed9507fe4086aeb305c6222fa588" status: 200 len: 190 microversion: 2.57 time: 0.257746 Dec 25 21:07:38.317762 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 114/212] 10.222.0.32 () {60 vars in 1363 bytes} [Sat Dec 25 21:07:38 2021] GET /compute/v2.1/os-quota-sets/a03f809592e74ac1b7696c8ce5985320?user_id=98f0ed9507fe4086aeb305c6222fa588 => generated 190 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:38.322638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c1bd86cf-8dba-4f3c-8765-4dc2731451d8 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.324410 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.324410 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:38.358557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0707c5ea-92b9-4fd1-85e5-7af4016062a9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.359984 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.359984 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:38.370614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0707c5ea-92b9-4fd1-85e5-7af4016062a9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.370614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0707c5ea-92b9-4fd1-85e5-7af4016062a9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.370614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0707c5ea-92b9-4fd1-85e5-7af4016062a9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.371524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0707c5ea-92b9-4fd1-85e5-7af4016062a9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.391527 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0707c5ea-92b9-4fd1-85e5-7af4016062a9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.121117 Dec 25 21:07:38.392445 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 99/213] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:38 2021] GET /compute/v2.1/os-services => generated 947 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:38.397955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.398823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:38.410979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.416290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.416290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.416290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.583068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:38.591119 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32fe42a0-24fc-4415-801e-37a87a9c7c74 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.197662 Dec 25 21:07:38.591688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 100/214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:38 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:38.602009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80c9c062-7818-420c-84ad-1615be4c352d tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.603627 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.603627 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:38.605985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80c9c062-7818-420c-84ad-1615be4c352d tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.606504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80c9c062-7818-420c-84ad-1615be4c352d tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.607363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80c9c062-7818-420c-84ad-1615be4c352d tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.607802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80c9c062-7818-420c-84ad-1615be4c352d tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.616412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c1bd86cf-8dba-4f3c-8765-4dc2731451d8 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.297194 Dec 25 21:07:38.617299 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 115/215] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:38 2021] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:38.638404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df2429a3-87be-48d4-96f8-3f05f2c91b92 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-223062231"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:38.638632 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80c9c062-7818-420c-84ad-1615be4c352d tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.044839 Dec 25 21:07:38.639240 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 101/216] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:07:38 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:38.640639 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.640639 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:38.642179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-df2429a3-87be-48d4-96f8-3f05f2c91b92 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid 27fd6c97-8c22-4b8d-b496-90e840d03caa for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:38.652613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbd8dbc8-80e1-4587-88cd-e768f28a8684 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.654117 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.654117 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:38.655666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbd8dbc8-80e1-4587-88cd-e768f28a8684 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.656171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbd8dbc8-80e1-4587-88cd-e768f28a8684 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.657329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbd8dbc8-80e1-4587-88cd-e768f28a8684 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.657761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbd8dbc8-80e1-4587-88cd-e768f28a8684 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.681380 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbd8dbc8-80e1-4587-88cd-e768f28a8684 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.034431 Dec 25 21:07:38.681974 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 102/217] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:38 2021] GET /compute/v2.1/os-services => generated 947 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:38.686760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7aca54a7-e85f-490b-bc6e-ce3395678fcf tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1841599160"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:38.688018 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.688018 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:38.689251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-7aca54a7-e85f-490b-bc6e-ce3395678fcf tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Generated uuid a7b2f9ff-8fd6-418d-9ba9-d746200564e9 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:38.863100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7aca54a7-e85f-490b-bc6e-ce3395678fcf tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.180034 Dec 25 21:07:38.864663 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df2429a3-87be-48d4-96f8-3f05f2c91b92 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.230928 Dec 25 21:07:38.865483 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 103/218] 10.222.0.32 () {62 vars in 1204 bytes} [Sat Dec 25 21:07:38 2021] POST /compute/v2.1/os-aggregates => generated 247 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:38.873526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 116/219] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:38 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:38.873610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-884a4c5e-0aa2-40c6-b6f7-01683044d080 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.873610 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.873610 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:38.874930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-884a4c5e-0aa2-40c6-b6f7-01683044d080 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.875396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-884a4c5e-0aa2-40c6-b6f7-01683044d080 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.876214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-884a4c5e-0aa2-40c6-b6f7-01683044d080 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:38.876660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-884a4c5e-0aa2-40c6-b6f7-01683044d080 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:38.882096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aa3b35a-e60a-46a1-b092-8deff53a108b tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:38.883162 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.883162 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:38.905596 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-884a4c5e-0aa2-40c6-b6f7-01683044d080 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038177 Dec 25 21:07:38.906776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 104/220] 10.222.0.32 () {58 vars in 1195 bytes} [Sat Dec 25 21:07:38 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:38.911416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53f8f52f-d68e-4287-bd8e-69296f3e360b tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-759854382"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:38.994928 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:38.994928 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.038644 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0aa3b35a-e60a-46a1-b092-8deff53a108b tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.162217 Dec 25 21:07:39.039825 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 117/221] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:38 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:39.049058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7bbf67da-270a-48a5-866f-9bd4a7cff1e9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.050456 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.050456 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:39.052227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7bbf67da-270a-48a5-866f-9bd4a7cff1e9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.054089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7bbf67da-270a-48a5-866f-9bd4a7cff1e9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.054887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7bbf67da-270a-48a5-866f-9bd4a7cff1e9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.057424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7bbf67da-270a-48a5-866f-9bd4a7cff1e9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.098726 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7bbf67da-270a-48a5-866f-9bd4a7cff1e9 tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.057955 Dec 25 21:07:39.100251 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 118/222] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/os-services => generated 947 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:39.114054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.115696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:39.126532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.127220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.128023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.128525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.140088 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53f8f52f-d68e-4287-bd8e-69296f3e360b tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.232080 Dec 25 21:07:39.142694 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 105/223] 10.222.0.32 () {62 vars in 1212 bytes} [Sat Dec 25 21:07:38 2021] PUT /compute/v2.1/os-aggregates/12 => generated 299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:39.155495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0e5b6749-c854-44ee-af76-55ba80287165 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.160847 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.160847 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.168131 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0e5b6749-c854-44ee-af76-55ba80287165 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Dec 25 21:07:39.169442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0e5b6749-c854-44ee-af76-55ba80287165 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:39.170480 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0e5b6749-c854-44ee-af76-55ba80287165 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.019343 Dec 25 21:07:39.171539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 106/224] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:39.176948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.177856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:39.185823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.186526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.187604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.188249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.374332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:39.393045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:39.396396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:39.402443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b0c8899-51f7-430d-a36f-bb878256f97b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1320 microversion: 2.25 time: 0.226229 Dec 25 21:07:39.402443 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 107/225] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1320 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:39.406439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de0ba250-2753-4bf0-a258-2f21ae705faf tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.408018 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.408018 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.412168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de0ba250-2753-4bf0-a258-2f21ae705faf tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.412993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de0ba250-2753-4bf0-a258-2f21ae705faf tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.414742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de0ba250-2753-4bf0-a258-2f21ae705faf tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.415438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de0ba250-2753-4bf0-a258-2f21ae705faf tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.453997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de0ba250-2753-4bf0-a258-2f21ae705faf tempest-ServicesAdminNegativeTestJSON-1993339572 tempest-ServicesAdminNegativeTestJSON-1993339572-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.053133 Dec 25 21:07:39.460922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 108/226] 10.222.0.32 () {58 vars in 1197 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:07:39.461257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f3f60c0-a1c3-4041-b81c-3b4ccb423056 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.462396 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.462396 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.472355 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f3f60c0-a1c3-4041-b81c-3b4ccb423056 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.016367 Dec 25 21:07:39.479691 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 109/227] 10.222.0.32 () {60 vars in 1192 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/os-aggregates/12 => generated 299 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:39.486429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5527f1d3-34dd-452f-bb11-5f421a28c431 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.487334 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.487334 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.502048 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-5527f1d3-34dd-452f-bb11-5f421a28c431 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Dec 25 21:07:39.502913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5527f1d3-34dd-452f-bb11-5f421a28c431 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:39.504433 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5527f1d3-34dd-452f-bb11-5f421a28c431 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.022884 Dec 25 21:07:39.505241 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 110/228] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:39 2021] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:39.515003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:39.522809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e0653876-f39d-43bf-9711-5240d54ff5cf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.417227 Dec 25 21:07:39.532467 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 119/229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:39.537748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6824939-f67c-4ab8-a6be-cd77e0fba0f1 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:39.539235 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.539235 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:39.548194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6824939-f67c-4ab8-a6be-cd77e0fba0f1 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.548912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6824939-f67c-4ab8-a6be-cd77e0fba0f1 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.709564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4202875-c38c-4d28-8092-0098b85e2843 tempest-ServicesAdminNegativeTestJSON-2104206993 tempest-ServicesAdminNegativeTestJSON-2104206993-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.711385 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.711385 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.712792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b4202875-c38c-4d28-8092-0098b85e2843 tempest-ServicesAdminNegativeTestJSON-2104206993 tempest-ServicesAdminNegativeTestJSON-2104206993-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '46466f06288146e0820156cca41c54e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f398b36b788e41059edfb2ffe167686a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:39.715755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4202875-c38c-4d28-8092-0098b85e2843 tempest-ServicesAdminNegativeTestJSON-2104206993 tempest-ServicesAdminNegativeTestJSON-2104206993-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:39.716574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4202875-c38c-4d28-8092-0098b85e2843 tempest-ServicesAdminNegativeTestJSON-2104206993 tempest-ServicesAdminNegativeTestJSON-2104206993-project] 10.222.0.32 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.210412 Dec 25 21:07:39.717353 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 111/230] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/os-services => generated 112 bytes in 211 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:39.721484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-609d6bc4-3914-4559-b3f1-140b4e15d553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1028769", "name": "tempest-test_aggregate-1678231106"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:39.722859 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:39.722859 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:39.724186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-609d6bc4-3914-4559-b3f1-140b4e15d553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid 87640cb8-88d5-4252-bb91-7c7c71a24124 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:39.905071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-609d6bc4-3914-4559-b3f1-140b4e15d553 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.186857 Dec 25 21:07:39.905677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 112/231] 10.222.0.32 () {60 vars in 1164 bytes} [Sat Dec 25 21:07:39 2021] POST /compute/v2.1/os-aggregates => generated 220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:39.918388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:39.919142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:39.932078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.933945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:39.934634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:39.937921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:40.111484 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6824939-f67c-4ab8-a6be-cd77e0fba0f1 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 314 microversion: 2.41 time: 0.577551 Dec 25 21:07:40.120232 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 120/232] 10.222.0.32 () {62 vars in 1234 bytes} [Sat Dec 25 21:07:39 2021] POST /compute/v2.1/os-aggregates/12/action => generated 314 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:40.127731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79447370-a018-432e-9d52-0750ca91f50d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:40.128827 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:40.128827 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:40.223170 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79447370-a018-432e-9d52-0750ca91f50d tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.100683 Dec 25 21:07:40.224155 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 121/233] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:40 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:40.231332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f681c8c-fdb1-4cbd-b1d6-01c946d9ea53 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:40.234819 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:40.234819 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:40.249296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f681c8c-fdb1-4cbd-b1d6-01c946d9ea53 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:40.249660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f681c8c-fdb1-4cbd-b1d6-01c946d9ea53 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:40.279764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:40.291969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49f65781-49be-4909-8b50-3c261674b919 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.384802 Dec 25 21:07:40.293124 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 113/234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:39 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:40.300600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3750a2d2-7d38-4aec-934c-5c4171c22bfc tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:40.301652 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:40.301652 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:40.318226 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3750a2d2-7d38-4aec-934c-5c4171c22bfc tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Dec 25 21:07:40.319829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3750a2d2-7d38-4aec-934c-5c4171c22bfc tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:40.324521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3750a2d2-7d38-4aec-934c-5c4171c22bfc tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.029557 Dec 25 21:07:40.327725 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 114/235] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:40 2021] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:40.341365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-574a70fa-83ec-4f5c-87e3-e0efca71732c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:40.342385 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:40.342385 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:40.363621 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-574a70fa-83ec-4f5c-87e3-e0efca71732c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Dec 25 21:07:40.364224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-574a70fa-83ec-4f5c-87e3-e0efca71732c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:40.365379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-574a70fa-83ec-4f5c-87e3-e0efca71732c tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.028505 Dec 25 21:07:40.371774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 115/236] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:40 2021] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:40.376556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49a5efe7-0984-4d58-9b97-ba662c262f27 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1995101992"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:40.378105 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:40.378105 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:40.379326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-49a5efe7-0984-4d58-9b97-ba662c262f27 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid ebf1cb7b-1a92-4c44-9926-f157116467f4 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:40.573305 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49a5efe7-0984-4d58-9b97-ba662c262f27 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.200367 Dec 25 21:07:40.579665 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 116/237] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:40 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:40.586225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:40.591444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:40.605608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:40.606066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:40.606867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:40.607303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:40.688463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f681c8c-fdb1-4cbd-b1d6-01c946d9ea53 tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 299 microversion: 2.41 time: 0.463257 Dec 25 21:07:40.689875 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 122/238] 10.222.0.32 () {62 vars in 1234 bytes} [Sat Dec 25 21:07:40 2021] POST /compute/v2.1/os-aggregates/12/action => generated 299 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:40.699890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:40.700860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:40.731461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:40.731461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:40.734128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:40.734873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:41.188370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:41.199707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:41.201520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:41.202866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f087f7e0-1d0a-4d96-bcb1-2cf8a06a65e7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.621915 Dec 25 21:07:41.203732 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 117/239] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:40 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:41.209518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a84edeb-3ca0-4e57-bb52-ae9cb2bf26aa tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:41.210210 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.210210 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:41.218583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a84edeb-3ca0-4e57-bb52-ae9cb2bf26aa tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 228 microversion: 2.1 time: 0.013930 Dec 25 21:07:41.220633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 118/240] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:41 2021] GET /compute/v2.1/os-aggregates/14 => generated 228 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.231710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20bf40d8-6436-452f-80e5-b670ac20e31e tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:41.232679 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.232679 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:41.346307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20bf40d8-6436-452f-80e5-b670ac20e31e tempest-AggregatesAdminTestV241-53672951 tempest-AggregatesAdminTestV241-53672951-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.119367 Dec 25 21:07:41.347198 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 119/241] 10.222.0.32 () {60 vars in 1195 bytes} [Sat Dec 25 21:07:41 2021] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.377264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:41.386575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-515d2896-905f-445c-a858-e0572354c433 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.694794 Dec 25 21:07:41.387164 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 123/242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:40 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:41.399826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d49c0444-2cf5-49b8-9aee-55e8ae9551b2 req-77390c0c-43b1-484b-b322-9674beca0a47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cd2be37-78a6-4e40-813d-8e2478ea8dc2", "tag": "ddbefb64-c371-4875-871e-5d999ff82a14"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:41.404771 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.404771 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:41.415326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d49c0444-2cf5-49b8-9aee-55e8ae9551b2 req-77390c0c-43b1-484b-b322-9674beca0a47 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:41.415926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d49c0444-2cf5-49b8-9aee-55e8ae9551b2 req-77390c0c-43b1-484b-b322-9674beca0a47 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:41.436313 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d49c0444-2cf5-49b8-9aee-55e8ae9551b2 req-77390c0c-43b1-484b-b322-9674beca0a47 service nova] Creating event network-changed:ddbefb64-c371-4875-871e-5d999ff82a14 for instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 on nch2-master-1 Dec 25 21:07:41.449641 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d49c0444-2cf5-49b8-9aee-55e8ae9551b2 req-77390c0c-43b1-484b-b322-9674beca0a47 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052441 Dec 25 21:07:41.450259 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 124/243] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.456562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f452b0d2-e760-48e0-8b70-b970a520fdfb tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:41.457933 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.457933 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:41.598332 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f452b0d2-e760-48e0-8b70-b970a520fdfb tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 266 microversion: 2.1 time: 0.146803 Dec 25 21:07:41.600189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 125/244] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:41 2021] POST /compute/v2.1/os-aggregates/14/action => generated 266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.608711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:41.610098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:41.616694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:41.617305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:41.618259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:41.618975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:41.777660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:41.785593 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d19d79ab-5575-4c7f-b999-d20e4b437a65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.183982 Dec 25 21:07:41.787286 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 126/245] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:41 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:41.791565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ca2c519-3951-4a94-a8c7-7fb9972f0b88 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-4155873"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:41.792906 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.792906 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:41.794090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-2ca2c519-3951-4a94-a8c7-7fb9972f0b88 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid 209cee9b-5a1b-43a4-a7bf-e668bf54b38c for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:41.896840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-deafd760-870a-4eff-be4e-3faf3d5caf2c req-8d7255f1-6ea3-4561-a473-526b0d296faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b814523-70ff-4cb2-b14c-f77ae086c04f", "tag": "1bcf9756-ed56-4846-ad16-befd4fd2f0e0"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:41.898434 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.898434 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:41.906376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-deafd760-870a-4eff-be4e-3faf3d5caf2c req-8d7255f1-6ea3-4561-a473-526b0d296faa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:41.907056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-deafd760-870a-4eff-be4e-3faf3d5caf2c req-8d7255f1-6ea3-4561-a473-526b0d296faa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:41.913581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ca2c519-3951-4a94-a8c7-7fb9972f0b88 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.125759 Dec 25 21:07:41.914198 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 127/246] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:41 2021] POST /compute/v2.1/os-aggregates => generated 196 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.923080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-318dc414-9ac7-4b23-8452-821b1422e725 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:41.925879 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.925879 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:41.928847 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-deafd760-870a-4eff-be4e-3faf3d5caf2c req-8d7255f1-6ea3-4561-a473-526b0d296faa service nova] Creating event network-changed:1bcf9756-ed56-4846-ad16-befd4fd2f0e0 for instance 1b814523-70ff-4cb2-b14c-f77ae086c04f on nch2-master-1 Dec 25 21:07:41.935451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-deafd760-870a-4eff-be4e-3faf3d5caf2c req-8d7255f1-6ea3-4561-a473-526b0d296faa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.582375 Dec 25 21:07:41.939555 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 120/247] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.942105 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-318dc414-9ac7-4b23-8452-821b1422e725 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 242 microversion: 2.1 time: 0.026277 Dec 25 21:07:41.946895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-edd64b5b-e6fa-491d-911c-245882a17cbe tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:41.948719 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.948719 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:41.952392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 128/248] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:07:41 2021] GET /compute/v2.1/os-aggregates/14 => generated 242 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:41.962627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edd64b5b-e6fa-491d-911c-245882a17cbe tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:41.965409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e80392a3-8067-4fdb-8a40-a6dbba49c31a tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:41.966573 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:41.966573 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:41.977182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edd64b5b-e6fa-491d-911c-245882a17cbe tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.068034 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e80392a3-8067-4fdb-8a40-a6dbba49c31a tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.109175 Dec 25 21:07:42.068034 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 129/249] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:41 2021] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:42.075079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5927cc5f-47ed-4367-892d-98e1200a7420 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1225737319", "availability_zone": "tempest-test_az-1152557599"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:42.104516 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:42.104516 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:42.151135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-5927cc5f-47ed-4367-892d-98e1200a7420 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid 72ee1303-5631-4788-ad0e-4b55ec727989 for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:42.266921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5927cc5f-47ed-4367-892d-98e1200a7420 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.197123 Dec 25 21:07:42.268187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 130/250] 10.222.0.32 () {60 vars in 1164 bytes} [Sat Dec 25 21:07:42 2021] POST /compute/v2.1/os-aggregates => generated 223 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:42.277653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:42.278680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:42.285422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.285957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.286916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.287500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.347418 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-edd64b5b-e6fa-491d-911c-245882a17cbe tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 240 microversion: 2.1 time: 0.406585 Dec 25 21:07:42.348147 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 121/251] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:41 2021] POST /compute/v2.1/os-aggregates/15/action => generated 240 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:42.354499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4407b2cb-0561-485d-84dd-bd57caf50409 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1225737319_new", "availability_zone": "tempest-test_az-1152557599_new"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:42.356824 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:42.356824 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:42.471641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4407b2cb-0561-485d-84dd-bd57caf50409 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.472465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4407b2cb-0561-485d-84dd-bd57caf50409 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.543025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:42.563951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:42.565648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:42.566795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfaa1786-a2f2-4475-9190-b76d17218308 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.297353 Dec 25 21:07:42.574405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 131/252] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:42 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:42.579425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ccbe7a2-91aa-42ea-bcc3-78a4b3973a49 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:42.582721 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:42.582721 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:42.583714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ccbe7a2-91aa-42ea-bcc3-78a4b3973a49 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'cadb0831770246a49a9aac30067fa14f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45c9d7948afa49e5bc0261e1f17180f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:42.584366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ccbe7a2-91aa-42ea-bcc3-78a4b3973a49 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:42.590697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ccbe7a2-91aa-42ea-bcc3-78a4b3973a49 tempest-AggregatesAdminNegativeTestJSON-976043546 tempest-AggregatesAdminNegativeTestJSON-976043546-project] 10.222.0.32 "POST /compute/v2.1/os-aggregates/15/action" status: 403 len: 121 microversion: 2.1 time: 0.014970 Dec 25 21:07:42.599455 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 132/253] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:42 2021] POST /compute/v2.1/os-aggregates/15/action => generated 121 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:42.607946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:42.618554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:42.622821 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4407b2cb-0561-485d-84dd-bd57caf50409 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.273443 Dec 25 21:07:42.624029 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 122/254] 10.222.0.32 () {60 vars in 1172 bytes} [Sat Dec 25 21:07:42 2021] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:42.629054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a367e214-b0b1-4792-8ef2-650b7a597089 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:42.633252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.633702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.634025 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:42.634025 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:42.634511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.634946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.655756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a367e214-b0b1-4792-8ef2-650b7a597089 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.656567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a367e214-b0b1-4792-8ef2-650b7a597089 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.863262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:42.875645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-69657234-2a5e-4aa1-a37d-71ab26c81427 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.268815 Dec 25 21:07:42.875645 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 133/255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:42 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:42.889523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94324ba4-e893-4e01-a708-5fa3068838df tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:42.890342 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:42.890342 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:42.902386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94324ba4-e893-4e01-a708-5fa3068838df tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 567 microversion: 2.1 time: 0.025795 Dec 25 21:07:42.902960 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 134/256] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:07:42 2021] GET /compute/v2.1/os-aggregates => generated 567 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:42.907543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:42.908653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:42.917975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.926187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:42.926187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:42.926187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:43.022377 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a367e214-b0b1-4792-8ef2-650b7a597089 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 225 microversion: 2.1 time: 0.397115 Dec 25 21:07:43.028678 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 123/257] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:42 2021] POST /compute/v2.1/os-aggregates/15/action => generated 225 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:43.033431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9d44ac02-2c6d-4ca5-b117-0e4dab8c491c req-e4c39942-6fe3-495b-b92d-cff1e2d6832f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "name": "network-vif-plugged", "status": "completed", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:43.034878 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.034878 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:43.049553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9d44ac02-2c6d-4ca5-b117-0e4dab8c491c req-e4c39942-6fe3-495b-b92d-cff1e2d6832f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:43.050751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9d44ac02-2c6d-4ca5-b117-0e4dab8c491c req-e4c39942-6fe3-495b-b92d-cff1e2d6832f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:43.070105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9d44ac02-2c6d-4ca5-b117-0e4dab8c491c req-e4c39942-6fe3-495b-b92d-cff1e2d6832f service nova] Creating event network-vif-plugged:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:07:43.077271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9d44ac02-2c6d-4ca5-b117-0e4dab8c491c req-e4c39942-6fe3-495b-b92d-cff1e2d6832f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046984 Dec 25 21:07:43.078184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 124/258] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:43.083513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bacbf81d-8375-4396-bf90-dc87ee555cb4 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:43.085003 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.085003 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:43.204267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:43.216243 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bacbf81d-8375-4396-bf90-dc87ee555cb4 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.136367 Dec 25 21:07:43.218169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 125/259] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:43 2021] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:43.220703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e653b95-d88c-4616-98cb-a7c9eeb0cdc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.315986 Dec 25 21:07:43.222389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 135/260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:42 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:43.228421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dae46b9-4b71-4f85-b7ae-0d32eefc60c1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2123757083"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:43.228686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cef1a59f-4084-4e4a-85ea-ab27eb289af8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:43.229621 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.229621 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:43.236250 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.236250 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:43.239586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.aggregate [None req-7dae46b9-4b71-4f85-b7ae-0d32eefc60c1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Generated uuid 2f7a3601-53f7-4fe5-9597-5df442267aae for aggregate {{(pid=136548) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:43.487862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dae46b9-4b71-4f85-b7ae-0d32eefc60c1 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.263331 Dec 25 21:07:43.495235 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 136/261] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:43 2021] POST /compute/v2.1/os-aggregates => generated 199 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:43.502209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d2b018ca-a506-4514-84b6-827a2f207075 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:43.506241 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.506241 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:43.509896 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cef1a59f-4084-4e4a-85ea-ab27eb289af8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.287439 Dec 25 21:07:43.515934 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 126/262] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:43 2021] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:43.532358 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d2b018ca-a506-4514-84b6-827a2f207075 tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.031196 Dec 25 21:07:43.541624 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 137/263] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:07:43 2021] GET /compute/v2.1/os-aggregates => generated 231 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:43.547340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a59728cb-40ef-4a2e-b843-f31554d00b5f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:43.548957 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.548957 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:43.552191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c624c71-6da4-420d-99de-cf0dea310211 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-969298993"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:43.556367 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.556367 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:43.564467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-5c624c71-6da4-420d-99de-cf0dea310211 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Generated uuid a55c07b4-c1f8-4dfa-8078-47a9d1fac286 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:07:43.792371 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a59728cb-40ef-4a2e-b843-f31554d00b5f tempest-AggregatesAdminTestJSON-784802096 tempest-AggregatesAdminTestJSON-784802096-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.249259 Dec 25 21:07:43.792983 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 138/264] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:43 2021] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:43.797570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:43.798179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:43.804144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:43.804594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:43.805402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:43.805842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:43.845413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c624c71-6da4-420d-99de-cf0dea310211 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.302741 Dec 25 21:07:43.846378 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 127/265] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:07:43 2021] POST /compute/v2.1/os-aggregates => generated 198 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:43.852468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:43.853141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:43.861531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:43.862168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:43.863122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:43.863768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:43.895298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:07:43.970014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:43.979776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:43.981393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:43.982546 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e627ac4-020f-4eff-bf95-8a7cd60e9992 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.188550 Dec 25 21:07:43.983086 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 139/266] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:43 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:43.993492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:43.994904 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:43.994904 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:44.004006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.004490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.012265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.013332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.039692 ncdv-master-1 devstack@n-api.service[136548]: ERROR nova.api.openstack.compute.aggregates [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Dec 25 21:07:44.040328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Dec 25 21:07:44.041000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:44.041880 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7f346a2-b8a9-4780-a963-02f0da9efbc8 tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.057668 Dec 25 21:07:44.043129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 140/267] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:07:43 2021] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:07:44.047974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:44.048371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:44.054501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.054950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.055729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.056163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.204895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:44.212103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-856303c2-5101-4baf-b5e9-85f63feef464 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.168082 Dec 25 21:07:44.212664 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 141/268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:44 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:44.217441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd97d517-446a-431f-866a-b2227939a4be tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:44.218203 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:44.218203 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:44.298206 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab4d1839-be3a-45a3-baa1-572e555d387a tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 204 len: 0 microversion: 2.1 time: 0.450398 Dec 25 21:07:44.298696 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 128/269] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:07:43 2021] DELETE /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:07:44.304734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:44.305458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:44.311245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.311905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.312686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.313140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.392970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd97d517-446a-431f-866a-b2227939a4be tempest-AggregatesAdminNegativeTestJSON-2054232562 tempest-AggregatesAdminNegativeTestJSON-2054232562-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.179085 Dec 25 21:07:44.397811 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 142/270] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:07:44 2021] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:07:44.403760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:44.404446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:44.410409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.410922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.411731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:44.412157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:44.460813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:44.469173 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80b45f47-83e2-4ebc-b41e-6252029d1b4d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.168450 Dec 25 21:07:44.469754 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 129/271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:44 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:44.586575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:44.595689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ee6dd18-957d-4d24-a5d7-f27e139a8dd5 tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1473 microversion: 2.1 time: 0.195993 Dec 25 21:07:44.596268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 143/272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:44 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1473 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:45.000111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:45.000779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:45.045929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.045929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.045929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.045929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.180724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:45.187008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:45.188545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:45.189674 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0fd636af-680b-4c7e-9dd7-acde403a1f94 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.193907 Dec 25 21:07:45.190230 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 130/273] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:44 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:45.229196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:45.230768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:45.237573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.238020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.238789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.239218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.374255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:45.381498 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00e2ae3d-b59b-40f3-8957-09ffd52bcdd6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.155969 Dec 25 21:07:45.382054 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 144/274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:45 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:45.485466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:45.486075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:45.491993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.492442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.493275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.493708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.612894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:45.613454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:45.623866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.624235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.625071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:45.630148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:45.910564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:45.918215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ab15d28-7094-40a6-a042-c479ce9af54e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1316 microversion: 2.1 time: 0.436396 Dec 25 21:07:45.928833 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 131/275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:45 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1316 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:46.013997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:46.033080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-924ee0eb-8feb-4778-b921-da328a05ed3f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1473 microversion: 2.1 time: 0.421858 Dec 25 21:07:46.033697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 145/276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:45 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1473 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:46.208818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:46.210221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:46.219357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.220163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:46.221099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.221807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:46.373306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:46.387995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:46.389587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:46.390725 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-211a2457-88a4-45ac-b028-20facda1de4c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.187037 Dec 25 21:07:46.391286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 132/277] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:46 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:46.406334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:46.407084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:46.413238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.414782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:46.415060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.415720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:46.552032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:46.560143 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8747bba-41e1-467a-bc4a-6555716f253c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.165898 Dec 25 21:07:46.560722 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 146/278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:46 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:46.775615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d6384723-2dc2-41ac-92a7-746e85b1bc32 req-bb22c8a4-f115-4f10-847e-f4530bec40be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c20c1ee-2eb6-4064-b36f-e99d867be09e", "name": "network-vif-deleted", "tag": "4d3caa25-16de-49aa-aaa3-c1184d217368"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:46.780660 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:46.780660 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:46.800340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d6384723-2dc2-41ac-92a7-746e85b1bc32 req-bb22c8a4-f115-4f10-847e-f4530bec40be service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.800797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d6384723-2dc2-41ac-92a7-746e85b1bc32 req-bb22c8a4-f115-4f10-847e-f4530bec40be service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:46.818538 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d6384723-2dc2-41ac-92a7-746e85b1bc32 req-bb22c8a4-f115-4f10-847e-f4530bec40be service nova] Creating event network-vif-deleted:4d3caa25-16de-49aa-aaa3-c1184d217368 for instance 9c20c1ee-2eb6-4064-b36f-e99d867be09e on nch1-master-1 Dec 25 21:07:46.824622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d6384723-2dc2-41ac-92a7-746e85b1bc32 req-bb22c8a4-f115-4f10-847e-f4530bec40be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052608 Dec 25 21:07:46.825808 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 133/279] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:46.935076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:46.935685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:46.941584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.942030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:46.942809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:46.943243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.049777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.058682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:47.058682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.058682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.059053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.059216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.091179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:47.102309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55ebf92e-a672-4766-b09f-36e25578a865 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1465 microversion: 2.1 time: 0.171485 Dec 25 21:07:47.102967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 147/280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:46 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:47.121025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-562405316", "metadata": {"image_type": "test"}}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:47.125910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:47.141136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.144643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.144643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.144643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.144934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd98ab3d372a343daaeef8435bdba83c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cb1dfb58a1493b8193ad0024840486', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:47.153701 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-249851a1-89ac-4a8d-b83f-5e512f9057ff tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 200 len: 1302 microversion: 2.1 time: 0.107570 Dec 25 21:07:47.154799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 134/281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:47.190608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Getting quotas for project 1cbb59dcbd544ccfbcbb709c6fe1201a. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:47.198590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Getting quotas for user 90d14ca3dbcf46d799645c342fc39b0e and project 1cbb59dcbd544ccfbcbb709c6fe1201a. Resources: dict_keys(['metadata_items']) {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:47.496868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-791913f6-21ee-44c0-82af-0e06b1ef33f7 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.505445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-791913f6-21ee-44c0-82af-0e06b1ef33f7 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.341647 Dec 25 21:07:47.506001 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 135/282] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:47.510202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.517407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:47.517407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.517407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.518100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.518533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.709217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:47.717890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:47.720560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:47.722542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-674409ff-98bb-4d44-8894-8b2f3d6811ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.215629 Dec 25 21:07:47.723619 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 136/283] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:47.734412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ad70084-265f-424f-9f1a-c2644e067d0d tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.757172 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ad70084-265f-424f-9f1a-c2644e067d0d tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.032284 Dec 25 21:07:47.757759 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 137/284] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/flavors => generated 2594 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:47.763016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.763627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:47.771033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.785022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.786583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:47.787349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:47.842169 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6b05fefa-5c7a-4f7f-b3d1-b853c7b9c1cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "POST /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.725300 Dec 25 21:07:47.849206 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 148/285] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:07:47 2021] POST /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:07:47.853984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e51fbbc-2632-4a43-82fb-99732ed727e0 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.882745 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e51fbbc-2632-4a43-82fb-99732ed727e0 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.037675 Dec 25 21:07:47.883335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 149/286] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:47.888038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99fc6711-5684-4985-922e-ef1d4ff860ff tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc305dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.963444 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99fc6711-5684-4985-922e-ef1d4ff860ff tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.078920 Dec 25 21:07:47.971147 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 150/287] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:47.978791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f807f3bd-71b6-4bfa-a479-47d729fde978 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:47.987487 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f807f3bd-71b6-4bfa-a479-47d729fde978 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012413 Dec 25 21:07:47.988605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 151/288] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:48.000304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6bf95d40-4673-492e-a6b4-4d56561f3734 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.038391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6bf95d40-4673-492e-a6b4-4d56561f3734 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.043218 Dec 25 21:07:48.039386 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 152/289] 10.222.0.32 () {58 vars in 1164 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:48.050130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:48.054833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-116bf0dc-9438-4e5b-b287-55b56d9120db tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.057041 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ee805b9-3496-4012-9e22-f7c8e988439e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.298065 Dec 25 21:07:48.058990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 138/290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:47 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:48.079403 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-116bf0dc-9438-4e5b-b287-55b56d9120db tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029100 Dec 25 21:07:48.079976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 153/291] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:48.090862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63d43a27-5a2c-42e8-9c61-50321ca490c9 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.113908 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63d43a27-5a2c-42e8-9c61-50321ca490c9 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.027255 Dec 25 21:07:48.124773 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 154/292] 10.222.0.32 () {58 vars in 1168 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:48.128577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4614f85f-f2d0-42df-84b9-4a2e1a60824f tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.141784 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4614f85f-f2d0-42df-84b9-4a2e1a60824f tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.017694 Dec 25 21:07:48.145197 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 155/293] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:48.157857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-899d2418-1df4-49d1-9107-179d99af4e40 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.172735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-899d2418-1df4-49d1-9107-179d99af4e40 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019010 Dec 25 21:07:48.176171 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 156/294] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:48.185004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.190138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] [instance: 9c20c1ee-2eb6-4064-b36f-e99d867be09e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:48.196541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:48.197041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:48.197844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:48.199052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:48.213063 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] HTTP exception thrown: Instance 9c20c1ee-2eb6-4064-b36f-e99d867be09e could not be found. Dec 25 21:07:48.213662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] Returning 404 to user: Instance 9c20c1ee-2eb6-4064-b36f-e99d867be09e could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:48.215284 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-baf7050a-ef6a-4aac-b024-8a1bd7b4472f tempest-AggregatesAdminTestJSON-2136797577 tempest-AggregatesAdminTestJSON-2136797577-project] 10.222.0.32 "GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e" status: 404 len: 111 microversion: 2.1 time: 0.033587 Dec 25 21:07:48.215910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 157/295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/servers/9c20c1ee-2eb6-4064-b36f-e99d867be09e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:48.223929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5b67add-964b-4911-b52d-9bf954828b02 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.240436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2afefe6e-21f6-4d64-ab9b-be2a9be9d258 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Calling method '.version_select at 0x7fa4fc18cca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.265344 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5b67add-964b-4911-b52d-9bf954828b02 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.045228 Dec 25 21:07:48.267672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 158/296] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:48.291590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09aea8ab-7025-47a6-a2e7-4b8376863a88 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.301404 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09aea8ab-7025-47a6-a2e7-4b8376863a88 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013020 Dec 25 21:07:48.305933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 159/297] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:48.311810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e375e402-397f-4ce7-b9bc-9145be3205bf tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.328917 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e375e402-397f-4ce7-b9bc-9145be3205bf tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.020591 Dec 25 21:07:48.332351 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 160/298] 10.222.0.32 () {58 vars in 1143 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:48.343202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d9acdb8-4846-49b8-999b-282c5c3e21c5 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.351215 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d9acdb8-4846-49b8-999b-282c5c3e21c5 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012042 Dec 25 21:07:48.351917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 161/299] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:48.361308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30c4bfd0-44b4-4560-98dc-a07e9754fac0 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.377310 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30c4bfd0-44b4-4560-98dc-a07e9754fac0 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.019242 Dec 25 21:07:48.377858 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 162/300] 10.222.0.32 () {58 vars in 1147 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:48.389434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-edbfbb0d-616a-48ca-bf2a-3cd30487c8fb tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.400042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-edbfbb0d-616a-48ca-bf2a-3cd30487c8fb tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.014495 Dec 25 21:07:48.401564 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 163/301] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:48.411142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a032e2dc-7830-487a-a27f-718d527225d1 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.418789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a032e2dc-7830-487a-a27f-718d527225d1 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011080 Dec 25 21:07:48.419540 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 164/302] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:48.428802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d845c495-b2b6-4d64-8f99-b2ad66c587ce tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.447990 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d845c495-b2b6-4d64-8f99-b2ad66c587ce tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.022455 Dec 25 21:07:48.449388 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 165/303] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:48.461028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d32ee86-3a16-4b4f-8d4b-48aec9aaf568 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.479380 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d32ee86-3a16-4b4f-8d4b-48aec9aaf568 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022122 Dec 25 21:07:48.479930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 166/304] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:48.493128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e2ecece-d5b5-4bf7-a900-1b53e04fcb48 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.502046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e2ecece-d5b5-4bf7-a900-1b53e04fcb48 tempest-FlavorsV2TestJSON-1321165048 tempest-FlavorsV2TestJSON-1321165048-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012167 Dec 25 21:07:48.509020 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 167/305] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:48.742400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:48.743007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:48.749608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:48.750062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:48.750846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:48.751285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:48.895422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:48.903910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:48.905600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:48.906546 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58e349be-c841-4e4b-8922-bffe1bf58602 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.168431 Dec 25 21:07:48.907332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 168/306] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:07:48.911385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-301b7ba8-0dfb-4b4e-8093-a077fe9e04c0 req-f9f1d166-9deb-4091-ad46-5e64afc879c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b814523-70ff-4cb2-b14c-f77ae086c04f", "name": "network-vif-plugged", "status": "completed", "tag": "1bcf9756-ed56-4846-ad16-befd4fd2f0e0"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:48.912913 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:48.912913 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:48.920099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-301b7ba8-0dfb-4b4e-8093-a077fe9e04c0 req-f9f1d166-9deb-4091-ad46-5e64afc879c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:48.920915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-301b7ba8-0dfb-4b4e-8093-a077fe9e04c0 req-f9f1d166-9deb-4091-ad46-5e64afc879c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:48.932123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-301b7ba8-0dfb-4b4e-8093-a077fe9e04c0 req-f9f1d166-9deb-4091-ad46-5e64afc879c7 service nova] Creating event network-vif-plugged:1bcf9756-ed56-4846-ad16-befd4fd2f0e0 for instance 1b814523-70ff-4cb2-b14c-f77ae086c04f on nch2-master-1 Dec 25 21:07:48.937941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-301b7ba8-0dfb-4b4e-8093-a077fe9e04c0 req-f9f1d166-9deb-4091-ad46-5e64afc879c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029660 Dec 25 21:07:48.940188 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 169/307] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:48.979082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d07fd03-669b-468e-9faa-eebde25b56ad tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc17df70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:49.032712 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d07fd03-669b-468e-9faa-eebde25b56ad tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.057964 Dec 25 21:07:49.033316 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 170/308] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:49.081735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:49.082575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:49.090483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:49.090944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:49.091745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:49.092676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:49.260920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:49.269352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a432176-bbe1-4fe5-a131-94bac18cd860 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.197223 Dec 25 21:07:49.270058 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 171/309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:49 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:49.467322 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2afefe6e-21f6-4d64-ab9b-be2a9be9d258 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 371 microversion: 2.1 time: 1.396585 Dec 25 21:07:49.468227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 139/310] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:07:48 2021] GET /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 371 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:49.478197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67f9e514-3fc1-4c6a-bf54-7f0b8f71f5fd tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc0e2310>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:49.480731 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:49.480731 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:49.669796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67f9e514-3fc1-4c6a-bf54-7f0b8f71f5fd tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:49.670243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67f9e514-3fc1-4c6a-bf54-7f0b8f71f5fd tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:49.671407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67f9e514-3fc1-4c6a-bf54-7f0b8f71f5fd tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:49.672045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67f9e514-3fc1-4c6a-bf54-7f0b8f71f5fd tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:49.870223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67f9e514-3fc1-4c6a-bf54-7f0b8f71f5fd tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 328 microversion: 2.1 time: 0.395621 Dec 25 21:07:49.870863 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 172/311] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:07:49 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 328 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:49.926672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:49.935409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:49.938629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:49.939099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:49.941110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:49.941588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:50.117331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:50.125964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:50.127525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:50.128940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58eb598e-b6a6-44a3-9e86-94e124bceb7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.207741 Dec 25 21:07:50.129662 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 140/312] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:49 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:50.134127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce7fcd2a-46a2-4810-8455-f66528cb4721 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc24d310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:50.180588 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce7fcd2a-46a2-4810-8455-f66528cb4721 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.049704 Dec 25 21:07:50.181188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 141/313] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:50 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:50.195808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-733364016", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:50.244747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:50.287714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:50.288668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:50.313518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:50.314369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:50.316227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:50.317740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:50.532499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:50.533027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:50.533569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:50.534075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:50.534548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:50.543574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:50.543928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:50.544842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:50.545338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:50.551202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:50.560496 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e2bce52-c1aa-473c-b388-369ee39981d5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1317 microversion: 2.1 time: 0.276050 Dec 25 21:07:50.563432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Getting quotas for project 096b5278e40e405bac0dc56dbeb706df. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:50.567321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Getting quotas for user 0b5347862d6b49aaa8c48e883187d1db and project 096b5278e40e405bac0dc56dbeb706df. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:50.569645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 142/314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:50 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:50.579548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.utils [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] cores quota exceeded for 096b5278e40e405bac0dc56dbeb706df, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136548) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Dec 25 21:07:50.580343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Dec 25 21:07:50.580964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:50.591067 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d81f576c-c7f8-4207-8452-c700b28724c3 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.555757 Dec 25 21:07:50.591067 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 173/315] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:50 2021] POST /compute/v2.1/servers => generated 111 bytes in 558 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:07:50.598076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed4eac5a-e53b-4901-98bc-1db61f84e2a8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc0b7700>, body: {"quota_set": {"cores": 20}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:50.599828 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:50.599828 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:50.987301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8e484335-2a28-49ae-b0bf-5ccd2c047eba req-ae595bb8-7f60-48fd-8015-a307a06ba4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd2be37-78a6-4e40-813d-8e2478ea8dc2", "name": "network-vif-plugged", "status": "completed", "tag": "ddbefb64-c371-4875-871e-5d999ff82a14"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:50.988842 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:50.988842 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:50.996014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8e484335-2a28-49ae-b0bf-5ccd2c047eba req-ae595bb8-7f60-48fd-8015-a307a06ba4b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:50.996457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8e484335-2a28-49ae-b0bf-5ccd2c047eba req-ae595bb8-7f60-48fd-8015-a307a06ba4b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.007233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8e484335-2a28-49ae-b0bf-5ccd2c047eba req-ae595bb8-7f60-48fd-8015-a307a06ba4b5 service nova] Creating event network-vif-plugged:ddbefb64-c371-4875-871e-5d999ff82a14 for instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 on nch2-master-1 Dec 25 21:07:51.018855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8e484335-2a28-49ae-b0bf-5ccd2c047eba req-ae595bb8-7f60-48fd-8015-a307a06ba4b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035419 Dec 25 21:07:51.019608 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 174/316] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:51.146947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:51.148267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:51.156135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:51.156820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.158929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:51.158929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.322965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed4eac5a-e53b-4901-98bc-1db61f84e2a8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:51.324237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed4eac5a-e53b-4901-98bc-1db61f84e2a8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.329459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed4eac5a-e53b-4901-98bc-1db61f84e2a8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:51.329920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed4eac5a-e53b-4901-98bc-1db61f84e2a8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.350553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:51.364171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:51.367888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:51.371242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b296e145-2fb6-40fb-8e82-41a26c3f4d3e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.226645 Dec 25 21:07:51.371823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 175/317] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:51 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:07:51.381424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b848af6d-3bdc-4ff7-8d4f-889260bfb157 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc03af70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:51.458960 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b848af6d-3bdc-4ff7-8d4f-889260bfb157 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.086092 Dec 25 21:07:51.464669 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 176/318] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:51 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:51.579297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:51.580446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:51.587260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:51.587904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.588734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:51.589232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:51.672768 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed4eac5a-e53b-4901-98bc-1db61f84e2a8 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 329 microversion: 2.1 time: 1.076269 Dec 25 21:07:51.672768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 143/319] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:07:50 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 329 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:51.682068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9685552-df4e-475c-aeb1-2e9f6e41e1ae tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Calling method '.version_select at 0x7fa4fc1efe50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:51.742407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:51.755641 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8feb8696-ab82-43a7-8790-e8edf0ae3d6b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1467 microversion: 2.1 time: 0.182526 Dec 25 21:07:51.756412 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 177/320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:51 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1467 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:07:52.435035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:52.435684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:52.441925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:52.442375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:52.446974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:52.448048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:52.595425 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9685552-df4e-475c-aeb1-2e9f6e41e1ae tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 371 microversion: 2.1 time: 0.881842 Dec 25 21:07:52.595425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 144/321] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:07:51 2021] GET /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 371 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:52.595425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:52.595425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:52.595425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:52.596209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:52.596209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:52.596209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:52.885160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:52.895356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:52.897431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:52.898784 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2add5786-6f4f-4b10-9dde-43f0d41185b2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1362 microversion: 2.25 time: 0.337134 Dec 25 21:07:52.899902 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 145/322] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:52 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:52.915277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20c8475e-8d44-4616-bd37-2e06c7ffc514 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc0b70d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:52.983777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20c8475e-8d44-4616-bd37-2e06c7ffc514 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.082595 Dec 25 21:07:52.984577 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 146/323] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:52 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:52.989111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4af9fd5c-53b4-494e-b330-5b04c999ab6b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc24daf0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:52.990959 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:52.990959 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:53.179074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-edbf6c7f-636e-451f-9ccd-a10e1d6cba81 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1618 microversion: 2.1 time: 1.366799 Dec 25 21:07:53.182132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 178/324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:51 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1618 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:53.200497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48c01758-2550-4d6c-b28d-92c64b19a724 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: .version_select at 0x7fa4fc17dca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-752688103", "policies": ["affinity"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:53.229339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-48c01758-2550-4d6c-b28d-92c64b19a724 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:53.235971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-48c01758-2550-4d6c-b28d-92c64b19a724 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:53.468418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-48c01758-2550-4d6c-b28d-92c64b19a724 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:53.477976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-48c01758-2550-4d6c-b28d-92c64b19a724 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:53.512115 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48c01758-2550-4d6c-b28d-92c64b19a724 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.317842 Dec 25 21:07:53.517684 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 179/325] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:07:53 2021] POST /compute/v2.1/os-server-groups => generated 187 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:07:53.880717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af9fd5c-53b4-494e-b330-5b04c999ab6b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:53.881910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af9fd5c-53b4-494e-b330-5b04c999ab6b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:53.882751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af9fd5c-53b4-494e-b330-5b04c999ab6b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:53.883198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af9fd5c-53b4-494e-b330-5b04c999ab6b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:53.918078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:53.918619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:53.941912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:53.941912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:53.941912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:53.941912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:54.152384 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4af9fd5c-53b4-494e-b330-5b04c999ab6b tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 328 microversion: 2.1 time: 1.165387 Dec 25 21:07:54.166008 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 147/326] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:07:52 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 328 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:54.186182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3345ce79-872a-46b8-a3ae-1dd3c1564226 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc24d820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:54.240230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:54.250912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:54.256236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:54.260040 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd055cd9-3275-425e-93de-33e1563a7a96 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1557 microversion: 2.25 time: 0.348247 Dec 25 21:07:54.263550 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 180/327] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:53 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1557 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:54.274783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-615429934", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "2a16c084-4364-4366-b497-ad95436a844d"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:54.281376 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3345ce79-872a-46b8-a3ae-1dd3c1564226 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.114200 Dec 25 21:07:54.287806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 148/328] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:54 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:54.346842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:54.794091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:54.794791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:54.794970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:54.795408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:54.795996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:54.840020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:54.840020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:54.848202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:54.850543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:54.851352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:54.852020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:54.853699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:54.855311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:54.856524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:54.869886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:54.929927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:54.942891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:54.973001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Going to run 2 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:07:54.975970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:07:55.128231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:07:55.185475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=136548) _server_group_count_members_by_user /opt/stack/nova/nova/quota.py:1154}} Dec 25 21:07:55.247189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:55.272548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:55.302512 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a17a1bc-12ed-4c33-b84f-172300b84ecc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 2050 microversion: 2.25 time: 1.013339 Dec 25 21:07:55.317413 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 149/329] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:54 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 2050 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:55.324245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1671366916", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:55.394367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:07:55.442606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:55.458607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:55.495981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=9f68f874-59f2-4c67-90f1-50665110bd4e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:07:55.762883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:55.773582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:55.882659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:07:55.883071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:07:55.883540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:07:55.884187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:07:55.884739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:07:55.902252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:55.903223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:55.904213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:55.905497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:55.917606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:55.931481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:55.965893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Getting quotas for project 096b5278e40e405bac0dc56dbeb706df. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:07:55.974278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Getting quotas for user 0b5347862d6b49aaa8c48e883187d1db and project 096b5278e40e405bac0dc56dbeb706df. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:07:56.015479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.utils [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] instances quota exceeded for 096b5278e40e405bac0dc56dbeb706df, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136547) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Dec 25 21:07:56.016757 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Dec 25 21:07:56.017766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:07:56.018953 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f4b4d866-d66d-4528-a953-990ded653fcb tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.700262 Dec 25 21:07:56.020894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-820ef24f-3bf4-444e-874d-8a21a8d2d336 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.755818 Dec 25 21:07:56.027189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 181/330] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:54 2021] POST /compute/v2.1/servers => generated 32 bytes in 1762 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Dec 25 21:07:56.038286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 150/331] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:55 2021] POST /compute/v2.1/servers => generated 119 bytes in 720 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:07:56.045753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4725392b-3682-48b6-aa14-64946c716e6e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc0b7820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:56.075755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c94306c8-3c4c-45af-9754-1dce7b2337a1 req-a5745186-f10c-43c9-8c9a-89bf54060e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "name": "network-vif-plugged", "status": "completed", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:56.078305 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:56.078305 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:56.101821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c94306c8-3c4c-45af-9754-1dce7b2337a1 req-a5745186-f10c-43c9-8c9a-89bf54060e01 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.102244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c94306c8-3c4c-45af-9754-1dce7b2337a1 req-a5745186-f10c-43c9-8c9a-89bf54060e01 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:56.140705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4725392b-3682-48b6-aa14-64946c716e6e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.100914 Dec 25 21:07:56.141774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 151/332] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:56 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:56.159252 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c94306c8-3c4c-45af-9754-1dce7b2337a1 req-a5745186-f10c-43c9-8c9a-89bf54060e01 service nova] Creating event network-vif-plugged:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:07:56.160530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:56.161336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:56.168582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.169064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:56.169979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.170413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:56.173959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c94306c8-3c4c-45af-9754-1dce7b2337a1 req-a5745186-f10c-43c9-8c9a-89bf54060e01 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146111 Dec 25 21:07:56.174756 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 182/333] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:07:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:56.188708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43fd9313-644d-41d7-bc6a-01ea35adaccb tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc14a280>, body: {"quota_set": {"instances": 10}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:56.191712 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:56.191712 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:56.431755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:07:56.465781 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cbd49f2c-7fc9-4b04-b4cd-671c6c7e3c38 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 2050 microversion: 2.25 time: 0.319517 Dec 25 21:07:56.467622 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 152/334] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:07:56 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 2050 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:07:56.476785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:56.493856 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:56.493856 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:56.496685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:56.500503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Searching by: {'deleted': False, 'project_id': '19a16dcc3c214ac2a218d3758e551792'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:07:56.567187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.569294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:56.572728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.575791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:56.872462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:07:56.902459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43fd9313-644d-41d7-bc6a-01ea35adaccb tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.903934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43fd9313-644d-41d7-bc6a-01ea35adaccb tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:56.909724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43fd9313-644d-41d7-bc6a-01ea35adaccb tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:56.909724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43fd9313-644d-41d7-bc6a-01ea35adaccb tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:57.192950 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c0324c5-ef5b-40e8-9537-ed519dccbbe5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.724032 Dec 25 21:07:57.199100 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 153/335] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:07:56 2021] GET /compute/v2.1/servers => generated 1002 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:57.202258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58c6c016-a34e-4569-a3f8-473295069402 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:57.203559 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:57.203559 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:07:57.205213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c6c016-a34e-4569-a3f8-473295069402 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:57.205660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c6c016-a34e-4569-a3f8-473295069402 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:57.206618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c6c016-a34e-4569-a3f8-473295069402 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:57.207053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c6c016-a34e-4569-a3f8-473295069402 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:57.242005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58c6c016-a34e-4569-a3f8-473295069402 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.046297 Dec 25 21:07:57.248367 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 154/336] 10.222.0.32 () {60 vars in 1216 bytes} [Sat Dec 25 21:07:57 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:07:57.249104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-126c3673-48ea-4a35-b9a6-0c8b17492e37 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc0c13a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:57.274130 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43fd9313-644d-41d7-bc6a-01ea35adaccb tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 329 microversion: 2.1 time: 1.094765 Dec 25 21:07:57.285651 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 183/337] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:07:56 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 329 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:57.297900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a96eddb7-f667-41c6-b669-bb4db46b3185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:57.298693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a96eddb7-f667-41c6-b669-bb4db46b3185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:57.327255 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-126c3673-48ea-4a35-b9a6-0c8b17492e37 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.083047 Dec 25 21:07:57.328170 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 155/338] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:57 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:57.333881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:57.340483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:57.357518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:57.360022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:57.361820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:57.367198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:57.462191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a96eddb7-f667-41c6-b669-bb4db46b3185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:57.470203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a96eddb7-f667-41c6-b669-bb4db46b3185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1218 microversion: 2.1 time: 0.185092 Dec 25 21:07:57.473306 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 184/339] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:57 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1218 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:57.487924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ffa547f-1e4c-43a1-aa6d-fcc85abee49c tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Calling method '.version_select at 0x7fa4f77c4b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:57.866169 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ffa547f-1e4c-43a1-aa6d-fcc85abee49c tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 371 microversion: 2.1 time: 0.387169 Dec 25 21:07:57.867890 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 185/340] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:07:57 2021] GET /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 371 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:57.941829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'flavor' on Instance uuid 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:07:58.044073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e79e9b3c-32e7-4c7b-b378-5149cae52349 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1958745727", "id": 738286453, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:58.048833 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:58.048833 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:58.103228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Going to try to live migrate instance to nch1-master-1 {{(pid=136547) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:07:58.173493 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e79e9b3c-32e7-4c7b-b378-5149cae52349 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.304188 Dec 25 21:07:58.175410 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 186/341] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:57 2021] POST /compute/v2.1/flavors => generated 427 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:58.190420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5db38c09-e288-4700-a846-b5cb7c794641 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc03a0d0>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:58.200177 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:58.200177 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:58.617854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5db38c09-e288-4700-a846-b5cb7c794641 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:58.618467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5db38c09-e288-4700-a846-b5cb7c794641 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:58.685380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5db38c09-e288-4700-a846-b5cb7c794641 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:58.685380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5db38c09-e288-4700-a846-b5cb7c794641 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:59.053090 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5db38c09-e288-4700-a846-b5cb7c794641 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 325 microversion: 2.1 time: 0.875084 Dec 25 21:07:59.054039 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 187/342] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:07:58 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 325 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:59.062578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c5f6f06-c294-4920-acc0-6d6549bcd759 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:59.063588 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:07:59.063588 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:07:59.241795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c5f6f06-c294-4920-acc0-6d6549bcd759 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/738286453" status: 202 len: 0 microversion: 2.1 time: 0.185830 Dec 25 21:07:59.244494 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 188/343] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:07:59 2021] DELETE /compute/v2.1/flavors/738286453 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:07:59.537115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8cb4e85c-ee2b-4988-9067-5da4718782ad tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-175996108", "id": 359664317, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:07:59.690048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8cb4e85c-ee2b-4988-9067-5da4718782ad tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.442096 Dec 25 21:07:59.690878 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 189/344] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:59 2021] POST /compute/v2.1/flavors => generated 435 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:07:59.711343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7cb9808-aa1c-4c4a-bd79-f467e7563aec tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77693a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:59.796708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7cb9808-aa1c-4c4a-bd79-f467e7563aec tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.100930 Dec 25 21:07:59.800715 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 190/345] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:07:59 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:59.805641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:07:59.806842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:07:59.815728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:59.816529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:59.817769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:07:59.818442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:07:59.953812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:07:59.973771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-133b27ac-0ee2-41cc-a7c6-2fd7f8084abd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1222 microversion: 2.1 time: 0.172443 Dec 25 21:07:59.987599 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 191/346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:07:59 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1222 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:07:59.997080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1219945099", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:00.119187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:08:00.949764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:08:00.950336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:08:00.953053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:08:00.953501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:08:00.953929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:08:00.974175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:00.977699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:00.977699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:00.977699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:01.013688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Getting quotas for project 096b5278e40e405bac0dc56dbeb706df. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:01.036272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Getting quotas for user 0b5347862d6b49aaa8c48e883187d1db and project 096b5278e40e405bac0dc56dbeb706df. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:01.075018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.utils [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] ram quota exceeded for 096b5278e40e405bac0dc56dbeb706df, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=136548) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1171}} Dec 25 21:08:01.075604 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Dec 25 21:08:01.076252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:01.078706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-747ff743-3b37-4ccf-be73-c1e3c9da77c6 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.086893 Dec 25 21:08:01.082816 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 192/347] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:07:59 2021] POST /compute/v2.1/servers => generated 110 bytes in 1094 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:01.099646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a43aa8f4-e3eb-4bee-8fd7-65d68ff606f1 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:01.156273 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a43aa8f4-e3eb-4bee-8fd7-65d68ff606f1 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072233 Dec 25 21:08:01.161547 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 193/348] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:01 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:01.175511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79054b35-5fa3-4ead-b138-053530d1cafd tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:01.179631 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:01.179631 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:01.389803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79054b35-5fa3-4ead-b138-053530d1cafd tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/359664317/action" status: 200 len: 96 microversion: 2.1 time: 0.224708 Dec 25 21:08:01.390852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 194/349] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:08:01 2021] POST /compute/v2.1/flavors/359664317/action => generated 96 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:08:01.394999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84073301-915c-4053-a2ad-5d6e3c271322 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77ae9d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:01.553193 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84073301-915c-4053-a2ad-5d6e3c271322 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.161451 Dec 25 21:08:01.553976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 195/350] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:01 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:01.558585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:01.565259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:01.584645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:01.585491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:01.586506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:01.587148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:02.065945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:02.079048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-069b3a34-2be0-4aea-9e0e-f462408d7ad5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1278 microversion: 2.1 time: 0.523854 Dec 25 21:08:02.079980 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 196/351] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:01 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1278 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:02.096540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e179797c-cbf5-457e-a443-bf2970806c00 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f77053a0>, body: {"quota_set": {"ram": 51200}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:02.100116 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:02.100116 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:02.251526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e179797c-cbf5-457e-a443-bf2970806c00 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:02.251992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e179797c-cbf5-457e-a443-bf2970806c00 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:02.252842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e179797c-cbf5-457e-a443-bf2970806c00 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:02.253305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e179797c-cbf5-457e-a443-bf2970806c00 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:02.657284 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e179797c-cbf5-457e-a443-bf2970806c00 tempest-QuotasAdminNegativeTest-792041027 tempest-QuotasAdminNegativeTest-792041027-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 200 len: 329 microversion: 2.1 time: 0.571732 Dec 25 21:08:02.658774 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 197/352] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:08:02 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 329 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:02.674679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-643e67e5-d956-4e07-a06f-fb6b1a15b056 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1942294638", "id": 1652311446, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:02.678951 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:02.678951 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:02.798489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-643e67e5-d956-4e07-a06f-fb6b1a15b056 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.138302 Dec 25 21:08:02.799421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 198/353] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:02 2021] POST /compute/v2.1/flavors => generated 417 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:02.821672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-591f01fd-bfc2-4974-bebb-c2d01e07f2d8 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:02.825598 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:02.825598 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:03.007475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-591f01fd-bfc2-4974-bebb-c2d01e07f2d8 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] HTTP exception thrown: Flavor access already exists for flavor 21 and project e5666a184d9d4b14bb32e635a9b75bf4 combination. Dec 25 21:08:03.008186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-591f01fd-bfc2-4974-bebb-c2d01e07f2d8 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Returning 409 to user: Flavor access already exists for flavor 21 and project e5666a184d9d4b14bb32e635a9b75bf4 combination. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:03.009579 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-591f01fd-bfc2-4974-bebb-c2d01e07f2d8 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/359664317/action" status: 409 len: 152 microversion: 2.1 time: 0.208704 Dec 25 21:08:03.011033 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 199/354] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:08:02 2021] POST /compute/v2.1/flavors/359664317/action => generated 152 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:08:03.016191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-784448ed-26ea-43c2-ad2b-45ebbc76317a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f776ff70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:03.150548 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-784448ed-26ea-43c2-ad2b-45ebbc76317a tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.138416 Dec 25 21:08:03.151204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 200/355] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:03 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:03.168314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1206021-9502-4566-8f58-8dce835fbdc4 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Action: 'update', calling method: .version_select at 0x7fa4f7705b80>, body: {"quota_set": {"ram": 0}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:03.181290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f1206021-9502-4566-8f58-8dce835fbdc4 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '0b5347862d6b49aaa8c48e883187d1db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '096b5278e40e405bac0dc56dbeb706df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:03.181995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1206021-9502-4566-8f58-8dce835fbdc4 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:03.187099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1206021-9502-4566-8f58-8dce835fbdc4 tempest-QuotasAdminNegativeTest-1373857085 tempest-QuotasAdminNegativeTest-1373857085-project] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df" status: 403 len: 116 microversion: 2.1 time: 0.034068 Dec 25 21:08:03.192674 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 201/356] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:08:03 2021] PUT /compute/v2.1/os-quota-sets/096b5278e40e405bac0dc56dbeb706df => generated 116 bytes in 41 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:03.234514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c703233b-5e61-413d-82cb-ef57ffe43cde tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:03.283959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c703233b-5e61-413d-82cb-ef57ffe43cde tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.089663 Dec 25 21:08:03.284768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 202/357] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:03 2021] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:03.298510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ddb99959-49d1-4d39-92f2-f3d89f1059c0 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:03.300002 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:03.300002 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:03.587088 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ddb99959-49d1-4d39-92f2-f3d89f1059c0 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/359664317/action" status: 200 len: 21 microversion: 2.1 time: 0.299114 Dec 25 21:08:03.595808 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 203/358] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:08:03 2021] POST /compute/v2.1/flavors/359664317/action => generated 21 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:08:03.614997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:03.616594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:03.628103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:03.628638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:03.629566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:03.630085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:03.919246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:03.929240 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-319d30c1-01a5-41f5-b81f-d3e40dc8b5ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1276 microversion: 2.1 time: 0.332129 Dec 25 21:08:03.933895 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 204/359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:03 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1276 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:03.961399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce0c6b1d-27b8-426d-87b0-15a561f5464e tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:03.966026 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:03.966026 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:03.975822 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-896c24bb-e40e-4f55-bbd4-4f26d88663fc tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2/action" status: 202 len: 0 microversion: 2.25 time: 6.645898 Dec 25 21:08:03.977161 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 156/360] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:07:57 2021] POST /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2/action => generated 0 bytes in 6648 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:08:03.983594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0c0514d-7ed7-4b0f-a2b4-839cfaeb29e7 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:03.984801 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:03.984801 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:04.140640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0c0514d-7ed7-4b0f-a2b4-839cfaeb29e7 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/359664317" status: 202 len: 0 microversion: 2.1 time: 0.161793 Dec 25 21:08:04.141539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 157/361] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:03 2021] DELETE /compute/v2.1/flavors/359664317 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:04.146672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.149084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:04.151837 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce0c6b1d-27b8-426d-87b0-15a561f5464e tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1652311446" status: 202 len: 0 microversion: 2.1 time: 0.214319 Dec 25 21:08:04.151837 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 205/362] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:08:03 2021] DELETE /compute/v2.1/flavors/1652311446 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:04.162518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1cd8c286-c5a1-4ccf-b61d-60ca29872f06 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.171780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:04.173202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:04.179833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:04.180808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:04.286815 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1cd8c286-c5a1-4ccf-b61d-60ca29872f06 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.130512 Dec 25 21:08:04.288849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 206/363] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:04 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:04.304151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e7d8c59-013d-42e7-8fe6-f69259d1112f tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.379895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e7d8c59-013d-42e7-8fe6-f69259d1112f tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089788 Dec 25 21:08:04.381549 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 207/364] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:04 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:04.401212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4cabd6a2-e6ca-4b95-8975-104f400f9fc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc145550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.535211 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4cabd6a2-e6ca-4b95-8975-104f400f9fc8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.151899 Dec 25 21:08:04.535790 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 208/365] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:04 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:04.544641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35d07b2d-5484-4eb5-82d5-67d8630fe52b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1203539942", "id": 896715940, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:04.552783 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:04.552783 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:04.685372 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35d07b2d-5484-4eb5-82d5-67d8630fe52b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.148391 Dec 25 21:08:04.686757 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 209/366] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:04 2021] POST /compute/v2.1/flavors => generated 435 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:04.697479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bc505c93-84dd-4349-8567-37a02a87b1b5 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1711595443", "id": 335377120, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:04.804102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bc505c93-84dd-4349-8567-37a02a87b1b5 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.114487 Dec 25 21:08:04.806642 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 210/367] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:04 2021] POST /compute/v2.1/flavors => generated 426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:04.815985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c46fa6dd-8c85-4a08-aef9-4ec91cf2f420 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.818185 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:04.818185 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:04.825575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:04.839171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:04.852563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:04.855667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3262be3e-7666-4378-8113-16cfad5f4bbf tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 0.712967 Dec 25 21:08:04.856122 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c46fa6dd-8c85-4a08-aef9-4ec91cf2f420 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] HTTP exception thrown: Access list not available for public flavors. Dec 25 21:08:04.857531 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 158/368] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:04 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:04.857725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c46fa6dd-8c85-4a08-aef9-4ec91cf2f420 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:04.862712 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c46fa6dd-8c85-4a08-aef9-4ec91cf2f420 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/896715940/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.054910 Dec 25 21:08:04.869142 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 211/369] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:08:04 2021] GET /compute/v2.1/flavors/896715940/os-flavor-access => generated 91 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:08:04.883112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec305394-648f-46c0-a4a5-181707366aee tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.884298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6de95fc6-461e-4f69-840b-f722f63b7217 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:04.886440 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:04.886440 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:05.030344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec305394-648f-46c0-a4a5-181707366aee tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/335377120" status: 202 len: 0 microversion: 2.1 time: 0.168112 Dec 25 21:08:05.034725 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 159/370] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:04 2021] DELETE /compute/v2.1/flavors/335377120 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:05.040019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:05.040802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:05.064437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:05.064901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:05.065911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:05.066619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:05.072011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6de95fc6-461e-4f69-840b-f722f63b7217 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/896715940" status: 202 len: 0 microversion: 2.1 time: 0.201334 Dec 25 21:08:05.075364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 212/371] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:04 2021] DELETE /compute/v2.1/flavors/896715940 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:05.090140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b169122a-e632-438c-a40d-3cac3e47f2f0 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:05.148026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b169122a-e632-438c-a40d-3cac3e47f2f0 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061378 Dec 25 21:08:05.160118 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 213/372] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:05 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:05.168001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-711f6e13-8bee-406e-b778-6d29cd9e5f35 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:05.220492 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-711f6e13-8bee-406e-b778-6d29cd9e5f35 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049618 Dec 25 21:08:05.234930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 214/373] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:05 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:05.242411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0849cf2c-ff9a-4036-aa9c-7c4f143e7f39 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2067906866", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:05.738889 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0849cf2c-ff9a-4036-aa9c-7c4f143e7f39 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.502006 Dec 25 21:08:05.739518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 215/374] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:05 2021] POST /compute/v2.1/flavors => generated 507 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:05.753996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc3ab82e-bc58-4c3f-8073-904ee6f61afe tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1108191863", "id": 657849624, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:05.930102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc3ab82e-bc58-4c3f-8073-904ee6f61afe tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.188482 Dec 25 21:08:05.931379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 216/375] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:05 2021] POST /compute/v2.1/flavors => generated 436 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:05.960679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a68d1980-fa33-4feb-9ad0-401fc72d7408 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc145f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:06.051169 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a68d1980-fa33-4feb-9ad0-401fc72d7408 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.111308 Dec 25 21:08:06.055124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 217/376] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:05 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:06.075328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-464ca285-bccc-4f8a-9e88-de02c9526030 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:06.210326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:06.233325 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-464ca285-bccc-4f8a-9e88-de02c9526030 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/f68f528c-2cc9-4c5d-87a9-284c42bc8f01" status: 202 len: 0 microversion: 2.1 time: 0.173771 Dec 25 21:08:06.238672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 218/377] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:08:06 2021] DELETE /compute/v2.1/flavors/f68f528c-2cc9-4c5d-87a9-284c42bc8f01 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:06.243983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:06.249473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:06.249801 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67b2952a-eae5-4f91-88ed-b90fbc0d543d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 1.189213 Dec 25 21:08:06.252271 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 160/378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:05 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:06.271998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:06.273878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:06.279619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:06.280377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:06.676678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a49b730-3250-430a-9dad-f4d354d34f74 tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:06.680095 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:06.680095 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:06.683830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1a49b730-3250-430a-9dad-f4d354d34f74 tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '8bd1919231cd43d7a4b5bdf170586892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5666a184d9d4b14bb32e635a9b75bf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:06.685185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a49b730-3250-430a-9dad-f4d354d34f74 tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:06.686277 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a49b730-3250-430a-9dad-f4d354d34f74 tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] 10.222.0.32 "POST /compute/v2.1/flavors/657849624/action" status: 403 len: 130 microversion: 2.1 time: 0.431180 Dec 25 21:08:06.690503 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 161/379] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:08:06 2021] POST /compute/v2.1/flavors/657849624/action => generated 130 bytes in 437 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:06.702487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd0bb027-7f39-48ef-9ba6-397398af6a6b tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:06.734200 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd0bb027-7f39-48ef-9ba6-397398af6a6b tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040680 Dec 25 21:08:06.735357 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 162/380] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:06 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:06.740184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e096897-8536-48d9-9541-a0f3b9f0b0f1 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:06.743215 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:06.743215 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:06.935984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:06.945053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:06.946835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:06.948308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98a489f8-8992-4d69-9fb9-c4350dd2ae1f tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 0.707856 Dec 25 21:08:06.962220 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 219/381] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:06 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:06.973457 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e096897-8536-48d9-9541-a0f3b9f0b0f1 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/657849624" status: 202 len: 0 microversion: 2.1 time: 0.236637 Dec 25 21:08:06.978178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 163/382] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:06 2021] DELETE /compute/v2.1/flavors/657849624 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:06.980779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efbdd9ff-058a-49dd-a95f-b161d954ff82 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2043514340", "id": "4a5a7838-a5fe-4306-a8c4-1ffb5e7c91a5", "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:06.984482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f11a9853-32b7-4f7c-90d5-f0e63790f725 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:06.984928 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:06.984928 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:07.010200 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f11a9853-32b7-4f7c-90d5-f0e63790f725 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030599 Dec 25 21:08:07.011016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 164/383] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:06 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:07.030246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e268e258-f3b3-4b2c-8195-36dd76926424 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-65210362", "id": 1230838378, "os-flavor-access:is_public": "False"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:07.031784 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:07.031784 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:07.176054 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efbdd9ff-058a-49dd-a95f-b161d954ff82 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.212455 Dec 25 21:08:07.176749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 220/384] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:06 2021] POST /compute/v2.1/flavors => generated 507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:07.182308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e268e258-f3b3-4b2c-8195-36dd76926424 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.151906 Dec 25 21:08:07.184315 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 165/385] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:07 2021] POST /compute/v2.1/flavors => generated 437 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:07.185254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d0edd44-05dd-436b-b223-1d65cf6c5548 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77691f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:07.189239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d026fb23-e748-440f-8bbf-ddf59d553786 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:07.284105 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d0edd44-05dd-436b-b223-1d65cf6c5548 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.106288 Dec 25 21:08:07.297764 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 221/386] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:07 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:07.317399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bbf946fa-745b-466d-9706-54bd31da6cdd tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:07.318730 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:07.318730 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:07.384193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d026fb23-e748-440f-8bbf-ddf59d553786 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/4a5a7838-a5fe-4306-a8c4-1ffb5e7c91a5" status: 202 len: 0 microversion: 2.1 time: 0.198571 Dec 25 21:08:07.386913 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 166/387] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:08:07 2021] DELETE /compute/v2.1/flavors/4a5a7838-a5fe-4306-a8c4-1ffb5e7c91a5 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:07.396973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:07.398897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:07.433907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:07.438366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:07.443996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:07.445032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:08.046249 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bbf946fa-745b-466d-9706-54bd31da6cdd tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1230838378/action" status: 200 len: 97 microversion: 2.1 time: 0.744818 Dec 25 21:08:08.046926 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 222/388] 10.222.0.32 () {60 vars in 1199 bytes} [Sat Dec 25 21:08:07 2021] POST /compute/v2.1/flavors/1230838378/action => generated 97 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:08:08.061190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee4d6543-eab1-49a3-bd1a-5246ff3420e0 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:08.127791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee4d6543-eab1-49a3-bd1a-5246ff3420e0 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079562 Dec 25 21:08:08.129026 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 223/389] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:08 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:08.138118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f1c0b080-b6de-4c30-81bc-817649ea8802 req-2fc5c2d6-698f-4e68-aea3-03e309bdf294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f68f874-59f2-4c67-90f1-50665110bd4e", "tag": "bf94d897-4956-441a-9897-be577975a8f7"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:08.140608 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:08.140608 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:08.173083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f1c0b080-b6de-4c30-81bc-817649ea8802 req-2fc5c2d6-698f-4e68-aea3-03e309bdf294 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:08.173935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f1c0b080-b6de-4c30-81bc-817649ea8802 req-2fc5c2d6-698f-4e68-aea3-03e309bdf294 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:08.194352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f1c0b080-b6de-4c30-81bc-817649ea8802 req-2fc5c2d6-698f-4e68-aea3-03e309bdf294 service nova] Creating event network-changed:bf94d897-4956-441a-9897-be577975a8f7 for instance 9f68f874-59f2-4c67-90f1-50665110bd4e on nch1-master-1 Dec 25 21:08:08.202606 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f1c0b080-b6de-4c30-81bc-817649ea8802 req-2fc5c2d6-698f-4e68-aea3-03e309bdf294 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072077 Dec 25 21:08:08.204388 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 224/390] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:08.228684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:08.230226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:08.242111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:08.242865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:08.244104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:08.262784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:08.538945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:08.545889 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-922f0e0d-503e-4038-8088-42ff37895d5a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 1.157657 Dec 25 21:08:08.549833 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 167/391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:07 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:08.574445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfe2692e-e5c5-454d-90f0-67fb7c095cfb tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:08.576154 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:08.576154 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:08.582120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dfe2692e-e5c5-454d-90f0-67fb7c095cfb tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '8bd1919231cd43d7a4b5bdf170586892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5666a184d9d4b14bb32e635a9b75bf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:08.583171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfe2692e-e5c5-454d-90f0-67fb7c095cfb tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:08.584284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dfe2692e-e5c5-454d-90f0-67fb7c095cfb tempest-FlavorsAccessNegativeTestJSON-1257320725 tempest-FlavorsAccessNegativeTestJSON-1257320725-project] 10.222.0.32 "POST /compute/v2.1/flavors/1230838378/action" status: 403 len: 133 microversion: 2.1 time: 0.031871 Dec 25 21:08:08.586359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 168/392] 10.222.0.32 () {60 vars in 1199 bytes} [Sat Dec 25 21:08:08 2021] POST /compute/v2.1/flavors/1230838378/action => generated 133 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:08.595049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-097dfee3-45bf-4a4c-b0aa-fd91f4f64f64 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1519514428", "id": 2052915756, "os-flavor-access:is_public": "True"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:08.601636 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:08.601636 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:08.718353 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-097dfee3-45bf-4a4c-b0aa-fd91f4f64f64 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.130047 Dec 25 21:08:08.724236 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 169/393] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:08 2021] POST /compute/v2.1/flavors => generated 414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:08.724236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e2c6042-505f-4567-a2c1-6b8869646906 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75cf9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:08.834037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e2c6042-505f-4567-a2c1-6b8869646906 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.113149 Dec 25 21:08:08.844690 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 170/394] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:08 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:08.855899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ae2184d-c79a-4bac-bcf4-f4f9d2d91f38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "e5666a184d9d4b14bb32e635a9b75bf4"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:09.186549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:09.203791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:09.206098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:09.207538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1d83490-2f04-4b3f-ac5b-53a795581e63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 0.990503 Dec 25 21:08:09.211552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 225/395] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:08 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:09.228614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-48eae635-cb82-4dd9-ba1a-307b304438b7 req-8e74346e-4326-46df-b39e-88dadcb2eee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e47b7882-0d9a-4469-b7aa-9ea14292ab12", "tag": "bfee550f-dfee-43e5-88c3-be85d5ccff12"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:09.231758 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:09.231758 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:09.245923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-48eae635-cb82-4dd9-ba1a-307b304438b7 req-8e74346e-4326-46df-b39e-88dadcb2eee7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:09.249523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-48eae635-cb82-4dd9-ba1a-307b304438b7 req-8e74346e-4326-46df-b39e-88dadcb2eee7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:09.271301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-48eae635-cb82-4dd9-ba1a-307b304438b7 req-8e74346e-4326-46df-b39e-88dadcb2eee7 service nova] Creating event network-changed:bfee550f-dfee-43e5-88c3-be85d5ccff12 for instance e47b7882-0d9a-4469-b7aa-9ea14292ab12 on nch1-master-1 Dec 25 21:08:09.286327 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-48eae635-cb82-4dd9-ba1a-307b304438b7 req-8e74346e-4326-46df-b39e-88dadcb2eee7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073318 Dec 25 21:08:09.286934 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 226/396] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:09.296408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-462a35c9-5103-4a9f-b0b8-189feb6622ba tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:09.306683 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-462a35c9-5103-4a9f-b0b8-189feb6622ba tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/2052915756" status: 200 len: 414 microversion: 2.1 time: 0.017801 Dec 25 21:08:09.307575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 227/397] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:09 2021] GET /compute/v2.1/flavors/2052915756 => generated 414 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:09.347647 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ae2184d-c79a-4bac-bcf4-f4f9d2d91f38 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/1230838378/action" status: 200 len: 21 microversion: 2.1 time: 0.501541 Dec 25 21:08:09.361375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 171/398] 10.222.0.32 () {60 vars in 1199 bytes} [Sat Dec 25 21:08:08 2021] POST /compute/v2.1/flavors/1230838378/action => generated 21 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:08:09.379232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b51ffcf3-b487-4bd5-8b27-f279e5611761 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:09.381753 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:09.381753 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:09.612720 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b51ffcf3-b487-4bd5-8b27-f279e5611761 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1230838378" status: 202 len: 0 microversion: 2.1 time: 0.245137 Dec 25 21:08:09.613398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 172/399] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:08:09 2021] DELETE /compute/v2.1/flavors/1230838378 => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:09.622622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:09.623246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:09.647017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:09.648015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:09.649693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:09.650492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:09.663821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-589fc7ba-de68-417d-a928-6a5090428fce tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:09.702133 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-589fc7ba-de68-417d-a928-6a5090428fce tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.386750 Dec 25 21:08:09.707604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 228/400] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:09 2021] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:09.712256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5369da3c-7278-4fce-ab35-91d48ff78506 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:09.744261 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5369da3c-7278-4fce-ab35-91d48ff78506 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.035350 Dec 25 21:08:09.763295 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 229/401] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:09 2021] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:09.763295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3cfdb805-75ab-4c32-b4e6-00154266aaeb tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:09.763295 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:09.763295 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:09.929318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3cfdb805-75ab-4c32-b4e6-00154266aaeb tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2052915756" status: 202 len: 0 microversion: 2.1 time: 0.174054 Dec 25 21:08:09.930611 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 230/402] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:08:09 2021] DELETE /compute/v2.1/flavors/2052915756 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:09.935836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca35d780-383b-48e6-b2a0-de45f095e3b7 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-627477682", "id": 503807143, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:09.937603 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:09.937603 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:10.114953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca35d780-383b-48e6-b2a0-de45f095e3b7 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.181396 Dec 25 21:08:10.115731 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 231/403] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:09 2021] POST /compute/v2.1/flavors => generated 435 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:10.126806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-17d06a9e-5a51-4726-854c-6d23b5a8723e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc106280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:10.222020 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-17d06a9e-5a51-4726-854c-6d23b5a8723e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.103544 Dec 25 21:08:10.226461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 232/404] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:10 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:10.233364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a017196-cab6-4c49-bc74-93e673af7dcf tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:10.267894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6a017196-cab6-4c49-bc74-93e673af7dcf tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039917 Dec 25 21:08:10.272081 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 233/405] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:10 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:10.277579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-869dff06-2827-4cee-9c2c-58d7a4a23934 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0b2cf24cb701492c91a759d2a54b35b3"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:10.284306 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:10.284306 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:10.514928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:10.532734 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-852c283d-4cb3-4cc9-b0ba-f81ab10345c3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 0.913563 Dec 25 21:08:10.533604 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 173/406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:09 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:10.541779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:10.543994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:10.567540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:10.582303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:10.595843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:10.598982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:10.983780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-869dff06-2827-4cee-9c2c-58d7a4a23934 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] HTTP exception thrown: Flavor access not found for 30 / 0b2cf24cb701492c91a759d2a54b35b3 combination. Dec 25 21:08:10.988790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-869dff06-2827-4cee-9c2c-58d7a4a23934 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Returning 404 to user: Flavor access not found for 30 / 0b2cf24cb701492c91a759d2a54b35b3 combination. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:10.988790 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-869dff06-2827-4cee-9c2c-58d7a4a23934 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors/503807143/action" status: 404 len: 124 microversion: 2.1 time: 0.712045 Dec 25 21:08:10.998864 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 234/407] 10.222.0.32 () {60 vars in 1196 bytes} [Sat Dec 25 21:08:10 2021] POST /compute/v2.1/flavors/503807143/action => generated 124 bytes in 726 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:11.013969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3bfd37e1-8d5d-4e82-892a-f833cad2027a tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-666265597", "id": 301763930, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:11.110203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3bfd37e1-8d5d-4e82-892a-f833cad2027a tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.110162 Dec 25 21:08:11.110794 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 235/408] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:10 2021] POST /compute/v2.1/flavors => generated 426 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:11.124026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4f9fa75-558e-487d-9533-a2a1d70e2bd3 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:11.280891 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4f9fa75-558e-487d-9533-a2a1d70e2bd3 tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/503807143" status: 202 len: 0 microversion: 2.1 time: 0.168846 Dec 25 21:08:11.282505 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 236/409] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:11 2021] DELETE /compute/v2.1/flavors/503807143 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:11.288274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28a28e3b-8ca3-40c4-9f26-4284e616b21d tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "301763930"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:11.304745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:11.309961 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-28a28e3b-8ca3-40c4-9f26-4284e616b21d tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] HTTP exception thrown: Flavor 301763930 could not be found. Dec 25 21:08:11.310922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28a28e3b-8ca3-40c4-9f26-4284e616b21d tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] Returning 400 to user: Flavor 301763930 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:11.311948 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28a28e3b-8ca3-40c4-9f26-4284e616b21d tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.028278 Dec 25 21:08:11.313872 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 237/410] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:11 2021] POST /compute/v2.1/servers => generated 80 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:08:11.324187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:11.325920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f59e74d-de07-47af-9205-801e881554c7 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77694c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:11.328079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:11.338182 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7179e2f3-7ef3-451c-a5dd-8292b8f363f0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 0.801206 Dec 25 21:08:11.348679 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 174/411] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:10 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:11.350574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-efbd5a18-1327-4a46-8b74-533cf8af051b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:11.398192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-efbd5a18-1327-4a46-8b74-533cf8af051b tempest-FlavorsAccessNegativeTestJSON-1775573299 tempest-FlavorsAccessNegativeTestJSON-1775573299-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.056857 Dec 25 21:08:11.399045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 175/412] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:11 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:11.404329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-76dc9cb1-c64a-4ef3-be93-f4c8450211f2 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:11.405426 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:11.405426 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:11.445861 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f59e74d-de07-47af-9205-801e881554c7 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.130570 Dec 25 21:08:11.451854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 238/413] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:11 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:11.465335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-19760cfa-9354-412a-b899-8a11c5fdce02 req-c7b126ec-2be0-44ba-ba55-49f1a73334f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd2be37-78a6-4e40-813d-8e2478ea8dc2", "name": "network-vif-unplugged", "status": "completed", "tag": "ddbefb64-c371-4875-871e-5d999ff82a14"}, {"name": "network-changed", "server_uuid": "7cd2be37-78a6-4e40-813d-8e2478ea8dc2", "tag": "ddbefb64-c371-4875-871e-5d999ff82a14"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:11.467154 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:11.467154 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:11.492233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-19760cfa-9354-412a-b899-8a11c5fdce02 req-c7b126ec-2be0-44ba-ba55-49f1a73334f5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:11.494371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-19760cfa-9354-412a-b899-8a11c5fdce02 req-c7b126ec-2be0-44ba-ba55-49f1a73334f5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:11.519833 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-76dc9cb1-c64a-4ef3-be93-f4c8450211f2 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/301763930" status: 202 len: 0 microversion: 2.1 time: 0.119526 Dec 25 21:08:11.523274 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 176/414] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:11 2021] DELETE /compute/v2.1/flavors/301763930 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:11.528448 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-19760cfa-9354-412a-b899-8a11c5fdce02 req-c7b126ec-2be0-44ba-ba55-49f1a73334f5 service nova] Creating event network-vif-unplugged:ddbefb64-c371-4875-871e-5d999ff82a14 for instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 on nch2-master-1 Dec 25 21:08:11.528448 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-19760cfa-9354-412a-b899-8a11c5fdce02 req-c7b126ec-2be0-44ba-ba55-49f1a73334f5 service nova] Creating event network-changed:ddbefb64-c371-4875-871e-5d999ff82a14 for instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 on nch2-master-1 Dec 25 21:08:11.532062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1da96d5-0104-4882-b550-9d5fa77aae45 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:11.539962 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-19760cfa-9354-412a-b899-8a11c5fdce02 req-c7b126ec-2be0-44ba-ba55-49f1a73334f5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.085111 Dec 25 21:08:11.545036 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 239/415] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:11 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:11.563724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:11.567938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:11.597708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:11.607730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:11.609658 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1da96d5-0104-4882-b550-9d5fa77aae45 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.081754 Dec 25 21:08:11.611130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:11.611600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:11.616971 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 177/416] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:11 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:11.635519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-293cde60-4562-4a4f-b991-71425a48f8b9 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-894694", "id": 1854887174, "os-flavor-access:is_public": "False"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:11.639601 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:11.639601 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:11.751335 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-293cde60-4562-4a4f-b991-71425a48f8b9 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.120828 Dec 25 21:08:11.752654 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 178/417] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:11 2021] POST /compute/v2.1/flavors => generated 411 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:08:12.290425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-57a75dfa-efc6-46f8-8067-f46381d7761a tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Action: 'create', calling method: .version_select at 0x7fa4f75aedc0>, body: {"pool": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:13.240166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:13.249538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c20fc0cd-d490-4bbe-8335-429bbf75a14f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 1.701865 Dec 25 21:08:13.259949 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 240/418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:11 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:13.259949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8776869-dad4-47e4-9fe3-0a9d5b2c83ed tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1052170013", "id": 2143404720, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:13.260303 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:13.260303 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:13.381026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8776869-dad4-47e4-9fe3-0a9d5b2c83ed tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.128299 Dec 25 21:08:13.384361 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 241/419] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:13 2021] POST /compute/v2.1/flavors => generated 414 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:13.393837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:13.402120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:13.427992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:13.432304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:13.433815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:13.435496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:14.756547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:14.773088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:14.773870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:14.780561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1991a6f4-2597-46d7-a802-989bee3b18ea tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 1.392343 Dec 25 21:08:14.782411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 242/420] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:13 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:14.797479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dced933b-8d44-4e41-87f8-37307dcef063 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77273a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:14.895505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dced933b-8d44-4e41-87f8-37307dcef063 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.106450 Dec 25 21:08:14.897102 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 243/421] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:14 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:14.908329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b592d2a0-132c-4127-842d-26d917a11afc tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:14.952010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b592d2a0-132c-4127-842d-26d917a11afc tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.053118 Dec 25 21:08:14.955397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 244/422] 10.222.0.32 () {58 vars in 1168 bytes} [Sat Dec 25 21:08:14 2021] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:14.962859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:14.964311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:14.972277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:14.972949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:14.974638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:14.975238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:15.937393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:15.945653 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2faee703-655c-4d84-bb05-a336af46ef1d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 0.988959 Dec 25 21:08:15.946231 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 245/423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:14 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:15.957166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-869c30da-920d-418a-89f3-1b801d087117 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:15.968463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-869c30da-920d-418a-89f3-1b801d087117 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.020862 Dec 25 21:08:15.969881 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 246/424] 10.222.0.32 () {58 vars in 1176 bytes} [Sat Dec 25 21:08:15 2021] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.199523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4414617-e050-44f0-96fe-d29da87f4c2b tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.201412 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:16.201412 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:16.203435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4414617-e050-44f0-96fe-d29da87f4c2b tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.204143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4414617-e050-44f0-96fe-d29da87f4c2b tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.205439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4414617-e050-44f0-96fe-d29da87f4c2b tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.208139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4414617-e050-44f0-96fe-d29da87f4c2b tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.302285 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4414617-e050-44f0-96fe-d29da87f4c2b tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.310808 Dec 25 21:08:16.302285 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 247/425] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:08:15 2021] GET /compute/v2.1/os-services => generated 947 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.302285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.302285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:16.324035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.324850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.326038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.329184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.592810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:16.601501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:16.603127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:16.604549 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f2d4395-381c-41b8-920a-d2a7dc417979 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 0.320422 Dec 25 21:08:16.605235 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 248/426] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:16.609721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecc160d6-475c-4a68-af2e-9b2d376a1e9b tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77aed30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.654196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecc160d6-475c-4a68-af2e-9b2d376a1e9b tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1423 microversion: 2.1 time: 0.047869 Dec 25 21:08:16.654930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 249/427] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1423 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:16.659327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24fd95b0-1a5c-49a5-a649-e88abc45a86c tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.669494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24fd95b0-1a5c-49a5-a649-e88abc45a86c tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.013546 Dec 25 21:08:16.670405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 250/428] 10.222.0.32 () {58 vars in 1170 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.674868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d7f1f17-bb7c-4357-ad52-a964bbcc0afd tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.676187 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:16.676187 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:16.677798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f17-bb7c-4357-ad52-a964bbcc0afd tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.678213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f17-bb7c-4357-ad52-a964bbcc0afd tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.679019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f17-bb7c-4357-ad52-a964bbcc0afd tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.679448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7f1f17-bb7c-4357-ad52-a964bbcc0afd tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.703220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d7f1f17-bb7c-4357-ad52-a964bbcc0afd tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.031736 Dec 25 21:08:16.703871 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 251/429] 10.222.0.32 () {58 vars in 1173 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.708361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb90e466-3df1-4c95-97aa-20a2897f09e4 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.717081 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb90e466-3df1-4c95-97aa-20a2897f09e4 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.012124 Dec 25 21:08:16.717621 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 252/430] 10.222.0.32 () {58 vars in 1168 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.722375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25b753df-3067-4552-b198-eccf7893e194 tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.724006 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:16.724006 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:16.725544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25b753df-3067-4552-b198-eccf7893e194 tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.725990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25b753df-3067-4552-b198-eccf7893e194 tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.726875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25b753df-3067-4552-b198-eccf7893e194 tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.727303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25b753df-3067-4552-b198-eccf7893e194 tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.750348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25b753df-3067-4552-b198-eccf7893e194 tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.031646 Dec 25 21:08:16.759443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 253/431] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.759443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad97b398-83c6-4d78-9de3-88cb179c0ce5 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.780971 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad97b398-83c6-4d78-9de3-88cb179c0ce5 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.028198 Dec 25 21:08:16.791747 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 254/432] 10.222.0.32 () {58 vars in 1168 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:16.796449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73720ed5-c240-46cd-a314-db76804d3d7c tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.797764 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:16.797764 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:16.799312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73720ed5-c240-46cd-a314-db76804d3d7c tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.799767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73720ed5-c240-46cd-a314-db76804d3d7c tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.800594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73720ed5-c240-46cd-a314-db76804d3d7c tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:16.801069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73720ed5-c240-46cd-a314-db76804d3d7c tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:16.831840 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-73720ed5-c240-46cd-a314-db76804d3d7c tempest-ServicesAdminTestJSON-204582866 tempest-ServicesAdminTestJSON-204582866-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.038907 Dec 25 21:08:16.832364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 255/433] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/os-services => generated 947 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:16.841656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e48cc45d-9c03-43e0-a5c0-bf75761de29d tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.880472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e48cc45d-9c03-43e0-a5c0-bf75761de29d tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.046991 Dec 25 21:08:16.893039 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 256/434] 10.222.0.32 () {58 vars in 1174 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:16.909397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e1ae345-62b5-4536-95f3-5b18f669658a tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.971239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e1ae345-62b5-4536-95f3-5b18f669658a tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.066431 Dec 25 21:08:16.982631 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 257/435] 10.222.0.32 () {58 vars in 1172 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:16.989772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:16.992428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:17.010605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:17.011063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:17.011882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:17.012319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:17.684825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:17.693486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a63725c9-0192-4e0b-bccf-b20d79a5c712 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 0.713310 Dec 25 21:08:17.696592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 258/436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:16 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:17.712783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-173c3e98-7c00-4140-a335-84a550985733 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:17.764278 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-173c3e98-7c00-4140-a335-84a550985733 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.066361 Dec 25 21:08:17.767426 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 259/437] 10.222.0.32 () {58 vars in 1168 bytes} [Sat Dec 25 21:08:17 2021] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:17.774627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:17.777502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:17.790156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:17.798642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:17.798642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:17.798642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:18.646461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-57a75dfa-efc6-46f8-8067-f46381d7761a tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.891750 Dec 25 21:08:18.653142 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 179/438] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:08:11 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6894 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:18.653142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc6486b0-f24f-4eb4-866f-4d005ee33a8c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75d6310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:18.716969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc6486b0-f24f-4eb4-866f-4d005ee33a8c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1432 microversion: 2.1 time: 0.068358 Dec 25 21:08:18.724844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 180/439] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:18 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1432 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:18.730455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26a3c5a1-b356-4198-b6e1-5cf57d159633 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:18.824327 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26a3c5a1-b356-4198-b6e1-5cf57d159633 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/2143404720" status: 202 len: 0 microversion: 2.1 time: 0.098156 Dec 25 21:08:18.825932 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 181/440] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:08:18 2021] DELETE /compute/v2.1/flavors/2143404720 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:18.832846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-dd3052bc-6ec0-421b-84b7-3c27f6487453 req-92f1af28-2bc3-4d0f-8e49-9fde736d2135 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f68f874-59f2-4c67-90f1-50665110bd4e", "name": "network-vif-plugged", "status": "completed", "tag": "bf94d897-4956-441a-9897-be577975a8f7"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:18.834825 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:18.834825 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:18.846562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dd3052bc-6ec0-421b-84b7-3c27f6487453 req-92f1af28-2bc3-4d0f-8e49-9fde736d2135 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:18.847524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dd3052bc-6ec0-421b-84b7-3c27f6487453 req-92f1af28-2bc3-4d0f-8e49-9fde736d2135 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:18.863732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-dd3052bc-6ec0-421b-84b7-3c27f6487453 req-92f1af28-2bc3-4d0f-8e49-9fde736d2135 service nova] Creating event network-vif-plugged:bf94d897-4956-441a-9897-be577975a8f7 for instance 9f68f874-59f2-4c67-90f1-50665110bd4e on nch1-master-1 Dec 25 21:08:18.871345 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-dd3052bc-6ec0-421b-84b7-3c27f6487453 req-92f1af28-2bc3-4d0f-8e49-9fde736d2135 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043280 Dec 25 21:08:18.875885 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 182/441] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:18.883247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f6fda3c-5a8f-4d33-8bad-b2ca837de1a6 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Calling method '.version_select at 0x7fa4f758cd30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:18.913580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:18.924445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:18.925909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:18.934484 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a4af7025-9476-4bb2-b09c-ed3d6f3c15ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 1.165743 Dec 25 21:08:18.935571 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 260/442] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:17 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:18.941402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:18.942226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:18.949179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:18.953674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:18.954584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:18.955022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:19.544586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:19.545035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f6fda3c-5a8f-4d33-8bad-b2ca837de1a6 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/12a9e585-764e-4ab3-8e33-ca9f72a5eb6d" status: 200 len: 141 microversion: 2.1 time: 0.667115 Dec 25 21:08:19.548370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 183/443] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:08:18 2021] GET /compute/v2.1/os-floating-ips/12a9e585-764e-4ab3-8e33-ca9f72a5eb6d => generated 141 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:19.556956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb9ddd59-9a8d-41c2-b016-2546138405ff tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 0.619507 Dec 25 21:08:19.558318 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 261/444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:18 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:19.571674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f837f7b-1be4-4180-b561-717e37cade19 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:19.574270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f43a192a-31d7-4d3c-8ae0-cd970b904570 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75ae040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:19.599035 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f837f7b-1be4-4180-b561-717e37cade19 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039152 Dec 25 21:08:19.600179 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 262/445] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:19 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:19.605534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8fcb3f0-3d63-401a-be36-50936b86c0d3 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Calling method '.version_select at 0x7fa4f77c4790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:19.649595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f43a192a-31d7-4d3c-8ae0-cd970b904570 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 200 len: 1432 microversion: 2.1 time: 0.099332 Dec 25 21:08:19.650476 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 184/446] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:19 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 1432 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:19.657539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54e031a4-6174-410f-9511-68e83c4b7f67 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:19.658670 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:19.658670 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:19.888102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54e031a4-6174-410f-9511-68e83c4b7f67 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1854887174" status: 202 len: 0 microversion: 2.1 time: 0.235843 Dec 25 21:08:19.892595 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 185/447] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:08:19 2021] DELETE /compute/v2.1/flavors/1854887174 => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:19.898147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:19.899862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:19.910262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:19.911579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:19.912702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:19.913273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:20.079996 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8fcb3f0-3d63-401a-be36-50936b86c0d3 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.468099 Dec 25 21:08:20.089124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 263/448] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:08:19 2021] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:20.102579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8e470f52-e480-4b54-9e38-b59aa704f8ce tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:20.192803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8e470f52-e480-4b54-9e38-b59aa704f8ce tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.097733 Dec 25 21:08:20.200951 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 264/449] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:20 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:20.208816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:20.215983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:20.225717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:20.226161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:20.226952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:20.227384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:20.437559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:20.461574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40d9c844-5bf6-448b-919a-2b930d228dcc tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1465 microversion: 2.1 time: 0.567422 Dec 25 21:08:20.475596 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 186/450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:19 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1465 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:20.480819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-276481ef-7e26-4240-9483-1f2acd162b33 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Calling method '.version_select at 0x7fa4fc18c430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:20.915195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:20.927138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:20.927138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:20.928124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2217806-c4b4-43c9-807c-cb1f4eae18a0 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1567 microversion: 2.25 time: 0.725922 Dec 25 21:08:20.942126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 265/451] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:20 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1567 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:20.956681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5447dcc0-c85d-412d-ba33-4187afb6e997 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1396308123", "id": 1833748938, "os-flavor-access:is_public": "False"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:20.965424 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:20.965424 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:21.066570 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5447dcc0-c85d-412d-ba33-4187afb6e997 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.122831 Dec 25 21:08:21.067333 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 266/452] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:20 2021] POST /compute/v2.1/flavors => generated 415 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:21.071832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a742fec5-b14b-49fe-b332-d915dfbb1cc2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f77270d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:21.118138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a742fec5-b14b-49fe-b332-d915dfbb1cc2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/aca914d0-5f7b-465f-a024-75efa27d7291" status: 200 len: 784 microversion: 2.1 time: 0.049649 Dec 25 21:08:21.118733 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 267/453] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:21 2021] GET /compute/v2.1/images/aca914d0-5f7b-465f-a024-75efa27d7291 => generated 784 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:21.128058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:21.128806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:21.134907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:21.135355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:21.136179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:21.136607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:21.694359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:21.702758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c95c81fb-dee8-4a2f-b718-4e0c7df3f675 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 0.578761 Dec 25 21:08:21.712992 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 268/454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:21 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:21.717842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6ef9a2ee-b7e5-403f-8ade-fce616fbfb29 req-aae5c7f5-b3c4-4638-a751-ba82434555e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47b7882-0d9a-4469-b7aa-9ea14292ab12", "name": "network-vif-plugged", "status": "completed", "tag": "bfee550f-dfee-43e5-88c3-be85d5ccff12"}, {"server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "name": "network-vif-unplugged", "status": "completed", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:21.719588 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:21.719588 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:21.727862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6ef9a2ee-b7e5-403f-8ade-fce616fbfb29 req-aae5c7f5-b3c4-4638-a751-ba82434555e7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:21.733303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6ef9a2ee-b7e5-403f-8ade-fce616fbfb29 req-aae5c7f5-b3c4-4638-a751-ba82434555e7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:21.741989 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6ef9a2ee-b7e5-403f-8ade-fce616fbfb29 req-aae5c7f5-b3c4-4638-a751-ba82434555e7 service nova] Creating event network-vif-plugged:bfee550f-dfee-43e5-88c3-be85d5ccff12 for instance e47b7882-0d9a-4469-b7aa-9ea14292ab12 on nch1-master-1 Dec 25 21:08:21.742494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6ef9a2ee-b7e5-403f-8ade-fce616fbfb29 req-aae5c7f5-b3c4-4638-a751-ba82434555e7 service nova] Creating event network-vif-unplugged:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:08:21.756617 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6ef9a2ee-b7e5-403f-8ade-fce616fbfb29 req-aae5c7f5-b3c4-4638-a751-ba82434555e7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.042208 Dec 25 21:08:21.774025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 269/455] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:21 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:21.783114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae3d1789-7e7d-41da-b587-7c88ff7f9ce7 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:21.824941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae3d1789-7e7d-41da-b587-7c88ff7f9ce7 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049574 Dec 25 21:08:21.825423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 270/456] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:21 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:21.831726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07f40587-626f-4c06-87e4-fdbca394f9c8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:21.847570 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07f40587-626f-4c06-87e4-fdbca394f9c8 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020903 Dec 25 21:08:21.853331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 271/457] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:08:21 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:21.861183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c633d6f3-2b89-43f6-a959-f598fede1a0c tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:21.888173 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c633d6f3-2b89-43f6-a959-f598fede1a0c tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032965 Dec 25 21:08:21.888973 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 272/458] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:21 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:21.893508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3cc28ae2-4fac-4405-b0a4-f93c103b2a31 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc305b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:22.766639 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-276481ef-7e26-4240-9483-1f2acd162b33 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/12a9e585-764e-4ab3-8e33-ca9f72a5eb6d" status: 202 len: 0 microversion: 2.1 time: 2.289362 Dec 25 21:08:22.773668 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 187/459] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:08:20 2021] DELETE /compute/v2.1/os-floating-ips/12a9e585-764e-4ab3-8e33-ca9f72a5eb6d => generated 0 bytes in 2297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:22.780660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1596371c-d643-405a-9f3d-3e4c561611cb tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:22.781761 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:22.781761 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:22.920614 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1596371c-d643-405a-9f3d-3e4c561611cb tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1833748938" status: 202 len: 0 microversion: 2.1 time: 0.145269 Dec 25 21:08:22.921501 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 188/460] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:08:22 2021] DELETE /compute/v2.1/flavors/1833748938 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:22.927189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:22.928001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:22.935194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:22.935814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:22.936968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:22.937696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:23.297624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:23.319470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:23.326997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:23.329844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cd3bf4b-3973-47a7-b142-63f98d954245 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1557 microversion: 2.25 time: 0.407239 Dec 25 21:08:23.332612 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 189/461] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:22 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1557 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:23.338386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:23.339002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:23.349925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:23.351512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:23.351512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:23.352051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:23.651939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:23.661432 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35744bb4-7f80-4080-bc3f-3497cbc38c38 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1318 microversion: 2.1 time: 0.327369 Dec 25 21:08:23.672520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 190/462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:23 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:23.901175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6d9b6ea-53ea-4d47-b495-ca459b01e2e3 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Calling method '.version_select at 0x7fa4f75d6a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:23.902000 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:23.902000 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:23.903347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d6d9b6ea-53ea-4d47-b495-ca459b01e2e3 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'f871adc4c2954c29b7cf443219440ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffb8f31156140e99186291a9ada4eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:23.904026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6d9b6ea-53ea-4d47-b495-ca459b01e2e3 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:23.904829 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6d9b6ea-53ea-4d47-b495-ca459b01e2e3 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.238305 Dec 25 21:08:23.905361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 191/463] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:08:23 2021] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 239 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:23.909981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e65aa6c-8e71-409d-b62f-22ad49e5eb18 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Action: 'create', calling method: .version_select at 0x7fa4f759dc10>, body: {"pool": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:23.927575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3cc28ae2-4fac-4405-b0a4-f93c103b2a31 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "DELETE /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 204 len: 0 microversion: 2.1 time: 2.037344 Dec 25 21:08:23.928800 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 273/464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:21 2021] DELETE /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 0 bytes in 2039 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:08:23.934764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce3645bd-00b2-4c1f-ac53-2c7ccd38fc62 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:23.956227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce3645bd-00b2-4c1f-ac53-2c7ccd38fc62 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025875 Dec 25 21:08:23.957472 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 274/465] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:23 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:23.962516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a13187e-8d3d-4316-88a8-15a402c9b8fa tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '.version_select at 0x7fa4f77c4280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:23.964664 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:23.964664 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:23.967951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a13187e-8d3d-4316-88a8-15a402c9b8fa tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:23.970890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a13187e-8d3d-4316-88a8-15a402c9b8fa tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:23.989087 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a13187e-8d3d-4316-88a8-15a402c9b8fa tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.030291 Dec 25 21:08:23.990414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 275/466] 10.222.0.32 () {60 vars in 1183 bytes} [Sat Dec 25 21:08:23 2021] GET /compute/v2.1/os-migrations => generated 680 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:08:23.995453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44c5a9d1-0d63-4443-b974-1419c20eb208 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Calling method '.version_select at 0x7fa4f77c45e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:23.996724 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:23.996724 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:23.998307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-44c5a9d1-0d63-4443-b974-1419c20eb208 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'f871adc4c2954c29b7cf443219440ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffb8f31156140e99186291a9ada4eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:23.999800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44c5a9d1-0d63-4443-b974-1419c20eb208 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:24.001030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44c5a9d1-0d63-4443-b974-1419c20eb208 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.009489 Dec 25 21:08:24.002154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 276/467] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:23 2021] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:24.007714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2cdad82-0f75-4f94-a41f-80761459bc59 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc145f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:24.036896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c2cdad82-0f75-4f94-a41f-80761459bc59 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] HTTP exception thrown: Image not found. Dec 25 21:08:24.037704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2cdad82-0f75-4f94-a41f-80761459bc59 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:24.038701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2cdad82-0f75-4f94-a41f-80761459bc59 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 404 len: 62 microversion: 2.1 time: 0.035418 Dec 25 21:08:24.039631 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 277/468] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:24 2021] GET /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:08:24.045910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df65e4bc-ff6a-4568-90e2-a47700517de9 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1087855318", "id": 976230939, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:24.048289 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:24.048289 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:24.158512 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df65e4bc-ff6a-4568-90e2-a47700517de9 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.111563 Dec 25 21:08:24.158512 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 278/469] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:24 2021] POST /compute/v2.1/flavors => generated 411 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:24.160041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:24.160826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:24.169316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:24.170117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:24.170941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:24.171375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:24.738472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:08:24.811933 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e269124c-5288-4aa8-8a08-7ae27aa81907 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 2050 microversion: 2.25 time: 0.656465 Dec 25 21:08:24.812535 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 279/470] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:24 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 2050 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:24.817274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da5265ca-86b5-4b6a-a37b-1e24efee8883 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Calling method '.version_select at 0x7fa4f777a670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:24.818165 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:24.818165 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:24.819544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da5265ca-86b5-4b6a-a37b-1e24efee8883 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'f871adc4c2954c29b7cf443219440ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffb8f31156140e99186291a9ada4eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:24.820214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da5265ca-86b5-4b6a-a37b-1e24efee8883 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:24.821038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da5265ca-86b5-4b6a-a37b-1e24efee8883 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.007219 Dec 25 21:08:24.836292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 280/471] 10.222.0.32 () {58 vars in 1178 bytes} [Sat Dec 25 21:08:24 2021] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:24.836292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-133288405"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:24.836292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:24.866876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:24.867332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:24.868143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:24.868582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:25.514832 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9410b5b-d715-4c02-b19c-f8d1a82b0ce1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "POST /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4/action" status: 202 len: 0 microversion: 2.1 time: 0.684806 Dec 25 21:08:25.519509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 281/472] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:08:24 2021] POST /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:08:25.534654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90fc66bc-0a3c-43e6-9989-62d28c382ed9 tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:25.560520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90fc66bc-0a3c-43e6-9989-62d28c382ed9 tempest-FlavorsAdminTestJSON-1076402742 tempest-FlavorsAdminTestJSON-1076402742-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.043841 Dec 25 21:08:25.573292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 282/473] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:25 2021] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:25.578839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:25.579570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:25.585970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:25.586556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:25.587195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:25.587628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:25.899030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:25.909659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27958c1f-cfa5-4817-965b-38973b29ed28 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1468 microversion: 2.1 time: 0.334989 Dec 25 21:08:25.922037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 283/474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:25 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1468 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:26.076606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Calling method '.version_select at 0x7fa4f77a0a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:26.077891 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:26.077891 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:26.080055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:26.080685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:26.098962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:26.099597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:26.132168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:26.132168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:26.146988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-11eb35a8-3870-448b-9556-65497538742d tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.223416 Dec 25 21:08:26.147645 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 284/475] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:25 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:26.162790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1517908533", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "1e137e86-76be-493f-9b25-1d17756925b5"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:26.233550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] validate_networks() for [('1e137e86-76be-493f-9b25-1d17756925b5', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:08:26.895773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:08:26.897122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:08:26.897809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:08:26.898405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:08:26.899312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:08:26.926235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:26.926677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:26.929136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:26.929596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:26.958729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:26.969529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for user 2cb2a59c7c9b4a13964c78ff0fb1a8f4 and project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:26.982384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:08:26.985491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:08:27.200698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c95134a2-731f-4de5-8ece-982834f79e49 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.041599 Dec 25 21:08:27.201416 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 285/476] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:08:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:08:27.215844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33d40b87-cf31-4f19-b077-2c41efea1e94 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc14a5e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.219302 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e65aa6c-8e71-409d-b62f-22ad49e5eb18 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.312129 Dec 25 21:08:27.220983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 192/477] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:08:23 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:27.228250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b13ab184-7b6d-4ac7-a509-e0a4579214d0 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.229876 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:27.229876 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:27.279553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33d40b87-cf31-4f19-b077-2c41efea1e94 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.075442 Dec 25 21:08:27.280812 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 286/478] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:27 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:27.286523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.287351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:27.296750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:27.297240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:27.298051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:27.298491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:27.437945 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b13ab184-7b6d-4ac7-a509-e0a4579214d0 tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/976230939" status: 202 len: 0 microversion: 2.1 time: 0.212718 Dec 25 21:08:27.437945 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 193/479] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:08:27 2021] DELETE /compute/v2.1/flavors/976230939 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:27.442326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-faa803ab-d209-42d5-886c-79f824b0d34e tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Calling method '.version_select at 0x7fa4f75d6310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.443330 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:27.443330 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:27.449643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-faa803ab-d209-42d5-886c-79f824b0d34e tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'f871adc4c2954c29b7cf443219440ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffb8f31156140e99186291a9ada4eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:27.450526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-faa803ab-d209-42d5-886c-79f824b0d34e tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:27.451854 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-faa803ab-d209-42d5-886c-79f824b0d34e tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.014192 Dec 25 21:08:27.452891 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 194/480] 10.222.0.32 () {58 vars in 1172 bytes} [Sat Dec 25 21:08:27 2021] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:27.567294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:27.587427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4a489bf-bfbc-45b3-9cf8-a063f1e0ec3c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 200 len: 1468 microversion: 2.1 time: 0.297748 Dec 25 21:08:27.595000 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 287/481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:27 2021] GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 1468 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:27.601721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-34402f37-bac0-4211-9104-f6658169638c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.602668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-34402f37-bac0-4211-9104-f6658169638c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:27.673733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54eacf31-a389-4642-ac2b-640c528b4eae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.694996 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54eacf31-a389-4642-ac2b-640c528b4eae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.240576 Dec 25 21:08:27.698091 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 195/482] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:08:27 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:27.709573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-97dc1236-3fb2-4788-85ca-bd03a8aac7e4 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Calling method '.version_select at 0x7fa4f75ae4c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:27.983427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34402f37-bac0-4211-9104-f6658169638c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:27.990742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34402f37-bac0-4211-9104-f6658169638c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:28.002952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34402f37-bac0-4211-9104-f6658169638c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:28.004219 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-34402f37-bac0-4211-9104-f6658169638c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1262 microversion: 2.25 time: 0.408035 Dec 25 21:08:28.004652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 288/483] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:27 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1262 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:28.009112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cdcf80b7-aed9-4b29-b5a1-1fa36c3cf20c tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:28.035735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cdcf80b7-aed9-4b29-b5a1-1fa36c3cf20c tempest-FlavorsAdminTestJSON-1539057728 tempest-FlavorsAdminTestJSON-1539057728-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029807 Dec 25 21:08:28.047529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 289/484] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:28 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:28.053273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1af62a08-9f5b-43ef-ac8b-2fb74a889145 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Calling method '.version_select at 0x7fa4f77699d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:28.054282 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:28.054282 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:28.055731 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1af62a08-9f5b-43ef-ac8b-2fb74a889145 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] HTTP exception thrown: Hypervisor with ID '52aa0249-e332-475b-83aa-e284cff69894' could not be found. Dec 25 21:08:28.057161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1af62a08-9f5b-43ef-ac8b-2fb74a889145 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Returning 404 to user: Hypervisor with ID '52aa0249-e332-475b-83aa-e284cff69894' could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:28.058346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1af62a08-9f5b-43ef-ac8b-2fb74a889145 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/52aa0249-e332-475b-83aa-e284cff69894/uptime" status: 404 len: 123 microversion: 2.1 time: 0.009016 Dec 25 21:08:28.064452 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 290/485] 10.222.0.32 () {58 vars in 1277 bytes} [Sat Dec 25 21:08:28 2021] GET /compute/v2.1/os-hypervisors/52aa0249-e332-475b-83aa-e284cff69894/uptime => generated 123 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:28.070314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:28.077939 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:28.077939 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:28.077939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:28.077939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Searching by: {'reservation_id': 'r-q0f3bbnq', 'deleted': False, 'project_id': '19a16dcc3c214ac2a218d3758e551792'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:08:28.086538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:28.087552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:28.089608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:28.090238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:28.248096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:08:28.426738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:28.448472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:28.449618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:28.862049 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9c31ce7-b4ed-4740-839e-70e32896d45d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?reservation_id=r-q0f3bbnq" status: 200 len: 2929 microversion: 2.1 time: 0.796176 Dec 25 21:08:28.864492 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 291/486] 10.222.0.32 () {58 vars in 1196 bytes} [Sat Dec 25 21:08:28 2021] GET /compute/v2.1/servers/detail?reservation_id=r-q0f3bbnq => generated 2929 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:29.214487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-220b8c0e-aa2a-441f-b23b-67446621ba61 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1053920354", "id": 1498146698, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:29.216201 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:29.216201 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:29.335847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-220b8c0e-aa2a-441f-b23b-67446621ba61 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.468089 Dec 25 21:08:29.336717 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 292/487] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:28 2021] POST /compute/v2.1/flavors => generated 425 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:29.344988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Calling method '.version_select at 0x7fa4f7561430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.350892 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:29.350892 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:29.356905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.360526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.383970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.384599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.398842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.399650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.408377 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa716cc2-8098-4ec4-bb05-d9bf35299ea5 tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.069600 Dec 25 21:08:29.409489 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 293/488] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:29.421815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b40512df-a257-47d5-8769-a6190cb6e80e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7662e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.496826 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b40512df-a257-47d5-8769-a6190cb6e80e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.086006 Dec 25 21:08:29.497439 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 294/489] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:29.502427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f84e3a5d-1f85-46af-bdcf-155d0a0acc58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.521281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_groups [None req-f84e3a5d-1f85-46af-bdcf-155d0a0acc58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Querying cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) for 2 instances {{(pid=136548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 25 21:08:29.522462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f84e3a5d-1f85-46af-bdcf-155d0a0acc58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.523059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f84e3a5d-1f85-46af-bdcf-155d0a0acc58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.580973 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f84e3a5d-1f85-46af-bdcf-155d0a0acc58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/2a16c084-4364-4366-b497-ad95436a844d" status: 200 len: 265 microversion: 2.1 time: 0.081373 Dec 25 21:08:29.585193 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 295/490] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/os-server-groups/2a16c084-4364-4366-b497-ad95436a844d => generated 265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:29.599710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.603232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:29.616707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.621987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.623420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.624413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.777893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:29.793629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:29.800534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:29.801891 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb097692-edb9-4c4c-b3f6-1bb4ea9170e2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1314 microversion: 2.25 time: 0.215324 Dec 25 21:08:29.813024 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 296/491] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:29.813214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4132faa0-dfbd-43bf-9223-0a88332879dd tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.827496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4132faa0-dfbd-43bf-9223-0a88332879dd tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.019323 Dec 25 21:08:29.828330 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 297/492] 10.222.0.32 () {58 vars in 1181 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:08:29.833496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58a15d20-3655-432d-9eb1-fdf1f0119104 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Calling method '.version_select at 0x7fa4f7769160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.834638 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:29.834638 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:29.836480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58a15d20-3655-432d-9eb1-fdf1f0119104 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'f871adc4c2954c29b7cf443219440ed9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ffb8f31156140e99186291a9ada4eed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:29.837253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58a15d20-3655-432d-9eb1-fdf1f0119104 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:29.838612 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58a15d20-3655-432d-9eb1-fdf1f0119104 tempest-HypervisorAdminNegativeTestJSON-1436016832 tempest-HypervisorAdminNegativeTestJSON-1436016832-project] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.008872 Dec 25 21:08:29.839023 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 298/493] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:29.843965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:29.844695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:29.852570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.853235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:29.854202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:29.854921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:30.331809 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-97dc1236-3fb2-4788-85ca-bd03a8aac7e4 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/be75c01f-5745-4c8b-8424-fb938e420f04" status: 202 len: 0 microversion: 2.1 time: 2.631024 Dec 25 21:08:30.334943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 196/494] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:08:27 2021] DELETE /compute/v2.1/os-floating-ips/be75c01f-5745-4c8b-8424-fb938e420f04 => generated 0 bytes in 2636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:08:30.344122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20fbb36c-6f9f-4eb6-9bc0-c845a07fa481 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-2117427620", "id": 146250592, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:30.345901 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:30.345901 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:30.476011 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20fbb36c-6f9f-4eb6-9bc0-c845a07fa481 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.139633 Dec 25 21:08:30.479067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 197/495] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:30 2021] POST /compute/v2.1/flavors => generated 422 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:30.484297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a4b73cd4-ca17-4652-9c3f-2b44931efb5f tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Calling method '.version_select at 0x7fa4fc29d0d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:30.486314 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:30.486314 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:30.487934 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a4b73cd4-ca17-4652-9c3f-2b44931efb5f tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] HTTP exception thrown: Hypervisor with ID '0109adde-f750-431b-91c3-9a020a9d7517' could not be found. Dec 25 21:08:30.488927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a4b73cd4-ca17-4652-9c3f-2b44931efb5f tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] Returning 404 to user: Hypervisor with ID '0109adde-f750-431b-91c3-9a020a9d7517' could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:30.490001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a4b73cd4-ca17-4652-9c3f-2b44931efb5f tempest-HypervisorAdminNegativeTestJSON-2085838169 tempest-HypervisorAdminNegativeTestJSON-2085838169-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors/0109adde-f750-431b-91c3-9a020a9d7517" status: 404 len: 123 microversion: 2.1 time: 0.011827 Dec 25 21:08:30.491303 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 198/496] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:08:30 2021] GET /compute/v2.1/os-hypervisors/0109adde-f750-431b-91c3-9a020a9d7517 => generated 123 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:30.500022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d00e8e3-975d-4903-b57d-31c942f9eb29 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Calling method '.version_select at 0x7fa4f758c4c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:30.745015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-1d00e8e3-975d-4903-b57d-31c942f9eb29 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP be75c01f-5745-4c8b-8424-fb938e420f04 could not be found", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:08:30.745015 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-1d00e8e3-975d-4903-b57d-31c942f9eb29 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] HTTP exception thrown: Floating IP not found for ID be75c01f-5745-4c8b-8424-fb938e420f04 Dec 25 21:08:30.745015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d00e8e3-975d-4903-b57d-31c942f9eb29 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Returning 404 to user: Floating IP not found for ID be75c01f-5745-4c8b-8424-fb938e420f04 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:30.745015 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d00e8e3-975d-4903-b57d-31c942f9eb29 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/be75c01f-5745-4c8b-8424-fb938e420f04" status: 404 len: 111 microversion: 2.1 time: 0.247943 Dec 25 21:08:30.745015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 199/497] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:08:30 2021] GET /compute/v2.1/os-floating-ips/be75c01f-5745-4c8b-8424-fb938e420f04 => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:30.750698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd5bc23d-9ed3-4378-a992-bdb5f0207f53 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:30.760679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd5bc23d-9ed3-4378-a992-bdb5f0207f53 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013451 Dec 25 21:08:30.761867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 200/498] 10.222.0.32 () {58 vars in 1181 bytes} [Sat Dec 25 21:08:30 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:08:30.767643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cdd9169-8f50-4028-8ea3-2d20bce6f8c4 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4fc18cf70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:30.782032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba089803-05f3-42c8-8122-75e73f47471a tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 200 len: 1619 microversion: 2.1 time: 0.941815 Dec 25 21:08:30.791715 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 299/499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:29 2021] GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 1619 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:30.797045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec3c4b43-a856-4d4c-aa27-13c9b25fa308 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Calling method '.version_select at 0x7fa4f7662b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:30.864706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cdd9169-8f50-4028-8ea3-2d20bce6f8c4 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.101593 Dec 25 21:08:30.873072 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 201/500] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:30 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:30.878227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41add065-0533-4022-ba2b-452378123470 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'create', calling method: .version_select at 0x7fa4f76fa310>, body: {"keypair": {"name": "tempest-keypair-1535556607"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:30.918491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41add065-0533-4022-ba2b-452378123470 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:30.931070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41add065-0533-4022-ba2b-452378123470 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for user aa5e089e14854aec83cc6b1f9ca9fedc and project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:30.980726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-ec3c4b43-a856-4d4c-aa27-13c9b25fa308 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP be75c01f-5745-4c8b-8424-fb938e420f04 could not be found", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:08:30.981610 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ec3c4b43-a856-4d4c-aa27-13c9b25fa308 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] HTTP exception thrown: Floating IP not found for ID be75c01f-5745-4c8b-8424-fb938e420f04 Dec 25 21:08:30.982338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec3c4b43-a856-4d4c-aa27-13c9b25fa308 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] Returning 404 to user: Floating IP not found for ID be75c01f-5745-4c8b-8424-fb938e420f04 {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:08:30.983395 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec3c4b43-a856-4d4c-aa27-13c9b25fa308 tempest-FloatingIPsTestJSON-228493622 tempest-FloatingIPsTestJSON-228493622-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/be75c01f-5745-4c8b-8424-fb938e420f04" status: 404 len: 111 microversion: 2.1 time: 0.190185 Dec 25 21:08:30.990045 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 300/501] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:08:30 2021] DELETE /compute/v2.1/os-floating-ips/be75c01f-5745-4c8b-8424-fb938e420f04 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:08:30.995933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:30.998126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:31.015037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:31.018236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:31.020495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:31.025229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:31.457580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41add065-0533-4022-ba2b-452378123470 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:31.471212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41add065-0533-4022-ba2b-452378123470 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for user aa5e089e14854aec83cc6b1f9ca9fedc and project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:31.512411 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41add065-0533-4022-ba2b-452378123470 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.637973 Dec 25 21:08:31.513706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 202/502] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:08:30 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:31.524844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:31.527659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:31.537394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:31.538258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:31.540585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:31.545370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:31.583911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cca2c05b-7c66-44ef-8930-55bad7840298 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 200 len: 1619 microversion: 2.1 time: 0.592261 Dec 25 21:08:31.584499 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 301/503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:30 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 1619 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:31.602184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f724f00-3ef0-4d17-93e3-2967a62e311d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: .version_select at 0x7fa4f751cb80>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1093146468", "policies": ["anti-affinity"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:31.636134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8f724f00-3ef0-4d17-93e3-2967a62e311d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:31.649218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8f724f00-3ef0-4d17-93e3-2967a62e311d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:31.726985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:31.743145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:31.751168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:31.752844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2f561be-97d9-4c30-a0ff-95c1cb374d9d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1320 microversion: 2.25 time: 0.237170 Dec 25 21:08:31.756414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 203/504] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:31 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:31.847988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8f724f00-3ef0-4d17-93e3-2967a62e311d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:31.857616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8f724f00-3ef0-4d17-93e3-2967a62e311d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:31.880245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ddf6a384-1077-424f-b6a7-a5fe0bc966ef tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75d6280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:31.886506 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f724f00-3ef0-4d17-93e3-2967a62e311d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.288001 Dec 25 21:08:31.890822 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 302/505] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:08:31 2021] POST /compute/v2.1/os-server-groups => generated 193 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:08:31.975160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ddf6a384-1077-424f-b6a7-a5fe0bc966ef tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.098488 Dec 25 21:08:31.978176 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 204/506] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:31 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:32.118383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1887850113", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "e7fc432d-11f1-400d-bcc5-e158a802484b"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:32.214712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:08:32.775319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:32.776316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:32.801210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:32.804884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:32.805838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:32.806262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:33.369642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:08:33.370171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:08:33.370848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:08:33.371373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:08:33.371917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:08:33.408449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:33.412614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:33.415792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:33.422611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:33.478121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:33.492817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:33.519079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Going to run 2 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:08:33.521398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:08:33.767123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:33.776155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:33.828725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:33.848796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:33.850836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:33.852409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c898855a-1c7b-480f-89dd-8a5777b89da6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 1.082162 Dec 25 21:08:33.853212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 205/507] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:32 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:08:33.859954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71233195-33f0-45d7-8948-56a16d7f5d08 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75dc1f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:33.984670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:33.991588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:34.007844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71233195-33f0-45d7-8948-56a16d7f5d08 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.152052 Dec 25 21:08:34.008903 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 206/508] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:33 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:34.024053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2b7d24d7-b721-4900-8e26-eeb961d1a1a3 req-d5580634-008e-4408-b7b6-7051dff147cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "name": "network-vif-plugged", "status": "completed", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:34.034819 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:34.034819 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:34.051638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=083a54e8-8841-4d6e-b720-a0e06409e0d4,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:08:34.059599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2b7d24d7-b721-4900-8e26-eeb961d1a1a3 req-d5580634-008e-4408-b7b6-7051dff147cc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:34.062830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2b7d24d7-b721-4900-8e26-eeb961d1a1a3 req-d5580634-008e-4408-b7b6-7051dff147cc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:34.115594 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2b7d24d7-b721-4900-8e26-eeb961d1a1a3 req-d5580634-008e-4408-b7b6-7051dff147cc service nova] Creating event network-vif-plugged:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:08:34.141821 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2b7d24d7-b721-4900-8e26-eeb961d1a1a3 req-d5580634-008e-4408-b7b6-7051dff147cc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129282 Dec 25 21:08:34.145284 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 207/509] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:34.319073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:34.329293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:34.451235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:34.456577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:34.502595 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5b3c01d-a3f8-4c53-a805-24e4ea1b9e27 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.388736 Dec 25 21:08:34.504759 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 303/510] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:32 2021] POST /compute/v2.1/servers => generated 32 bytes in 2392 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Dec 25 21:08:34.513716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:34.528116 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:34.528116 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:34.529631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:34.530642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Searching by: {'deleted': False, 'project_id': '19a16dcc3c214ac2a218d3758e551792'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:08:34.550467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:34.550978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:34.553741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:34.554383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:34.591549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:08:34.644102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8103f2e6-a5b7-4ffe-bbf8-102855ecefc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1664 microversion: 2.1 time: 0.135013 Dec 25 21:08:34.655572 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 208/511] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:08:34 2021] GET /compute/v2.1/servers => generated 1664 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:34.668345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2a22cc7-c750-43be-a7d2-02e2961fd727 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:34.673234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2a22cc7-c750-43be-a7d2-02e2961fd727 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:34.870380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:34.871889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:34.887304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:34.887763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:34.888576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:34.899643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:35.390315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2a22cc7-c750-43be-a7d2-02e2961fd727 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:35.398056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2a22cc7-c750-43be-a7d2-02e2961fd727 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1219 microversion: 2.1 time: 0.742437 Dec 25 21:08:35.398633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 304/512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:34 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1219 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:35.412532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8996f37-1db0-4488-955e-d6677e447a6e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f74d24c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:35.521002 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8996f37-1db0-4488-955e-d6677e447a6e tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.119110 Dec 25 21:08:35.522430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 305/513] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:35 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:35.785165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:35.804934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:35.815708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:35.817991 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50960fdf-1a7e-40b9-9f72-2c2502ede444 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 0.951861 Dec 25 21:08:35.827229 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 209/514] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:34 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:35.971647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1535598751", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "d11a6d20-7c9e-4651-a65c-c60d3931cc4e"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:36.090094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] validate_networks() for [('d11a6d20-7c9e-4651-a65c-c60d3931cc4e', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:08:36.419552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b231838-a782-45ce-88a8-c9194500a94e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:36.421758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b231838-a782-45ce-88a8-c9194500a94e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:36.521638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b231838-a782-45ce-88a8-c9194500a94e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:36.549434 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b231838-a782-45ce-88a8-c9194500a94e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1219 microversion: 2.1 time: 0.134092 Dec 25 21:08:36.560327 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 210/515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:36 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:36.565703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c9c6f27-aa6e-4cce-b6f5-f955fbfb05e4 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7555820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:36.662383 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c9c6f27-aa6e-4cce-b6f5-f955fbfb05e4 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.100528 Dec 25 21:08:36.663194 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 211/516] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:36 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:37.455943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-90843909-8ae0-4401-ae60-de0a38baf4ec tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1394877509", "id": 252426248, "os-flavor-access:is_public": "True"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:37.459765 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:37.459765 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:37.636300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:08:37.637411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:08:37.638154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:08:37.638759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:08:37.639381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:08:37.660301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:37.661816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:37.664244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:37.665019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:37.690341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Getting quotas for project e65cafc179094f63bf88bfba4c57fd1f. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:37.706128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Getting quotas for user 6441cac91831435cb23d56e935cb99c6 and project e65cafc179094f63bf88bfba4c57fd1f. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:37.725287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:08:37.727620 ncdv-master-1 devstack@n-api.service[136548]: WARNING nova.utils [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1535598751 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-153559875 Dec 25 21:08:37.729163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:08:37.778936 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-90843909-8ae0-4401-ae60-de0a38baf4ec tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 1.030728 Dec 25 21:08:37.792343 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 212/517] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:08:36 2021] POST /compute/v2.1/flavors => generated 446 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:08:37.810904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:37.814425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:37.852522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:37.852522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:37.852522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:37.852522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:38.011475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-71e64cdc-b339-466a-8c3c-ec0dca4c0ffd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.482386 Dec 25 21:08:38.016576 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 306/518] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 2493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:08:38.024303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:38.024977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:38.050544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:38.050999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:38.055948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:38.059149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:38.650267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:38.662451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a83cd44b-5d9f-444b-aaeb-5ba433a12d80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1223 microversion: 2.1 time: 0.644729 Dec 25 21:08:38.676461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 307/519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:38 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1223 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:38.686337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-626bfe03-6ae5-4a32-843d-d319114ee314 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f751c4c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:38.778060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-626bfe03-6ae5-4a32-843d-d319114ee314 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.097591 Dec 25 21:08:38.778949 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 308/520] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:38 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:39.249799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:39.285974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:39.296822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:39.306004 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34f4d306-e7bf-4592-9c2b-6ee5088b56af tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 1.507362 Dec 25 21:08:39.315704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 213/521] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:37 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:39.333067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-089f3599-4804-4e0b-9ac1-364c827d1bbd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:39.333964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-089f3599-4804-4e0b-9ac1-364c827d1bbd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:39.396637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-051e7b78-424b-40de-989d-764e1dc567bc tempest-FlavorsV255TestJSON-1097103450 tempest-FlavorsV255TestJSON-1097103450-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:39.417587 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-051e7b78-424b-40de-989d-764e1dc567bc tempest-FlavorsV255TestJSON-1097103450 tempest-FlavorsV255TestJSON-1097103450-project] 10.222.0.32 "GET /compute/v2.1/flavors/252426248" status: 200 len: 446 microversion: 2.55 time: 0.636633 Dec 25 21:08:39.433533 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 309/522] 10.222.0.32 () {60 vars in 1195 bytes} [Sat Dec 25 21:08:38 2021] GET /compute/v2.1/flavors/252426248 => generated 446 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:08:39.446132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1d7bcf66-8302-43da-a4dd-732ae2308039 req-44778575-619b-425c-80da-993fde243543 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e370ad00-0f15-4014-99c2-3ecd6b33849e", "tag": "9026d1d6-3da8-4905-baa7-966ecb80b10a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:39.451044 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:39.451044 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:39.474287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1d7bcf66-8302-43da-a4dd-732ae2308039 req-44778575-619b-425c-80da-993fde243543 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:39.474976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1d7bcf66-8302-43da-a4dd-732ae2308039 req-44778575-619b-425c-80da-993fde243543 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:39.502102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1d7bcf66-8302-43da-a4dd-732ae2308039 req-44778575-619b-425c-80da-993fde243543 service nova] Creating event network-changed:9026d1d6-3da8-4905-baa7-966ecb80b10a for instance e370ad00-0f15-4014-99c2-3ecd6b33849e on nch2-master-1 Dec 25 21:08:39.512349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1d7bcf66-8302-43da-a4dd-732ae2308039 req-44778575-619b-425c-80da-993fde243543 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075931 Dec 25 21:08:39.513677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 310/523] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:39.521751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20ac78e4-a459-464c-9f75-fd6fc1e9d5ed tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fdbd3700>, body: {"flavor": {"description": "new"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:39.539543 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:39.539543 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:39.663394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-089f3599-4804-4e0b-9ac1-364c827d1bbd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:39.675495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-089f3599-4804-4e0b-9ac1-364c827d1bbd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1232 microversion: 2.1 time: 0.357882 Dec 25 21:08:39.676086 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 214/524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:39 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1232 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:39.693589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:39.695567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:39.713122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:39.713581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:39.714392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:39.714832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:39.809357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20ac78e4-a459-464c-9f75-fd6fc1e9d5ed tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] 10.222.0.32 "PUT /compute/v2.1/flavors/252426248" status: 200 len: 447 microversion: 2.55 time: 0.293903 Dec 25 21:08:39.809946 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 311/525] 10.222.0.32 () {62 vars in 1215 bytes} [Sat Dec 25 21:08:39 2021] PUT /compute/v2.1/flavors/252426248 => generated 447 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:08:39.815602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-69a0face-dc1b-4531-8a02-2c9611b8c39d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7561280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:39.871962 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-69a0face-dc1b-4531-8a02-2c9611b8c39d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.058798 Dec 25 21:08:39.872566 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 312/526] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:39 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:39.877619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7600f8f-d53b-4e9f-8ae0-7fc05377273b tempest-FlavorsV255TestJSON-1097103450 tempest-FlavorsV255TestJSON-1097103450-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:39.909220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7600f8f-d53b-4e9f-8ae0-7fc05377273b tempest-FlavorsV255TestJSON-1097103450 tempest-FlavorsV255TestJSON-1097103450-project] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 6591 microversion: 2.55 time: 0.030465 Dec 25 21:08:39.909220 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 313/527] 10.222.0.32 () {60 vars in 1186 bytes} [Sat Dec 25 21:08:39 2021] GET /compute/v2.1/flavors/detail => generated 6591 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:39.921091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efd2b64d-ab3f-4853-bd11-9c11ff4abb57 tempest-FlavorsV255TestJSON-1097103450 tempest-FlavorsV255TestJSON-1097103450-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:39.961450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:39.971804 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-63372929-56b1-4ac8-84c0-2e5e83c00759 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1271 microversion: 2.1 time: 0.282623 Dec 25 21:08:39.984855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efd2b64d-ab3f-4853-bd11-9c11ff4abb57 tempest-FlavorsV255TestJSON-1097103450 tempest-FlavorsV255TestJSON-1097103450-project] 10.222.0.32 "GET /compute/v2.1/flavors" status: 200 len: 3681 microversion: 2.55 time: 0.067726 Dec 25 21:08:39.989431 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 314/528] 10.222.0.32 () {60 vars in 1165 bytes} [Sat Dec 25 21:08:39 2021] GET /compute/v2.1/flavors => generated 3681 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:08:39.992460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 215/529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:39 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1271 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:40.007026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-143ecd3a-0d03-45de-8fbe-c33cccdfea63 tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:40.009791 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:40.009791 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:40.248481 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-143ecd3a-0d03-45de-8fbe-c33cccdfea63 tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/252426248" status: 202 len: 0 microversion: 2.55 time: 0.248769 Dec 25 21:08:40.252115 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 315/530] 10.222.0.32 () {60 vars in 1198 bytes} [Sat Dec 25 21:08:39 2021] DELETE /compute/v2.1/flavors/252426248 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:08:40.263083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-edcefb78-19b8-4dd9-96cc-83c0f0bb97c6 tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:40.331963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:40.333309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:40.355414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:40.356019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:40.364225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:40.367853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:40.382769 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-edcefb78-19b8-4dd9-96cc-83c0f0bb97c6 tempest-FlavorsV255TestJSON-1725366377 tempest-FlavorsV255TestJSON-1725366377-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 6154 microversion: 2.55 time: 0.119389 Dec 25 21:08:40.387107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 216/531] 10.222.0.32 () {60 vars in 1186 bytes} [Sat Dec 25 21:08:40 2021] GET /compute/v2.1/flavors/detail => generated 6154 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:40.697700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:40.698595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:40.724937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:40.731847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:40.734804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:40.735455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:41.213899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:41.229997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a2f71a1-c9b6-412b-a9c1-935b663435a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1236 microversion: 2.1 time: 0.537414 Dec 25 21:08:41.235590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 217/532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:40 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1236 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:41.240497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98b6b8f9-7c27-4d62-990f-fde53e389551 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75d6af0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:41.368591 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98b6b8f9-7c27-4d62-990f-fde53e389551 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.131651 Dec 25 21:08:41.370292 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 218/533] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:41 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:41.383405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:41.384928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:41.403067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:41.404579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:41.409097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:41.409097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:41.880744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:41.898883 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d50f973f-153a-49a4-a945-8665ce4e5979 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1277 microversion: 2.1 time: 0.522755 Dec 25 21:08:41.902230 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 219/534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:41 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1277 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:42.024683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:42.038310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:42.041941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:42.045767 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d40c463d-5a1a-4433-a611-6b6c678e6133 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 1.716360 Dec 25 21:08:42.047702 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 316/535] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:40 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:42.255523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:42.256458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:42.268033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:42.268610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:42.269633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:42.270687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:42.382324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b38d278-e9ea-4a02-bc11-9294da3585cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f751c4c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:42.437830 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b38d278-e9ea-4a02-bc11-9294da3585cd tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.059070 Dec 25 21:08:42.438670 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 317/536] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:42 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:42.550443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:42.591788 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a4d94ba0-6b0d-44c5-a357-451534be15b4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1292 microversion: 2.1 time: 0.341918 Dec 25 21:08:42.592665 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 220/537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:42 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1292 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:42.818387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-38744320", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "146250592", "adminPass": "***", "networks": [{"uuid": "629690dc-316c-48ba-b3f8-2395f5f041a6"}], "security_groups": [{"name": "tempest-securitygroup--1982068629"}], "key_name": "tempest-keypair-1535556607", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:42.920364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:42.922559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:42.932717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:42.933573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:42.934494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:42.935116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:43.173624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:43.183331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bafaf69-ce7e-4c88-89ed-a3e670460858 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1277 microversion: 2.1 time: 0.268123 Dec 25 21:08:43.186412 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 221/538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:42 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1277 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:43.200969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:43.201870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:43.215976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:43.217867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:43.219011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:43.229959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:43.428108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] validate_networks() for [('629690dc-316c-48ba-b3f8-2395f5f041a6', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:08:44.421281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:44.433454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:44.437770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:44.438900 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ba1f2cf-475b-4202-bf42-ccb12552a491 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 1.248230 Dec 25 21:08:44.439463 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 222/539] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:43 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:44.459236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf18f8a4-7d8f-4ae9-a234-1dac52cb8bb2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75761f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:44.529801 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf18f8a4-7d8f-4ae9-a234-1dac52cb8bb2 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.089282 Dec 25 21:08:44.530379 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 223/540] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:44 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:44.539246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:44.539857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:44.554658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:44.555752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:44.559158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:44.560530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:45.518082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:45.525955 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1584746a-201b-4d2d-90b0-ef61b1ed6f4f tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.992992 Dec 25 21:08:45.526675 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 224/541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:44 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:45.545118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:45.545737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:45.560440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:45.560916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:45.563426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:45.566054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.039488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:08:46.040054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:08:46.041165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:08:46.041681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:08:46.042186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:08:46.063442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:46.064423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.067583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:46.068295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.118529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:08:46.130642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for user aa5e089e14854aec83cc6b1f9ca9fedc and project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:08:46.156666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:08:46.159354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:08:46.439370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-323d407a-61d5-4900-9ac4-a76a230b9099 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.630348 Dec 25 21:08:46.440296 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 318/542] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:08:42 2021] POST /compute/v2.1/servers => generated 402 bytes in 3632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:08:46.445864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:46.446544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:46.465569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:46.466424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.468206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:46.469684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.751865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:46.751865 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67ee651d-79b6-41bd-abb7-1cebbb062a89 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 1.124628 Dec 25 21:08:46.751865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 225/543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:45 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:46.751865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13f416fc-7378-4939-b932-1bc9021c958c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7555c10>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:46.756462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13f416fc-7378-4939-b932-1bc9021c958c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.079295 Dec 25 21:08:46.756462 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 226/544] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:46 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:46.756462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20f16bb0-b05e-4a62-be97-ba100efb44d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:46.756462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-20f16bb0-b05e-4a62-be97-ba100efb44d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:46.839599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-20f16bb0-b05e-4a62-be97-ba100efb44d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:46.846422 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20f16bb0-b05e-4a62-be97-ba100efb44d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1261 microversion: 2.1 time: 0.103685 Dec 25 21:08:46.847111 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 227/545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:46 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:46.851465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:46.852136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:46.860051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:46.860722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.861555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:46.861997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:46.978535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:46.986985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:46.988519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:46.989628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ba078c8-2aef-49ae-8246-e7b8057c05c1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 0.548213 Dec 25 21:08:46.990192 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 319/546] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:46 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:47.230773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:47.241287 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2107d553-f7aa-4f2c-8ad2-5be15e0bcc47 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.392151 Dec 25 21:08:47.242316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6db8b9e5-0d54-437f-8123-67a86ae540e5 req-cd0749ed-01d3-44fb-aad5-9863e747a3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083a54e8-8841-4d6e-b720-a0e06409e0d4", "tag": "2150b774-dd7c-4f45-910d-01e39333a0ce"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:47.245717 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 228/547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:46 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:47.246251 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:47.246251 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:47.296335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6db8b9e5-0d54-437f-8123-67a86ae540e5 req-cd0749ed-01d3-44fb-aad5-9863e747a3e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:47.297243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6db8b9e5-0d54-437f-8123-67a86ae540e5 req-cd0749ed-01d3-44fb-aad5-9863e747a3e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:47.343363 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6db8b9e5-0d54-437f-8123-67a86ae540e5 req-cd0749ed-01d3-44fb-aad5-9863e747a3e9 service nova] Creating event network-changed:2150b774-dd7c-4f45-910d-01e39333a0ce for instance 083a54e8-8841-4d6e-b720-a0e06409e0d4 on nch2-master-1 Dec 25 21:08:47.357565 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6db8b9e5-0d54-437f-8123-67a86ae540e5 req-cd0749ed-01d3-44fb-aad5-9863e747a3e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119083 Dec 25 21:08:47.360212 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 320/548] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:47.756691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77576fdc-ead4-4e21-af48-454f20839961 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7555ee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:47.760617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:47.761544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:47.792069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:47.801132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:47.805076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:47.809322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:47.883644 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77576fdc-ead4-4e21-af48-454f20839961 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.130692 Dec 25 21:08:47.884340 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 229/549] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:47 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:47.910756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a34d5dd-1684-418a-9473-dbadacc87d81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:47.911396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a34d5dd-1684-418a-9473-dbadacc87d81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:48.283258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a34d5dd-1684-418a-9473-dbadacc87d81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:48.303770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a34d5dd-1684-418a-9473-dbadacc87d81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1261 microversion: 2.1 time: 0.404844 Dec 25 21:08:48.304483 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 230/550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:47 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1261 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:48.330071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f9b8ece7-656a-4819-9f66-806c3d47f0ad req-2431e51e-59ef-4f88-9625-a017cfb22197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370ad00-0f15-4014-99c2-3ecd6b33849e", "name": "network-vif-plugged", "status": "completed", "tag": "9026d1d6-3da8-4905-baa7-966ecb80b10a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:48.336184 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:48.336184 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:48.351085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f9b8ece7-656a-4819-9f66-806c3d47f0ad req-2431e51e-59ef-4f88-9625-a017cfb22197 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:48.352333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f9b8ece7-656a-4819-9f66-806c3d47f0ad req-2431e51e-59ef-4f88-9625-a017cfb22197 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:48.391595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f9b8ece7-656a-4819-9f66-806c3d47f0ad req-2431e51e-59ef-4f88-9625-a017cfb22197 service nova] Creating event network-vif-plugged:9026d1d6-3da8-4905-baa7-966ecb80b10a for instance e370ad00-0f15-4014-99c2-3ecd6b33849e on nch2-master-1 Dec 25 21:08:48.397364 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f9b8ece7-656a-4819-9f66-806c3d47f0ad req-2431e51e-59ef-4f88-9625-a017cfb22197 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086906 Dec 25 21:08:48.399351 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 231/551] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:48.411221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:48.412187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:48.420663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:48.421319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:48.422350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:48.422925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:48.770530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:48.782850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dbd39011-5f75-491e-a151-24c5c9081698 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 1.026015 Dec 25 21:08:48.795055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 321/552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:47 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:48.816416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-88a2c267-4caf-4f61-b0f2-c82672499145 req-be9c3891-ba4a-4275-af51-4909150f8722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7", "tag": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:48.823016 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:48.823016 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:48.841875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-88a2c267-4caf-4f61-b0f2-c82672499145 req-be9c3891-ba4a-4275-af51-4909150f8722 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:48.842322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-88a2c267-4caf-4f61-b0f2-c82672499145 req-be9c3891-ba4a-4275-af51-4909150f8722 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:48.863759 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-88a2c267-4caf-4f61-b0f2-c82672499145 req-be9c3891-ba4a-4275-af51-4909150f8722 service nova] Creating event network-changed:95f9468e-c1ab-4e1c-856f-19efb9ee29b8 for instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 on nch1-master-1 Dec 25 21:08:48.874532 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-88a2c267-4caf-4f61-b0f2-c82672499145 req-be9c3891-ba4a-4275-af51-4909150f8722 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076358 Dec 25 21:08:48.875146 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 322/553] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:48.880671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:48.892288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:48.899366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:48.900525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:48.903604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:48.904112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:49.271504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:49.282930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:49.286105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:49.287714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da06a6ad-fc81-427f-a4ec-7090f557ab43 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 0.881272 Dec 25 21:08:49.288573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 232/554] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:48 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:49.295574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3855eea5-a951-4059-82f1-1a7481437cde tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75dc0d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:49.419582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3855eea5-a951-4059-82f1-1a7481437cde tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.129702 Dec 25 21:08:49.420767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 233/555] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:49 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:49.426720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:49.428052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:49.435628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:49.439831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:49.441107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:49.441830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:49.527540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:49.545469 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cd9a139-d035-4f7a-8d5f-ebb595119182 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.668863 Dec 25 21:08:49.546063 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 323/556] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:48 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:49.608495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:49.627521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-63123386-3676-496e-83a9-01193c40ea53 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1257 microversion: 2.1 time: 0.205369 Dec 25 21:08:49.629652 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 234/557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:49 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1257 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:49.802205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:49.803578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:49.817638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:49.822738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:49.822738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:49.822738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:50.307890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:50.310428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:50.337450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:50.339688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:50.340376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:50.344152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:50.345608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:50.348699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2cd1d8f9-fe4c-4f98-8eaa-182a3f98e3af tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.551761 Dec 25 21:08:50.361460 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 324/558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:49 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:50.438765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e51cabf4-fd6d-4258-9f20-ee695bbf4d06 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7526550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:50.500024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e51cabf4-fd6d-4258-9f20-ee695bbf4d06 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.070400 Dec 25 21:08:50.501340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 325/559] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:50 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:50.562919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:50.563983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:50.572007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:50.574679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:50.576675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:50.578684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:51.511703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:51.513185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:51.522766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0bf1773-9a60-4db6-959b-d6b96c486aa1 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.963560 Dec 25 21:08:51.526559 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 326/560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:50 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:51.536915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:51.537798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:51.538702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:51.553357 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c916254a-c566-496c-a56f-0b6bd02f326c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1362 microversion: 2.25 time: 1.237983 Dec 25 21:08:51.553357 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 235/561] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:50 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1362 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:08:51.553656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:51.560089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:51.560857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:51.561942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:51.562868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:51.570743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7a68593c-0f12-45ea-9383-8fde0e3bb36e req-020d6c06-9ad6-4ead-bfaa-ecd34faa87db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfb762b4-175c-45df-b530-e2ac66bf96cf", "tag": "b5c53dfd-8507-4f31-ba6b-58c68d41b36b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:51.573062 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:51.573062 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:08:51.611174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7a68593c-0f12-45ea-9383-8fde0e3bb36e req-020d6c06-9ad6-4ead-bfaa-ecd34faa87db service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:51.611650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7a68593c-0f12-45ea-9383-8fde0e3bb36e req-020d6c06-9ad6-4ead-bfaa-ecd34faa87db service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:51.628192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7a68593c-0f12-45ea-9383-8fde0e3bb36e req-020d6c06-9ad6-4ead-bfaa-ecd34faa87db service nova] Creating event network-changed:b5c53dfd-8507-4f31-ba6b-58c68d41b36b for instance bfb762b4-175c-45df-b530-e2ac66bf96cf on nch1-master-1 Dec 25 21:08:51.646692 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7a68593c-0f12-45ea-9383-8fde0e3bb36e req-020d6c06-9ad6-4ead-bfaa-ecd34faa87db service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104989 Dec 25 21:08:51.647635 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 236/562] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:08:51.659069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:51.660300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:51.669026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:51.669851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:51.670890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:51.671752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:51.833982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:51.842277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03b10e4b-137e-40c4-9caa-fb25dcb173d2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1319 microversion: 2.1 time: 0.314508 Dec 25 21:08:51.845016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 327/563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:51 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:51.858350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d74fbb1-bc31-43ad-9fd8-503471be4581 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f751c940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:51.930018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d74fbb1-bc31-43ad-9fd8-503471be4581 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.083718 Dec 25 21:08:51.937563 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 328/564] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:51 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:52.412003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:52.421659 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40845eb6-98b6-4e47-aa5a-e3dfa73cacb2 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.771103 Dec 25 21:08:52.431096 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 237/565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:51 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:52.542038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:52.542810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:52.550769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:52.554478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:52.562104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:52.562877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:52.565179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:52.566334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:52.581377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:52.581831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:52.589557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:52.590166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:53.374793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:53.386040 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e67a834-2fbe-469c-8997-1c9cfbaa8dfd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.848106 Dec 25 21:08:53.395106 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 329/566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:52 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:53.403743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:53.414308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:53.418893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:53.435989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:53.441970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:53.447025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:53.455059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:53.455232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2663d64f-fe82-4232-85bb-b74153a97982 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1558 microversion: 2.25 time: 0.892436 Dec 25 21:08:53.458768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:53.459987 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 238/567] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:52 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1558 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:53.460551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:53.482727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dec0ee17-8fb8-4dc5-bfed-b8b6c7d84256 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f76fab80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:53.594252 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dec0ee17-8fb8-4dc5-bfed-b8b6c7d84256 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.128529 Dec 25 21:08:53.594840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 239/568] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:53 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:53.614675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:53.615862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:53.651378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:53.652825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:53.656290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:53.657828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:53.893454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:53.920457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d43635d-8fba-4ec2-975d-42b3c3212155 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.523193 Dec 25 21:08:53.936764 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 330/569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:53 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:53.992131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:53.992764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:53.999663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:54.000547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:54.001585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:54.002182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:54.442710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:54.458521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd7e7013-f5c0-4fee-8021-1084537fe740 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.861991 Dec 25 21:08:54.459522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 240/570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:53 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:54.470324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:54.472199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:54.489229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:54.489678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:54.490739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:54.491341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:54.561717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:08:54.592463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85394fc3-d710-43b2-8258-83075d43f05c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 2051 microversion: 2.25 time: 0.645865 Dec 25 21:08:54.593126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 331/571] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:53 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 2051 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:54.609626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a304ec9e-ac7e-46fd-b743-c1315b71f859 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f74f4ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:54.669547 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a304ec9e-ac7e-46fd-b743-c1315b71f859 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.065260 Dec 25 21:08:54.676176 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 332/572] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:54 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:54.681824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:54.682752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:54.689359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:54.690058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:54.691052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:54.691677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:54.979092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:54.996645 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19dfbeeb-3926-42f6-9355-2fb09d637c22 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.529200 Dec 25 21:08:55.000014 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 241/573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:54 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:55.013294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:55.018750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:55.033160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.035861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.037917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.040975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.055237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:08:55.107267 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c8999f6-7d60-41b4-be4b-8a8008fcd4a0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 2051 microversion: 2.25 time: 0.429650 Dec 25 21:08:55.120211 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 333/574] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:54 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 2051 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:55.125624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70b770aa-a1ca-4c03-9a8d-a6056933ab7f tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:55.127259 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:55.127259 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:55.129655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b770aa-a1ca-4c03-9a8d-a6056933ab7f tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.130644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b770aa-a1ca-4c03-9a8d-a6056933ab7f tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.131712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b770aa-a1ca-4c03-9a8d-a6056933ab7f tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.132394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b770aa-a1ca-4c03-9a8d-a6056933ab7f tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.195216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70b770aa-a1ca-4c03-9a8d-a6056933ab7f tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.073127 Dec 25 21:08:55.196237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 334/575] 10.222.0.32 () {60 vars in 1216 bytes} [Sat Dec 25 21:08:55 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:08:55.207842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:55.208684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:55.216324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.217144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.218187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.218844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.518919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:55.528486 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51d6bfb4-666f-47a3-b910-fdb1be8aa482 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.523879 Dec 25 21:08:55.531138 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 242/576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:55 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:55.551383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:55.552098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:55.568485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.570197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.571025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.571780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.634350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a122437-962e-4bff-9fe6-91d3cbcf3764 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e/action" status: 202 len: 0 microversion: 2.25 time: 0.430051 Dec 25 21:08:55.636258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 335/577] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:08:55 2021] POST /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:08:55.647422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:55.650683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:55.666149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.666981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:55.667988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:55.668603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:56.107262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:56.121014 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb467c20-4940-4ab0-af30-1e3c195e534b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.582716 Dec 25 21:08:56.121747 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 243/578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:55 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:56.126695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f48ab383-bfc4-49b0-aa0d-bd3cb5cba835 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75cf5e0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:56.255996 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f48ab383-bfc4-49b0-aa0d-bd3cb5cba835 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.131133 Dec 25 21:08:56.256800 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 244/579] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:56 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:56.262934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:08:56.271657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:56.272376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:56.284568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:56.285065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:56.287375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:56.288515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:56.330602 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f62bb4e-0a31-4303-8e58-bbee0ea04c01 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 2056 microversion: 2.25 time: 0.685347 Dec 25 21:08:56.335467 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 336/580] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:55 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 2056 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:56.395229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-65dec7c3-83e7-4f57-91d9-2b5b99018806 req-541bd3d7-ee58-4b53-8026-a9e936648e15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4cbf2d-cea7-4432-9264-6ac3fed9238d", "tag": "7c429c38-cf37-4881-8541-dad894677bf4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:56.398722 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:56.398722 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:56.443288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-65dec7c3-83e7-4f57-91d9-2b5b99018806 req-541bd3d7-ee58-4b53-8026-a9e936648e15 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:56.444775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-65dec7c3-83e7-4f57-91d9-2b5b99018806 req-541bd3d7-ee58-4b53-8026-a9e936648e15 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:56.514411 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-65dec7c3-83e7-4f57-91d9-2b5b99018806 req-541bd3d7-ee58-4b53-8026-a9e936648e15 service nova] Creating event network-changed:7c429c38-cf37-4881-8541-dad894677bf4 for instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d on nch2-master-1 Dec 25 21:08:56.529050 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-65dec7c3-83e7-4f57-91d9-2b5b99018806 req-541bd3d7-ee58-4b53-8026-a9e936648e15 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143703 Dec 25 21:08:56.529968 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 337/581] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:08:56.562851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:56.569224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:56.599448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:56.601079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:56.602080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:56.602901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:56.939080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:56.957746 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-927d44f0-f19f-4a15-8b1b-69bf91f3bac3 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.699315 Dec 25 21:08:56.958597 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 245/582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:56 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:57.133413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:57.144928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:57.151060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.151863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.154897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.155659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.273198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:57.284412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f15f1ada-bac1-48ea-ae8b-e73b3ad13ba5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.741635 Dec 25 21:08:57.294389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 338/583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:56 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:57.294955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e11ee262-322e-4440-818d-f776c4077ad3 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7769670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:57.372994 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e11ee262-322e-4440-818d-f776c4077ad3 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1428 microversion: 2.1 time: 0.081321 Dec 25 21:08:57.379733 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 339/584] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:57 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1428 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:57.385263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:57.386176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:57.392667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.393501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.394558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.395301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.419010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:57.429869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22261713-7a0e-4e21-993e-bfab8abfda62 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.301862 Dec 25 21:08:57.431310 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 246/585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:57 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:57.600983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:08:57.619010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f28f87ca-c772-4fae-bb38-eea94d1116ae tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 2036 microversion: 2.25 time: 0.237828 Dec 25 21:08:57.620182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 340/586] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:08:57 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 2036 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:08:57.639906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:57.644088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:57.654334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.655160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.656213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.658275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.696152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'flavor' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:08:57.709801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Going to try to live migrate instance to nch1-master-1 {{(pid=136547) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:08:57.841181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-68e36320-cedf-439a-9348-c5d1a6a4f263 req-1c86b52f-b3fe-4f89-b5a6-2791a24161e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083a54e8-8841-4d6e-b720-a0e06409e0d4", "name": "network-vif-plugged", "status": "completed", "tag": "2150b774-dd7c-4f45-910d-01e39333a0ce"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:08:57.844511 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:08:57.844511 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:08:57.875328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-68e36320-cedf-439a-9348-c5d1a6a4f263 req-1c86b52f-b3fe-4f89-b5a6-2791a24161e3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.877046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-68e36320-cedf-439a-9348-c5d1a6a4f263 req-1c86b52f-b3fe-4f89-b5a6-2791a24161e3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.897625 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-68e36320-cedf-439a-9348-c5d1a6a4f263 req-1c86b52f-b3fe-4f89-b5a6-2791a24161e3 service nova] Creating event network-vif-plugged:2150b774-dd7c-4f45-910d-01e39333a0ce for instance 083a54e8-8841-4d6e-b720-a0e06409e0d4 on nch2-master-1 Dec 25 21:08:57.908526 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-68e36320-cedf-439a-9348-c5d1a6a4f263 req-1c86b52f-b3fe-4f89-b5a6-2791a24161e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078037 Dec 25 21:08:57.911280 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 341/587] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:08:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:08:57.981411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:57.982333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:57.989660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.990110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:57.991074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:57.991511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:58.183661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:58.191947 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fefa2191-61b3-407b-bc90-d01d9760a5a5 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.216486 Dec 25 21:08:58.193191 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 342/588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:57 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:58.303560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:58.306426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:58.313029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:58.314204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:58.315239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:58.315841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:58.487481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:58.496752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b26c615e-e1b9-4d8b-a63d-8c01fa91ab92 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.197657 Dec 25 21:08:58.497654 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 343/589] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:58 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:08:58.503126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c444fec3-39f1-4272-8f4b-d57ba43d0fbb tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f751c0d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:58.553648 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c444fec3-39f1-4272-8f4b-d57ba43d0fbb tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1437 microversion: 2.1 time: 0.054633 Dec 25 21:08:58.554236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 344/590] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:58 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1437 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:58.558627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:58.559662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:58.565891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:58.566349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:58.567155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:58.567888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:58.754165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:58.763777 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9eb80240-3521-4d7f-a185-1264dbbebfdf tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.208520 Dec 25 21:08:58.773850 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 345/591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:58 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:58.780254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c86f8830-a159-4518-8e4a-074f9d7fef84 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f74f4160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:58.871733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c86f8830-a159-4518-8e4a-074f9d7fef84 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 200 len: 1437 microversion: 2.1 time: 0.094149 Dec 25 21:08:58.872826 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 346/592] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:08:58 2021] GET /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 1437 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:58.890202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:08:58.890202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:08:58.893665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:58.894369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:58.895397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:08:58.896057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:08:59.143052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:08:59.152282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f0ac41e-6d38-4c0e-a021-6903f860c89d tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1465 microversion: 2.1 time: 0.271616 Dec 25 21:08:59.153430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 347/593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:58 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1465 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:08:59.178606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efbff583-9ebb-4c4b-9b09-d5ef718e3ec3 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f7769af0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:01.094203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efbff583-9ebb-4c4b-9b09-d5ef718e3ec3 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "DELETE /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13" status: 204 len: 0 microversion: 2.1 time: 1.926038 Dec 25 21:09:01.096104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 348/594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:08:59 2021] DELETE /compute/v2.1/images/9d343933-7cd6-4767-85cd-16fbb0b2db13 => generated 0 bytes in 1929 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:09:01.104672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:01.105326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:01.112249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:01.113577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:01.114609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:01.115049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:01.314597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:01.330534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98855464-9f33-4e3e-bfc1-8c80b90b6421 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.232880 Dec 25 21:09:01.331122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 349/595] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:01 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:01.348183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:01.349120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:01.357144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:01.357838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:01.358651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:01.359095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:01.585636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:01.597360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-158fcd30-5fd5-4813-9041-0e59cc4b896d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.255716 Dec 25 21:09:01.599721 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 350/596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:01 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:01.780058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-435136693", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2332d558-39bb-411c-88af-b74bee7e32ab"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:01.842616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] validate_networks() for [('2332d558-39bb-411c-88af-b74bee7e32ab', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:02.297654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:02.297654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:02.297654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:02.297654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:02.297654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:02.299441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.299441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.299441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.299441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.300167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:02.300799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for user 9bf2eefd87de409785735fc802bc95ed and project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:02.314540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:02.317061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:02.319735 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4c55116-1a27-4587-80ab-1da68cc82ff7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e/action" status: 202 len: 0 microversion: 2.25 time: 4.685211 Dec 25 21:09:02.333498 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 247/597] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:08:57 2021] POST /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e/action => generated 0 bytes in 4700 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:02.348213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:02.348213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:02.360363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.360817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.361649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.362092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.493950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:02.503653 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d847b30-8ab5-4e2f-ba22-58e37e58b089 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.168631 Dec 25 21:09:02.516910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 248/598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:02 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:02.516910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-19c7c4f7-e90e-466d-a0c6-1af6623442bc req-5f2117a2-d3c9-477f-a69f-90a57b72a16a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7", "name": "network-vif-plugged", "status": "completed", "tag": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:02.516910 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:02.516910 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:02.517399 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a433bdda-07c9-46d0-adc5-af72515df826 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.911861 Dec 25 21:09:02.517399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 351/599] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:02.518037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-19c7c4f7-e90e-466d-a0c6-1af6623442bc req-5f2117a2-d3c9-477f-a69f-90a57b72a16a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.518673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-19c7c4f7-e90e-466d-a0c6-1af6623442bc req-5f2117a2-d3c9-477f-a69f-90a57b72a16a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.531116 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-19c7c4f7-e90e-466d-a0c6-1af6623442bc req-5f2117a2-d3c9-477f-a69f-90a57b72a16a service nova] Creating event network-vif-plugged:95f9468e-c1ab-4e1c-856f-19efb9ee29b8 for instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 on nch1-master-1 Dec 25 21:09:02.537995 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-19c7c4f7-e90e-466d-a0c6-1af6623442bc req-5f2117a2-d3c9-477f-a69f-90a57b72a16a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Dec 25 21:09:02.539213 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 249/600] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:02.595734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cff824f5-4456-488b-81f1-4ceedc602e93 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '.version_select at 0x7fa4f75d6d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:02.701667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-cff824f5-4456-488b-81f1-4ceedc602e93 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] HTTP exception thrown: Image not found. Dec 25 21:09:02.702567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cff824f5-4456-488b-81f1-4ceedc602e93 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:02.703622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cff824f5-4456-488b-81f1-4ceedc602e93 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "DELETE /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0" status: 404 len: 62 microversion: 2.1 time: 0.151566 Dec 25 21:09:02.704676 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 250/601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:02 2021] DELETE /compute/v2.1/images/561fe01c-9d9a-4ced-9964-8c4e7a5488a0 => generated 62 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:09:02.711025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:02.712238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:02.727247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.727987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.731333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:02.731978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:02.813850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b5551aed-91f5-4f56-924d-69d33a5944c5 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Action: 'create', calling method: .version_select at 0x7fa4fc14a9d0>, body: {"pool": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:03.542204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:03.550651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:03.552174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:03.553631 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a24fb87a-54f7-432d-8c98-2728b82eea63 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1568 microversion: 2.25 time: 0.847095 Dec 25 21:09:03.554162 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 251/602] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:02 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1568 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:03.560862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:03.561813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:03.570190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:03.570740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:03.572219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:03.572655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:03.991432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:04.003196 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c59b765-fb27-4995-a56e-97882ae07022 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1332 microversion: 2.1 time: 0.447745 Dec 25 21:09:04.012706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 252/603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:03 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1332 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:04.012706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:04.012985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:04.028514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.028514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.028514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.029064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.139336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:04.148762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2dcad353-f921-4ba4-b913-b306e236d116 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1214 microversion: 2.1 time: 0.142282 Dec 25 21:09:04.151653 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 253/604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:04 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1214 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:04.161133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:04.162108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:04.168663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.169481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.170723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.171729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.475344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:04.488605 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e68cbc1a-a2ef-48f3-adae-162fda5b187c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.335392 Dec 25 21:09:04.489526 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 254/605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:04 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:04.497976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:04.498838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:04.505236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.505687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.506518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.506951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.538909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:09:04.919685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1a07fdd-f768-4a76-80a2-adbab89c36c1 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "DELETE /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 204 len: 0 microversion: 2.1 time: 0.428670 Dec 25 21:09:04.924626 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 255/606] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:09:04 2021] DELETE /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:04.925720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:04.926418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:04.932178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.932632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:04.933441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:04.933880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:05.199662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:05.207616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad822aa5-17fc-4d10-b8ef-7914ec5c1b5f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.286005 Dec 25 21:09:05.208184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 256/607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:04 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:05.338346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d401c92-f5e1-4f48-9325-8c9a41f49a17 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '.version_select at 0x7fa4f75d6040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:05.406213 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d401c92-f5e1-4f48-9325-8c9a41f49a17 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf" status: 200 len: 371 microversion: 2.1 time: 0.196360 Dec 25 21:09:05.407352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 257/608] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:09:05 2021] GET /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf => generated 371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:05.412656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb762b4-175c-45df-b530-e2ac66bf96cf", "name": "network-vif-plugged", "status": "completed", "tag": "b5c53dfd-8507-4f31-ba6b-58c68d41b36b"}, {"server_uuid": "1a4cbf2d-cea7-4432-9264-6ac3fed9238d", "name": "network-vif-plugged", "status": "completed", "tag": "7c429c38-cf37-4881-8541-dad894677bf4"}, {"server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "name": "network-vif-unplugged", "status": "completed", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:05.415436 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:05.415436 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:05.426519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:05.426519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:05.440841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] Creating event network-vif-plugged:b5c53dfd-8507-4f31-ba6b-58c68d41b36b for instance bfb762b4-175c-45df-b530-e2ac66bf96cf on nch1-master-1 Dec 25 21:09:05.441447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] Creating event network-vif-plugged:7c429c38-cf37-4881-8541-dad894677bf4 for instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d on nch2-master-1 Dec 25 21:09:05.441945 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] Creating event network-vif-unplugged:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:09:05.454329 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2b8f6bfc-c8ca-4789-9c97-59b568bd0560 req-bdc8c7fe-1469-4cb9-85c6-308167336970 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.045149 Dec 25 21:09:05.455026 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 258/609] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:05.470948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:05.471663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:05.479697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:05.480420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:05.481260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:05.481885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:05.876089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:05.887875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:05.889639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:05.892058 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c13a46e-b8e8-45ed-aec2-7da912a4d855 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1568 microversion: 2.25 time: 0.432623 Dec 25 21:09:05.892058 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 259/610] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:05 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1568 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:05.896246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:05.896365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:05.902881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:05.903332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:05.904327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:05.904785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.263592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90d14ca3dbcf46d799645c342fc39b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbb59dcbd544ccfbcbb709c6fe1201a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:06.271238 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f5eba71-d5e3-429f-ae0e-60c80501af65 tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 200 len: 1471 microversion: 2.1 time: 0.378834 Dec 25 21:09:06.271914 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 260/611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:05 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 1471 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:06.276378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:06.277152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:06.283012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.283467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.287397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.287397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.324708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b5551aed-91f5-4f56-924d-69d33a5944c5 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.810247 Dec 25 21:09:06.325930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 352/612] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:09:02 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:06.330863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0aa981e4-6b70-4229-942f-43cd3fa2f06e req-6420957b-0133-4ed9-94d1-4433a4f8c5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370ad00-0f15-4014-99c2-3ecd6b33849e", "name": "network-vif-unplugged", "status": "completed", "tag": "9026d1d6-3da8-4905-baa7-966ecb80b10a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:06.332510 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:06.332510 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:06.340235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0aa981e4-6b70-4229-942f-43cd3fa2f06e req-6420957b-0133-4ed9-94d1-4433a4f8c5bd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.340678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0aa981e4-6b70-4229-942f-43cd3fa2f06e req-6420957b-0133-4ed9-94d1-4433a4f8c5bd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.351731 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0aa981e4-6b70-4229-942f-43cd3fa2f06e req-6420957b-0133-4ed9-94d1-4433a4f8c5bd service nova] Creating event network-vif-unplugged:9026d1d6-3da8-4905-baa7-966ecb80b10a for instance e370ad00-0f15-4014-99c2-3ecd6b33849e on nch2-master-1 Dec 25 21:09:06.357366 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0aa981e4-6b70-4229-942f-43cd3fa2f06e req-6420957b-0133-4ed9-94d1-4433a4f8c5bd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030155 Dec 25 21:09:06.358114 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 353/613] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:06 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:06.362634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:06.363322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:06.369734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.370185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.370976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.371400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.456394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:06.464209 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf27af0a-bc44-4a1f-b4e1-40d17aa0edce tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1268 microversion: 2.1 time: 0.105156 Dec 25 21:09:06.464780 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 354/614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:06 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1268 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:06.469293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0278931-cabd-470a-a7c1-a564c582d9f1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Action: 'update', calling method: .version_select at 0x7fa4fc14ac10>, body: {"quota_set": {"ram": "5120"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:06.471154 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:06.471154 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:06.534770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0278931-cabd-470a-a7c1-a564c582d9f1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.535254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0278931-cabd-470a-a7c1-a564c582d9f1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.536164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0278931-cabd-470a-a7c1-a564c582d9f1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.536600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0278931-cabd-470a-a7c1-a564c582d9f1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.663988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0278931-cabd-470a-a7c1-a564c582d9f1 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf" status: 200 len: 328 microversion: 2.1 time: 0.197873 Dec 25 21:09:06.665325 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 355/615] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:09:06 2021] PUT /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf => generated 328 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:06.669668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:06.670278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:06.676265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.676708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.677662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.678093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.789130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:06.796635 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7418a67-5a0f-4502-8b7a-abbe67ad8680 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1535 microversion: 2.1 time: 0.523537 Dec 25 21:09:06.808844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 261/616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:06 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1535 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:06.813555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:06.814179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:06.820618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.821884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.822689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:06.823128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:06.900328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:06.908457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c17d1d2c-14ec-4364-8db0-2660cabf611b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1387 microversion: 2.1 time: 0.242049 Dec 25 21:09:06.909633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 356/617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:06 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1387 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:06.918383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f935b58e-2216-4f11-bdae-5d5ae854ba37 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Action: 'create', calling method: .version_select at 0x7fa4f7498a60>, body: {"pool": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:07.128843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:07.136823 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e20212f7-fb9b-4192-974f-5b222e8cc26f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1319 microversion: 2.1 time: 0.326876 Dec 25 21:09:07.138106 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 262/618] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:06 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:07.144016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ab29802-6f6a-498d-b7f4-b6256e8a8e0a tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:07.145748 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:07.145748 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:07.227857 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ab29802-6f6a-498d-b7f4-b6256e8a8e0a tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf" status: 202 len: 0 microversion: 2.1 time: 0.087229 Dec 25 21:09:07.228564 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 263/619] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:09:07 2021] DELETE /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:07.234038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebbd7dc8-582b-4e29-b744-414c1c6f599c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'create', calling method: .version_select at 0x7fa4f75cf700>, body: {"pool": "7201e55c-7c5f-41aa-a042-a363696539d0"} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:10.105271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f935b58e-2216-4f11-bdae-5d5ae854ba37 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.192316 Dec 25 21:09:10.106224 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 357/620] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:09:06 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:10.111389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:10.112360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:10.120274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.120728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.123353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.123353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.300799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:10.309416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:10.310936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:10.312102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0fcf0a13-49e8-40f8-b968-c122ada7c0ce tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1568 microversion: 2.25 time: 0.205023 Dec 25 21:09:10.312642 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 358/621] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:10 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:10.317014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3cef8ab-93fc-4e0c-819d-3bcc0e1e642c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '.version_select at 0x7fa4f7533820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:10.385949 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3cef8ab-93fc-4e0c-819d-3bcc0e1e642c tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf" status: 200 len: 371 microversion: 2.1 time: 0.072207 Dec 25 21:09:10.387468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 359/622] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:09:10 2021] GET /compute/v2.1/os-quota-sets/ec2b69462262462791c19681f2da8acf => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:10.393206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:10.399297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] [instance: 27fc4723-405f-42eb-b2a5-d46301d13fd4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:10.402509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.403150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.405761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.407842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.422391 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebbd7dc8-582b-4e29-b744-414c1c6f599c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.191578 Dec 25 21:09:10.423745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 264/623] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:09:07 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:10.425181 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] HTTP exception thrown: Instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 could not be found. Dec 25 21:09:10.425972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] Returning 404 to user: Instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:10.427060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-185b622b-9e0a-4bcb-b70e-95116573e11c tempest-ImagesOneServerTestJSON-1420499622 tempest-ImagesOneServerTestJSON-1420499622-project] 10.222.0.32 "GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4" status: 404 len: 111 microversion: 2.1 time: 0.038243 Dec 25 21:09:10.431132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:10.438663 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 360/624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:10 2021] GET /compute/v2.1/servers/27fc4723-405f-42eb-b2a5-d46301d13fd4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:09:10.439137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:10.439229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-70d3a5f7-18a0-4777-beb6-cc625c6cc3e3 req-07fb61d4-f19c-41f8-880c-ea1f03d965fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27fc4723-405f-42eb-b2a5-d46301d13fd4", "name": "network-vif-deleted", "tag": "01f02470-98cd-4e53-8321-3a26d68c7daf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:10.439581 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:10.439581 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:10.440236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.440830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.441811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.442402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.448926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-70d3a5f7-18a0-4777-beb6-cc625c6cc3e3 req-07fb61d4-f19c-41f8-880c-ea1f03d965fd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.450369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-70d3a5f7-18a0-4777-beb6-cc625c6cc3e3 req-07fb61d4-f19c-41f8-880c-ea1f03d965fd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.467437 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-70d3a5f7-18a0-4777-beb6-cc625c6cc3e3 req-07fb61d4-f19c-41f8-880c-ea1f03d965fd service nova] Creating event network-vif-deleted:01f02470-98cd-4e53-8321-3a26d68c7daf for instance 27fc4723-405f-42eb-b2a5-d46301d13fd4 on nch2-master-1 Dec 25 21:09:10.472780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-70d3a5f7-18a0-4777-beb6-cc625c6cc3e3 req-07fb61d4-f19c-41f8-880c-ea1f03d965fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040291 Dec 25 21:09:10.474878 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 361/625] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:10.481254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:10.482090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:10.492614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.496721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.497847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.498411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.639180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:10.646843 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0fb9960b-071b-4648-8029-3c2fe3e48617 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1310 microversion: 2.1 time: 0.221560 Dec 25 21:09:10.647417 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 265/626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:10 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1310 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:10.652301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:10.652939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:10.661432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.668926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.668926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.668926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.766429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:10.766429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-128f079d-78ea-47a6-84af-abe09c13242b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1585 microversion: 2.1 time: 0.289729 Dec 25 21:09:10.777037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 362/627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:10 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1585 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:10.780553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-939b1d2f-5549-4d09-a898-90a7483f3c4d req-10174926-265b-484d-9559-84b92d3ab106 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e370ad00-0f15-4014-99c2-3ecd6b33849e", "tag": "9026d1d6-3da8-4905-baa7-966ecb80b10a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:10.782199 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:10.782199 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:10.789250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-939b1d2f-5549-4d09-a898-90a7483f3c4d req-10174926-265b-484d-9559-84b92d3ab106 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.789821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-939b1d2f-5549-4d09-a898-90a7483f3c4d req-10174926-265b-484d-9559-84b92d3ab106 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.801391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-939b1d2f-5549-4d09-a898-90a7483f3c4d req-10174926-265b-484d-9559-84b92d3ab106 service nova] Creating event network-changed:9026d1d6-3da8-4905-baa7-966ecb80b10a for instance e370ad00-0f15-4014-99c2-3ecd6b33849e on nch2-master-1 Dec 25 21:09:10.806736 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-939b1d2f-5549-4d09-a898-90a7483f3c4d req-10174926-265b-484d-9559-84b92d3ab106 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038729 Dec 25 21:09:10.807992 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 363/628] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:10.812855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05ecc5eb-0bd7-49d7-b66c-2695c354e004 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Action: 'create', calling method: .version_select at 0x7fa4f7533f70>, body: {"pool": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:10.908012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:10.916254 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06238810-67de-46f9-8edf-ae6c56c2468c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1469 microversion: 2.1 time: 0.267820 Dec 25 21:09:10.916831 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 266/629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:10 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1469 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:10.921391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'action', calling method: .version_select at 0x7fa4fd98f820>, body: {"addFloatingIp": {"address": "172.35.3.29"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:10.922487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:10.931231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.931684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:10.932478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:10.932946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:11.034080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Acquired lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:09:13.809805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Building network info cache for instance {{(pid=136547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:09:14.374597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05ecc5eb-0bd7-49d7-b66c-2695c354e004 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.564093 Dec 25 21:09:14.381515 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 364/630] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:09:10 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:14.382454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c49bed84-9f76-4bad-ae92-27095becb010 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '.version_select at 0x7fa4f75610d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:14.615101 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c49bed84-9f76-4bad-ae92-27095becb010 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.239036 Dec 25 21:09:14.618042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Updating instance_info_cache with network_info: [{"id": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8", "address": "fa:16:3e:52:70:7a", "network": {"id": "d11a6d20-7c9e-4651-a65c-c60d3931cc4e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-676909578-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e65cafc179094f63bf88bfba4c57fd1f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap95f9468e-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:09:14.621103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 365/631] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:09:14 2021] GET /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22/defaults => generated 371 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:14.628941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:14.629771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:14.637758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:14.638400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:14.639540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:14.640133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:14.733986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af90e411-bedd-4f7b-82ac-b3481e938d54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111586 Dec 25 21:09:14.734618 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 366/632] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:09:14 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:14.739150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:14.739758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:14.746096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:14.746687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:14.747492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:14.748104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:14.748408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Releasing lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:09:14.749481 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4394a6a-41a4-4aee-938e-f2d171b93ff8 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action" status: 202 len: 0 microversion: 2.1 time: 3.831445 Dec 25 21:09:14.750186 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 267/633] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:10 2021] POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action => generated 0 bytes in 3833 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:09:14.756857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:14.762621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:14.767465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:14.768174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:14.769201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:14.769827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:15.021852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:15.031832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:15.034646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:15.035839 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-012c6637-5ec1-4eec-a04e-27601c679e8e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1543 microversion: 2.25 time: 0.284249 Dec 25 21:09:15.037526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:15.047923 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 268/634] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:14 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1543 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:15.050415 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b81e52d8-79e8-467c-94cb-e47d162ffaf7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 200 len: 1468 microversion: 2.1 time: 0.312877 Dec 25 21:09:15.053628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:15.054342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:15.060904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:15.061843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:15.061964 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 367/635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:14 2021] GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 1468 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:15.063052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:15.063693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:15.207118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:15.218483 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78f49f38-7063-4393-a452-aea8759da0fb tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1310 microversion: 2.1 time: 0.169289 Dec 25 21:09:15.220427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 269/636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:15 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1310 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:15.226031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d60ca424-7249-4883-91cf-c9d21aaa1695 req-a50f480b-8a36-4231-82bd-65a9f393910a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe", "tag": "d3279f41-5733-434c-babe-c0306203f4fa"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:15.228150 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:15.228150 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:15.238516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d60ca424-7249-4883-91cf-c9d21aaa1695 req-a50f480b-8a36-4231-82bd-65a9f393910a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:15.239129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d60ca424-7249-4883-91cf-c9d21aaa1695 req-a50f480b-8a36-4231-82bd-65a9f393910a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:15.251997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d60ca424-7249-4883-91cf-c9d21aaa1695 req-a50f480b-8a36-4231-82bd-65a9f393910a service nova] Creating event network-changed:d3279f41-5733-434c-babe-c0306203f4fa for instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe on nch1-master-1 Dec 25 21:09:15.257303 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d60ca424-7249-4883-91cf-c9d21aaa1695 req-a50f480b-8a36-4231-82bd-65a9f393910a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Dec 25 21:09:15.258779 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 270/637] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:15.264052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae8867f6-460d-4423-8281-adf0c5e2c9de tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Action: 'create', calling method: .version_select at 0x7fa4fc252040>, body: {"pool": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:15.270284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ec6f88e-71ce-4866-b1f1-3d6d72b0023d tempest-ListImagesTestJSON-1330468597 tempest-ListImagesTestJSON-1330468597-project] Calling method '.version_select at 0x7fa4f7533e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:15.322718 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ec6f88e-71ce-4866-b1f1-3d6d72b0023d tempest-ListImagesTestJSON-1330468597 tempest-ListImagesTestJSON-1330468597-project] 10.222.0.32 "GET /compute/v2.1/images/aca914d0-5f7b-465f-a024-75efa27d7291" status: 200 len: 784 microversion: 2.1 time: 0.259367 Dec 25 21:09:15.331243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 368/638] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:09:15 2021] GET /compute/v2.1/images/aca914d0-5f7b-465f-a024-75efa27d7291 => generated 784 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:15.337717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b1272f2-62a8-4253-8302-8bc2b804d468 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'create', calling method: .version_select at 0x7fa4f74699d0>, body: {"pool": "7201e55c-7c5f-41aa-a042-a363696539d0"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:17.840109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae8867f6-460d-4423-8281-adf0c5e2c9de tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.579935 Dec 25 21:09:17.840933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 271/639] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:09:15 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:17.850667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6241c4ca-02f8-46cc-9036-a15b2841f38d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f75d6af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:17.853085 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:17.853085 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:17.924986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6241c4ca-02f8-46cc-9036-a15b2841f38d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:17.925503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6241c4ca-02f8-46cc-9036-a15b2841f38d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:17.926318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6241c4ca-02f8-46cc-9036-a15b2841f38d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:17.926766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6241c4ca-02f8-46cc-9036-a15b2841f38d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.092373 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6241c4ca-02f8-46cc-9036-a15b2841f38d tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37" status: 200 len: 328 microversion: 2.1 time: 0.245046 Dec 25 21:09:18.092948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 272/640] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:09:17 2021] PUT /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37 => generated 328 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.097210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-872c5e7b-aa49-4894-a137-7545f8905cbf tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '.version_select at 0x7fa4f751f4c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.098405 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:18.098405 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:18.099835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872c5e7b-aa49-4894-a137-7545f8905cbf tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.100265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872c5e7b-aa49-4894-a137-7545f8905cbf tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.114842 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-872c5e7b-aa49-4894-a137-7545f8905cbf tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 856 microversion: 2.25 time: 0.020880 Dec 25 21:09:18.115437 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 273/641] 10.222.0.32 () {60 vars in 1183 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/os-migrations => generated 856 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:18.119662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.123178 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:18.123178 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:18.124197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:18.125092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Searching by: {'reservation_id': 'r-240aqqxa', 'deleted': False, 'project_id': '19a16dcc3c214ac2a218d3758e551792'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:09:18.130389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.130835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.131650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.132083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.183028 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b1272f2-62a8-4253-8302-8bc2b804d468 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.850086 Dec 25 21:09:18.189187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 369/642] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:09:15 2021] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.189861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01537921-b956-45d2-98f5-f477176432ee tempest-ListImagesTestJSON-1330468597 tempest-ListImagesTestJSON-1330468597-project] Calling method '.version_select at 0x7fa4f74f4b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.227127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:09:18.262701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01537921-b956-45d2-98f5-f477176432ee tempest-ListImagesTestJSON-1330468597 tempest-ListImagesTestJSON-1330468597-project] 10.222.0.32 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.077627 Dec 25 21:09:18.263258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 370/643] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/images => generated 445 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.274282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fded226f-4b44-4bc2-94c9-bf8a4ba31e18 req-c82e46a6-e777-4154-be62-29c5883d2281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe", "name": "network-vif-plugged", "status": "completed", "tag": "d3279f41-5733-434c-babe-c0306203f4fa"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:18.275843 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:18.275843 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:18.282663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fded226f-4b44-4bc2-94c9-bf8a4ba31e18 req-c82e46a6-e777-4154-be62-29c5883d2281 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.283135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fded226f-4b44-4bc2-94c9-bf8a4ba31e18 req-c82e46a6-e777-4154-be62-29c5883d2281 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.293332 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fded226f-4b44-4bc2-94c9-bf8a4ba31e18 req-c82e46a6-e777-4154-be62-29c5883d2281 service nova] Creating event network-vif-plugged:d3279f41-5733-434c-babe-c0306203f4fa for instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe on nch1-master-1 Dec 25 21:09:18.297585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:18.298078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fded226f-4b44-4bc2-94c9-bf8a4ba31e18 req-c82e46a6-e777-4154-be62-29c5883d2281 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027918 Dec 25 21:09:18.298653 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 371/644] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.303301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.303976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:18.304465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.304973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.309815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.310264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.311037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.311501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.547088 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e040e36-bdff-41cf-ace1-5a79b7dd9030 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?reservation_id=r-240aqqxa" status: 200 len: 2930 microversion: 2.1 time: 0.430609 Dec 25 21:09:18.547767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 274/645] 10.222.0.32 () {58 vars in 1196 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/servers/detail?reservation_id=r-240aqqxa => generated 2930 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:18.559829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:18.559829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:18.561388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.561843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.562636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.563075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.563847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:18.571910 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-38266300-0915-4f87-919c-d49b319ca136 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1310 microversion: 2.1 time: 0.272090 Dec 25 21:09:18.572496 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 372/646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1310 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:18.579052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e281f597-86dc-40fb-939e-eb58e3871f5f req-3236d1bc-3879-43ca-9647-ce5af203774a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a4cbf2d-cea7-4432-9264-6ac3fed9238d", "tag": "7c429c38-cf37-4881-8541-dad894677bf4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:18.580651 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:18.580651 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:18.587613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e281f597-86dc-40fb-939e-eb58e3871f5f req-3236d1bc-3879-43ca-9647-ce5af203774a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.588089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e281f597-86dc-40fb-939e-eb58e3871f5f req-3236d1bc-3879-43ca-9647-ce5af203774a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.599894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e281f597-86dc-40fb-939e-eb58e3871f5f req-3236d1bc-3879-43ca-9647-ce5af203774a service nova] Creating event network-changed:7c429c38-cf37-4881-8541-dad894677bf4 for instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d on nch2-master-1 Dec 25 21:09:18.605224 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e281f597-86dc-40fb-939e-eb58e3871f5f req-3236d1bc-3879-43ca-9647-ce5af203774a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031547 Dec 25 21:09:18.606004 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 373/647] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.611973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-66caed18-375d-4701-a42f-e1c542d5c5fc req-ff64e14c-1081-4d8b-aab9-436ae92b07b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7", "tag": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:18.617661 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:18.617661 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:18.622894 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b034226-b58f-48a7-a591-21c4345790ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 14 microversion: 2.1 time: 0.073768 Dec 25 21:09:18.626507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 275/648] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:18 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:09:18.626684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-66caed18-375d-4701-a42f-e1c542d5c5fc req-ff64e14c-1081-4d8b-aab9-436ae92b07b0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.626684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-66caed18-375d-4701-a42f-e1c542d5c5fc req-ff64e14c-1081-4d8b-aab9-436ae92b07b0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.628631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-90553470-dead-4db0-b717-99f4c3a72c9c tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f73e69d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.639466 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-66caed18-375d-4701-a42f-e1c542d5c5fc req-ff64e14c-1081-4d8b-aab9-436ae92b07b0 service nova] Creating event network-changed:95f9468e-c1ab-4e1c-856f-19efb9ee29b8 for instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 on nch1-master-1 Dec 25 21:09:18.644510 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-66caed18-375d-4701-a42f-e1c542d5c5fc req-ff64e14c-1081-4d8b-aab9-436ae92b07b0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036799 Dec 25 21:09:18.645604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 374/649] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.651261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a4acf26-53cf-4b3e-9321-4bf7198c2e22 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '.version_select at 0x7fa4f74e4310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.721793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a4acf26-53cf-4b3e-9321-4bf7198c2e22 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.722237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a4acf26-53cf-4b3e-9321-4bf7198c2e22 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.723042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a4acf26-53cf-4b3e-9321-4bf7198c2e22 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.723668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a4acf26-53cf-4b3e-9321-4bf7198c2e22 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.744043 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a4acf26-53cf-4b3e-9321-4bf7198c2e22 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37/detail" status: 200 len: 916 microversion: 2.1 time: 0.097200 Dec 25 21:09:18.749035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 375/650] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37/detail => generated 916 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.758147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:18.759681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:18.768333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.768959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.771068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.772258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.822751 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-90553470-dead-4db0-b717-99f4c3a72c9c tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/5427fa91-1403-4afc-ba17-982dc99a5f3c" status: 200 len: 141 microversion: 2.1 time: 0.197778 Dec 25 21:09:18.823626 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 276/651] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/os-floating-ips/5427fa91-1403-4afc-ba17-982dc99a5f3c => generated 141 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:18.833930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.64"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:18.834975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:18.842980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.843651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.844472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:18.845007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:18.875024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Acquired lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:09:19.115211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:09:19.128123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43b71f39-5ca9-4ac6-aa8f-7eb790c323f7 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 2036 microversion: 2.25 time: 0.377630 Dec 25 21:09:19.136465 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 376/652] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:18 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 2036 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:19.143929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4263ecfc-de38-4bf7-aaa1-610cad27d59b tempest-ListImagesTestJSON-1330468597 tempest-ListImagesTestJSON-1330468597-project] Calling method '.version_select at 0x7fa4f740caf0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:19.196509 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4263ecfc-de38-4bf7-aaa1-610cad27d59b tempest-ListImagesTestJSON-1330468597 tempest-ListImagesTestJSON-1330468597-project] 10.222.0.32 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.058216 Dec 25 21:09:19.205128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 377/653] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:09:19 2021] GET /compute/v2.1/images/detail => generated 787 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:19.211487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce0be084-635b-4ebb-ac49-c7cd9be88f84 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:19.231070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_groups [None req-ce0be084-635b-4ebb-ac49-c7cd9be88f84 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Querying cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) for 2 instances {{(pid=136548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 25 21:09:19.232157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce0be084-635b-4ebb-ac49-c7cd9be88f84 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:19.232598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce0be084-635b-4ebb-ac49-c7cd9be88f84 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:19.260644 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce0be084-635b-4ebb-ac49-c7cd9be88f84 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/e7fc432d-11f1-400d-bcc5-e158a802484b" status: 200 len: 271 microversion: 2.1 time: 0.054167 Dec 25 21:09:19.266738 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 378/654] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:19 2021] GET /compute/v2.1/os-server-groups/e7fc432d-11f1-400d-bcc5-e158a802484b => generated 271 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:19.272421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8121fc15-09ff-4656-9d6d-85ca021b6eca tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f74d28b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:19.650063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.3.64 (4e068485-b31a-41b3-ab06-94a0e90c42b4) with port 95f9468e-c1ab-4e1c-856f-19efb9ee29b8 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 7201e55c-7c5f-41aa-a042-a363696539d0.", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:09:19.650758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Releasing lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:09:19.651399 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] HTTP exception thrown: Cannot associate floating IP 172.35.3.64 (4e068485-b31a-41b3-ab06-94a0e90c42b4) with port 95f9468e-c1ab-4e1c-856f-19efb9ee29b8 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 7201e55c-7c5f-41aa-a042-a363696539d0. Dec 25 21:09:19.651399 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-42102e5c-d0c7-47fa-b4c4-04ad4d3266bd'] Dec 25 21:09:19.652133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Returning 400 to user: Cannot associate floating IP 172.35.3.64 (4e068485-b31a-41b3-ab06-94a0e90c42b4) with port 95f9468e-c1ab-4e1c-856f-19efb9ee29b8 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network 7201e55c-7c5f-41aa-a042-a363696539d0. Dec 25 21:09:19.652133 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-42102e5c-d0c7-47fa-b4c4-04ad4d3266bd'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:19.653145 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c49d0a28-083d-45d9-8d07-3dccf0974d19 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action" status: 400 len: 380 microversion: 2.1 time: 0.823163 Dec 25 21:09:19.662514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 277/655] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:18 2021] POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action => generated 380 bytes in 835 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:09:19.668517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f738d0d0>, body: {"quota_set": {"ram": "2048"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:19.670390 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:19.670390 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:19.893327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:19.893920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:19.894633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:19.895077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:19.931257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:19.931966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:19.932781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:19.933240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:20.109388 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1edcbf8-4c03-4b9b-9642-234bae872a58 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37?user_id=7c13eeb416894ee8abaf242537f66dc8" status: 200 len: 328 microversion: 2.1 time: 0.448779 Dec 25 21:09:20.115247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 278/656] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:09:19 2021] PUT /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37?user_id=7c13eeb416894ee8abaf242537f66dc8 => generated 328 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:20.115247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:20.115247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:20.122018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:20.122472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:20.126171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:20.126171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:20.390615 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5483e7d6-7e9a-47f2-bb1b-65e2dad56b39 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 200 len: 1620 microversion: 2.1 time: 0.279404 Dec 25 21:09:20.391290 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 279/657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:20 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 1620 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:20.404813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-442453570", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "1e137e86-76be-493f-9b25-1d17756925b5"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:20.466705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] validate_networks() for [('1e137e86-76be-493f-9b25-1d17756925b5', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:20.941126 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8121fc15-09ff-4656-9d6d-85ca021b6eca tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/5427fa91-1403-4afc-ba17-982dc99a5f3c" status: 202 len: 0 microversion: 2.1 time: 1.672752 Dec 25 21:09:20.946653 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 379/658] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:19 2021] DELETE /compute/v2.1/os-floating-ips/5427fa91-1403-4afc-ba17-982dc99a5f3c => generated 0 bytes in 1675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:20.950044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:20.950658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:20.957791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:20.958470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:20.959461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:20.960029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.037482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:21.037968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:21.038573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:21.039642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:21.040131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:21.048830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:21.049396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.050303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:21.050840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.071181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:21.075541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for user 2cb2a59c7c9b4a13964c78ff0fb1a8f4 and project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:21.088038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:21.090651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:21.113322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:21.122216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83e8afa9-889b-4a43-ba1a-fb347672832c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1494 microversion: 2.1 time: 0.178950 Dec 25 21:09:21.123067 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 380/659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:20 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1494 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:21.129194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:21.130287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:21.136285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:21.137092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.138023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:21.141086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.192954 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b1635d4-79af-4032-adc6-309bf9e5e9f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 8205 microversion: 2.1 time: 0.068769 Dec 25 21:09:21.193574 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 381/660] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:21 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 8205 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:21.198734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b886ecec-931a-46fd-8375-0af7a5c92254 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '.version_select at 0x7fa4f7469310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:21.213462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a176053-257a-41bb-ad37-d218a40fcafe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.821084 Dec 25 21:09:21.214321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 280/661] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:09:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:09:21.218805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-403d8286-87a0-46a9-946f-0d51863d0e04 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '.version_select at 0x7fa4f73f0430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:21.518447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-403d8286-87a0-46a9-946f-0d51863d0e04 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37?user_id=7c13eeb416894ee8abaf242537f66dc8" status: 200 len: 370 microversion: 2.1 time: 0.302913 Dec 25 21:09:21.519034 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 281/662] 10.222.0.32 () {58 vars in 1322 bytes} [Sat Dec 25 21:09:21 2021] GET /compute/v2.1/os-quota-sets/0870cfe8b19c4e2cb4d1455e21067c37?user_id=7c13eeb416894ee8abaf242537f66dc8 => generated 370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:21.524073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:21.524889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:21.531039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:21.531668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.532615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:21.533232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:21.758309 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-109f5d93-b11b-4046-a614-f975928475d5 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 200 len: 1619 microversion: 2.1 time: 0.237549 Dec 25 21:09:21.758873 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 282/663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:21 2021] GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 1619 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:21.763350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed1eff99-58a0-4b7d-ad03-c1a18b4e7eb8 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f73f0e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:22.028555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed1eff99-58a0-4b7d-ad03-c1a18b4e7eb8 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.268272 Dec 25 21:09:22.029640 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 283/664] 10.222.0.32 () {58 vars in 1163 bytes} [Sat Dec 25 21:09:21 2021] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:09:22.209952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:22.210645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:22.216636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.217154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.217931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.218368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.379619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b886ecec-931a-46fd-8375-0af7a5c92254 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/4e068485-b31a-41b3-ab06-94a0e90c42b4" status: 202 len: 0 microversion: 2.1 time: 1.184849 Dec 25 21:09:22.380206 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 382/665] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:21 2021] DELETE /compute/v2.1/os-floating-ips/4e068485-b31a-41b3-ab06-94a0e90c42b4 => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:22.385957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:22.386717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:22.392910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.393375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.394155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.394584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.420738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d435a57f-4dab-415f-b30a-138cbabf5dd2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1645 microversion: 2.1 time: 0.389997 Dec 25 21:09:22.421336 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 284/666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:22 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1645 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:22.455226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:22.463590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:22.465164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:22.466271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ccecc9c1-eba9-4e80-a398-f7e04c1f83f8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1265 microversion: 2.25 time: 0.085140 Dec 25 21:09:22.466859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 383/667] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:22 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:22.471550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1715627903", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1b814523-70ff-4cb2-b14c-f77ae086c04f"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:22.526899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:22.597898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6aae9f2-a035-46d7-8f13-53fd565ff4e3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f73fe0d0>, body: {"keypair": {"name": "tempest-keypair-788266551"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:22.613284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f6aae9f2-a035-46d7-8f13-53fd565ff4e3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:22.618524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f6aae9f2-a035-46d7-8f13-53fd565ff4e3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:22.751854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:22.752275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:22.752978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:22.753419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:22.754012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:22.762804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.763439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.764249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.764673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.789838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:22.794235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:22.805646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:22.807991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:22.896451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f6aae9f2-a035-46d7-8f13-53fd565ff4e3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:22.900636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f6aae9f2-a035-46d7-8f13-53fd565ff4e3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:22.913351 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6aae9f2-a035-46d7-8f13-53fd565ff4e3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.2 time: 0.491074 Dec 25 21:09:22.914556 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 285/668] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:22 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 493 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:22.918899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-45ade6bb-298d-46b4-8dce-4baeb8353e91 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f73bc700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:22.948330 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08be5e23-49fd-48a7-b2f9-2f00e99e150c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480392 Dec 25 21:09:22.949815 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 384/669] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:22 2021] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:22.963763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:22.965226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:22.971326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.971938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:22.973155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:22.973534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:23.025068 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a912593c-ab67-44a4-955c-c27482c6007c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 16394 microversion: 2.1 time: 0.069672 Dec 25 21:09:23.029137 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 385/670] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:22 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 16394 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:23.031444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a80efaaa-8f98-4647-ac6b-3f45a0eb6570 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Calling method '.version_select at 0x7fa4f7469a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:23.142583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-45ade6bb-298d-46b4-8dce-4baeb8353e91 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips" status: 200 len: 398 microversion: 2.1 time: 0.226583 Dec 25 21:09:23.144065 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 286/671] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:09:22 2021] GET /compute/v2.1/os-floating-ips => generated 398 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:23.153327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'action', calling method: .version_select at 0x7fa4fd98f700>, body: {"removeFloatingIp": {"address": "172.35.3.29"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:23.171087 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a80efaaa-8f98-4647-ac6b-3f45a0eb6570 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22/defaults" status: 200 len: 371 microversion: 2.1 time: 0.143524 Dec 25 21:09:23.171677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 386/672] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:09:23 2021] GET /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22/defaults => generated 371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:23.176327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:23.177742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:23.184519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:23.184997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:23.185779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:23.186210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:23.327684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:23.334159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:23.334727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:23.335590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:23.336769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:23.378120 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-edc6a4f2-75a1-4d20-86d8-f7353244ad00 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1645 microversion: 2.1 time: 0.205390 Dec 25 21:09:23.379312 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 387/673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:23 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1645 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:23.385777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-763fa844-89e4-4661-bd3b-e9a0c3370858 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f740c670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:23.395496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-763fa844-89e4-4661-bd3b-e9a0c3370858 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-788266551" status: 200 len: 705 microversion: 2.2 time: 0.014838 Dec 25 21:09:23.396548 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 388/674] 10.222.0.32 () {60 vars in 1254 bytes} [Sat Dec 25 21:09:23 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-788266551 => generated 705 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:23.403627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4aceb10-edbf-4e39-8b77-024f8e7f28a4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:23.404466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e4aceb10-edbf-4e39-8b77-024f8e7f28a4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:23.710203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e4aceb10-edbf-4e39-8b77-024f8e7f28a4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:23.717268 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e4aceb10-edbf-4e39-8b77-024f8e7f28a4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1217 microversion: 2.1 time: 0.319433 Dec 25 21:09:23.727083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 389/675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:23 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:23.737946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3834187d-cdcb-46ab-86f8-b01c7cae627d tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f74e4dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:23.880183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Acquired lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:09:25.018798 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3834187d-cdcb-46ab-86f8-b01c7cae627d tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/d0a8cdb0-0587-4498-8e60-0bcf6dc5278c" status: 202 len: 0 microversion: 2.1 time: 1.290536 Dec 25 21:09:25.019399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 390/676] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:23 2021] DELETE /compute/v2.1/os-floating-ips/d0a8cdb0-0587-4498-8e60-0bcf6dc5278c => generated 0 bytes in 1292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:25.024678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-290be5c4-6e4e-49e8-a8d3-90f9f984f2a9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f741cee0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:25.027435 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:25.027435 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:25.029511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Building network info cache for instance {{(pid=136547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:09:25.113116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-290be5c4-6e4e-49e8-a8d3-90f9f984f2a9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:25.114907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-290be5c4-6e4e-49e8-a8d3-90f9f984f2a9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:25.116407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-290be5c4-6e4e-49e8-a8d3-90f9f984f2a9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:25.117722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-290be5c4-6e4e-49e8-a8d3-90f9f984f2a9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:25.783113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Updating instance_info_cache with network_info: [{"id": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8", "address": "fa:16:3e:52:70:7a", "network": {"id": "d11a6d20-7c9e-4651-a65c-c60d3931cc4e", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-676909578-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e65cafc179094f63bf88bfba4c57fd1f", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap95f9468e-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:09:25.926288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Releasing lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:09:25.931019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-548da7c6-b33a-4ab7-b88d-f952efff8e2b tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action" status: 202 len: 0 microversion: 2.1 time: 2.784231 Dec 25 21:09:25.936221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 287/677] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:23 2021] POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action => generated 0 bytes in 2791 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:09:25.942032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-198ef402-fc5c-49a1-b571-11d5556677b7 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:25.944127 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:25.944127 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:25.947863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-198ef402-fc5c-49a1-b571-11d5556677b7 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:25.948509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-198ef402-fc5c-49a1-b571-11d5556677b7 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:25.951991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-198ef402-fc5c-49a1-b571-11d5556677b7 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:25.952687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-198ef402-fc5c-49a1-b571-11d5556677b7 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:25.985382 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-198ef402-fc5c-49a1-b571-11d5556677b7 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.046809 Dec 25 21:09:25.986904 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 288/678] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:09:25 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:25.998181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a485031-adc5-4e4b-ba89-66326b14cb3d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f7363310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:26.225482 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a485031-adc5-4e4b-ba89-66326b14cb3d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788266551" status: 204 len: 0 microversion: 2.2 time: 0.236627 Dec 25 21:09:26.226134 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 289/679] 10.222.0.32 () {60 vars in 1257 bytes} [Sat Dec 25 21:09:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788266551 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:26.231841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:26.232466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:26.240553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:26.241118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:26.242518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:26.243158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:26.548362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:26.556840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:26.558402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:26.559968 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a0ab189-7f8c-4ed9-9bf7-7bdb432bc809 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1361 microversion: 2.25 time: 0.331704 Dec 25 21:09:26.560077 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 290/680] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:26 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:26.566906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:26.567915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:26.574155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:26.574979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:26.575766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:26.576270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:26.636736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-428117e0-2131-4625-8f56-36e70b03db86 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.075480 Dec 25 21:09:26.637428 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 291/681] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:26 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:26.642504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:26.643226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:26.650684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:26.651144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:26.651927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:26.652370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:26.713204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:26.720805 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-866ca847-524d-4b9b-bcc0-a64330df965b tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1275 microversion: 2.1 time: 0.082178 Dec 25 21:09:26.730717 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 292/682] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:26 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1275 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:26.730717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-595e2e7f-1f61-4391-93e2-e5b560491ba0 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f73631f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:26.997858 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-290be5c4-6e4e-49e8-a8d3-90f9f984f2a9 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22" status: 200 len: 329 microversion: 2.1 time: 1.977213 Dec 25 21:09:27.004194 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 391/683] 10.222.0.32 () {60 vars in 1262 bytes} [Sat Dec 25 21:09:25 2021] PUT /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22 => generated 329 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:27.010789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-75c9ca48-6c9f-4412-833a-66d1d31bbc54 req-09b51fa5-baf8-4eee-9b6e-380794d1dc8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7", "tag": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:27.012462 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:27.012462 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:27.022501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-75c9ca48-6c9f-4412-833a-66d1d31bbc54 req-09b51fa5-baf8-4eee-9b6e-380794d1dc8c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:27.022501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-75c9ca48-6c9f-4412-833a-66d1d31bbc54 req-09b51fa5-baf8-4eee-9b6e-380794d1dc8c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:27.035151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-75c9ca48-6c9f-4412-833a-66d1d31bbc54 req-09b51fa5-baf8-4eee-9b6e-380794d1dc8c service nova] Creating event network-changed:95f9468e-c1ab-4e1c-856f-19efb9ee29b8 for instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 on nch1-master-1 Dec 25 21:09:27.040991 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-75c9ca48-6c9f-4412-833a-66d1d31bbc54 req-09b51fa5-baf8-4eee-9b6e-380794d1dc8c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035029 Dec 25 21:09:27.042394 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 392/684] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:27.049191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fb8d5db0-e084-413f-9b3f-4d3fd1ed3a49 req-3454d840-61b2-4fe6-b3f3-35acadcc642e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34088aa4-5622-46a6-a155-94ef62f87546", "tag": "1f34074e-0a6d-4eef-a7d5-cef1f7f400f3"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:27.050769 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:27.050769 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:27.058578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fb8d5db0-e084-413f-9b3f-4d3fd1ed3a49 req-3454d840-61b2-4fe6-b3f3-35acadcc642e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:27.059391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fb8d5db0-e084-413f-9b3f-4d3fd1ed3a49 req-3454d840-61b2-4fe6-b3f3-35acadcc642e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:27.072766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fb8d5db0-e084-413f-9b3f-4d3fd1ed3a49 req-3454d840-61b2-4fe6-b3f3-35acadcc642e service nova] Creating event network-changed:1f34074e-0a6d-4eef-a7d5-cef1f7f400f3 for instance 34088aa4-5622-46a6-a155-94ef62f87546 on nch2-master-1 Dec 25 21:09:27.078007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fb8d5db0-e084-413f-9b3f-4d3fd1ed3a49 req-3454d840-61b2-4fe6-b3f3-35acadcc642e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034205 Dec 25 21:09:27.078790 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 393/685] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:27.083798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54d1b3b4-9233-48a9-9660-331f176aa938 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '.version_select at 0x7fa4f7526b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:29.080266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-595e2e7f-1f61-4391-93e2-e5b560491ba0 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/641013fa-b2b2-4fbf-baab-83d883d67653" status: 202 len: 0 microversion: 2.1 time: 2.356457 Dec 25 21:09:29.082028 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 293/686] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:26 2021] DELETE /compute/v2.1/os-floating-ips/641013fa-b2b2-4fbf-baab-83d883d67653 => generated 0 bytes in 2359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:29.089506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:29.090721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:29.100020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:29.100020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:29.100020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:29.100020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:29.123523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lazy-loading 'flavor' on Instance uuid c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:09:29.135477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Going to try to live migrate instance to nch2-master-1 {{(pid=136547) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:09:29.427283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54d1b3b4-9233-48a9-9660-331f176aa938 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/f5d3ff9b-b4b6-4c3d-9bb6-a6de61cb3b0e" status: 202 len: 0 microversion: 2.1 time: 2.346326 Dec 25 21:09:29.428171 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 394/687] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:27 2021] DELETE /compute/v2.1/os-floating-ips/f5d3ff9b-b4b6-4c3d-9bb6-a6de61cb3b0e => generated 0 bytes in 2349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:29.435586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00f84510-b9f4-471d-bd78-f1cbc38c70cc tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f741cc10>, body: {"keypair": {"name": "tempest-keypair-1484837731"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:29.460001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-00f84510-b9f4-471d-bd78-f1cbc38c70cc tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:29.465322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-00f84510-b9f4-471d-bd78-f1cbc38c70cc tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:29.916248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-00f84510-b9f4-471d-bd78-f1cbc38c70cc tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:29.920108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-00f84510-b9f4-471d-bd78-f1cbc38c70cc tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:29.933563 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00f84510-b9f4-471d-bd78-f1cbc38c70cc tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.503874 Dec 25 21:09:29.934077 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 395/688] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:29 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 505 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:29.938517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-19832f22-70a1-4ed1-9236-1f27c86b3c09 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f7498b80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:29.940672 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:29.940672 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:30.003171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19832f22-70a1-4ed1-9236-1f27c86b3c09 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:30.003613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19832f22-70a1-4ed1-9236-1f27c86b3c09 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:30.004505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19832f22-70a1-4ed1-9236-1f27c86b3c09 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:30.005051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19832f22-70a1-4ed1-9236-1f27c86b3c09 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.516519 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34887ddf-3845-44c7-80c7-842564ffa622 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe/action" status: 202 len: 0 microversion: 2.1 time: 2.431178 Dec 25 21:09:31.517272 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 294/689] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:29 2021] POST /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe/action => generated 0 bytes in 2433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:31.521636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:31.522230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:31.528752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:31.529230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.530005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:31.530435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.669142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:31.676920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:31.678614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:31.680322 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-551e92db-3184-4ca9-b065-58af08ded86e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1361 microversion: 2.25 time: 0.162060 Dec 25 21:09:31.680890 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 295/690] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:31 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:31.688138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:31.689290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:31.695930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:31.696378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.697192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:31.697627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.737821 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af792710-323f-461d-941c-ad6f54da8f34 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.055698 Dec 25 21:09:31.738473 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 296/691] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:31 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:31.744003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:31.744718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:31.751485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:31.755440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.755440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:31.755440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:31.881901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:31.889721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-018ac5e1-4e88-4e58-8708-7f91c711e279 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1317 microversion: 2.1 time: 0.150146 Dec 25 21:09:31.890307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 297/692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:31 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:31.894634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9efa3e9f-665d-4be2-8d0b-71884eaf7b95 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] Calling method '.version_select at 0x7fa4f75dc0d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:32.367472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-19832f22-70a1-4ed1-9236-1f27c86b3c09 tempest-QuotasAdminTestJSON-233964442 tempest-QuotasAdminTestJSON-233964442-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22" status: 200 len: 329 microversion: 2.1 time: 2.432243 Dec 25 21:09:32.376290 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 396/693] 10.222.0.32 () {60 vars in 1262 bytes} [Sat Dec 25 21:09:29 2021] PUT /compute/v2.1/os-quota-sets/deb36d0e1a0e4dc6baba28441b926b22 => generated 329 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:32.399487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-64ef002b-e84b-400c-9ccf-ada6d4c33176 req-716fc4ff-e8ca-4787-8e72-7729f0224af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dbb558c-1149-4835-803f-d1368522f573", "tag": "3240e6a9-7ed6-4f9e-a0e5-cf084791ba34"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:32.399487 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:32.399487 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:32.403994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-64ef002b-e84b-400c-9ccf-ada6d4c33176 req-716fc4ff-e8ca-4787-8e72-7729f0224af9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:32.404431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-64ef002b-e84b-400c-9ccf-ada6d4c33176 req-716fc4ff-e8ca-4787-8e72-7729f0224af9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:32.416050 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-64ef002b-e84b-400c-9ccf-ada6d4c33176 req-716fc4ff-e8ca-4787-8e72-7729f0224af9 service nova] Creating event network-changed:3240e6a9-7ed6-4f9e-a0e5-cf084791ba34 for instance 4dbb558c-1149-4835-803f-d1368522f573 on nch1-master-1 Dec 25 21:09:32.428148 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-64ef002b-e84b-400c-9ccf-ada6d4c33176 req-716fc4ff-e8ca-4787-8e72-7729f0224af9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040082 Dec 25 21:09:32.428148 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 397/694] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:32.434431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dc38047-6813-49b5-9ad9-df01a5e5ef98 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'action', calling method: .version_select at 0x7fa4fd990820>, body: {"addFloatingIp": {"address": ""}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:32.435682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dc38047-6813-49b5-9ad9-df01a5e5ef98 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:32.437900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dc38047-6813-49b5-9ad9-df01a5e5ef98 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action" status: 400 len: 142 microversion: 2.1 time: 0.009848 Dec 25 21:09:32.439577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 398/695] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:32 2021] POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action => generated 142 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:09:32.447607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0adf7c8e-1d06-4278-9127-c3efae563853 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f7413670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:32.623845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0adf7c8e-1d06-4278-9127-c3efae563853 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484837731" status: 204 len: 0 microversion: 2.2 time: 0.182712 Dec 25 21:09:32.624787 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 399/696] 10.222.0.32 () {60 vars in 1260 bytes} [Sat Dec 25 21:09:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484837731 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:32.629831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8e8bc6a9-1586-4872-9b92-926df34bca53 req-df091ab2-168e-4720-a1b4-f2b49ac39ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34088aa4-5622-46a6-a155-94ef62f87546", "name": "network-vif-plugged", "status": "completed", "tag": "1f34074e-0a6d-4eef-a7d5-cef1f7f400f3"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:32.634507 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:32.634507 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:32.639794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8e8bc6a9-1586-4872-9b92-926df34bca53 req-df091ab2-168e-4720-a1b4-f2b49ac39ce9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:32.640242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8e8bc6a9-1586-4872-9b92-926df34bca53 req-df091ab2-168e-4720-a1b4-f2b49ac39ce9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:32.651015 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8e8bc6a9-1586-4872-9b92-926df34bca53 req-df091ab2-168e-4720-a1b4-f2b49ac39ce9 service nova] Creating event network-vif-plugged:1f34074e-0a6d-4eef-a7d5-cef1f7f400f3 for instance 34088aa4-5622-46a6-a155-94ef62f87546 on nch2-master-1 Dec 25 21:09:32.655800 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8e8bc6a9-1586-4872-9b92-926df34bca53 req-df091ab2-168e-4720-a1b4-f2b49ac39ce9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029643 Dec 25 21:09:32.656386 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 400/697] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:32.661352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:32.662072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:32.668555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:32.670365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:32.671043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:32.671484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:32.999034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9efa3e9f-665d-4be2-8d0b-71884eaf7b95 tempest-FloatingIPDetailsTestJSON-450377605 tempest-FloatingIPDetailsTestJSON-450377605-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/5959c674-43b3-4ce2-bfd5-ea5206187eb9" status: 202 len: 0 microversion: 2.1 time: 1.107573 Dec 25 21:09:33.000343 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 298/698] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:09:31 2021] DELETE /compute/v2.1/os-floating-ips/5959c674-43b3-4ce2-bfd5-ea5206187eb9 => generated 0 bytes in 1109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:09:33.006672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:33.008163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:33.014789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.016252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.017342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.017997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.046987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Acquired lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:09:33.165284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:33.176625 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25076dac-f10d-488d-bd76-5c8c03894e6a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.518829 Dec 25 21:09:33.178045 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 401/699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:32 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:33.195156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45eebab4-763b-48d5-b625-77d355d0fb5a tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f75268b0>, body: {"keypair": {"name": "tempest-keypair-1226048651", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:33.210968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-45eebab4-763b-48d5-b625-77d355d0fb5a tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:33.214704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-45eebab4-763b-48d5-b625-77d355d0fb5a tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:33.322454 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45eebab4-763b-48d5-b625-77d355d0fb5a tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.132935 Dec 25 21:09:33.327533 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 402/700] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:09:33 2021] POST /compute/v2.1/os-keypairs => generated 589 bytes in 134 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Dec 25 21:09:33.328097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:33.328700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:33.336032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.336489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.337372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.337498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Releasing lock "refresh_cache-24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:09:33.337815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.338296 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] HTTP exception thrown: floating IP not found Dec 25 21:09:33.339255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Returning 404 to user: floating IP not found {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:33.340296 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68a7a23e-ed57-4835-af23-418ac2916edd tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action" status: 404 len: 67 microversion: 2.1 time: 0.338545 Dec 25 21:09:33.347339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 299/701] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:33 2021] POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action => generated 67 bytes in 346 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:09:33.353289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:33.361159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:33.361159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.362415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.363538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.364333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.410326 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb7f91b7-c5da-4858-bc09-eadc36310376 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.061186 Dec 25 21:09:33.411087 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 300/702] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:33 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:33.418822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:33.419210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:33.430583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.431715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.432725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.433200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.737561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:33.751158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:33.753963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:33.755744 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-639ce402-b86f-4f4e-b79f-26d984e7c4ee tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1361 microversion: 2.25 time: 0.431336 Dec 25 21:09:33.759378 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 403/703] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:33 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1361 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:33.772712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e80e5dfd-9fa1-4ba6-b27c-3c56b77c306e req-68084e05-01c4-49a7-a2cc-7aaa5b928db7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe", "name": "network-vif-unplugged", "status": "completed", "tag": "d3279f41-5733-434c-babe-c0306203f4fa"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:33.775533 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:33.775533 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:33.783530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e80e5dfd-9fa1-4ba6-b27c-3c56b77c306e req-68084e05-01c4-49a7-a2cc-7aaa5b928db7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:33.784334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e80e5dfd-9fa1-4ba6-b27c-3c56b77c306e req-68084e05-01c4-49a7-a2cc-7aaa5b928db7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:33.795751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:33.804362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3dc1341b-4440-4a15-88a1-39f4b3c8b180 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1317 microversion: 2.1 time: 0.391801 Dec 25 21:09:33.814667 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e80e5dfd-9fa1-4ba6-b27c-3c56b77c306e req-68084e05-01c4-49a7-a2cc-7aaa5b928db7 service nova] Creating event network-vif-unplugged:d3279f41-5733-434c-babe-c0306203f4fa for instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe on nch1-master-1 Dec 25 21:09:33.814872 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 301/704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:33 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:33.815079 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e80e5dfd-9fa1-4ba6-b27c-3c56b77c306e req-68084e05-01c4-49a7-a2cc-7aaa5b928db7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050423 Dec 25 21:09:33.815079 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 404/705] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:33.819487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-976c6958-8396-4dc9-ae20-031a1998d8e2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f73f0280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:33.822428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a211537-7c3f-4fd1-9df3-0ff4c41ed2a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Action: 'action', calling method: .version_select at 0x7fa4fd990700>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:33.922245 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-976c6958-8396-4dc9-ae20-031a1998d8e2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226048651" status: 204 len: 0 microversion: 2.2 time: 0.116031 Dec 25 21:09:33.923079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 302/706] 10.222.0.32 () {60 vars in 1260 bytes} [Sat Dec 25 21:09:33 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1226048651 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:33.934200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-91dcdb0d-7185-47d9-a893-83d20e68318d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f7322af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1651172882"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:33.960413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-91dcdb0d-7185-47d9-a893-83d20e68318d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:33.966282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-91dcdb0d-7185-47d9-a893-83d20e68318d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:34.158638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6a211537-7c3f-4fd1-9df3-0ff4c41ed2a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Dec 25 21:09:34.159238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a211537-7c3f-4fd1-9df3-0ff4c41ed2a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:34.160557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6a211537-7c3f-4fd1-9df3-0ff4c41ed2a9 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action" status: 404 len: 88 microversion: 2.1 time: 0.345898 Dec 25 21:09:34.161199 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 405/707] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:33 2021] POST /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7/action => generated 88 bytes in 347 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:09:34.170558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:34.171382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:34.180097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.180514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.181384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.181895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.222139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:09:34.342092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-91dcdb0d-7185-47d9-a893-83d20e68318d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:34.345932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-91dcdb0d-7185-47d9-a893-83d20e68318d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:34.359328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-91dcdb0d-7185-47d9-a893-83d20e68318d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2336 microversion: 2.2 time: 0.429032 Dec 25 21:09:34.359926 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 303/708] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:33 2021] POST /compute/v2.1/os-keypairs => generated 2336 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:34.370398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:34.372646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:34.379723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.380445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.381478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.382862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.675272 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3995bd2-0bf9-4d09-800c-63742b7f4056 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "DELETE /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 204 len: 0 microversion: 2.1 time: 0.508526 Dec 25 21:09:34.676522 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 406/709] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:09:34 2021] DELETE /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:09:34.682346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8eeaf6ad-ff28-427b-8e26-4d8f6df599a4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f741c5e0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-478464360"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:34.701574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8eeaf6ad-ff28-427b-8e26-4d8f6df599a4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:34.706216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8eeaf6ad-ff28-427b-8e26-4d8f6df599a4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:34.818916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:34.828056 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f5e026d-e043-445f-bcc4-ef46531e21a3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.462009 Dec 25 21:09:34.829183 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 304/710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:34 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:34.833995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:34.834903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:34.841551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.842025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.842812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.843354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.889450 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6a9feca-1da4-4c28-b704-9ad0785f1e6b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.058438 Dec 25 21:09:34.889694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8eeaf6ad-ff28-427b-8e26-4d8f6df599a4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:34.891336 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 305/711] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:34 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:34.897673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8eeaf6ad-ff28-427b-8e26-4d8f6df599a4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:34.898282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:34.899686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:34.908478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.908964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.909821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.910260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.913989 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8eeaf6ad-ff28-427b-8e26-4d8f6df599a4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.2 time: 0.236395 Dec 25 21:09:34.915615 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 407/712] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:34 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 239 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:34.922216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:34.923391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:34.930251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.931229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:34.932098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:34.932740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.189026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:35.199470 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcb1d5a8-54f4-4898-b48d-e3744c3bb6df tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1541 microversion: 2.1 time: 0.306596 Dec 25 21:09:35.200042 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 306/713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:34 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1541 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:35.204727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:35.207648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:35.211984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.212481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.213295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.214084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.216607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:35.231675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:35.233773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:35.235169 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d917b22d-3575-471a-a6d8-7b02ea41a8fe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1557 microversion: 2.25 time: 0.318372 Dec 25 21:09:35.235955 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 408/714] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:34 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1557 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:35.253725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7c2255d-4e6b-418a-9f34-d9be367a45a2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f7526b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-889457463"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:35.290004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f7c2255d-4e6b-418a-9f34-d9be367a45a2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:35.293148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f7c2255d-4e6b-418a-9f34-d9be367a45a2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:35.485504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:35.503733 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e3e53b4-fed0-41aa-b081-f79c8728d6cd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1317 microversion: 2.1 time: 0.302637 Dec 25 21:09:35.509833 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 307/715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:35 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:35.514992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:35.515606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:35.543629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.544001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.544807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.545275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.781828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:09:35.805671 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74667dac-1e7c-4069-adfa-2db9271b18e1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 2049 microversion: 2.25 time: 0.294329 Dec 25 21:09:35.806812 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 308/716] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:35 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 2049 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:35.824502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f92d019-e3bf-4fe6-9cff-134a22140425 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:35.829783 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:35.829783 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:35.829783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92d019-e3bf-4fe6-9cff-134a22140425 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.829783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92d019-e3bf-4fe6-9cff-134a22140425 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.829783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92d019-e3bf-4fe6-9cff-134a22140425 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.830597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92d019-e3bf-4fe6-9cff-134a22140425 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.857939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f92d019-e3bf-4fe6-9cff-134a22140425 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.036434 Dec 25 21:09:35.859821 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 309/717] 10.222.0.32 () {60 vars in 1216 bytes} [Sat Dec 25 21:09:35 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:35.864404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-415a64da-e7ba-4988-a708-c27837f6a037 req-6116abdc-1c50-4232-a3e1-5c7705273f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe", "tag": "d3279f41-5733-434c-babe-c0306203f4fa"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:35.870883 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:35.870883 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:35.882829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-415a64da-e7ba-4988-a708-c27837f6a037 req-6116abdc-1c50-4232-a3e1-5c7705273f80 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.883074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f7c2255d-4e6b-418a-9f34-d9be367a45a2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:35.883590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-415a64da-e7ba-4988-a708-c27837f6a037 req-6116abdc-1c50-4232-a3e1-5c7705273f80 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.893344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f7c2255d-4e6b-418a-9f34-d9be367a45a2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:35.900730 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-415a64da-e7ba-4988-a708-c27837f6a037 req-6116abdc-1c50-4232-a3e1-5c7705273f80 service nova] Creating event network-changed:d3279f41-5733-434c-babe-c0306203f4fa for instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe on nch1-master-1 Dec 25 21:09:35.918804 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-415a64da-e7ba-4988-a708-c27837f6a037 req-6116abdc-1c50-4232-a3e1-5c7705273f80 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055118 Dec 25 21:09:35.920332 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 310/718] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:35.925965 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7c2255d-4e6b-418a-9f34-d9be367a45a2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.688595 Dec 25 21:09:35.927423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 409/719] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:35 2021] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 690 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:35.933911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:35.934730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:35.935427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:35.947930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:35.948086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.948086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.948086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.948320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.948411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.948411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:35.948411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:35.948411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:36.030195 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8355f047-d1a2-43bd-9c3a-7bddfe5b358b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.101147 Dec 25 21:09:36.030849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 410/720] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:35 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:36.035894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b64719b-7ff4-4081-851a-a0daf8cd0e54 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f75268b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:36.047408 ncdv-master-1 devstack@n-api.service[136548]: WARNING oslo_db.sqlalchemy.utils [None req-7b64719b-7ff4-4081-851a-a0daf8cd0e54 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 25 21:09:36.073374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b64719b-7ff4-4081-851a-a0daf8cd0e54 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 1722 microversion: 2.2 time: 0.025910 Dec 25 21:09:36.073374 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 411/721] 10.222.0.32 () {60 vars in 1176 bytes} [Sat Dec 25 21:09:36 2021] GET /compute/v2.1/os-keypairs => generated 1722 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:36.084013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f95419e5-a8cb-4959-ae75-0f86203dc56d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f73f5ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:36.184187 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f95419e5-a8cb-4959-ae75-0f86203dc56d tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-889457463" status: 204 len: 0 microversion: 2.2 time: 0.103945 Dec 25 21:09:36.187894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 412/722] 10.222.0.32 () {60 vars in 1317 bytes} [Sat Dec 25 21:09:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-889457463 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:36.193209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03b97288-e56b-4c29-a68d-1131016c340e tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f73c2b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:36.287458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03b97288-e56b-4c29-a68d-1131016c340e tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-478464360" status: 204 len: 0 microversion: 2.2 time: 0.097851 Dec 25 21:09:36.291134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 413/723] 10.222.0.32 () {60 vars in 1317 bytes} [Sat Dec 25 21:09:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-478464360 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:09:36.292453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:36.293211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:36.309414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:36.310052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:36.310777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:36.311097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:36.516433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:36.526566 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-561a6e97-8a68-4fc4-8a78-13541bd9bd93 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.602702 Dec 25 21:09:36.545486 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 311/724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:35 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:36.559170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2aa92545-c1d1-4a27-a8fc-0e7e11933bf4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f75cf9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:36.658880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2aa92545-c1d1-4a27-a8fc-0e7e11933bf4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1651172882" status: 204 len: 0 microversion: 2.2 time: 0.111425 Dec 25 21:09:36.666064 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 312/725] 10.222.0.32 () {60 vars in 1320 bytes} [Sat Dec 25 21:09:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1651172882 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:36.666064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2d5a55bc-08cd-4d75-a251-bbca391e253c req-44cd9a28-5aca-4efd-8418-3524660c257b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbb558c-1149-4835-803f-d1368522f573", "name": "network-vif-plugged", "status": "completed", "tag": "3240e6a9-7ed6-4f9e-a0e5-cf084791ba34"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:36.669183 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:36.669183 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:36.696357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2d5a55bc-08cd-4d75-a251-bbca391e253c req-44cd9a28-5aca-4efd-8418-3524660c257b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:36.699831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2d5a55bc-08cd-4d75-a251-bbca391e253c req-44cd9a28-5aca-4efd-8418-3524660c257b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:36.725714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2d5a55bc-08cd-4d75-a251-bbca391e253c req-44cd9a28-5aca-4efd-8418-3524660c257b service nova] Creating event network-vif-plugged:3240e6a9-7ed6-4f9e-a0e5-cf084791ba34 for instance 4dbb558c-1149-4835-803f-d1368522f573 on nch1-master-1 Dec 25 21:09:36.739232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2d5a55bc-08cd-4d75-a251-bbca391e253c req-44cd9a28-5aca-4efd-8418-3524660c257b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075869 Dec 25 21:09:36.740557 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 313/726] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:36.750491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:36.750950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:36.774015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:36.774470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:36.775425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:36.775873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:37.031388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:37.054593 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e07ded3c-f6d1-4476-b217-1b608de80cea tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1541 microversion: 2.1 time: 0.764677 Dec 25 21:09:37.073216 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 414/727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:36 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1541 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:37.079766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7bf9c82-4155-4301-9b3c-850737c78f41 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f73f5e50>, body: {"keypair": {"name": "tempest-keypair-1225744286"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:37.108305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c7bf9c82-4155-4301-9b3c-850737c78f41 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:37.116552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c7bf9c82-4155-4301-9b3c-850737c78f41 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:37.831213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:37.853804 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9276f426-bb96-44db-ab70-1f2c533adc39 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1317 microversion: 2.1 time: 1.110155 Dec 25 21:09:37.857296 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 314/728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:36 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1317 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:37.869132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:37.870375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:37.876451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:37.877019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:37.878045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:37.878882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:37.949733 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89f08981-dfa6-4444-aa65-2ef85528865c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.088400 Dec 25 21:09:37.951045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 315/729] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:37 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:37.964314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:37.965446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:37.974444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:37.975436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:37.977652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:37.978258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:38.089044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c7bf9c82-4155-4301-9b3c-850737c78f41 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:38.093673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c7bf9c82-4155-4301-9b3c-850737c78f41 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:38.110845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7bf9c82-4155-4301-9b3c-850737c78f41 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.2 time: 1.036199 Dec 25 21:09:38.111748 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 415/730] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:37 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1038 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:38.455910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:38.455910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68b62c39-ba9f-4e44-9960-95deccb6c876 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.251838 Dec 25 21:09:38.455910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 316/731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:37 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:38.455910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:38.466003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:38.466003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:38.466003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:38.466003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:38.467653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:38.467653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:38.467653 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19246a03-8888-4942-9bff-48658fed7829 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1499 microversion: 2.1 time: 0.127426 Dec 25 21:09:38.467653 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 317/732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:38 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1499 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:38.468938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc5200da-80ea-47a7-b9b4-724bd9486c78 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f751f9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:38.469628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-630611626", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:38.470327 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc5200da-80ea-47a7-b9b4-724bd9486c78 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-1225744286" status: 200 len: 706 microversion: 2.2 time: 0.010941 Dec 25 21:09:38.470327 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 318/733] 10.222.0.32 () {60 vars in 1257 bytes} [Sat Dec 25 21:09:38 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1225744286 => generated 706 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:38.470327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-348e37a6-276b-474e-985c-21e8083b82e0 req-260e5a84-f17f-458f-babc-29cff6a0e209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7", "name": "network-vif-deleted", "tag": "95f9468e-c1ab-4e1c-856f-19efb9ee29b8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:38.470327 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:38.470327 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:38.471745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-348e37a6-276b-474e-985c-21e8083b82e0 req-260e5a84-f17f-458f-babc-29cff6a0e209 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:38.471745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-348e37a6-276b-474e-985c-21e8083b82e0 req-260e5a84-f17f-458f-babc-29cff6a0e209 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:38.471745 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-348e37a6-276b-474e-985c-21e8083b82e0 req-260e5a84-f17f-458f-babc-29cff6a0e209 service nova] Creating event network-vif-deleted:95f9468e-c1ab-4e1c-856f-19efb9ee29b8 for instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 on nch1-master-1 Dec 25 21:09:38.471745 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-348e37a6-276b-474e-985c-21e8083b82e0 req-260e5a84-f17f-458f-babc-29cff6a0e209 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Dec 25 21:09:38.471745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 319/734] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:38.472450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:38.476762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-418240c5-21da-4d17-bae5-66203fc05cf2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4fc047e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:38.480852 ncdv-master-1 devstack@n-api.service[136547]: WARNING oslo_db.sqlalchemy.utils [None req-418240c5-21da-4d17-bae5-66203fc05cf2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 25 21:09:38.489667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-418240c5-21da-4d17-bae5-66203fc05cf2 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 564 microversion: 2.2 time: 0.017931 Dec 25 21:09:38.490469 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 320/735] 10.222.0.32 () {60 vars in 1176 bytes} [Sat Dec 25 21:09:38 2021] GET /compute/v2.1/os-keypairs => generated 564 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:38.500198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e3e677b-35e2-4420-a0b8-a60d08acbb44 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f75cf940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:38.619663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:38.620091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:38.620571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:38.621024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:38.621494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:38.630231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:38.630682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:38.631510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:38.631965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:38.649977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Getting quotas for project c70df2525137490a9e18b5e4af25a7b4. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:38.653980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Getting quotas for user c6c295b9814d44efba37e7a37df6fa9b and project c70df2525137490a9e18b5e4af25a7b4. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:38.666045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:38.670175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:38.703114 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e3e677b-35e2-4420-a0b8-a60d08acbb44 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225744286" status: 204 len: 0 microversion: 2.2 time: 0.205665 Dec 25 21:09:38.703655 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 321/736] 10.222.0.32 () {60 vars in 1260 bytes} [Sat Dec 25 21:09:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1225744286 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:09:38.715581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Action: 'create', calling method: .version_select at 0x7fa4f758c1f0>, body: {"keypair": {"name": "tempest-keypair-837555959", "type": "x509"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:38.750408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:38.760411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:38.784501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.processutils [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpgh7k1it3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpgh7k1it3/temp.key -subj /CN=a53d0545f68d4b7eb74eff42f386f5c5 -extensions v3_req_client {{(pid=136547) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:09:38.988291 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e70588db-7fba-47cd-b05b-9240f84d6533 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.869926 Dec 25 21:09:38.993352 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 416/737] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:39.000421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.processutils [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpgh7k1it3/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpgh7k1it3/temp.key -subj /CN=a53d0545f68d4b7eb74eff42f386f5c5 -extensions v3_req_client" returned: 0 in 0.216s {{(pid=136547) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:09:39.006327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.processutils [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpgh7k1it3/temp.key -password pass: {{(pid=136547) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Dec 25 21:09:39.006751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:39.022069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:39.063511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.065619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.068024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.processutils [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpgh7k1it3/temp.key -password pass:" returned: 0 in 0.066s {{(pid=136547) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Dec 25 21:09:39.068489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.072156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.229048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:39.231615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Getting quotas for user a53d0545f68d4b7eb74eff42f386f5c5 and project 63cdf796f2e84d6ebb3c03943ef35e0c. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:39.262140 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94abdae5-3898-4840-bfa1-b0dd11cc8e21 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.553052 Dec 25 21:09:39.268540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 322/738] 10.222.0.32 () {62 vars in 1197 bytes} [Sat Dec 25 21:09:38 2021] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 560 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:09:39.275442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:39.276662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:39.284685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.285193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.286056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.286500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.336542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39e15d29-4dce-4910-9db7-c4354b18906b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.066537 Dec 25 21:09:39.337767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 323/739] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:39 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:39.345830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-228126345", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:39.419520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:39.424645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:39.428619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df3e2b9a-3f56-4917-82e5-92fc9c4c39ed tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1467 microversion: 2.1 time: 0.433888 Dec 25 21:09:39.430963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 417/740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:38 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:39.435482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06f2c444-1584-4019-8705-e5f5d1d52ede tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f73e3e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:39.443085 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06f2c444-1584-4019-8705-e5f5d1d52ede tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-837555959" status: 200 len: 1532 microversion: 2.2 time: 0.011321 Dec 25 21:09:39.443902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 418/741] 10.222.0.32 () {60 vars in 1254 bytes} [Sat Dec 25 21:09:39 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-837555959 => generated 1532 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:39.464997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:39.464997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:39.466617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.467068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.468042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.469631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.735339 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-65464ec4-407d-49c2-b5d5-78f37a7a7123 tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1618 microversion: 2.1 time: 0.290404 Dec 25 21:09:39.743198 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 419/742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:39 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1618 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:39.755335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58d7f3e7-f680-4a2b-b122-70bd3fb99fc4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f73f5820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:39.758849 ncdv-master-1 devstack@n-api.service[136548]: WARNING oslo_db.sqlalchemy.utils [None req-58d7f3e7-f680-4a2b-b122-70bd3fb99fc4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 25 21:09:39.764024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58d7f3e7-f680-4a2b-b122-70bd3fb99fc4 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.027111 Dec 25 21:09:39.768249 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 420/743] 10.222.0.32 () {60 vars in 1176 bytes} [Sat Dec 25 21:09:39 2021] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:39.779244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:39.780461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:39.787007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.787613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.789127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.789734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.796431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:39.797172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:39.797795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:39.798206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:39.798627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:39.823938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.823938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.825011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.825011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.847623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Getting quotas for project c70df2525137490a9e18b5e4af25a7b4. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:39.852634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Getting quotas for user c6c295b9814d44efba37e7a37df6fa9b and project c70df2525137490a9e18b5e4af25a7b4. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:39.864468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:39.867699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:39.954999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:39.962715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb5a864a-e522-40d0-a68d-63cc6c90e082 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.196499 Dec 25 21:09:39.963390 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 421/744] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:39 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:39.968062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:39.968662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:39.974910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.975364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:39.976674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:39.977130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:40.008780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:40.009261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:40.009712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lazy-loading 'fault' on Instance uuid 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:09:40.046124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ecf82fbf-dd04-4451-916f-e22e2e5f9b6d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706898 Dec 25 21:09:40.046777 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 324/745] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:39 2021] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:40.057483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6441cac91831435cb23d56e935cb99c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65cafc179094f63bf88bfba4c57fd1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:40.059319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64f56b9c-4663-4274-84df-9ac590d6eef0", "device": "/dev/xvdb"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:40.063393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:40.071357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee55052c-c74a-4a0b-aef7-e7c366014b4c tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 200 len: 1322 microversion: 2.1 time: 0.106658 Dec 25 21:09:40.072138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:40.072368 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 422/746] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:39 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 1322 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:40.073214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:40.076457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:40.077130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:40.078651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa7caa0a-229f-4707-97fe-f5de264713c3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] Calling method '.version_select at 0x7fa4f73e3f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:40.189919 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa7caa0a-229f-4707-97fe-f5de264713c3 tempest-KeyPairsV22TestJSON-1188883411 tempest-KeyPairsV22TestJSON-1188883411-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-837555959" status: 204 len: 0 microversion: 2.2 time: 0.116467 Dec 25 21:09:40.196713 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 423/747] 10.222.0.32 () {60 vars in 1257 bytes} [Sat Dec 25 21:09:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-837555959 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:40.196713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-509368211", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1b814523-70ff-4cb2-b14c-f77ae086c04f"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:40.268755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:40.665765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:40.668699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:40.674101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:40.676823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:40.685397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:40.744215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:40.750480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:40.752215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:40.757796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:40.815815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:40.823023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:40.847501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:40.876852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:41.050244 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81ff6b46-669b-47e9-b775-8a769f9ac1f3 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857224 Dec 25 21:09:41.054313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 424/748] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:41.113717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef3b177d-9e74-4b18-991a-c72625ab46ee tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:41.132481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef3b177d-9e74-4b18-991a-c72625ab46ee tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:41.244061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef3b177d-9e74-4b18-991a-c72625ab46ee tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:41.261580 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef3b177d-9e74-4b18-991a-c72625ab46ee tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1213 microversion: 2.1 time: 0.204847 Dec 25 21:09:41.263556 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 425/749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:41 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:41.274970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:41.275845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:41.298902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:41.307787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:41.308908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:41.309566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:41.358999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d24dac4a-f9d5-4bb7-bacc-286f5b8cc126 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 24567 microversion: 2.1 time: 0.093103 Dec 25 21:09:41.360196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 426/750] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:41 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 24567 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:41.368923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:41.369990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:41.378752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:41.379316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:41.380186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:41.380476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:41.588252 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0c3ba6c-c952-405c-9b15-c5431a391b0c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "POST /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.529313 Dec 25 21:09:41.589570 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 325/751] 10.222.0.32 () {62 vars in 1363 bytes} [Sat Dec 25 21:09:40 2021] POST /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments => generated 194 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:41.627936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0e70618b-e49f-4ffe-8fdf-0a02663534b9 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:41.627936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0e70618b-e49f-4ffe-8fdf-0a02663534b9 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:41.740064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0e70618b-e49f-4ffe-8fdf-0a02663534b9 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:41.747950 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0e70618b-e49f-4ffe-8fdf-0a02663534b9 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1216 microversion: 2.1 time: 0.155229 Dec 25 21:09:41.758694 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 326/752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:41 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:41.758694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:41.758694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] [instance: 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:41.761751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:41.762349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:41.763437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:41.763878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:41.787979 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] HTTP exception thrown: Instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 could not be found. Dec 25 21:09:41.794375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] Returning 404 to user: Instance 24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:41.795168 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6359f809-33e8-4cf5-8505-53050a7a88d4 tempest-FloatingIPsAssociationNegativeTestJSON-495794297 tempest-FloatingIPsAssociationNegativeTestJSON-495794297-project] 10.222.0.32 "GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7" status: 404 len: 111 microversion: 2.1 time: 0.045434 Dec 25 21:09:41.795996 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 327/753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:41 2021] GET /compute/v2.1/servers/24fbe6b2-8ab0-4b10-932c-de5d0c1f1ec7 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:09:41.824359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:41.833056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fba65a2-2c4a-467e-b044-29b696f49ba3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.471251 Dec 25 21:09:41.837571 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 427/754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:41 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:42.279610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:42.280989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:42.291496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.292540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.294356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.295125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.374414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:42.375338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:42.384209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.384654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.385466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.385898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.469826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:42.475342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26bebffb-ceff-40ef-8bf8-ab80e3ecf080 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1209 microversion: 2.1 time: 0.200359 Dec 25 21:09:42.477552 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 328/755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:42 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1209 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:42.715888 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9685b659-1f00-48b8-9bf3-9864408062f8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.345028 Dec 25 21:09:42.717411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 428/756] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:42 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:42.777510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:42.778745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:42.789989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.798247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.799405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.799965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.850236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:42.851624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:42.872792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.872792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.872792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:42.872792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:42.946440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:42.966350 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4fc4d9f-b72c-4f76-bbc5-f93a7ac80be6 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1220 microversion: 2.1 time: 0.203746 Dec 25 21:09:42.967212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 329/757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:42 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1220 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:43.494337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:43.495270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:43.538904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:43.539756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:43.540735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:43.541499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:43.655511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:43.664422 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dca0b37d-1993-4b78-aa6d-5e79d901a6f6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.818121 Dec 25 21:09:43.665285 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 429/758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:42 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:43.684844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:43.693897 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c7297a5-4aac-4aba-989c-fcb9b4255967 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1273 microversion: 2.1 time: 0.204583 Dec 25 21:09:43.694540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 330/759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:43 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:43.730000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:43.731328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:43.739262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:43.739988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:43.741871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:43.742647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:43.821088 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d18f3ec7-94c6-4445-b9b3-68ca13c4a893 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.096690 Dec 25 21:09:43.826369 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 430/760] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:43 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:43.983496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:43.984736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:44.001699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.002370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.008807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.008807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.203197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:44.212704 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc62035a-8c02-4747-aad0-5cd582875185 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1268 microversion: 2.1 time: 0.233548 Dec 25 21:09:44.224314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 331/761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:43 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1268 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:44.413032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42b74d6f-ec2f-4884-bb64-cc6bd23bd2c3 tempest-AbsoluteLimitsTestJSON-591794068 tempest-AbsoluteLimitsTestJSON-591794068-project] Calling method '.version_select at 0x7fa4f73b4c10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:44.431141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b74d6f-ec2f-4884-bb64-cc6bd23bd2c3 tempest-AbsoluteLimitsTestJSON-591794068 tempest-AbsoluteLimitsTestJSON-591794068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.432805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b74d6f-ec2f-4884-bb64-cc6bd23bd2c3 tempest-AbsoluteLimitsTestJSON-591794068 tempest-AbsoluteLimitsTestJSON-591794068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.439781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b74d6f-ec2f-4884-bb64-cc6bd23bd2c3 tempest-AbsoluteLimitsTestJSON-591794068 tempest-AbsoluteLimitsTestJSON-591794068-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.439781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b74d6f-ec2f-4884-bb64-cc6bd23bd2c3 tempest-AbsoluteLimitsTestJSON-591794068 tempest-AbsoluteLimitsTestJSON-591794068-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.454970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42b74d6f-ec2f-4884-bb64-cc6bd23bd2c3 tempest-AbsoluteLimitsTestJSON-591794068 tempest-AbsoluteLimitsTestJSON-591794068-project] 10.222.0.32 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.223282 Dec 25 21:09:44.455562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 431/762] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:44 2021] GET /compute/v2.1/limits => generated 511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:44.682318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:44.683152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:44.691425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.692039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.693028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.702254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.711716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:44.712919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:44.722944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.731343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.732425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.733059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.871719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:44.883314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eae8f651-b487-443b-86c0-d741be3fcd74 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1271 microversion: 2.1 time: 0.175634 Dec 25 21:09:44.893282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 432/763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:44 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:09:44.899809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:44.901263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:44.908206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.909066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.910044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:44.910753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:44.987704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a04f899-6169-4e08-aaa8-dee60195ac35 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.091927 Dec 25 21:09:44.988463 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 433/764] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:44 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:45.143342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:45.152025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d83a9cd-7d5b-4a9c-9c3f-63d9c768f18f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1504 microversion: 2.1 time: 0.474911 Dec 25 21:09:45.155355 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 332/765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:44 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1504 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:45.235158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:45.235910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:45.264799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:45.265288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:45.266105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:45.266548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:45.351427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:45.361967 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-576713db-002e-4906-b4af-2c66bbc039a7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1274 microversion: 2.1 time: 0.136032 Dec 25 21:09:45.373196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 434/766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:45 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1274 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:45.900196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:45.900780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:45.914388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:45.914844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:45.915659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:45.916099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.002354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:46.003428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:46.014031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:46.015087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.025264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:46.030974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.125562 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ab095ff-1cb9-47fd-bd28-ac473acfcf2e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.126406 Dec 25 21:09:46.126619 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 435/767] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:45 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:09:46.173778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:46.181250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:46.200190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:46.203019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.208042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:46.208696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.716116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:46.734174 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afec1189-f8f6-43c0-98be-b2ab78ee44db tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.838233 Dec 25 21:09:46.737401 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 333/768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:45 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:46.751008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:46.751992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:46.795150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:46.798313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.801867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:46.807307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:46.866070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:46.877826 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3839abe8-3b60-4fe7-b953-46cdf8b5f5e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1494 microversion: 2.1 time: 0.708817 Dec 25 21:09:46.882770 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 436/769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:46 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1494 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:47.248242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:47.248447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0809f70-54f5-450b-8f8c-e3ac199fa5e1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.501808 Dec 25 21:09:47.249767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 334/770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:46 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:47.255313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c50a27bd-e578-4d3b-859a-9e85e8179ff3 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '.version_select at 0x7fa4f7335ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:47.258315 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:47.258315 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:47.260371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c50a27bd-e578-4d3b-859a-9e85e8179ff3 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.261145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c50a27bd-e578-4d3b-859a-9e85e8179ff3 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:47.274176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c50a27bd-e578-4d3b-859a-9e85e8179ff3 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.023089 Dec 25 21:09:47.275372 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 335/771] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:09:47 2021] GET /compute/v2.1/os-migrations => generated 1166 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:47.285043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:47.286736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:47.293641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.294702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:47.295821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.296497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:47.363379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6cc91599-0f54-4961-b7dd-279eac70017e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.086543 Dec 25 21:09:47.364433 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 336/772] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:47 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:47.374182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:47.376504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:47.393747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.403389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:47.403389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.409749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-497940598", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "6dded111-84d7-4606-bd1c-e9369354dff9"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:47.417972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:47.521301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] validate_networks() for [('6dded111-84d7-4606-bd1c-e9369354dff9', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:47.861927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eca34a52-4c59-4964-96e6-9d6e84861d0f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1645 microversion: 2.1 time: 0.494606 Dec 25 21:09:47.892865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 337/773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:47 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1645 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:47.892865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:47.892865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:47.898362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.899115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:47.900140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:47.900815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:48.398808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:48.415743 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8c5d688-d3aa-45f7-8cd6-418ab2be6c45 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.529445 Dec 25 21:09:48.425910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 338/774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:47 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:48.434167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:48.434666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:48.435041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:48.435437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:48.435868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:48.439570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2124936017", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2332d558-39bb-411c-88af-b74bee7e32ab"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:48.455079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:48.455993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:48.457133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:48.457811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:48.481909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:48.489906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for user 613e2533f4e04cca8fafc3ea463accd9 and project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:48.500314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] validate_networks() for [('2332d558-39bb-411c-88af-b74bee7e32ab', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:48.503051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:48.507755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:48.636026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6149a951-2950-43ea-9211-b5d8aaf11d7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.749721 Dec 25 21:09:48.653464 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 437/775] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 1768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:48.983947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05a3d802-4a20-4c05-9f0a-7b85c9fd956d tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Calling method '.version_select at 0x7fa4f73cc280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:49.001201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a3d802-4a20-4c05-9f0a-7b85c9fd956d tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.001650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a3d802-4a20-4c05-9f0a-7b85c9fd956d tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.002471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a3d802-4a20-4c05-9f0a-7b85c9fd956d tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.003115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a3d802-4a20-4c05-9f0a-7b85c9fd956d tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.065385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:09:49.066039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:09:49.066588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:09:49.067071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:09:49.067603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:09:49.077843 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05a3d802-4a20-4c05-9f0a-7b85c9fd956d tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] 10.222.0.32 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.421870 Dec 25 21:09:49.078194 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 438/776] 10.222.0.32 () {58 vars in 1121 bytes} [Sat Dec 25 21:09:48 2021] GET /compute/v2.1/limits => generated 511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:49.091468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.091468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.091468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.091468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.119081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:49.121483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:49.134952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:49.135102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.135102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.135102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.137418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for user 9bf2eefd87de409785735fc802bc95ed and project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:49.137741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.170900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:09:49.176715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:09:49.330863 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3902f01e-47ec-4e12-b451-9f1cc3e131d4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903093 Dec 25 21:09:49.331842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 339/777] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:09:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:09:49.337129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:49.338629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:49.346609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.347416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.348428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.349897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.463394 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13401f71-093c-4f7a-aa80-3f2d355724e3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.129522 Dec 25 21:09:49.464780 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 340/778] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:49 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:49.476886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c27c7aa8-26ca-44a1-9479-f950dea9f229 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:49.480052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c27c7aa8-26ca-44a1-9479-f950dea9f229 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:49.481001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:49.496954 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a5965fd-2d04-4b19-9d61-553508443604 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.390859 Dec 25 21:09:49.506343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 439/779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:49 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:49.513993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c10f02f6-602d-4af7-aea7-9cd6757f6685 req-299f8cb8-bab3-4d72-87ab-87ed5737f2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a8114c1-85b3-4e15-9e15-95159b456e41", "tag": "f465e7da-b12a-4235-8af5-b0f521da6640"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:49.515597 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:49.515597 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:49.531114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c10f02f6-602d-4af7-aea7-9cd6757f6685 req-299f8cb8-bab3-4d72-87ab-87ed5737f2b2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.531777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c10f02f6-602d-4af7-aea7-9cd6757f6685 req-299f8cb8-bab3-4d72-87ab-87ed5737f2b2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.587660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c27c7aa8-26ca-44a1-9479-f950dea9f229 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:49.599469 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c27c7aa8-26ca-44a1-9479-f950dea9f229 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1207 microversion: 2.1 time: 0.132560 Dec 25 21:09:49.617156 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 341/780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:49 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1207 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:49.632830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-22131141", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:49.737622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:09:49.800223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c10f02f6-602d-4af7-aea7-9cd6757f6685 req-299f8cb8-bab3-4d72-87ab-87ed5737f2b2 service nova] Creating event network-changed:f465e7da-b12a-4235-8af5-b0f521da6640 for instance 9a8114c1-85b3-4e15-9e15-95159b456e41 on nch2-master-1 Dec 25 21:09:49.808084 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c10f02f6-602d-4af7-aea7-9cd6757f6685 req-299f8cb8-bab3-4d72-87ab-87ed5737f2b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299863 Dec 25 21:09:49.828202 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 440/781] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:49.828202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ccd162ec-01c6-4074-b9da-06de327a7099 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:49.828202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ccd162ec-01c6-4074-b9da-06de327a7099 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:49.892111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ccd162ec-01c6-4074-b9da-06de327a7099 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:49.899350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ccd162ec-01c6-4074-b9da-06de327a7099 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1211 microversion: 2.1 time: 0.082470 Dec 25 21:09:49.909723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 441/782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:49 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:49.914430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:49.915120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:49.933410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.934379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:49.936238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:49.936898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.330508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Getting quotas for project a49984f7eca64635a0a1aad92f289295. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:09:50.346266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Getting quotas for user 7653d16383ca42c89a08be862d0edcb7 and project a49984f7eca64635a0a1aad92f289295. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:09:50.365520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Dec 25 21:09:50.366932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:09:50.370328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-843f5c16-5e59-4a87-846c-319459b0e78b tempest-AbsoluteLimitsNegativeTestJSON-2065531677 tempest-AbsoluteLimitsNegativeTestJSON-2065531677-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.744292 Dec 25 21:09:50.370328 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 342/783] 10.222.0.32 () {60 vars in 1147 bytes} [Sat Dec 25 21:09:49 2021] POST /compute/v2.1/servers => generated 87 bytes in 747 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:09:50.376612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:50.377471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:50.399809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.400671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.401891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.402703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.534365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:50.547908 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f102e1b8-e842-49e0-aaed-3d56cec1a03f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.633303 Dec 25 21:09:50.548743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 442/784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:49 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:50.560399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-bd701b7c-d5df-4e4d-b2d1-31fee2533dba req-0ee63db3-617f-4565-9a2a-73d2d8f1c203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ed7876-289e-4bb7-89b1-051968bd6e27", "tag": "11a8e073-faa1-4705-931b-5c53eaca0cb5"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:50.567405 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:50.567405 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:50.582829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bd701b7c-d5df-4e4d-b2d1-31fee2533dba req-0ee63db3-617f-4565-9a2a-73d2d8f1c203 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.583584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bd701b7c-d5df-4e4d-b2d1-31fee2533dba req-0ee63db3-617f-4565-9a2a-73d2d8f1c203 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.600158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bd701b7c-d5df-4e4d-b2d1-31fee2533dba req-0ee63db3-617f-4565-9a2a-73d2d8f1c203 service nova] Creating event network-changed:11a8e073-faa1-4705-931b-5c53eaca0cb5 for instance b5ed7876-289e-4bb7-89b1-051968bd6e27 on nch1-master-1 Dec 25 21:09:50.606459 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-bd701b7c-d5df-4e4d-b2d1-31fee2533dba req-0ee63db3-617f-4565-9a2a-73d2d8f1c203 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055704 Dec 25 21:09:50.607809 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 443/785] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:50.615196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:50.617594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:50.631390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.635749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.638059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.638683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.697427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb36eec7-b018-4bcc-ae12-6e08ce2b1851 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.086349 Dec 25 21:09:50.699487 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 444/786] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:50 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:50.707251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:50.708768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:50.717005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.721402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.725277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.726336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.838069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:09:50.873536 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc951b7e-d3fb-4f20-8c8a-ad3143a3b94c tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 2127 microversion: 2.25 time: 0.491838 Dec 25 21:09:50.874547 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 343/787] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:50 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 2127 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:50.890480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:50.891108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:50.906853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.907302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:50.908284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:50.910669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:51.026100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:51.034610 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c90879e-9a65-46db-9e7f-9cd7f1a89768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1203 microversion: 2.1 time: 0.158748 Dec 25 21:09:51.035202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 344/788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:50 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:51.048121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:51.051392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:51.064678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:51.080464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:51.081390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:51.081830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:51.114712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:51.124912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'flavor' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:09:51.129583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b764d63f-c2d2-4e87-9ebc-6519ff2546df tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.428561 Dec 25 21:09:51.130481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 445/789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:50 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:51.134833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:51.135445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:51.143689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Going to try to live migrate instance to nch1-master-1 {{(pid=136547) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:09:51.150717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:51.151169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:51.154125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:51.157071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:51.240807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:51.249864 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6956cd1c-50cb-4f5b-83d6-3221fde464fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1207 microversion: 2.1 time: 0.118352 Dec 25 21:09:51.250448 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 446/790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:51 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1207 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:51.566094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:51.567540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:51.575082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:51.575526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:51.576500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:51.576975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.263646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:52.270811 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e01c7c51-d86f-44b2-adc8-40ce52199410 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.709887 Dec 25 21:09:52.272508 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 447/791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:51 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:09:52.278976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:52.280141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:52.290208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.290989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.292682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.293938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.340212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f98a67d-edb1-4ff0-a85a-3fd622335e32 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.065764 Dec 25 21:09:52.341028 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 448/792] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:52 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:52.346682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0868411a-956f-4344-82de-f71c66a0c14e req-6eff62f4-b608-4cd3-afaa-f2fc93cbe11f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a96da32-1c68-4f60-8164-56d8ced8b069", "tag": "6e1c9c71-c87a-4d1b-aa9b-dbbcce58234a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:52.348166 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:52.348166 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:09:52.357024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0868411a-956f-4344-82de-f71c66a0c14e req-6eff62f4-b608-4cd3-afaa-f2fc93cbe11f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.361500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0868411a-956f-4344-82de-f71c66a0c14e req-6eff62f4-b608-4cd3-afaa-f2fc93cbe11f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.373107 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0868411a-956f-4344-82de-f71c66a0c14e req-6eff62f4-b608-4cd3-afaa-f2fc93cbe11f service nova] Creating event network-changed:6e1c9c71-c87a-4d1b-aa9b-dbbcce58234a for instance 7a96da32-1c68-4f60-8164-56d8ced8b069 on nch2-master-1 Dec 25 21:09:52.380232 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0868411a-956f-4344-82de-f71c66a0c14e req-6eff62f4-b608-4cd3-afaa-f2fc93cbe11f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036871 Dec 25 21:09:52.392989 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 449/793] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:52.410437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:52.413065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:52.422679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.423313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.424348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.425134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.592428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:52.609692 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfbcd0b7-410c-406d-a92f-5da038e1d3fd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1265 microversion: 2.1 time: 0.214423 Dec 25 21:09:52.621813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 450/794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:52 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:52.621813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:52.621813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:52.628487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.628971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.629788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.630224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.912643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:52.921262 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e448a3e-4b30-442e-a7ce-9ba1f3681e7d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.309946 Dec 25 21:09:52.930669 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 451/795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:52 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:52.935548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:52.936372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:52.942651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.945394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:52.945394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:52.945394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:53.035529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:53.049480 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08cd550e-c222-4657-b059-07dcabe3801e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1269 microversion: 2.1 time: 0.117432 Dec 25 21:09:53.054239 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 452/796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:52 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1269 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:53.287954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:53.288623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:53.300149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:53.305825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:53.305825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:53.305825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:53.610354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:53.620430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b924008c-47b0-4d2d-a9b2-e17d3e842449 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.336522 Dec 25 21:09:53.630103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 453/797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:53 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:53.635494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:53.636980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:53.644856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:53.645504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:53.646296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:53.648663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:53.692407 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e20c310-0df8-428f-8c93-1b57ff068a84 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.063930 Dec 25 21:09:53.697810 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 454/798] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:53 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:53.701564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:53.702256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:53.709070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:53.709558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:53.710856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:53.711289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.154347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:54.166489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6930b4f8-53dd-43af-8a48-d79362bfb86f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.470257 Dec 25 21:09:54.167384 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 455/799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:53 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:54.173236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:54.174095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:54.180837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.181349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.182151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.182643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.509458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:54.516824 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a518f954-a07e-4348-a53d-9334922bd82d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.348459 Dec 25 21:09:54.517427 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 456/800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:54 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:54.521959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:54.522582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:54.529109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.529568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.530364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.530805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.720219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:54.733024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-064903f3-c679-49b3-905d-f1610dae4532 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.213082 Dec 25 21:09:54.737128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 457/801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:54 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:54.742849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:54.753746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:54.760497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.765051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.766085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.766525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.905890 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0a5615e4-e3af-4c29-8da8-5ca2bf12e605 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/action" status: 202 len: 0 microversion: 2.25 time: 3.865400 Dec 25 21:09:54.907192 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 345/802] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:09:51 2021] POST /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/action => generated 0 bytes in 3869 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:09:54.912231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:54.913853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:54.923524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.923975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.924970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.925559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:54.981737 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00ad6cb2-ffdf-4c45-a78d-0d45b8046375 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.072994 Dec 25 21:09:54.982922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 346/803] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:54 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:54.989699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:54.990438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:54.995620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:54.999008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:54.999469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.000639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.002234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.023048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-954a90ff-f755-4c09-a084-e31e32295818 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.285779 Dec 25 21:09:55.023654 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 458/804] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:54 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:55.196256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:55.197998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:55.222799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.223300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.226912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.227442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.295728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:55.327420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:55.329400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:55.330860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a277f70-8a48-49f7-955a-843c27ccafc3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.345666 Dec 25 21:09:55.343549 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 347/805] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:54 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:55.352028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-afe8a2e1-d100-46c3-b463-d20154854a84 req-79d5f0c6-5f55-4391-bce6-16ff35e6992a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed1843d1-a627-404e-adf4-56974bcaa614", "tag": "0c6d5976-8c28-4b25-8b9e-c7dc7add6588"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:55.364440 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:55.364440 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:55.376773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-afe8a2e1-d100-46c3-b463-d20154854a84 req-79d5f0c6-5f55-4391-bce6-16ff35e6992a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.377471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-afe8a2e1-d100-46c3-b463-d20154854a84 req-79d5f0c6-5f55-4391-bce6-16ff35e6992a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.406703 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-afe8a2e1-d100-46c3-b463-d20154854a84 req-79d5f0c6-5f55-4391-bce6-16ff35e6992a service nova] Creating event network-changed:0c6d5976-8c28-4b25-8b9e-c7dc7add6588 for instance ed1843d1-a627-404e-adf4-56974bcaa614 on nch1-master-1 Dec 25 21:09:55.414384 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-afe8a2e1-d100-46c3-b463-d20154854a84 req-79d5f0c6-5f55-4391-bce6-16ff35e6992a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067398 Dec 25 21:09:55.415444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 348/806] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:55.457032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a53d4e1c-394a-40f7-ab86-907013184b66 req-f683642d-43e3-4935-9336-b173f01a47aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8114c1-85b3-4e15-9e15-95159b456e41", "name": "network-vif-plugged", "status": "completed", "tag": "f465e7da-b12a-4235-8af5-b0f521da6640"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:55.460313 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:55.460313 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:55.469219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a53d4e1c-394a-40f7-ab86-907013184b66 req-f683642d-43e3-4935-9336-b173f01a47aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.470467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a53d4e1c-394a-40f7-ab86-907013184b66 req-f683642d-43e3-4935-9336-b173f01a47aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.488645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:55.496350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-153eb565-651e-4ba9-8d95-ddff755dc58d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.314789 Dec 25 21:09:55.498042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a53d4e1c-394a-40f7-ab86-907013184b66 req-f683642d-43e3-4935-9336-b173f01a47aa service nova] Creating event network-vif-plugged:f465e7da-b12a-4235-8af5-b0f521da6640 for instance 9a8114c1-85b3-4e15-9e15-95159b456e41 on nch2-master-1 Dec 25 21:09:55.509255 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 459/807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:55 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:55.514538 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a53d4e1c-394a-40f7-ab86-907013184b66 req-f683642d-43e3-4935-9336-b173f01a47aa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064838 Dec 25 21:09:55.516064 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 349/808] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:55.534243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:55.534243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:55.555052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.555537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.556393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.556837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.752449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:55.753484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:55.762886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.763572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.764996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:55.765721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:55.962255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:55.971750 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a9cdb6d4-424e-47c1-bfb7-9588def4c7ba tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.441899 Dec 25 21:09:55.972522 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 460/809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:55 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:09:55.995329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:55.997525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:56.005581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.006400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.007701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.008154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.060151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24a83c15-f223-463e-8c12-e408e6c3f9fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.069295 Dec 25 21:09:56.061118 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 461/810] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:55 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:56.068806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:56.072275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:56.077130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.077849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.078646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.079267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.190707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:56.202207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39a06e9b-bab4-472d-a065-466e46e6774c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.454786 Dec 25 21:09:56.205603 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 350/811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:55 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:09:56.216747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-dc0d9060-c465-48f0-9fbe-15297e6a8cbe req-8ba79a59-5300-4520-bb7f-2f3730b985c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee5cf04-7b9e-46fd-b317-75a118617c96", "tag": "5576e36d-eb31-4f83-b0d9-b502678406cc"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:56.218532 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:56.218532 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:56.226768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dc0d9060-c465-48f0-9fbe-15297e6a8cbe req-8ba79a59-5300-4520-bb7f-2f3730b985c3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.227342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dc0d9060-c465-48f0-9fbe-15297e6a8cbe req-8ba79a59-5300-4520-bb7f-2f3730b985c3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.239586 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-dc0d9060-c465-48f0-9fbe-15297e6a8cbe req-8ba79a59-5300-4520-bb7f-2f3730b985c3 service nova] Creating event network-changed:5576e36d-eb31-4f83-b0d9-b502678406cc for instance dee5cf04-7b9e-46fd-b317-75a118617c96 on nch1-master-1 Dec 25 21:09:56.247670 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-dc0d9060-c465-48f0-9fbe-15297e6a8cbe req-8ba79a59-5300-4520-bb7f-2f3730b985c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040794 Dec 25 21:09:56.249717 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 351/812] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:56.354088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:56.355489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:56.365136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.365928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.367157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.367825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.620074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:56.628351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b93ea6f1-cbc6-4708-84e1-8e8453de66ab tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.565909 Dec 25 21:09:56.629266 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 462/813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:56 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:56.644957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:56.645896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:56.653178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.654262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:56.655277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:56.655872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.515322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:57.525995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:57.527430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:57.529692 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f61bd78-b54c-497c-ac62-7429289321f6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 1.182614 Dec 25 21:09:57.543463 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 352/814] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:56 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:57.549671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:57.550439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:57.557053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:57.557505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.558592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:57.559435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.684420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:57.695838 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43c55fb2-857b-475d-84ad-5adf6f0033e6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 1.064979 Dec 25 21:09:57.696545 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 463/815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:56 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:57.705547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:57.706611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:57.713940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:57.714465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.715503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:57.715996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.823688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:57.831113 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7dfd8511-9919-48a4-a014-8584b6e53b6c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.286522 Dec 25 21:09:57.835210 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 353/816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:57 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:57.836946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:57.837564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:57.843618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:57.844080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.844937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:57.845387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:57.847575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b55e2f7-f729-4420-9471-59182aec549c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.145504 Dec 25 21:09:57.848623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 464/817] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:57 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:57.993143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50f7c5f0-77bb-4384-b7ab-6726ee393956 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f7561d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1235115755", "description": "tempest-description-730206107"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:58.235801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:58.249958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dfba52a6-e93f-495c-bf44-7d62c49f41bc tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.417005 Dec 25 21:09:58.252514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 354/818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:57 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:58.259638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:58.260586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:58.267735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:58.268508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:58.269555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:58.270210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:58.746761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:58.756458 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f23aaeee-054c-4a71-8678-74516522e106 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.502577 Dec 25 21:09:58.757427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 355/819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:58 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:58.763047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:58.765805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:58.781671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:58.782362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:58.783815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:58.784431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:58.793201 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50f7c5f0-77bb-4384-b7ab-6726ee393956 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.941429 Dec 25 21:09:58.796065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 465/820] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:09:57 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:58.799830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:58.801701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:58.810952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:58.811838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:58.821065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:58.821913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.214725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:59.221642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:59.228223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:59.229967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:59.231459 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8d5f7ad-1ab5-45e6-9793-281d9a20ca5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.472879 Dec 25 21:09:59.232137 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 356/821] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:09:58 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:09:59.236743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13c4eeee-2296-4a6b-a70e-67962d22c9bf tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f733d3a0>, body: {"security_group_rule": {"parent_group_id": "c85a04f2-223d-48a1-97e6-caa2ec88908b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:59.246280 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-261cb657-62f5-41bc-9c0f-fd5721a3bd26 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.450389 Dec 25 21:09:59.247120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 466/822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:58 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:59.261467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:59.262317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:59.268931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.269401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.270594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.274763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.612801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:59.620958 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6adbfc2c-1263-4731-a74c-3809441a2a33 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.363116 Dec 25 21:09:59.621869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 467/823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:59 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:59.627196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:59.628193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:59.635174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.635638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.636435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.636888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.679000 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f087f807-db9d-4bc7-a2aa-022edc83db66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.055154 Dec 25 21:09:59.679644 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 468/824] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:09:59 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:09:59.684464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:59.685190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:59.691992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.692450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.693263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.694332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.872492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13c4eeee-2296-4a6b-a70e-67962d22c9bf tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.639051 Dec 25 21:09:59.873830 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 357/825] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:09:59 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:59.878957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-214e7014-264e-4c84-bd8a-52e1d202bfbe req-d564ba65-afef-47c7-a919-28c1de2eef00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a96da32-1c68-4f60-8164-56d8ced8b069", "name": "network-vif-plugged", "status": "completed", "tag": "6e1c9c71-c87a-4d1b-aa9b-dbbcce58234a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:09:59.881008 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:09:59.881008 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:09:59.889541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-214e7014-264e-4c84-bd8a-52e1d202bfbe req-d564ba65-afef-47c7-a919-28c1de2eef00 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.890110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-214e7014-264e-4c84-bd8a-52e1d202bfbe req-d564ba65-afef-47c7-a919-28c1de2eef00 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.901873 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-214e7014-264e-4c84-bd8a-52e1d202bfbe req-d564ba65-afef-47c7-a919-28c1de2eef00 service nova] Creating event network-vif-plugged:6e1c9c71-c87a-4d1b-aa9b-dbbcce58234a for instance 7a96da32-1c68-4f60-8164-56d8ced8b069 on nch2-master-1 Dec 25 21:09:59.906788 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-214e7014-264e-4c84-bd8a-52e1d202bfbe req-d564ba65-afef-47c7-a919-28c1de2eef00 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031519 Dec 25 21:09:59.907636 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 358/826] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:09:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:09:59.913731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:09:59.914634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:09:59.921624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.922289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.923094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:09:59.923702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:09:59.942705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:09:59.957540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fabe1bd8-406b-40b5-9006-6e12562da931 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.276649 Dec 25 21:09:59.958874 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 469/827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:59 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:09:59.964316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8be52c3-c4b1-4974-8236-12f463b8fdf1 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f73b4820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-717014730", "description": "tempest-description-746873733"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:00.109946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:00.123937 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3d3157e-917e-4662-8c6b-d3de121ec61a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.214827 Dec 25 21:10:00.125334 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 359/828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:09:59 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:00.249375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:00.250303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:00.258807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.259280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.260857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.270313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.415959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:00.425787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:00.426302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:00.427931 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2086f7b-5847-49c5-9ae6-f367f7076590 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.182009 Dec 25 21:10:00.438695 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 360/829] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:00 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:10:00.446319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:00.448312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:00.453521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.454130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.455556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.456001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.549277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8be52c3-c4b1-4974-8236-12f463b8fdf1 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.588274 Dec 25 21:10:00.550177 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 470/830] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:09:59 2021] POST /compute/v2.1/os-security-groups => generated 246 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:00.565512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3aafaf15-a240-4482-bec2-88db56e69aab tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f73a65e0>, body: {"security_group_rule": {"parent_group_id": "dc621918-a7d1-48ee-8b52-754e8b0b3c6f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:00.663498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:00.673033 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06940f80-2cc6-4b17-9dc3-d9e2655842c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.233128 Dec 25 21:10:00.673970 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 361/831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:00 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:00.679437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:00.680191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:00.688353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.688751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.690460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.690913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.887324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:00.896078 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83a579c0-625b-405e-a4fc-62c3bb5340b0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.220941 Dec 25 21:10:00.902178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 362/832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:00 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:00.909452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:00.910690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:00.924402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.925683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.926495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:00.927362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:00.999985 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10ca419c-92c9-4d83-ae24-47c265a7c826 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.096109 Dec 25 21:10:01.001066 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 363/833] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:00 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:01.009769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:01.010715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:01.023587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.024321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.026318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.026988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.059278 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3aafaf15-a240-4482-bec2-88db56e69aab tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.497547 Dec 25 21:10:01.063711 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 471/834] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:00 2021] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:01.068592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-162a0def-75f8-4cf9-9a02-afd7e4cdbce7 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f751c550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1233880999", "description": "tempest-description-1294104617"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:01.203146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:01.211970 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a6b3ed4-81cb-439f-a782-ac175d180e47 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.208640 Dec 25 21:10:01.221663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 364/835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:01 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:01.228395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:01.229317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:01.236352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.237184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.238182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.238781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.405370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:01.413954 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ea63d8b-5625-44f3-b706-cfff2e80ff11 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1313 microversion: 2.1 time: 0.190740 Dec 25 21:10:01.415169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 365/836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:01 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:01.447055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:01.449920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:01.462148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.462148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.462816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.463252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.624539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-162a0def-75f8-4cf9-9a02-afd7e4cdbce7 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.559451 Dec 25 21:10:01.625176 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 472/837] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:01 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:01.649490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e39829d4-9417-48c5-bd15-e8aae93105af tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f74d21f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1923394015", "description": "tempest-description-910360220"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:01.702811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:01.716123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:01.719059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:01.720547 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca028bd4-e6bf-4e2f-b7e6-b832b7ab62bb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.279014 Dec 25 21:10:01.733070 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 366/838] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:01 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:01.742800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:01.742800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:01.745429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.745885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.746695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.747165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.942469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:01.953900 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b52a6193-3b23-452f-a3fc-8a354c895699 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.219484 Dec 25 21:10:01.954988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 367/839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:01 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:01.973746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:01.974679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:01.980898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.981469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:01.982347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:01.982870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.156983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:02.165810 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca59eb67-cfb0-4632-b43f-6d9c5fa4df3e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.195265 Dec 25 21:10:02.166391 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 368/840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:01 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:02.172980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6cfa6ff7-ce6f-46b8-be67-8709238dd7c2 req-35a40829-530a-4f11-b630-5d9aad8d4389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ed7876-289e-4bb7-89b1-051968bd6e27", "name": "network-vif-plugged", "status": "completed", "tag": "11a8e073-faa1-4705-931b-5c53eaca0cb5"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:02.175148 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:02.175148 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:02.185922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e39829d4-9417-48c5-bd15-e8aae93105af tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.543430 Dec 25 21:10:02.185922 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 473/841] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:01 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:02.186751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6cfa6ff7-ce6f-46b8-be67-8709238dd7c2 req-35a40829-530a-4f11-b630-5d9aad8d4389 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.186751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6cfa6ff7-ce6f-46b8-be67-8709238dd7c2 req-35a40829-530a-4f11-b630-5d9aad8d4389 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.190470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:02.192397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:02.203165 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6cfa6ff7-ce6f-46b8-be67-8709238dd7c2 req-35a40829-530a-4f11-b630-5d9aad8d4389 service nova] Creating event network-vif-plugged:11a8e073-faa1-4705-931b-5c53eaca0cb5 for instance b5ed7876-289e-4bb7-89b1-051968bd6e27 on nch1-master-1 Dec 25 21:10:02.204299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.207727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.209330 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6cfa6ff7-ce6f-46b8-be67-8709238dd7c2 req-35a40829-530a-4f11-b630-5d9aad8d4389 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040936 Dec 25 21:10:02.210725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.210875 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 369/842] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:02.211550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.216926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db643500-a284-4d8a-a0c0-3b98a3c7cefd tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f730f9d0>, body: {"security_group_rule": {"parent_group_id": "149b12a1-a8cd-4a73-a0d9-43c4539a489b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "52689764-3ce9-43dd-9e16-a097939042c1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:02.289562 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36cfaf19-2bab-4a55-8567-ba359e39b51b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.104324 Dec 25 21:10:02.295310 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 474/843] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:02 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:02.301907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:02.302762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:02.310631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.311173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.312205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.312718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.567512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:02.589250 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54b33b7a-c2ba-4cdb-ad1f-f371385b8f59 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.289571 Dec 25 21:10:02.590123 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 475/844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:02 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:02.597447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:02.598325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:02.617091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.617853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.618687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.619230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.882090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:02.893147 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd1984cf-4f10-429d-b52d-9d84e7848c88 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1463 microversion: 2.1 time: 0.300777 Dec 25 21:10:02.894008 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 476/845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:02 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1463 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:02.903826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:02.904443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:02.917086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.925933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:02.927277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:02.928079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:03.014408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db643500-a284-4d8a-a0c0-3b98a3c7cefd tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.802248 Dec 25 21:10:03.016295 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 370/846] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:02 2021] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:03.028022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:03.028987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:03.036034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:03.036486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:03.037382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:03.037845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:03.405316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:03.413838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:03.415405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:03.416584 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48d8ea45-1cb7-46ed-a9c7-bcee4d64cffe tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.516622 Dec 25 21:10:03.417204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 477/847] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:02 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:03.475658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64dc79bf-a09c-41c3-bfd1-f74468f699fd tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'create', calling method: .version_select at 0x7fa4f73c2ee0>, body: {"keypair": {"name": "tempest-keypair-1900331492"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:03.481859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:03.489551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bdf22ede-dc5f-4087-a6ff-3b2e39be4a01 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1462 microversion: 2.1 time: 0.471894 Dec 25 21:10:03.489758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-64dc79bf-a09c-41c3-bfd1-f74468f699fd tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:03.491012 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 371/848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:03 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1462 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:03.495371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:03.496050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:03.502884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:03.503420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:03.504322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:03.504865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:03.511527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-64dc79bf-a09c-41c3-bfd1-f74468f699fd tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for user 888bca4c195e4f3185e32e956e256b06 and project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:03.753366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:03.758641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-64dc79bf-a09c-41c3-bfd1-f74468f699fd tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:03.761336 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-582b60da-2816-4f28-a693-ff427271c6e4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.269470 Dec 25 21:10:03.762103 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 372/849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:03 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:03.762974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-64dc79bf-a09c-41c3-bfd1-f74468f699fd tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for user 888bca4c195e4f3185e32e956e256b06 and project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:03.767007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca3f6ab0-efaa-4ce6-9869-11f4356c533b tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f733ddc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-234078110", "description": "tempest-description-378022361"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:03.785391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64dc79bf-a09c-41c3-bfd1-f74468f699fd tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.366966 Dec 25 21:10:03.785995 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 478/850] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:10:03 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:03.805684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:03.806317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:03.814347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:03.814913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:03.815874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:03.817814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.066759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:04.075841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81400d84-b0e7-408a-8ca5-399cc3e2d68e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1316 microversion: 2.1 time: 0.288807 Dec 25 21:10:04.076738 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 479/851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:03 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:04.081794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:04.083170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:04.090596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.091478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.092279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.092716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.138401 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af8e15d0-8ed3-454b-85af-42a3a57fee72 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.060087 Dec 25 21:10:04.139963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 480/852] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:04 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:04.146163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2097534929", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "9a8114c1-85b3-4e15-9e15-95159b456e41"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:04.230601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:04.491147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca3f6ab0-efaa-4ce6-9869-11f4356c533b tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.727654 Dec 25 21:10:04.495213 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 373/853] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:03 2021] POST /compute/v2.1/os-security-groups => generated 246 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:04.496561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:04.497352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:04.509412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.512731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.513820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.520946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.680296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:04.680843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:04.681217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:04.681633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:04.682047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:04.697971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.698426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.699475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.700149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.729719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Getting quotas for project c70df2525137490a9e18b5e4af25a7b4. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:04.737791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Getting quotas for user c6c295b9814d44efba37e7a37df6fa9b and project c70df2525137490a9e18b5e4af25a7b4. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:04.774405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:04.778167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:04.831855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:04.841337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a2318827-8bc4-42a1-9128-570fadc5d1f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.348089 Dec 25 21:10:04.851867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 374/854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:04 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:04.858707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c214853a-14b9-4143-a551-d486c45ef4cd req-3ce7980a-68e6-4702-b21c-13a7013a32f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34088aa4-5622-46a6-a155-94ef62f87546", "name": "network-vif-unplugged", "status": "completed", "tag": "1f34074e-0a6d-4eef-a7d5-cef1f7f400f3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:04.861918 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:04.861918 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:04.873920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c214853a-14b9-4143-a551-d486c45ef4cd req-3ce7980a-68e6-4702-b21c-13a7013a32f3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.874725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c214853a-14b9-4143-a551-d486c45ef4cd req-3ce7980a-68e6-4702-b21c-13a7013a32f3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.890508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c214853a-14b9-4143-a551-d486c45ef4cd req-3ce7980a-68e6-4702-b21c-13a7013a32f3 service nova] Creating event network-vif-unplugged:1f34074e-0a6d-4eef-a7d5-cef1f7f400f3 for instance 34088aa4-5622-46a6-a155-94ef62f87546 on nch2-master-1 Dec 25 21:10:04.895929 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c214853a-14b9-4143-a551-d486c45ef4cd req-3ce7980a-68e6-4702-b21c-13a7013a32f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041654 Dec 25 21:10:04.897198 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 375/855] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:04.902746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-535dc13b-ca7c-4ccc-98d4-d4e624f804ef req-3a1b44da-e0fa-40e0-b91b-6a45a704ded2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1843d1-a627-404e-adf4-56974bcaa614", "name": "network-vif-plugged", "status": "completed", "tag": "0c6d5976-8c28-4b25-8b9e-c7dc7add6588"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:04.905513 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:04.905513 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:04.918767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-535dc13b-ca7c-4ccc-98d4-d4e624f804ef req-3a1b44da-e0fa-40e0-b91b-6a45a704ded2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.918767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-535dc13b-ca7c-4ccc-98d4-d4e624f804ef req-3a1b44da-e0fa-40e0-b91b-6a45a704ded2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:04.932374 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-535dc13b-ca7c-4ccc-98d4-d4e624f804ef req-3a1b44da-e0fa-40e0-b91b-6a45a704ded2 service nova] Creating event network-vif-plugged:0c6d5976-8c28-4b25-8b9e-c7dc7add6588 for instance ed1843d1-a627-404e-adf4-56974bcaa614 on nch1-master-1 Dec 25 21:10:04.938713 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-535dc13b-ca7c-4ccc-98d4-d4e624f804ef req-3a1b44da-e0fa-40e0-b91b-6a45a704ded2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039665 Dec 25 21:10:04.939700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 376/856] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:04.940782 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d79340a-1bc8-4e81-ba55-e9edc81a3cef tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799236 Dec 25 21:10:04.946768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:04.948020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:04.951638 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 481/857] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:04.957989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cde7ad80-6db5-47aa-b00a-ffebb1760ddf tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f73c2820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-341784532", "description": "tempest-description-1373054702"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:04.995712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:04.998915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.003265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.003792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.355710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:05.383020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:05.385331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:05.386990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d65b2fa7-4739-421b-ad46-16c81930f7bd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.446004 Dec 25 21:10:05.387827 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 377/858] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:04 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:05.393127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:05.393746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:05.400474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.400994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.401801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.402271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.637832 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cde7ad80-6db5-47aa-b00a-ffebb1760ddf tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.684974 Dec 25 21:10:05.638456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 482/859] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:04 2021] POST /compute/v2.1/os-security-groups => generated 247 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:05.643472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-787abc6f-43c8-4253-a542-f4dfdf133efd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:05.644201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-787abc6f-43c8-4253-a542-f4dfdf133efd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:05.660272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:05.673403 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34e82be6-13ff-4494-996e-0b3fceb3512b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.283845 Dec 25 21:10:05.674176 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 378/860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:05 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:05.682016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:05.682634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:05.697647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.698100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.698915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.699358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.740957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-787abc6f-43c8-4253-a542-f4dfdf133efd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:05.746895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-787abc6f-43c8-4253-a542-f4dfdf133efd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1214 microversion: 2.1 time: 0.107356 Dec 25 21:10:05.757206 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 483/861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:05 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:05.764094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:05.765208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:05.773807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.774549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.775522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.776158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.848178 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-225a47fd-b44a-49dc-9b87-72b44e662dd2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.088918 Dec 25 21:10:05.849122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 484/862] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:05 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:05.855088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23eb8b0a-dfb3-4781-afe7-0c044b972b19 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f73a65e0>, body: {"security_group_rule": {"parent_group_id": "b69156ef-d5c8-4ebd-8a43-9f8dee41ff70", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "a8e83603-220e-4df4-b881-241db0fc572c"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:05.923231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:05.933119 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea39471e-021d-4416-a9ee-8b934604750d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1465 microversion: 2.1 time: 0.257961 Dec 25 21:10:05.934411 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 379/863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:05 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:05.941596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:05.942497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:05.971920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.972564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:05.973495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:05.974068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.313184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:06.324553 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35b894b1-1c69-4a12-bc27-1286f5069398 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.388244 Dec 25 21:10:06.328069 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 380/864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:05 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:06.342648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:06.343512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:06.350701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:06.351386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.352360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:06.352990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.539901 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a187fdb-8d36-4848-8317-ff92a401798e tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1616 microversion: 2.1 time: 0.200845 Dec 25 21:10:06.542487 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 381/865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:06 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1616 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:06.551151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:06.551746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:06.571819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:06.572274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.573116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:06.573864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.707284 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23eb8b0a-dfb3-4781-afe7-0c044b972b19 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.856017 Dec 25 21:10:06.707907 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 485/866] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:05 2021] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:06.722149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:06.723464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:06.739483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:06.740186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.741268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:06.743780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:06.877286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:06.899130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:06.900733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:06.902034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-965136e6-990d-4c38-b751-32b26052c19e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.358359 Dec 25 21:10:06.913194 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 382/867] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:06 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:06.917402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a520a3d-be5e-460f-8bb3-3e2e60197740 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f72ce160>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:07.024594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:07.042187 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99be4b40-97ea-48d9-afed-60ba4f986429 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1307 microversion: 2.1 time: 0.324793 Dec 25 21:10:07.043199 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 486/868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:06 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1307 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:07.050093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:07.051430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:07.060226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.065979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.065979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.065979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.147917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:07.158689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e6e4e5b-50ed-4972-90ed-9b691cc6cf08 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1266 microversion: 2.1 time: 0.112732 Dec 25 21:10:07.159577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 487/869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:07 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:07.164993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-988319952", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1b814523-70ff-4cb2-b14c-f77ae086c04f"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:07.249185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:07.334679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a520a3d-be5e-460f-8bb3-3e2e60197740 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/a8e83603-220e-4df4-b881-241db0fc572c" status: 202 len: 0 microversion: 2.1 time: 0.426087 Dec 25 21:10:07.335263 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 383/870] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:06 2021] DELETE /compute/v2.1/os-security-groups/a8e83603-220e-4df4-b881-241db0fc572c => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:07.341612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:07.342736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:07.349211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.351222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.352177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.353910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.408859 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-026697c4-115a-498f-9914-4b78e9148cbf tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.072031 Dec 25 21:10:07.409789 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 384/871] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:07 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:07.416577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e509e39f-7927-4590-ac80-2aa1368b7497 req-5cd88784-2a7f-4212-90b3-944bf5983de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34088aa4-5622-46a6-a155-94ef62f87546", "tag": "1f34074e-0a6d-4eef-a7d5-cef1f7f400f3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:07.418133 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:07.418133 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:07.426209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e509e39f-7927-4590-ac80-2aa1368b7497 req-5cd88784-2a7f-4212-90b3-944bf5983de9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.426671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e509e39f-7927-4590-ac80-2aa1368b7497 req-5cd88784-2a7f-4212-90b3-944bf5983de9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.439449 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e509e39f-7927-4590-ac80-2aa1368b7497 req-5cd88784-2a7f-4212-90b3-944bf5983de9 service nova] Creating event network-changed:1f34074e-0a6d-4eef-a7d5-cef1f7f400f3 for instance 34088aa4-5622-46a6-a155-94ef62f87546 on nch2-master-1 Dec 25 21:10:07.444721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e509e39f-7927-4590-ac80-2aa1368b7497 req-5cd88784-2a7f-4212-90b3-944bf5983de9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Dec 25 21:10:07.451881 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 385/872] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:07.462003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-87e0e7a1-c00f-4c62-8c8b-20a0be9a019a req-2efc43a3-880b-44f1-a868-0500230743e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee5cf04-7b9e-46fd-b317-75a118617c96", "name": "network-vif-plugged", "status": "completed", "tag": "5576e36d-eb31-4f83-b0d9-b502678406cc"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:07.464397 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:07.464397 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:07.472986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-87e0e7a1-c00f-4c62-8c8b-20a0be9a019a req-2efc43a3-880b-44f1-a868-0500230743e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.473658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-87e0e7a1-c00f-4c62-8c8b-20a0be9a019a req-2efc43a3-880b-44f1-a868-0500230743e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.487087 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-87e0e7a1-c00f-4c62-8c8b-20a0be9a019a req-2efc43a3-880b-44f1-a868-0500230743e9 service nova] Creating event network-vif-plugged:5576e36d-eb31-4f83-b0d9-b502678406cc for instance dee5cf04-7b9e-46fd-b317-75a118617c96 on nch1-master-1 Dec 25 21:10:07.493410 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-87e0e7a1-c00f-4c62-8c8b-20a0be9a019a req-2efc43a3-880b-44f1-a868-0500230743e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038767 Dec 25 21:10:07.494590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 386/873] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:07.505298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-564422659", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "d6675960-5a27-4fda-8ce3-11dfa09c56d6"}], "security_groups": [{"name": "tempest-securitygroup--629793168"}], "key_name": "tempest-keypair-1900331492", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:07.544404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:07.544838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:07.545419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:07.545831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:07.546245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:07.570410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.570981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.571693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.572137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.615831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:07.620185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Getting quotas for user 491f06d5a64145919a6e4a9ec0fa9171 and project 19a16dcc3c214ac2a218d3758e551792. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:07.637960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:07.640391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:07.712941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] validate_networks() for [('d6675960-5a27-4fda-8ce3-11dfa09c56d6', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:07.785516 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b060e32-bfb7-45d5-b83a-0cbbefae969d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624624 Dec 25 21:10:07.787032 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 488/874] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:07.792056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e43cffe9-de60-4fa6-bc6f-50f6109c4437 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f73b4940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:07.889086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e43cffe9-de60-4fa6-bc6f-50f6109c4437 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/b69156ef-d5c8-4ebd-8a43-9f8dee41ff70" status: 200 len: 246 microversion: 2.1 time: 0.100754 Dec 25 21:10:07.889910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 489/875] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:10:07 2021] GET /compute/v2.1/os-security-groups/b69156ef-d5c8-4ebd-8a43-9f8dee41ff70 => generated 246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:07.894921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:07.896313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:07.912083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.925208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:07.926520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:07.927198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.178187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:08.189618 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-366956a2-d20a-49d9-855a-b1fd1b1ddfab tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.298130 Dec 25 21:10:08.190818 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 490/876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:07 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:08.197714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d288c463-c66a-4780-a0bf-2b4820d35b30 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:08.199910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d288c463-c66a-4780-a0bf-2b4820d35b30 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:08.337991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d288c463-c66a-4780-a0bf-2b4820d35b30 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:08.346007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d288c463-c66a-4780-a0bf-2b4820d35b30 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1216 microversion: 2.1 time: 0.153777 Dec 25 21:10:08.347176 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 491/877] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:08 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:08.354069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38880916-4eb0-4744-80b9-fc8a2e0e412c tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f751c040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1360313012", "description": "tempest-description-1262720327"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:08.365982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:08.371474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for user 888bca4c195e4f3185e32e956e256b06 and project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:08.384005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:08.384766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:08.385339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:08.393140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:08.393140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:08.400095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.400551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.405726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.409820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.439304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:08.443514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Getting quotas for user 888bca4c195e4f3185e32e956e256b06 and project 4aa6a09f9e43475e8a7f5639f59b1654. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:08.455418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:08.458097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:08.597507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc7c6104-20e7-4a1b-ae31-56eed4f30aa2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.100946 Dec 25 21:10:08.598454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 387/878] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:07 2021] POST /compute/v2.1/servers => generated 408 bytes in 1103 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:08.605627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:08.606352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:08.616031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.617345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.619282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.619997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.779882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:08.786435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:08.788572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:08.789787 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-92cc9b33-cff6-493b-9df1-74c900aae026 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.189878 Dec 25 21:10:08.790346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 388/879] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:08 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:08.794562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:08.795159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:08.804698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.805128 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-38880916-4eb0-4744-80b9-fc8a2e0e412c tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.456203 Dec 25 21:10:08.805585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.809464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.809588 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 492/880] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:08 2021] POST /compute/v2.1/os-security-groups => generated 248 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:08.809674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.811019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:08.811651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:08.819122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.819910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:08.820864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:08.821525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.063779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:09.079086 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2bedece6-a605-45ab-a59a-e7e87aa4a6f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1487 microversion: 2.1 time: 0.287325 Dec 25 21:10:09.080404 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 389/881] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:08 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1487 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:09.086540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:09.088256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:09.096676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:09.097518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.099784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:09.099784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.128504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:09.142224 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e824cf88-94ab-41a3-8e88-f92115b04fe4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1314 microversion: 2.1 time: 0.334835 Dec 25 21:10:09.143086 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 493/882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:08 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:09.151201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-69e41558-dbf5-4e0a-804d-0266f5a187a7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:09.156362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-69e41558-dbf5-4e0a-804d-0266f5a187a7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:09.159831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3013bfdb-f29b-49f8-adda-301d5163449b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.077780 Dec 25 21:10:09.161129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 390/883] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:09 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:09.167008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4114bdb-21b5-407e-8785-119d9ac169e7 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f72f9ee0>, body: {"security_group_rule": {"parent_group_id": "6c513bf5-0bf6-4ed3-a52c-7a5ee9afd4f1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:09.314151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-69e41558-dbf5-4e0a-804d-0266f5a187a7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:09.322397 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-69e41558-dbf5-4e0a-804d-0266f5a187a7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1277 microversion: 2.1 time: 0.178268 Dec 25 21:10:09.329548 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 494/884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:09 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:09.334889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:09.335433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:09.343883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:09.344571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.350706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:09.350706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.775520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41b338e0-a83e-4863-a946-7b459914c2a5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614/action" status: 202 len: 0 microversion: 2.1 time: 0.444225 Dec 25 21:10:09.776476 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 495/885] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:09 2021] POST /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:09.785927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:09.793073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:09.795918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:09.796469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.797321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:09.797766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:09.985615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:09.997821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b37082d3-18c3-44ef-8f5b-f15ee3f12b61 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.216869 Dec 25 21:10:09.998525 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 496/886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:09 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:10.003478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:10.007186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:10.017341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.017807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.019273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.019858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.032173 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4114bdb-21b5-407e-8785-119d9ac169e7 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.869391 Dec 25 21:10:10.032783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 391/887] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:09 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:10.038494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:10.038864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:10.045532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.045982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.046817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.047253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.116465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.126327 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b193301-8a86-4971-b9f1-c96ec250beae tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1268 microversion: 2.1 time: 0.126082 Dec 25 21:10:10.127361 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 497/888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:09 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1268 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:10.133242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:10.134658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:10.142014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.142476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.143305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.143885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.344480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.352753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.356841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85b353eb-b0a8-4f76-9294-aadad95d88e9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1492 microversion: 2.1 time: 0.320783 Dec 25 21:10:10.356841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 392/889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:10 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1492 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:10.360036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80275823-a7a4-4b45-873f-bc9865c5c1ee tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Action: 'create', calling method: .version_select at 0x7fa4f731c310>, body: {"security_group_rule": {"parent_group_id": "6c513bf5-0bf6-4ed3-a52c-7a5ee9afd4f1", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:10.363520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.365371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.366834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bcf76396-2962-44b8-ac87-5cd509ed6018 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.238454 Dec 25 21:10:10.367406 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 498/890] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:10 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:10.374102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b99277a5-4096-4062-83ed-ece5570a068f req-d001a14c-3bb5-4be7-bc2c-883dc31fa6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4af366-b80d-4609-babc-fa7e67fc184a", "tag": "0452d256-fbe5-43b7-9bfc-ff41873d27cd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:10.376026 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:10.376026 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:10.399558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b99277a5-4096-4062-83ed-ece5570a068f req-d001a14c-3bb5-4be7-bc2c-883dc31fa6e0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.400090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b99277a5-4096-4062-83ed-ece5570a068f req-d001a14c-3bb5-4be7-bc2c-883dc31fa6e0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.416309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b99277a5-4096-4062-83ed-ece5570a068f req-d001a14c-3bb5-4be7-bc2c-883dc31fa6e0 service nova] Creating event network-changed:0452d256-fbe5-43b7-9bfc-ff41873d27cd for instance 4c4af366-b80d-4609-babc-fa7e67fc184a on nch2-master-1 Dec 25 21:10:10.422533 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b99277a5-4096-4062-83ed-ece5570a068f req-d001a14c-3bb5-4be7-bc2c-883dc31fa6e0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053582 Dec 25 21:10:10.423733 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 499/891] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:10.432021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:10.432727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:10.441938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.442611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.443320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.443773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.635234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.643135 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be991e02-74e6-4761-a927-dacb9e7cbbad tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1314 microversion: 2.1 time: 0.216793 Dec 25 21:10:10.653530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 500/892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:10 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:10.653530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:10.653530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:10.658025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.658565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.659434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.659942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.703883 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-74a6dfce-2f0e-4d77-8bc6-e704d8bb5cf9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.058253 Dec 25 21:10:10.704524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 501/893] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:10 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:10.710452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:10.711139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:10.718204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.722700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.722700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:10.722700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:10.804094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:10.820224 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a2cd297-c5d2-4a5c-a2c2-592a80114aec tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1273 microversion: 2.1 time: 0.114026 Dec 25 21:10:10.820834 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 502/894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:10 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1273 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:10.866979 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80275823-a7a4-4b45-873f-bc9865c5c1ee tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.510564 Dec 25 21:10:10.868423 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 393/895] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:10 2021] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:10.878859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5827d2e-edd7-4516-8b90-4e5256521e3b tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f73b4ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:10.934012 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5827d2e-edd7-4516-8b90-4e5256521e3b tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/6c513bf5-0bf6-4ed3-a52c-7a5ee9afd4f1" status: 200 len: 665 microversion: 2.1 time: 0.058825 Dec 25 21:10:10.934640 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 503/896] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:10:10 2021] GET /compute/v2.1/os-security-groups/6c513bf5-0bf6-4ed3-a52c-7a5ee9afd4f1 => generated 665 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:10:10.948168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27d21076-024c-460c-8b15-6ee27772cbb5 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f732f280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.014984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.015693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:11.022335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.023594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.024942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.025600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.218312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:11.228434 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68cce248-4333-4f5b-8261-eaeee4bbc0c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1311 microversion: 2.1 time: 0.217282 Dec 25 21:10:11.229059 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 504/897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:11 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1311 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:11.242635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.243314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:11.252771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.256776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.256776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.256776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.282992 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27d21076-024c-460c-8b15-6ee27772cbb5 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-group-rules/1d3ba781-a168-4c8e-bf5e-e4c3990c6db3" status: 202 len: 0 microversion: 2.1 time: 0.340465 Dec 25 21:10:11.283614 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 394/898] 10.222.0.32 () {58 vars in 1286 bytes} [Sat Dec 25 21:10:10 2021] DELETE /compute/v2.1/os-security-group-rules/1d3ba781-a168-4c8e-bf5e-e4c3990c6db3 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:11.293135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce9a3c64-0f20-42bf-ad18-08e541e4062e tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f72f9f70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.355828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:11.364078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5351ca8-db31-4f00-8a13-567338d9367e tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1274 microversion: 2.1 time: 0.133946 Dec 25 21:10:11.365094 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 505/899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:11 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:11.371859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.377157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:11.379924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.380552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.381586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.382211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.673535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:11.684721 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0724fb85-6338-496d-b120-91e8b3a85d67 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 200 len: 1472 microversion: 2.1 time: 0.316574 Dec 25 21:10:11.687284 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 506/900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:11 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:11.694609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.695224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:11.709636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.712131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.713876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.714203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.823469 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce9a3c64-0f20-42bf-ad18-08e541e4062e tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/6c513bf5-0bf6-4ed3-a52c-7a5ee9afd4f1" status: 202 len: 0 microversion: 2.1 time: 0.534223 Dec 25 21:10:11.824833 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 395/901] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:11 2021] DELETE /compute/v2.1/os-security-groups/6c513bf5-0bf6-4ed3-a52c-7a5ee9afd4f1 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:10:11.839080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:11.842883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:11.852555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.853351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:11.854368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:11.855764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.018656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:12.029234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:12.030747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:12.031974 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80635b75-e59d-4fbb-b21c-dfcc326d77fa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.342728 Dec 25 21:10:12.033132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 507/902] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:11 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:12.037936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-393348140"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:12.039015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:12.045621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.046248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.047272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.048045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.105149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:12.112974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab9d3531-5a07-4817-a758-934ec3d88415 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1314 microversion: 2.1 time: 0.282752 Dec 25 21:10:12.117002 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 396/903] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:11 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:12.119932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:12.121144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:12.127748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.128420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.129501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.130298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.196311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d574ddd4-5c83-499c-8813-53dc43ac5efe tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.078330 Dec 25 21:10:12.199226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 397/904] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:12 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:12.209589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-813365ca-331b-4bc9-968e-6502b148a215 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f72c6d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:12.278684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-813365ca-331b-4bc9-968e-6502b148a215 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8e83603-220e-4df4-b881-241db0fc572c does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:10:12.279349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-813365ca-331b-4bc9-968e-6502b148a215 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Neutron security group a8e83603-220e-4df4-b881-241db0fc572c not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:10:12.280763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-813365ca-331b-4bc9-968e-6502b148a215 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] HTTP exception thrown: Security group a8e83603-220e-4df4-b881-241db0fc572c does not exist Dec 25 21:10:12.280763 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-84575c02-83d3-473c-9d0a-1c81287b901f'] Dec 25 21:10:12.281684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-813365ca-331b-4bc9-968e-6502b148a215 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Returning 404 to user: Security group a8e83603-220e-4df4-b881-241db0fc572c does not exist Dec 25 21:10:12.281684 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-84575c02-83d3-473c-9d0a-1c81287b901f'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:12.283151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-813365ca-331b-4bc9-968e-6502b148a215 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/a8e83603-220e-4df4-b881-241db0fc572c" status: 404 len: 194 microversion: 2.1 time: 0.082773 Dec 25 21:10:12.285018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 398/905] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:12 2021] DELETE /compute/v2.1/os-security-groups/a8e83603-220e-4df4-b881-241db0fc572c => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:12.294804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:12.295558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:12.309953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.311403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.312494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.313910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.420636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:12.432239 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b83aeb4-c95c-4267-8dfa-5e4ada016955 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1335 microversion: 2.1 time: 0.144943 Dec 25 21:10:12.433944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 399/906] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:12 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1335 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:12.441434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:12.441434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:12.450289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.451122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.452157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.453005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.711921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2cedfaef-2c0b-4012-8927-4154840d0e08 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614/action" status: 202 len: 0 microversion: 2.1 time: 0.677001 Dec 25 21:10:12.713029 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 508/907] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:12 2021] POST /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:10:12.715585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:12.718964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4468a2ea-7edf-4191-8a81-d6627874732e tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f73b4a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:12.730324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-568c13d6-0341-448d-bd2c-a5fb2896f0c9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1495 microversion: 2.1 time: 0.294331 Dec 25 21:10:12.731281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 400/908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:12 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1495 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:12.739708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:12.740356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:12.750671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.751974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:12.753508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:12.754031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:13.223646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:13.239714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29b55443-b39f-4246-986d-ac41cb62bcc8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1316 microversion: 2.1 time: 0.507394 Dec 25 21:10:13.253730 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 401/909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:12 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1316 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:13.265592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98726752-bba3-43cd-905b-5c660197e89b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f72f8ee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:13.352241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98726752-bba3-43cd-905b-5c660197e89b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.096625 Dec 25 21:10:13.357203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 402/910] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:13 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:13.368744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:13.370182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:13.381645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4468a2ea-7edf-4191-8a81-d6627874732e tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/b69156ef-d5c8-4ebd-8a43-9f8dee41ff70" status: 202 len: 0 microversion: 2.1 time: 0.667563 Dec 25 21:10:13.383241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 509/911] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:12 2021] DELETE /compute/v2.1/os-security-groups/b69156ef-d5c8-4ebd-8a43-9f8dee41ff70 => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:13.386399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:13.387124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:13.388508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:13.389191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:13.389691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:13.390432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:13.410902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:13.410902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:13.411404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:13.411860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.082957 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b26054f8-2b7b-4053-8b0c-ffa7c9c3ac3c tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1646 microversion: 2.1 time: 0.724220 Dec 25 21:10:14.084491 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 403/912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:13 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1646 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:14.091292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:14.107242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:14.109927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:14.110709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:14.111163 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a6894c5-8525-432d-8637-f0abbc8fca7a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.726903 Dec 25 21:10:14.111597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:14.112200 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 510/913] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:13 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:14.118880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:14.123132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:14.123280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.125411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.126380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.126847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.127156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.127766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.128768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.129380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.187549 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b461b1ba-c57d-4b52-96c2-6eb495a05ce7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.073848 Dec 25 21:10:14.191602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 511/914] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:14 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:14.193295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dafc6176-6115-4805-bebf-694cad9d8923 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f7498c10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:14.445085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:14.452763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-582912fe-39e5-421d-856d-c1cae30a8454 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1314 microversion: 2.1 time: 0.367016 Dec 25 21:10:14.453467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 404/915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:14 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:14.458154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:14.459618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:14.465816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.470951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.470951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.470951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.749106 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dafc6176-6115-4805-bebf-694cad9d8923 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/52689764-3ce9-43dd-9e16-a097939042c1" status: 202 len: 0 microversion: 2.1 time: 0.559453 Dec 25 21:10:14.750303 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 512/916] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:14 2021] DELETE /compute/v2.1/os-security-groups/52689764-3ce9-43dd-9e16-a097939042c1 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:14.757118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0390c3eb-d0d4-443e-a3c8-0e8e4a2c7201 req-20adea29-bf5c-4ff0-a14b-af776fb3dace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d796d09-01b6-48f2-995f-4dbfa40b46ea", "tag": "315b00f0-a83e-4f05-a40b-5792fef297dd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:14.758759 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:14.758759 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:14.769838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0390c3eb-d0d4-443e-a3c8-0e8e4a2c7201 req-20adea29-bf5c-4ff0-a14b-af776fb3dace service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.770497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0390c3eb-d0d4-443e-a3c8-0e8e4a2c7201 req-20adea29-bf5c-4ff0-a14b-af776fb3dace service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.786993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0390c3eb-d0d4-443e-a3c8-0e8e4a2c7201 req-20adea29-bf5c-4ff0-a14b-af776fb3dace service nova] Creating event network-changed:315b00f0-a83e-4f05-a40b-5792fef297dd for instance 9d796d09-01b6-48f2-995f-4dbfa40b46ea on nch2-master-1 Dec 25 21:10:14.792849 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0390c3eb-d0d4-443e-a3c8-0e8e4a2c7201 req-20adea29-bf5c-4ff0-a14b-af776fb3dace service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040876 Dec 25 21:10:14.797031 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 513/917] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:14.801947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:14.803926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:14.811873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.813454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.815056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:14.816413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.817411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.833438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-390302b8-eba8-43c3-8bdb-3a4432bfe905 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.375620 Dec 25 21:10:14.838052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 405/918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:14 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:14.856036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:14.857245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:14.865511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.869043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:14.869888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:14.870363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.211611 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8e940d6e-5b24-476f-8905-b76ad8f4a43f tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1646 microversion: 2.1 time: 0.415362 Dec 25 21:10:15.212300 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 514/919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:14 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1646 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:15.217410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70521453-60b0-4404-97fd-6b90adc92760 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7526af0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:15.276815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:15.297364 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e543e1b5-ae00-4776-a6bf-cbded2bd69b7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1316 microversion: 2.1 time: 0.458077 Dec 25 21:10:15.299047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70521453-60b0-4404-97fd-6b90adc92760 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.085368 Dec 25 21:10:15.299650 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 515/920] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:15 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:15.304190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e28c936-9e9e-4633-a6d7-b2cef87d7d48 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f7533670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:15.309768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 406/921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:14 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:15.316141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:15.317163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:15.325509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:15.326047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.328754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:15.328754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.848524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:15.857996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:15.859533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:15.860975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2eaf29d2-33ee-42ff-8a26-56b86283f989 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1645 microversion: 2.25 time: 0.549848 Dec 25 21:10:15.871819 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 407/922] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:15 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1645 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:15.876637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:15.877635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:15.883738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:15.884561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.885017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:15.885461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.937975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7e74cbe-4269-4d8a-8f34-9b24bca86f27 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.064730 Dec 25 21:10:15.942180 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 408/923] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:15 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:15.948986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-654e12d8-e60e-46d4-af9b-d48aed24e5db tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:15.948986 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:15.948986 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:15.948986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-654e12d8-e60e-46d4-af9b-d48aed24e5db tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:15.950027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-654e12d8-e60e-46d4-af9b-d48aed24e5db tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.950510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-654e12d8-e60e-46d4-af9b-d48aed24e5db tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:15.951147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-654e12d8-e60e-46d4-af9b-d48aed24e5db tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:15.981096 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-654e12d8-e60e-46d4-af9b-d48aed24e5db tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.041183 Dec 25 21:10:15.981871 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 409/924] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:10:15 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:15.989221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5c5fcf6c-492d-4cdf-8b2a-fd2989b9efa8 req-ef69a34e-0b43-4085-8704-7ec8278fa1ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17b1ffc-cea0-4158-9ac3-273da9149cd5", "tag": "d2192e86-fcbc-467e-974d-50439566abff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:15.991332 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:15.991332 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:15.999962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5c5fcf6c-492d-4cdf-8b2a-fd2989b9efa8 req-ef69a34e-0b43-4085-8704-7ec8278fa1ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.000516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5c5fcf6c-492d-4cdf-8b2a-fd2989b9efa8 req-ef69a34e-0b43-4085-8704-7ec8278fa1ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.017192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5c5fcf6c-492d-4cdf-8b2a-fd2989b9efa8 req-ef69a34e-0b43-4085-8704-7ec8278fa1ec service nova] Creating event network-changed:d2192e86-fcbc-467e-974d-50439566abff for instance e17b1ffc-cea0-4158-9ac3-273da9149cd5 on nch2-master-1 Dec 25 21:10:16.022767 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5c5fcf6c-492d-4cdf-8b2a-fd2989b9efa8 req-ef69a34e-0b43-4085-8704-7ec8278fa1ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039735 Dec 25 21:10:16.023548 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 410/925] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:16.029107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c7f38c1b-4147-412e-9ae4-058e8ba1aeef req-fc7a5838-3cc7-4242-a564-504aa1e846e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4af366-b80d-4609-babc-fa7e67fc184a", "name": "network-vif-plugged", "status": "completed", "tag": "0452d256-fbe5-43b7-9bfc-ff41873d27cd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:16.030614 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:16.030614 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:16.039080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c7f38c1b-4147-412e-9ae4-058e8ba1aeef req-fc7a5838-3cc7-4242-a564-504aa1e846e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.039517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c7f38c1b-4147-412e-9ae4-058e8ba1aeef req-fc7a5838-3cc7-4242-a564-504aa1e846e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.058720 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c7f38c1b-4147-412e-9ae4-058e8ba1aeef req-fc7a5838-3cc7-4242-a564-504aa1e846e9 service nova] Creating event network-vif-plugged:0452d256-fbe5-43b7-9bfc-ff41873d27cd for instance 4c4af366-b80d-4609-babc-fa7e67fc184a on nch2-master-1 Dec 25 21:10:16.063831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c7f38c1b-4147-412e-9ae4-058e8ba1aeef req-fc7a5838-3cc7-4242-a564-504aa1e846e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039059 Dec 25 21:10:16.065063 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 411/926] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:16.071239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:16.077085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:16.089939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.090448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.091184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.091610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.149042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e28c936-9e9e-4633-a6d7-b2cef87d7d48 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/149b12a1-a8cd-4a73-a0d9-43c4539a489b" status: 202 len: 0 microversion: 2.1 time: 0.848294 Dec 25 21:10:16.153998 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 516/927] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:15 2021] DELETE /compute/v2.1/os-security-groups/149b12a1-a8cd-4a73-a0d9-43c4539a489b => generated 0 bytes in 854 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:16.159002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:16.159682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:16.168112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.168852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.169955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.171193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.421745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:16.431215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c921b671-489a-4005-96e7-a8784cc1d880 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1314 microversion: 2.1 time: 0.363897 Dec 25 21:10:16.440764 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 412/928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:16 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:16.446161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:16.446821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:16.453107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.453862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.454988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.455429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.460250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:16.469912 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5592e263-8d6d-47d5-86b2-cc34eca7b85c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.314242 Dec 25 21:10:16.477633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 517/929] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:16 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:16.485083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b3b63e7-46d2-44ea-82a7-fcda065e4861 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f7533820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:16.631069 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dad0963c-8de2-4204-b5b7-2d394259c215 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96/action" status: 202 len: 0 microversion: 2.1 time: 0.188736 Dec 25 21:10:16.632126 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 413/930] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:16 2021] POST /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:16.637950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fbf0358c-5a0c-46a7-9ed7-9825f95d62c2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f732f280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:16.714422 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fbf0358c-5a0c-46a7-9ed7-9825f95d62c2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.080687 Dec 25 21:10:16.715293 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 414/931] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:16 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:16.720430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:16.721202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:16.729751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.730207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.731013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.732542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.959589 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b3b63e7-46d2-44ea-82a7-fcda065e4861 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/dc621918-a7d1-48ee-8b52-754e8b0b3c6f" status: 202 len: 0 microversion: 2.1 time: 0.477271 Dec 25 21:10:16.961283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 518/932] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:16 2021] DELETE /compute/v2.1/os-security-groups/dc621918-a7d1-48ee-8b52-754e8b0b3c6f => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:16.967522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:16.968156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:16.974884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.975409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:16.976209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:16.976705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.089431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:17.097500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6490ed8-827e-4bf3-a24f-601ae5f04cd0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1316 microversion: 2.1 time: 0.381089 Dec 25 21:10:17.098175 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 415/933] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:16 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1316 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:17.121160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:17.122062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:17.130281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.133330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.133330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.133330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.342222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2796772-dd0c-4bf8-a507-930363f5f17e tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1651 microversion: 2.1 time: 0.379160 Dec 25 21:10:17.351838 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 519/934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:16 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1651 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:17.357577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:17.358797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:17.369853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.370523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.372436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.372436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.410559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:17.421791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a5d5494-6e2a-45db-9449-d2f9c7d43ec9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.068212 Dec 25 21:10:17.423130 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 520/935] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:17 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:17.425949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:17.430231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04d1d464-65ef-45d9-addb-ee5152a770d9 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] Calling method '.version_select at 0x7fa4f76ef3a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:17.442857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:17.444887 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b59a52c-7543-415a-a5e8-ceecbc1091a2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1635 microversion: 2.25 time: 0.328291 Dec 25 21:10:17.445923 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 416/936] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:17 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1635 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:17.459634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:17.460585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:17.473802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.474625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.478005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.479525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.728404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:17.739284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b55b863-6493-426c-9ff8-d010166026fd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1314 microversion: 2.1 time: 0.292133 Dec 25 21:10:17.740713 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 417/937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:17 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:17.752791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3bb3418c-a095-4ac7-9d3c-a4e0759f7e03 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '.version_select at 0x7fa4f72feb80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:17.754494 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:17.754494 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:17.756282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bb3418c-a095-4ac7-9d3c-a4e0759f7e03 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.756740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bb3418c-a095-4ac7-9d3c-a4e0759f7e03 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.766621 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3bb3418c-a095-4ac7-9d3c-a4e0759f7e03 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.024458 Dec 25 21:10:17.767478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 418/938] 10.222.0.32 () {60 vars in 1183 bytes} [Sat Dec 25 21:10:17 2021] GET /compute/v2.1/os-migrations => generated 1940 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:17.773553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:17.774496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:17.782486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.783177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:17.784297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:17.784925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.242992 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04d1d464-65ef-45d9-addb-ee5152a770d9 tempest-SecurityGroupRulesTestJSON-1060210440 tempest-SecurityGroupRulesTestJSON-1060210440-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/c85a04f2-223d-48a1-97e6-caa2ec88908b" status: 202 len: 0 microversion: 2.1 time: 0.818297 Dec 25 21:10:18.244006 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 521/939] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:17 2021] DELETE /compute/v2.1/os-security-groups/c85a04f2-223d-48a1-97e6-caa2ec88908b => generated 0 bytes in 820 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:18.248593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4e9a2e6-3298-4057-97e3-2e020e0936c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f73a6dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:18.319553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:18.319553 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b6b0ecb-7c84-4025-98d1-b3260ea90de3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.548445 Dec 25 21:10:18.320378 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 419/940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:17 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:18.334162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:18.338378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:18.346232 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4e9a2e6-3298-4057-97e3-2e020e0936c0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.101192 Dec 25 21:10:18.351896 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 522/941] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:18 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:18.354500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.355294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.356279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.356417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:18.357050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.358323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:18.366307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.366776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.367642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.368731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.587210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:18.599291 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99e1158c-7522-4150-a7fa-4a92c268fa11 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1316 microversion: 2.1 time: 0.250943 Dec 25 21:10:18.602364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 523/942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:18 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:18.606124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-978a106b-dd11-4fe6-bade-58b7d3a85131 req-efe9e852-90b8-4c99-bb80-a5ae91b27027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1843d1-a627-404e-adf4-56974bcaa614", "name": "network-vif-plugged", "status": "completed", "tag": "0c6d5976-8c28-4b25-8b9e-c7dc7add6588"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:18.611316 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:18.611316 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:18.620760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-978a106b-dd11-4fe6-bade-58b7d3a85131 req-efe9e852-90b8-4c99-bb80-a5ae91b27027 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.621514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-978a106b-dd11-4fe6-bade-58b7d3a85131 req-efe9e852-90b8-4c99-bb80-a5ae91b27027 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.643447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-978a106b-dd11-4fe6-bade-58b7d3a85131 req-efe9e852-90b8-4c99-bb80-a5ae91b27027 service nova] Creating event network-vif-plugged:0c6d5976-8c28-4b25-8b9e-c7dc7add6588 for instance ed1843d1-a627-404e-adf4-56974bcaa614 on nch1-master-1 Dec 25 21:10:18.652445 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-978a106b-dd11-4fe6-bade-58b7d3a85131 req-efe9e852-90b8-4c99-bb80-a5ae91b27027 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050670 Dec 25 21:10:18.653672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 524/943] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:18.660455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:18.665521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:18.671531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.672262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.673285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.673886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.678145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:10:18.695572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2cb91165-616c-46c7-ac56-db0d2ff687f1 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 2127 microversion: 2.25 time: 0.373928 Dec 25 21:10:18.696453 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 420/944] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:18 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 2127 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:18.701115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:18.702564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:18.710362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.711078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.712041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.712675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.794210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-788f7f13-20ec-4476-92b5-18112612aec6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.096305 Dec 25 21:10:18.795600 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 421/945] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:18 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:18.801534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:18.803353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:18.812674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.813416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.814558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.815147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.868688 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55f77e46-4a81-46d9-bdb5-d87975e21702 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1631 microversion: 2.1 time: 0.213440 Dec 25 21:10:18.871869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 525/946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:18 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1631 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:18.878925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:18.881731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:18.889102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.889551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:18.890521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:18.891009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.212581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:10:19.239706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:19.242137 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b498282d-257d-4403-a5ee-fd69fd90bd52 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 2127 microversion: 2.25 time: 0.444735 Dec 25 21:10:19.243251 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 422/947] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:10:18 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 2127 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:10:19.248793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:19.249581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6cd24fd0-243a-4559-8f1c-39d2a8e62167 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1464 microversion: 2.1 time: 0.376509 Dec 25 21:10:19.249960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:19.262402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.262402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.262402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.262402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.263865 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 526/948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:18 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1464 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:19.320540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lazy-loading 'flavor' on Instance uuid dee5cf04-7b9e-46fd-b317-75a118617c96 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:10:19.346301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Going to try to live migrate instance to nch2-master-1 {{(pid=136547) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:10:19.464507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:19.468139 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:19.468139 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:19.469769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'deleted': False, 'project_id': '27a856db1f1e4d76973ed5345627e80c'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:19.479819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.483360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.483360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.483360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.641877 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9c196c6-a358-40d7-9f8a-fb18bc5fb916 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.376571 Dec 25 21:10:19.642539 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 527/949] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:10:19 2021] GET /compute/v2.1/servers/detail => generated 15 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:19.647751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:19.648712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:19.656578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.657074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.657870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.658302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.844197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:19.857491 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb26dc0a-1c10-4d6f-b5d3-1c1180a60e26 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.213688 Dec 25 21:10:19.868638 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 528/950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:19 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:19.871302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:19.871960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:19.881562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.882320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:19.882955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:19.883398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:20.144517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lazy-loading 'services' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:10:20.518265 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-777ac030-d129-4e20-923a-4a94823842e1 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "DELETE /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments/64f56b9c-4663-4274-84df-9ac590d6eef0" status: 202 len: 0 microversion: 2.25 time: 0.657312 Dec 25 21:10:20.519043 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 529/951] 10.222.0.32 () {60 vars in 1456 bytes} [Sat Dec 25 21:10:19 2021] DELETE /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments/64f56b9c-4663-4274-84df-9ac590d6eef0 => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:20.530053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb9806f4-7091-49ee-8a23-1f8dc55729c2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f74699d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:20.594905 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cb9806f4-7091-49ee-8a23-1f8dc55729c2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.072623 Dec 25 21:10:20.594905 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 530/952] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:20 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:20.599606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:20.600857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:20.608053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:20.608512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:20.609417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:20.610051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:20.853303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:20.861988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3e7c176-9a47-472b-bb11-6fcf0ea766c4 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1316 microversion: 2.1 time: 0.266038 Dec 25 21:10:20.870963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 531/953] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:20 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:20.870963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:20.872718 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:20.872718 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:20.874056 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:20.874056 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:20.875689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'deleted': False} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:20.880638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:20.881136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:20.881987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:20.882427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:21.075503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Listed batch of 19 results from cell out of 1000 limit. Returned 19 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:10:21.181754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:21.182212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:21.809770 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b5d72f07-24e3-4365-b4fb-3eb2a767b695 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 30848 microversion: 2.1 time: 0.946224 Dec 25 21:10:21.810475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 532/954] 10.222.0.32 () {58 vars in 1170 bytes} [Sat Dec 25 21:10:20 2021] GET /compute/v2.1/servers/detail?all_tenants= => generated 30848 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:21.841878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:21.843011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:21.860671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:21.861375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:21.862382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:21.863000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:21.922579 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a155759b-24e1-45b1-88c4-7f6819eba074 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.095764 Dec 25 21:10:21.927729 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 533/955] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:21 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:21.935707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:21.936724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:21.955875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:21.956811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:21.958130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:21.959002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.011072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a2f0eeb-567d-4dfd-a0fd-0422fcc539a7 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.081958 Dec 25 21:10:22.014424 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 534/956] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:10:21 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:22.020156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a316195d-71e6-4d7c-9253-2e46fdd65ef2 req-ac2e0b39-b783-4538-a1c7-a54892e91415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d796d09-01b6-48f2-995f-4dbfa40b46ea", "name": "network-vif-plugged", "status": "completed", "tag": "315b00f0-a83e-4f05-a40b-5792fef297dd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:22.022325 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:22.022325 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:22.030100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a316195d-71e6-4d7c-9253-2e46fdd65ef2 req-ac2e0b39-b783-4538-a1c7-a54892e91415 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.036853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a316195d-71e6-4d7c-9253-2e46fdd65ef2 req-ac2e0b39-b783-4538-a1c7-a54892e91415 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.043319 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a316195d-71e6-4d7c-9253-2e46fdd65ef2 req-ac2e0b39-b783-4538-a1c7-a54892e91415 service nova] Creating event network-vif-plugged:315b00f0-a83e-4f05-a40b-5792fef297dd for instance 9d796d09-01b6-48f2-995f-4dbfa40b46ea on nch2-master-1 Dec 25 21:10:22.049752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a316195d-71e6-4d7c-9253-2e46fdd65ef2 req-ac2e0b39-b783-4538-a1c7-a54892e91415 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033113 Dec 25 21:10:22.053964 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 535/957] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:22.057256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:22.071738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:22.079931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.080390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.082158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.084116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.471246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:22.481188 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a4591a40-98e0-482c-8c7b-a95cff9899de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.428335 Dec 25 21:10:22.497222 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 536/958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:22 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:22.511917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-250004ba-cf72-4e9c-b8f4-16c97acd9867 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f72dfc10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:22.577791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-250004ba-cf72-4e9c-b8f4-16c97acd9867 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.076327 Dec 25 21:10:22.578898 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 537/959] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:22 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:22.586353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:22.595792 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:22.595792 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:22.598277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'deleted': False, 'project_id': '27a856db1f1e4d76973ed5345627e80c'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:22.604653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.604653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.605859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.606439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.639027 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5fc7496-e1df-4557-944d-27c7e999338e tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?tenant_id=c70df2525137490a9e18b5e4af25a7b4" status: 200 len: 15 microversion: 2.1 time: 0.058154 Dec 25 21:10:22.639814 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 538/960] 10.222.0.32 () {58 vars in 1230 bytes} [Sat Dec 25 21:10:22 2021] GET /compute/v2.1/servers/detail?tenant_id=c70df2525137490a9e18b5e4af25a7b4 => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:22.647060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:22.647917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:22.655008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.655669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.656451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.656906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.836185 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7db9eae-bafa-4067-8cea-aa7ca5302aa0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96/action" status: 202 len: 0 microversion: 2.1 time: 3.591820 Dec 25 21:10:22.837842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 423/961] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:19 2021] POST /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96/action => generated 0 bytes in 3594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:22.846594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:22.852427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:22.860787 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a8a9f14-5660-4257-abe6-27c16c49ff58 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1316 microversion: 2.1 time: 0.219424 Dec 25 21:10:22.861404 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 539/962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:22 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:22.863403 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:22.863403 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:22.867964 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:22.867964 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:22.872821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:22.873475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:22.876018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'tenant_id': 'c70df2525137490a9e18b5e4af25a7b4', 'deleted': False} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:22.889682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.890454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.891316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.892246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.892684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.893288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:22.894162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:22.894595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.048956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:10:23.158372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.159390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.208415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:23.219179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d8c1bfa-e56f-4525-8e52-1ecfbe07a7f8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.356556 Dec 25 21:10:23.229917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 540/963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:22 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:23.229917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:23.229917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:23.259873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.260395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.261717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.262161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.327636 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5261b5a7-b771-4cba-95eb-be2990a52b6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.103228 Dec 25 21:10:23.331495 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 541/964] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:23 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:23.336310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:23.337885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:23.361172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.361633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.362624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.363079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.427993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5466b351-d6aa-47bb-85d0-337218aa445d tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.097052 Dec 25 21:10:23.429193 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 542/965] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:10:23 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:23.512528 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1cae4553-efb1-4d99-9b77-f3bac572dfc9 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c70df2525137490a9e18b5e4af25a7b4" status: 200 len: 4825 microversion: 2.1 time: 0.666813 Dec 25 21:10:23.512528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 424/966] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:10:22 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c70df2525137490a9e18b5e4af25a7b4 => generated 4825 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:23.525536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:23.529967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:23.534351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:23.538300 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:23.538300 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:23.541122 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:detail:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:23.541122 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:23.557489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.558373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'tenant_id': '27a856db1f1e4d76973ed5345627e80c', 'deleted': False} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:23.566114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.567200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.569316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.572180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.572637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.573500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.573943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.640409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad1d7dec-6f69-4752-9e89-8ffda9432654 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=27a856db1f1e4d76973ed5345627e80c" status: 200 len: 15 microversion: 2.1 time: 0.109165 Dec 25 21:10:23.643396 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 425/967] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:10:23 2021] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=27a856db1f1e4d76973ed5345627e80c => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:23.659123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39ef63fd-c404-475a-a25d-5f3d1975a823 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f728b9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:23.749070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39ef63fd-c404-475a-a25d-5f3d1975a823 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.104314 Dec 25 21:10:23.751302 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 426/968] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:23 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:23.760098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6bdaa392-81f9-4c6c-bb61-8315fca2439f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:23.777210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6bdaa392-81f9-4c6c-bb61-8315fca2439f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.018214 Dec 25 21:10:23.789876 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 427/969] 10.222.0.32 () {58 vars in 1188 bytes} [Sat Dec 25 21:10:23 2021] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:23.800025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:23.801475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:23.810257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.811498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:23.812502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:23.813168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.330435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:24.331386 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0467fa9c-fcaf-41f0-b0fb-bbce0c5e3636 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 0 microversion: 2.1 time: 0.540273 Dec 25 21:10:24.332520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 428/970] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:23 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:24.341953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:24.343061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:24.346207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6879717a-14e4-467b-9ab7-3ceaf5f3d097 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.836456 Dec 25 21:10:24.347562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 543/971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:23 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:24.353814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.354558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.354920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7039a124-2acf-47ca-8892-32a2f3a2c5cc req-9abea8d2-77b8-4d5f-947b-ab35c889db0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b1ffc-cea0-4158-9ac3-273da9149cd5", "name": "network-vif-plugged", "status": "completed", "tag": "d2192e86-fcbc-467e-974d-50439566abff"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:24.355718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.356301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.359823 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:24.359823 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:24.373956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7039a124-2acf-47ca-8892-32a2f3a2c5cc req-9abea8d2-77b8-4d5f-947b-ab35c889db0e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.375127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7039a124-2acf-47ca-8892-32a2f3a2c5cc req-9abea8d2-77b8-4d5f-947b-ab35c889db0e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.401998 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7039a124-2acf-47ca-8892-32a2f3a2c5cc req-9abea8d2-77b8-4d5f-947b-ab35c889db0e service nova] Creating event network-vif-plugged:d2192e86-fcbc-467e-974d-50439566abff for instance e17b1ffc-cea0-4158-9ac3-273da9149cd5 on nch2-master-1 Dec 25 21:10:24.407603 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7039a124-2acf-47ca-8892-32a2f3a2c5cc req-9abea8d2-77b8-4d5f-947b-ab35c889db0e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058890 Dec 25 21:10:24.409167 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 544/972] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:24.416188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:24.417093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:24.425766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.426643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.428218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.428951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.750745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:24.774463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9970fb83-f6fb-42a8-8ef5-3efc41052fb8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1466 microversion: 2.1 time: 0.439829 Dec 25 21:10:24.776820 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 429/973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:24 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1466 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:24.779915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:24.782882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:24.784473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:24.791452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44f30b0f-ea96-4bf8-989d-88bb093934f0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.380789 Dec 25 21:10:24.792768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 545/974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:24 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:24.794924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.795669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.797190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.797783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.800311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:24.813708 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:24.813708 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:24.816350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:24.816350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:24.822143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.823068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.824011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:24.824756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:24.930651 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58a8e97c-68cc-4cfd-8f1b-9058cac47eaa tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.148391 Dec 25 21:10:24.934583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 430/975] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:24 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:24.945841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf43eb20-9487-4c50-828e-3b8ed8de68f0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f731c160>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:24.961927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:10:25.027469 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf43eb20-9487-4c50-828e-3b8ed8de68f0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1413 microversion: 2.1 time: 0.093935 Dec 25 21:10:25.030191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 431/976] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:24 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1413 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:25.043142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:25.043892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:25.058569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.059039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.060260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.063231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.095178 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b38b1d71-5fc7-4b63-9b21-5b3abaf361f7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.299051 Dec 25 21:10:25.095959 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 546/977] 10.222.0.32 () {58 vars in 1149 bytes} [Sat Dec 25 21:10:24 2021] GET /compute/v2.1/servers?status=error => generated 338 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:25.274722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3983930-120f-432c-ba0f-89072e0a0dd4 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f74f4b80>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-534445317", "description": "tempest-description-1429092652"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:25.433724 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a586bcdd-7b54-475c-9995-703b598da07d tempest-ServersOnMultiNodesTest-1189401283 tempest-ServersOnMultiNodesTest-1189401283-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1617 microversion: 2.1 time: 0.401612 Dec 25 21:10:25.447445 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 432/978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:25 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1617 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:25.457955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:25.457955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:25.461090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.462141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.463579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.464202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.844075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e000eb4-5124-4219-8579-36017b3fad74 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 0 microversion: 2.1 time: 0.395310 Dec 25 21:10:25.844738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 433/979] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:25 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:25.849665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:25.850281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:25.863735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.865026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.869983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.870491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.901684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3983930-120f-432c-ba0f-89072e0a0dd4 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.802266 Dec 25 21:10:25.910216 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 547/980] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:25 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:25.916762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:25.922646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:25.926074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.926616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.928058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:25.928573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:25.982298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:26.104380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:26.113901 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18b9250f-0643-4b88-b0b3-bac821436dd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1402 microversion: 2.1 time: 0.268048 Dec 25 21:10:26.114526 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 434/981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:25 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1402 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:26.120324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c511c202-6f9d-4968-88d1-064f9188b644 req-d6d62874-b5e6-4a1d-9649-3175ec04955f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee5cf04-7b9e-46fd-b317-75a118617c96", "name": "network-vif-unplugged", "status": "completed", "tag": "5576e36d-eb31-4f83-b0d9-b502678406cc"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:26.122462 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:26.122462 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:26.130205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c511c202-6f9d-4968-88d1-064f9188b644 req-d6d62874-b5e6-4a1d-9649-3175ec04955f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.130764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c511c202-6f9d-4968-88d1-064f9188b644 req-d6d62874-b5e6-4a1d-9649-3175ec04955f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.143111 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c511c202-6f9d-4968-88d1-064f9188b644 req-d6d62874-b5e6-4a1d-9649-3175ec04955f service nova] Creating event network-vif-unplugged:5576e36d-eb31-4f83-b0d9-b502678406cc for instance dee5cf04-7b9e-46fd-b317-75a118617c96 on nch1-master-1 Dec 25 21:10:26.148602 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c511c202-6f9d-4968-88d1-064f9188b644 req-d6d62874-b5e6-4a1d-9649-3175ec04955f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032726 Dec 25 21:10:26.151633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 435/982] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:26 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:26.154013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:26.154710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:26.160968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.161999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.162805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.163270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.301237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:26.309253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcc45b62-dd4c-4f9a-9522-521216e12124 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.158875 Dec 25 21:10:26.310107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 436/983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:26 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:26.314613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:26.315288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:26.321990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.322511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.323372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.323807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.467306 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5973064a-ae38-43bb-8196-193af6017415 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1613 microversion: 2.1 time: 0.155926 Dec 25 21:10:26.474099 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 437/984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:26 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1613 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:26.474099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb0b045c-023a-4054-88a3-85126dcdee05 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f71ccf70>, body: {"security_group_rule": {"parent_group_id": "87c075d4-e56c-48b6-aedb-78fefe7e2f53", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:26.850305 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1fa4d1c6-5236-44f5-9763-7ab568777c9f tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 204 len: 0 microversion: 2.1 time: 0.938407 Dec 25 21:10:26.851861 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 548/985] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:25 2021] DELETE /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 0 bytes in 941 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:26.860621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:26.863908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:26.877589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.881000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.882223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:26.882827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:26.943298 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-272b6aa0-7d1a-4bb3-8378-7f7fbc2cbb15 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.088001 Dec 25 21:10:26.948371 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 549/986] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:26 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:26.953750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41d13dab-6116-4555-bb1e-57396e8f16c3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f72faee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:27.013821 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb0b045c-023a-4054-88a3-85126dcdee05 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.544799 Dec 25 21:10:27.014429 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 438/987] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:26 2021] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:27.018943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:27.019583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:27.034052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.034423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.038036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.039805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.236855 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7879885b-d464-431c-a03c-78b29082dd2d tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1613 microversion: 2.1 time: 0.221231 Dec 25 21:10:27.238695 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 439/988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:27 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1613 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:27.245181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:27.246050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:27.252574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.253161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.254131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.254670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.422058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:27.432061 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a26ae114-dcc4-4581-9f86-d61319d8f9f0 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1472 microversion: 2.1 time: 0.191221 Dec 25 21:10:27.441292 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 440/989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:27 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1472 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:27.441292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef739643-1a42-4170-badf-4c3773a6bfa7 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f732faf0>, body: {"security_group_rule": {"parent_group_id": "87c075d4-e56c-48b6-aedb-78fefe7e2f53", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:27.499019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ef739643-1a42-4170-badf-4c3773a6bfa7 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: This rule already exists in group 87c075d4-e56c-48b6-aedb-78fefe7e2f53 Dec 25 21:10:27.499758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef739643-1a42-4170-badf-4c3773a6bfa7 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 400 to user: This rule already exists in group 87c075d4-e56c-48b6-aedb-78fefe7e2f53 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:27.501140 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef739643-1a42-4170-badf-4c3773a6bfa7 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.067285 Dec 25 21:10:27.513038 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 441/990] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:27 2021] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:10:27.513038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:27.513038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:27.515631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.516152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.517073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.517583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.690125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:27.699951 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-79c480f9-d428-43d5-8e42-1579c5835246 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1589 microversion: 2.1 time: 0.196813 Dec 25 21:10:27.701098 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 442/991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:27 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1589 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:27.705603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:27.709398 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:27.709398 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:27.710691 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:27.710691 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:27.712147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'host': 'nch2-master-1', 'deleted': False} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:27.717312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.717769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.718609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.719051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.819321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:10:27.895244 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a85ccb93-c7c1-4dfb-be68-7ff90444f471 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1" status: 200 len: 2962 microversion: 2.1 time: 0.191637 Dec 25 21:10:27.904941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 443/992] 10.222.0.32 () {58 vars in 1189 bytes} [Sat Dec 25 21:10:27 2021] GET /compute/v2.1/servers?host=nch2-master-1&all_tenants=1 => generated 2962 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:27.909848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:27.910959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:27.917644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.923437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:27.923437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:27.923437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:28.083899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:28.093478 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebf6417a-acd8-42b2-8e29-2e8480e06bf5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.187329 Dec 25 21:10:28.103256 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 444/993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:27 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:28.108041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8103502-6c0f-4fe7-b376-04b603f47758 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f72f8a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:28.931443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8103502-6c0f-4fe7-b376-04b603f47758 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-group-rules/67489bb4-937c-4978-89ae-797ca90e3183" status: 202 len: 0 microversion: 2.1 time: 0.826826 Dec 25 21:10:28.939034 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 445/994] 10.222.0.32 () {58 vars in 1286 bytes} [Sat Dec 25 21:10:28 2021] DELETE /compute/v2.1/os-security-group-rules/67489bb4-937c-4978-89ae-797ca90e3183 => generated 0 bytes in 835 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:28.950291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:28.950291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:28.964292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:28.968665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:28.973863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:28.974478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.122303 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61816627-f875-4406-843c-766db464043b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.181731 Dec 25 21:10:29.123319 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 446/995] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:10:28 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/os-interface => generated 285 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:29.127862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:29.135223 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:29.135223 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:29.135223 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:index:get_all_tenants": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:29.135223 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:29.135223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:10:29.149231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.149689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.150509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.150945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.195256 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e55469a-b414-4a3a-9cb2-7d5120395c98 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.070617 Dec 25 21:10:29.200905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 447/996] 10.222.0.32 () {58 vars in 1195 bytes} [Sat Dec 25 21:10:29 2021] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:29.212248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:29.213209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:29.228737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.228737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.228737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.228737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.337609 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e43fba66-fac2-428a-8a62-b62d634a899c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.133985 Dec 25 21:10:29.338974 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 448/997] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:29 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:29.344479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ba627bf6-5122-4661-895a-a311ebfd45c6 req-06c5ae1c-8d2b-43e3-9e60-a3affa590b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dee5cf04-7b9e-46fd-b317-75a118617c96", "tag": "5576e36d-eb31-4f83-b0d9-b502678406cc"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:29.348245 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:29.348245 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:29.368970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ba627bf6-5122-4661-895a-a311ebfd45c6 req-06c5ae1c-8d2b-43e3-9e60-a3affa590b07 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.376045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ba627bf6-5122-4661-895a-a311ebfd45c6 req-06c5ae1c-8d2b-43e3-9e60-a3affa590b07 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.410998 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ba627bf6-5122-4661-895a-a311ebfd45c6 req-06c5ae1c-8d2b-43e3-9e60-a3affa590b07 service nova] Creating event network-changed:5576e36d-eb31-4f83-b0d9-b502678406cc for instance dee5cf04-7b9e-46fd-b317-75a118617c96 on nch1-master-1 Dec 25 21:10:29.442907 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ba627bf6-5122-4661-895a-a311ebfd45c6 req-06c5ae1c-8d2b-43e3-9e60-a3affa590b07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089424 Dec 25 21:10:29.449121 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 449/998] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:29.470174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:29.470902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:29.508968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.510012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.510275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:29.510726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:29.737401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:29.751432 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-022e88ee-831f-4833-819a-d08f7996e2b8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 200 len: 1430 microversion: 2.1 time: 0.297765 Dec 25 21:10:29.762151 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 450/999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:29 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 1430 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:29.784521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f097dfe-3720-4be1-9fde-127500f34e12 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f728b820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-814172246", "description": "tempest-description-219225656"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:30.928736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f097dfe-3720-4be1-9fde-127500f34e12 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.165217 Dec 25 21:10:30.930849 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 451/1000] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:29 2021] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:30.937476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:30.941019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:30.983974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:30.984435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:30.985307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:30.988922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.155153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:31.163393 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9884bf9c-7cf4-4a45-8f1e-d841764e1b48 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.231147 Dec 25 21:10:31.165704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 452/1001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:30 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:31.168765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.169787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:31.179817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.180546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.181965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.182557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.540752 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c909656-4a24-4445-8a8c-4bb7740c5c4c tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 0 microversion: 2.1 time: 0.375519 Dec 25 21:10:31.543557 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 453/1002] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:31.546751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.547734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:31.557579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.558057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.558932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.559389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.612736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d48ceb0c-9d5b-4ff2-af11-d1412de68a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.069048 Dec 25 21:10:31.614988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 454/1003] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:31.621505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:31.622118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9d796d09-01b6-48f2-995f-4dbfa40b46ea] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:31.630034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.633549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.633549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.633549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.652299 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance 9d796d09-01b6-48f2-995f-4dbfa40b46ea could not be found. Dec 25 21:10:31.653014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance 9d796d09-01b6-48f2-995f-4dbfa40b46ea could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:31.653863 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-260d248d-d2b6-4524-b8ed-9e4be03de4f8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea" status: 404 len: 111 microversion: 2.1 time: 0.037775 Dec 25 21:10:31.657766 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 455/1004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:31 2021] GET /compute/v2.1/servers/9d796d09-01b6-48f2-995f-4dbfa40b46ea => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:31.664913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e732fa0e-bb70-4051-8f66-a5f055458340 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f71dbc10>, body: {"security_group_rule": {"parent_group_id": "0903df47-f3ec-4a61-b8f5-cf4b4f59c540", "ip_protocol": "tcp", "from_port": 36824823, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.740038 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e732fa0e-bb70-4051-8f66-a5f055458340 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Invalid port range 36824823:22. Former value cannot be greater than the later Dec 25 21:10:31.741198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e732fa0e-bb70-4051-8f66-a5f055458340 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 400 to user: Invalid port range 36824823:22. Former value cannot be greater than the later {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:31.742433 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e732fa0e-bb70-4051-8f66-a5f055458340 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.083442 Dec 25 21:10:31.743169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 456/1005] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:10:31.754393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.755638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:31.768852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.769608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.770861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.773701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.821916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2336aa1a-a011-4617-96c4-425cb73f54d8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.071048 Dec 25 21:10:31.824201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 457/1006] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:31.828951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d19e574f-c447-4e17-b017-59384922ab64 req-a071d136-3817-4716-b7ae-feae1fa057b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e17b1ffc-cea0-4158-9ac3-273da9149cd5", "tag": "d2192e86-fcbc-467e-974d-50439566abff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.830553 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:31.830553 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:31.840917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d19e574f-c447-4e17-b017-59384922ab64 req-a071d136-3817-4716-b7ae-feae1fa057b4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.841587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d19e574f-c447-4e17-b017-59384922ab64 req-a071d136-3817-4716-b7ae-feae1fa057b4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.860572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d19e574f-c447-4e17-b017-59384922ab64 req-a071d136-3817-4716-b7ae-feae1fa057b4 service nova] Creating event network-changed:d2192e86-fcbc-467e-974d-50439566abff for instance e17b1ffc-cea0-4158-9ac3-273da9149cd5 on nch2-master-1 Dec 25 21:10:31.865873 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d19e574f-c447-4e17-b017-59384922ab64 req-a071d136-3817-4716-b7ae-feae1fa057b4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041497 Dec 25 21:10:31.866846 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 458/1007] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:31.872508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-56059d46-39bb-4dbd-9989-e7472bdbdb07 req-9fd2e6b3-e952-43e2-8dd0-e4acf145df03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d796d09-01b6-48f2-995f-4dbfa40b46ea", "name": "network-vif-deleted", "tag": "315b00f0-a83e-4f05-a40b-5792fef297dd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.874424 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:31.874424 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:31.882945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-56059d46-39bb-4dbd-9989-e7472bdbdb07 req-9fd2e6b3-e952-43e2-8dd0-e4acf145df03 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.883391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-56059d46-39bb-4dbd-9989-e7472bdbdb07 req-9fd2e6b3-e952-43e2-8dd0-e4acf145df03 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.898334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-56059d46-39bb-4dbd-9989-e7472bdbdb07 req-9fd2e6b3-e952-43e2-8dd0-e4acf145df03 service nova] Creating event network-vif-deleted:315b00f0-a83e-4f05-a40b-5792fef297dd for instance 9d796d09-01b6-48f2-995f-4dbfa40b46ea on nch2-master-1 Dec 25 21:10:31.907935 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-56059d46-39bb-4dbd-9989-e7472bdbdb07 req-9fd2e6b3-e952-43e2-8dd0-e4acf145df03 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039325 Dec 25 21:10:31.909006 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 459/1008] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:31.915114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:31.917235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:31.927573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.928063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:31.928945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:31.929478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.443766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41d13dab-6116-4555-bb1e-57396e8f16c3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1422 microversion: 2.1 time: 5.493494 Dec 25 21:10:32.447989 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 550/1009] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:26 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1422 bytes in 5498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:32.456581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:32.457272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:32.465725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:32.471595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:32.471595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:32.471595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:32.471595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:32.476864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.477628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.478624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.479068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.517120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:32.664626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:32.671683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.672497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.673565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.674226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.710824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-879ef629-9ddc-49a6-b934-1bc082c4e6ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 1066 microversion: 2.1 time: 0.800522 Dec 25 21:10:32.712167 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 460/1010] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:31 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 1066 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 25 21:10:32.731060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1ff45bb-1958-4c23-8130-ef440f55cf30 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f72ac310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-301450383", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:32.737717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f1ff45bb-1958-4c23-8130-ef440f55cf30 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Security group id should be uuid Dec 25 21:10:32.740342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1ff45bb-1958-4c23-8130-ef440f55cf30 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 400 to user: Security group id should be uuid {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:32.742070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1ff45bb-1958-4c23-8130-ef440f55cf30 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.028594 Dec 25 21:10:32.747758 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 461/1011] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:32 2021] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:10:32.761799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:32.764018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:32.780682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.782225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.783470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.784045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.829557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3bfb7dc-4fbe-48eb-bf3f-ecdde9abeaf8 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 204 len: 0 microversion: 2.1 time: 0.380210 Dec 25 21:10:32.830399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 551/1012] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:32 2021] DELETE /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:32.836087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c22163b-162d-436c-8cca-b41bfdcc1a6f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7413820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:32.919899 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c22163b-162d-436c-8cca-b41bfdcc1a6f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 200 len: 1422 microversion: 2.1 time: 0.088104 Dec 25 21:10:32.921014 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 552/1013] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:10:32 2021] GET /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 1422 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:32.925726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:32.928411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:32.935219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.936060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.937093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:32.937690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:32.999227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1519023f-4b20-4eef-8e7f-adb5e5c443a6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.076513 Dec 25 21:10:33.003742 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 553/1014] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:32 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:33.008721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:33.009689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:33.017065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:33.023988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:33.023988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:33.023988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:33.055509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:33.064178 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2780e745-4dfe-46bf-a490-cbf2e152307c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.317941 Dec 25 21:10:33.065452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 462/1015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:32 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:33.070441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a1654f95-7058-4272-9730-4b04908b3d8d tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f71db0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-864041279", "description": "tempest-description-1803682987"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:33.259919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:33.267486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-19449964-9758-42ee-bd68-1474f04baca4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.265495 Dec 25 21:10:33.268065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 554/1016] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:33 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:33.272431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:33.273407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:33.279110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:33.279558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:33.280338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:33.280772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:33.321778 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e847654-8657-4703-be88-150727178b95 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.052349 Dec 25 21:10:33.322342 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 555/1017] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:33 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:33.327466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:33.328184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:33.339947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:33.339947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:33.339947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:33.339947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:33.620810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:33.629179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c533dd23-6031-4a8d-ac09-e2dd20554446 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1471 microversion: 2.1 time: 0.305403 Dec 25 21:10:33.630942 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 556/1018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:33 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1471 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:33.636643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94b11ae7-c4ba-4521-a6fd-f36e955f329e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7189790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:33.685778 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a1654f95-7058-4272-9730-4b04908b3d8d tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.611558 Dec 25 21:10:33.685778 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 463/1019] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:33 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:33.689638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6722155e-d872-4b04-a7b7-9c106a9e329e tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f728b5e0>, body: {"security_group_rule": {"parent_group_id": "ed2df01e-4a07-48c5-b0e2-76dd3173bb98", "ip_protocol": "tempest-999-1256074341", "from_port": 22, "to_port": 22}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:33.751966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6722155e-d872-4b04-a7b7-9c106a9e329e tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Invalid IP protocol tempest-999-1256074341. Dec 25 21:10:33.752565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6722155e-d872-4b04-a7b7-9c106a9e329e tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 400 to user: Invalid IP protocol tempest-999-1256074341. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:33.753501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6722155e-d872-4b04-a7b7-9c106a9e329e tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.067456 Dec 25 21:10:33.754392 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 464/1020] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:33 2021] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Dec 25 21:10:33.763866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f95b9ac-4fe7-4043-aa42-75fcff82fc92 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f71cc9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1326578344", "description": "tempest-description-547276273"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:34.321940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f95b9ac-4fe7-4043-aa42-75fcff82fc92 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.561918 Dec 25 21:10:34.323304 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 465/1021] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:33 2021] POST /compute/v2.1/os-security-groups => generated 255 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:34.328934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:34.330317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:34.337200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.337913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.338759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.339207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.388138 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6af01aa-1b7d-4abd-9c7f-2b6f67c4d8f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.062727 Dec 25 21:10:34.388949 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 466/1022] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:34 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:34.394647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:34.396021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:34.404324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.404827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.405723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.407563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.696127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:34.703770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f69b4f74-1a83-4897-af6c-256c742e70d2 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1505 microversion: 2.1 time: 0.313472 Dec 25 21:10:34.705355 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 467/1023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:34 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1505 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:34.711066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:34.714484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:34.717769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.718232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.719032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.719647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.932004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:34.940316 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41339966-a0a7-474e-9c01-8712ee1200b9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.233916 Dec 25 21:10:34.941002 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 468/1024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:34 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:34.946965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:34.948224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:34.957147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.961299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.961299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:34.961299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:34.996401 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c3214dc-664d-4700-8150-91cee1e69ecc tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.053945 Dec 25 21:10:34.997695 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 469/1025] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:34 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:35.002796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dce3bc9a-52b0-4e43-8255-2f3d8602599d tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f75cf430>, body: {"security_group_rule": {"parent_group_id": "a43e071b-93ca-462b-9893-341e2208985d", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:35.088144 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94b11ae7-c4ba-4521-a6fd-f36e955f329e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 204 len: 0 microversion: 2.1 time: 1.455887 Dec 25 21:10:35.092217 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 557/1026] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:33 2021] DELETE /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 0 bytes in 1457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:35.099257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:35.105954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:35.108220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.108996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.110475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.111117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.231613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:35.243271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-dce3bc9a-52b0-4e43-8255-2f3d8602599d tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Dec 25 21:10:35.243271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dce3bc9a-52b0-4e43-8255-2f3d8602599d tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:35.243271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dce3bc9a-52b0-4e43-8255-2f3d8602599d tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.239382 Dec 25 21:10:35.243581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99fd147d-0667-41cc-a4ea-31a5a33fde80 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 200 len: 1429 microversion: 2.1 time: 0.146660 Dec 25 21:10:35.243581 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 558/1027] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:35 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 1429 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:35.245395 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 470/1028] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:34 2021] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 247 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:10:35.246850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:35.247628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:35.250818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d59ae67d-4c3b-4b54-b582-f87e8b119a11 req-1a6e5474-0cff-430d-b658-28ff460dc4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ed7876-289e-4bb7-89b1-051968bd6e27", "name": "network-vif-deleted", "tag": "11a8e073-faa1-4705-931b-5c53eaca0cb5"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:35.252580 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:35.252580 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:35.254043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.254514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.255378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.255811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.261245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d59ae67d-4c3b-4b54-b582-f87e8b119a11 req-1a6e5474-0cff-430d-b658-28ff460dc4c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.262062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d59ae67d-4c3b-4b54-b582-f87e8b119a11 req-1a6e5474-0cff-430d-b658-28ff460dc4c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.283362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:35.292440 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d59ae67d-4c3b-4b54-b582-f87e8b119a11 req-1a6e5474-0cff-430d-b658-28ff460dc4c7 service nova] Creating event network-vif-deleted:11a8e073-faa1-4705-931b-5c53eaca0cb5 for instance b5ed7876-289e-4bb7-89b1-051968bd6e27 on nch1-master-1 Dec 25 21:10:35.298729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d59ae67d-4c3b-4b54-b582-f87e8b119a11 req-1a6e5474-0cff-430d-b658-28ff460dc4c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052088 Dec 25 21:10:35.299415 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 471/1029] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:35.313232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4f1ec0e-01b7-4e0c-8990-fb63da3e18f9 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f71e8c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-663447065", "description": "tempest-description-236040108"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:35.661099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c2f84a4-d789-41a4-8c65-dbd492a90973 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 204 len: 0 microversion: 2.1 time: 0.418848 Dec 25 21:10:35.663743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 559/1030] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:35 2021] DELETE /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:35.689899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:35.692121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:35.699858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.700758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.703714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.704731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.758080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07378906-a99e-435f-9c73-dd6702a75a3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.092605 Dec 25 21:10:35.759498 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 560/1031] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:35 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:35.768330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:35.775227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:35.780317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.780777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.781739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:35.782357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:35.797350 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4f1ec0e-01b7-4e0c-8990-fb63da3e18f9 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.496585 Dec 25 21:10:35.798991 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 472/1032] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:10:35 2021] POST /compute/v2.1/os-security-groups => generated 254 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:35.810285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e1f2f130-ed6b-47a8-925e-8e07e9934d6c tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f713b0d0>, body: {"security_group_rule": {"parent_group_id": "edb5f664-8575-4e56-9389-c292e0548d20", "ip_protocol": "tcp", "from_port": 22, "to_port": 813155936}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:35.896919 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e1f2f130-ed6b-47a8-925e-8e07e9934d6c tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Invalid port range 22:813155936. Valid TCP ports should be between 1-65535 Dec 25 21:10:35.897682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e1f2f130-ed6b-47a8-925e-8e07e9934d6c tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 400 to user: Invalid port range 22:813155936. Valid TCP ports should be between 1-65535 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:35.898643 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e1f2f130-ed6b-47a8-925e-8e07e9934d6c tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.092819 Dec 25 21:10:35.899220 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 473/1033] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:35 2021] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:10:35.904599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-72649321", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "6dded111-84d7-4606-bd1c-e9369354dff9"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:35.993748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:35.995801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] validate_networks() for [('6dded111-84d7-4606-bd1c-e9369354dff9', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:36.009940 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41bb39dc-6c23-416d-9a98-a5e507b7236c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1480 microversion: 2.1 time: 0.247650 Dec 25 21:10:36.012496 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 561/1034] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:35 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1480 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:36.017161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b584c331-e26d-4189-aba3-4c45de106929 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Action: 'create', calling method: .version_select at 0x7fa4f7088ee0>, body: {"security_group_rule": {"parent_group_id": "e2a423f1-999d-4908-a51d-8359165ca55a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:36.064202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-b584c331-e26d-4189-aba3-4c45de106929 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e2a423f1-999d-4908-a51d-8359165ca55a does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:10:36.064894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-b584c331-e26d-4189-aba3-4c45de106929 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Neutron security group e2a423f1-999d-4908-a51d-8359165ca55a not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:10:36.066257 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b584c331-e26d-4189-aba3-4c45de106929 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Security group e2a423f1-999d-4908-a51d-8359165ca55a does not exist Dec 25 21:10:36.066257 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-6a285b09-2c63-4db4-a052-dfb20c4ccf2f'] Dec 25 21:10:36.067050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b584c331-e26d-4189-aba3-4c45de106929 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 404 to user: Security group e2a423f1-999d-4908-a51d-8359165ca55a does not exist Dec 25 21:10:36.067050 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-6a285b09-2c63-4db4-a052-dfb20c4ccf2f'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:36.068704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b584c331-e26d-4189-aba3-4c45de106929 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.054994 Dec 25 21:10:36.070826 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 562/1035] 10.222.0.32 () {60 vars in 1194 bytes} [Sat Dec 25 21:10:36 2021] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:36.084367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.085295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:36.093986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.094645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.095243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.095686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.351943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:36.359961 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aed4ca59-700d-4482-ae55-436331ecda4a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.287211 Dec 25 21:10:36.362921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 563/1036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:36 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:36.375464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:36.376683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:36.385514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.385998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.387324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.388625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.435740 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cda4809e-248a-4594-a744-ca63619e5caa tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.073862 Dec 25 21:10:36.436366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 564/1037] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:36 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:36.443363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2261d786-a14d-4017-b7e7-16743b9f22e1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '.version_select at 0x7fa4f72845e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.445136 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:36.445136 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:36.446499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2261d786-a14d-4017-b7e7-16743b9f22e1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.449411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2261d786-a14d-4017-b7e7-16743b9f22e1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.460257 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2261d786-a14d-4017-b7e7-16743b9f22e1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 1934 microversion: 2.1 time: 0.022266 Dec 25 21:10:36.474042 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 565/1038] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:10:36 2021] GET /compute/v2.1/os-migrations => generated 1934 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:36.474042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9eed090-dac0-47ef-965d-30a7cbed4206 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f70f6040>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.519421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-d9eed090-dac0-47ef-965d-30a7cbed4206 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 6a41cfb5-b500-4416-a6bb-941361e464f2 does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:10:36.522365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-d9eed090-dac0-47ef-965d-30a7cbed4206 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Neutron security group rule 6a41cfb5-b500-4416-a6bb-941361e464f2 not found {{(pid=136548) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Dec 25 21:10:36.522962 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d9eed090-dac0-47ef-965d-30a7cbed4206 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] HTTP exception thrown: Security group rule 6a41cfb5-b500-4416-a6bb-941361e464f2 does not exist Dec 25 21:10:36.522962 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-cd869de7-1efb-4198-baa9-4481d825ba6a'] Dec 25 21:10:36.523965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9eed090-dac0-47ef-965d-30a7cbed4206 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Returning 404 to user: Security group rule 6a41cfb5-b500-4416-a6bb-941361e464f2 does not exist Dec 25 21:10:36.523965 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-cd869de7-1efb-4198-baa9-4481d825ba6a'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:36.524969 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9eed090-dac0-47ef-965d-30a7cbed4206 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-group-rules/6a41cfb5-b500-4416-a6bb-941361e464f2" status: 404 len: 199 microversion: 2.1 time: 0.062480 Dec 25 21:10:36.525716 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 566/1039] 10.222.0.32 () {58 vars in 1286 bytes} [Sat Dec 25 21:10:36 2021] DELETE /compute/v2.1/os-security-group-rules/6a41cfb5-b500-4416-a6bb-941361e464f2 => generated 199 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:36.533161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.535646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: b5ed7876-289e-4bb7-89b1-051968bd6e27] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:36.545248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.545911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.546711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.547279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.553155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:36.553803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:36.554885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:36.555398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:36.555922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:36.563234 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance b5ed7876-289e-4bb7-89b1-051968bd6e27 could not be found. Dec 25 21:10:36.563827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance b5ed7876-289e-4bb7-89b1-051968bd6e27 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:36.564804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bceaea92-5fe0-4a87-a894-1140ddf3d818 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27" status: 404 len: 111 microversion: 2.1 time: 0.036988 Dec 25 21:10:36.565541 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 567/1040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:36 2021] GET /compute/v2.1/servers/b5ed7876-289e-4bb7-89b1-051968bd6e27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:36.572556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.573147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.574329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.575024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.575443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-11ddba26-4f14-4a39-a179-ef45b546e8dd req-d6cab2bd-b9c6-49ec-966d-de83cd88457a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1843d1-a627-404e-adf4-56974bcaa614", "name": "network-vif-unplugged", "status": "completed", "tag": "0c6d5976-8c28-4b25-8b9e-c7dc7add6588"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:36.577046 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:36.577046 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:36.584780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-11ddba26-4f14-4a39-a179-ef45b546e8dd req-d6cab2bd-b9c6-49ec-966d-de83cd88457a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.587721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-11ddba26-4f14-4a39-a179-ef45b546e8dd req-d6cab2bd-b9c6-49ec-966d-de83cd88457a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.596009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:36.599982 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-11ddba26-4f14-4a39-a179-ef45b546e8dd req-d6cab2bd-b9c6-49ec-966d-de83cd88457a service nova] Creating event network-vif-unplugged:0c6d5976-8c28-4b25-8b9e-c7dc7add6588 for instance ed1843d1-a627-404e-adf4-56974bcaa614 on nch1-master-1 Dec 25 21:10:36.601163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for user 613e2533f4e04cca8fafc3ea463accd9 and project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:36.605187 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-11ddba26-4f14-4a39-a179-ef45b546e8dd req-d6cab2bd-b9c6-49ec-966d-de83cd88457a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038200 Dec 25 21:10:36.609128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 568/1041] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:36 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:36.617068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:36.617791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.623372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:36.623509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:36.624902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.625437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.626294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.626803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.770896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ddee9e4-276f-4596-9923-a55ae4568a0a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1631 microversion: 2.1 time: 0.160510 Dec 25 21:10:36.771767 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 569/1042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:36 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1631 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:36.776303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52193179-6f8e-46c3-948d-61056e632293 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f70def70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.778972 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-324b9e2c-0946-4d57-8bd8-ee4ee99ed7a2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.878549 Dec 25 21:10:36.779648 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 474/1043] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:36.792898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:36.806981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:36.836473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.836473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.836473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:36.836473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:36.927355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:37.163929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52193179-6f8e-46c3-948d-61056e632293 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/edb5f664-8575-4e56-9389-c292e0548d20" status: 202 len: 0 microversion: 2.1 time: 0.390907 Dec 25 21:10:37.164492 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 570/1044] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:36 2021] DELETE /compute/v2.1/os-security-groups/edb5f664-8575-4e56-9389-c292e0548d20 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:37.172964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:37.173945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:37.181272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:37.182327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:37.183507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:37.184133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:37.246668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d78cf67d-d233-4c02-a650-6de43392c758 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.080884 Dec 25 21:10:37.247308 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 571/1045] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:37 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:37.252222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9d274df-45c1-44ac-9cf0-e495036ccfcd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:37.253072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9d274df-45c1-44ac-9cf0-e495036ccfcd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:37.268202 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48a46c6a-a674-4e49-8635-f2fe561c6969 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 204 len: 0 microversion: 2.1 time: 0.486842 Dec 25 21:10:37.269622 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 475/1046] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:36 2021] DELETE /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:37.278786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1533428946", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2332d558-39bb-411c-88af-b74bee7e32ab"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:37.333687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9d274df-45c1-44ac-9cf0-e495036ccfcd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:37.341518 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9d274df-45c1-44ac-9cf0-e495036ccfcd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1206 microversion: 2.1 time: 0.093049 Dec 25 21:10:37.342728 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 572/1047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:37 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1206 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:37.351777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] validate_networks() for [('2332d558-39bb-411c-88af-b74bee7e32ab', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:37.352588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b38256ab-f0d6-43ac-b95b-262b221b9f68 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f719d550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:38.341768 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b38256ab-f0d6-43ac-b95b-262b221b9f68 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/a43e071b-93ca-462b-9893-341e2208985d" status: 202 len: 0 microversion: 2.1 time: 0.997116 Dec 25 21:10:38.343193 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 573/1048] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:37 2021] DELETE /compute/v2.1/os-security-groups/a43e071b-93ca-462b-9893-341e2208985d => generated 0 bytes in 1000 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:38.348012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:38.348664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:38.358446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.359843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.360858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.361870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.404427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:38.408671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:38.408671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:38.408671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:38.408671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:38.416165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.416815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.418018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.418466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.444252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:38.450142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for user 9bf2eefd87de409785735fc802bc95ed and project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:38.464757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:38.467436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:38.559733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:38.568573 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-169fef1b-7694-44c1-8408-b0f6e2710074 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1473 microversion: 2.1 time: 0.223980 Dec 25 21:10:38.569154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 574/1049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:38 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:38.578244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:38.578244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:38.580128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.580576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.581586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.582019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.624660 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c97c4cf7-b673-4934-b96f-5917b19ba708 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.352264 Dec 25 21:10:38.625331 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 476/1050] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1355 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:38.634925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:38.636342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:38.644914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.646459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.647458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.648073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.694369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56c43891-8073-4d82-85af-3fc36f8360f1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.063647 Dec 25 21:10:38.695271 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 477/1051] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:38 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:38.701131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:38.702145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:38.711034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.711713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.712675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:38.713324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:38.759344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-489324d0-8f5a-4b39-af74-a1886ada6f8c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.062649 Dec 25 21:10:38.760815 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 478/1052] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:38 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:38.766570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a04581b-1f3e-4d4a-bead-09db8a00d25f tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f713b1f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:39.105341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64751909-b860-44c2-b737-bef41d92f67b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.553758 Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 575/1053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:38 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.156243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.253650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:39.263368 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-658f5267-9160-4b1a-b0a3-37c27ea891a7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1266 microversion: 2.1 time: 0.137672 Dec 25 21:10:39.264283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 576/1054] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:39 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:39.269038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b17c5fa4-568f-4090-b2a2-19a34fa48e76 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:39.269882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b17c5fa4-568f-4090-b2a2-19a34fa48e76 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:39.400550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b17c5fa4-568f-4090-b2a2-19a34fa48e76 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:39.407371 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b17c5fa4-568f-4090-b2a2-19a34fa48e76 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1211 microversion: 2.1 time: 0.141749 Dec 25 21:10:39.408016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 577/1055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:39 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1211 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:39.422059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0cf73fe9-80ec-4b41-a4f0-e9342336b27e req-093e82fe-c56e-43ea-8b34-3d97da0cc74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1843d1-a627-404e-adf4-56974bcaa614", "name": "network-vif-deleted", "tag": "0c6d5976-8c28-4b25-8b9e-c7dc7add6588"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:39.423739 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:39.423739 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:39.431901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0cf73fe9-80ec-4b41-a4f0-e9342336b27e req-093e82fe-c56e-43ea-8b34-3d97da0cc74a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.432364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0cf73fe9-80ec-4b41-a4f0-e9342336b27e req-093e82fe-c56e-43ea-8b34-3d97da0cc74a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.444086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0cf73fe9-80ec-4b41-a4f0-e9342336b27e req-093e82fe-c56e-43ea-8b34-3d97da0cc74a service nova] Creating event network-vif-deleted:0c6d5976-8c28-4b25-8b9e-c7dc7add6588 for instance ed1843d1-a627-404e-adf4-56974bcaa614 on nch1-master-1 Dec 25 21:10:39.449293 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0cf73fe9-80ec-4b41-a4f0-e9342336b27e req-093e82fe-c56e-43ea-8b34-3d97da0cc74a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030744 Dec 25 21:10:39.450050 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 578/1056] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:39.586530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:39.588252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:39.595143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.595605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.596665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.597139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.785210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a04581b-1f3e-4d4a-bead-09db8a00d25f tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/ed2df01e-4a07-48c5-b0e2-76dd3173bb98" status: 202 len: 0 microversion: 2.1 time: 1.018324 Dec 25 21:10:39.785210 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 479/1057] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:38 2021] DELETE /compute/v2.1/os-security-groups/ed2df01e-4a07-48c5-b0e2-76dd3173bb98 => generated 0 bytes in 1021 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:39.787080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:39.789343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:39.797223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.804832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.804832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.804832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.848108 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-635c861d-582b-4096-8d43-0be323e9883e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.064464 Dec 25 21:10:39.849421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:39.851699 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 480/1058] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:39 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:39.861145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:39.863559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:39.872756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.873743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.876254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:39.877105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:39.877997 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a9bae55-23d2-4c27-b874-d9cecddb19f1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1473 microversion: 2.1 time: 0.296114 Dec 25 21:10:39.883787 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 579/1059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:39 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1473 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:39.897305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30b918e3-8dd3-4f5a-91be-e85aec501244 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f71895e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:39.938297 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c67b3eb9-1944-486a-8733-d02fb1205cd3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.084336 Dec 25 21:10:39.939436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 481/1060] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:39 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:40.174405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:40.175404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:40.192967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:40.193650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:40.198516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:40.198981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:40.499644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:40.510266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18587144-6de7-45ee-9cfd-7d0149ebc305 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.341169 Dec 25 21:10:40.511188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 482/1061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:40 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:40.516101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:40.516714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:40.523813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:40.524767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:40.525679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:40.528301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30b918e3-8dd3-4f5a-91be-e85aec501244 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/0903df47-f3ec-4a61-b8f5-cf4b4f59c540" status: 202 len: 0 microversion: 2.1 time: 0.641324 Dec 25 21:10:40.529764 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 580/1062] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:39 2021] DELETE /compute/v2.1/os-security-groups/0903df47-f3ec-4a61-b8f5-cf4b4f59c540 => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:40.536594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:40.538685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:40.543246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:40.564724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:40.567087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:40.568221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:40.569130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:40.807369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:40.815468 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c198e20b-2a83-4e8d-bff7-6adb85c48b11 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1215 microversion: 2.1 time: 0.284487 Dec 25 21:10:40.825955 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 581/1063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:40 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1215 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:40.825955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85528072-b30c-4b3e-a34f-e00793aa8bd6 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] Calling method '.version_select at 0x7fa4f719d700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:40.988298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:40.999335 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a92976a6-9fee-4fa3-ae1b-4c7bc2e417a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.486915 Dec 25 21:10:41.011770 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 483/1064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:40 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:41.018090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:41.019140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:41.028983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.028983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.028983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.028983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.079000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6795015-1763-417f-8c4c-2e6d623942de tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.065265 Dec 25 21:10:41.079871 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 484/1065] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:41 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:10:41.086709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:41.087408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:41.097565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.099427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.099427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.099964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.149805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.150330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.150815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lazy-loading 'fault' on Instance uuid 4dbb558c-1149-4835-803f-d1368522f573 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:10:41.232128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:41.256193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-258b4a02-6f68-4a18-a1c4-925d049ba5c1 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 200 len: 1307 microversion: 2.1 time: 0.175098 Dec 25 21:10:41.257026 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 485/1066] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:41 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:41.278822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:41.278822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:41.285728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.286115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.287062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.287510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.336013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9611446d-708a-4c5b-94f5-fd721f09f1a3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.068933 Dec 25 21:10:41.337253 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 486/1067] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:41 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:41.345388 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85528072-b30c-4b3e-a34f-e00793aa8bd6 tempest-SecurityGroupRulesNegativeTestJSON-1764933024 tempest-SecurityGroupRulesNegativeTestJSON-1764933024-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/87c075d4-e56c-48b6-aedb-78fefe7e2f53" status: 202 len: 0 microversion: 2.1 time: 0.528197 Dec 25 21:10:41.346055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 582/1068] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:10:40 2021] DELETE /compute/v2.1/os-security-groups/87c075d4-e56c-48b6-aedb-78fefe7e2f53 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:41.498829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3844cc02-6a20-4ca3-8a83-a04e17529c5d req-fecb7396-f27c-4157-8fb7-f334e8e41c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dbb558c-1149-4835-803f-d1368522f573", "name": "network-vif-deleted", "tag": "3240e6a9-7ed6-4f9e-a0e5-cf084791ba34"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:41.500391 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:41.500391 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:41.513203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3844cc02-6a20-4ca3-8a83-a04e17529c5d req-fecb7396-f27c-4157-8fb7-f334e8e41c39 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.513203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3844cc02-6a20-4ca3-8a83-a04e17529c5d req-fecb7396-f27c-4157-8fb7-f334e8e41c39 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.525706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3844cc02-6a20-4ca3-8a83-a04e17529c5d req-fecb7396-f27c-4157-8fb7-f334e8e41c39 service nova] Creating event network-vif-deleted:3240e6a9-7ed6-4f9e-a0e5-cf084791ba34 for instance 4dbb558c-1149-4835-803f-d1368522f573 on nch1-master-1 Dec 25 21:10:41.531656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3844cc02-6a20-4ca3-8a83-a04e17529c5d req-fecb7396-f27c-4157-8fb7-f334e8e41c39 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037747 Dec 25 21:10:41.532680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:41.534519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 487/1069] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:41.534844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:41.544225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.547876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.547876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.547876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.782533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:41.794080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33fba54b-b79d-476f-afd7-d2e0b569a759 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.269972 Dec 25 21:10:41.795210 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 583/1070] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:41 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:41.833699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:41.834435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:41.845161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.845161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.845846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:41.846434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:41.986531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:41.996048 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ab4a589-63fa-484f-8561-eaa4a554bb18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1263 microversion: 2.1 time: 0.167523 Dec 25 21:10:42.000720 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 488/1071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:41 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1263 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:42.019279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:42.019999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:42.040713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.043966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.046151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.046549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.108840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:42.108840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:42.108840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.108840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.108840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.108840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.147571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2058d72d-af0e-43a6-90fe-89d7d3d4a108 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 14 microversion: 2.1 time: 0.061229 Dec 25 21:10:42.148375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 489/1072] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:42 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:10:42.274071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:42.274788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 4dbb558c-1149-4835-803f-d1368522f573] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:42.282215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.282668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.283467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.283911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.299882 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance 4dbb558c-1149-4835-803f-d1368522f573 could not be found. Dec 25 21:10:42.300438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance 4dbb558c-1149-4835-803f-d1368522f573 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:42.301956 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41630fe5-7c10-42b8-ba7d-390351b1d072 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573" status: 404 len: 111 microversion: 2.1 time: 0.031508 Dec 25 21:10:42.305588 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 490/1073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:42 2021] GET /compute/v2.1/servers/4dbb558c-1149-4835-803f-d1368522f573 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:10:42.311020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:42.311529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:42.318664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.319122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.319927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.320369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.347616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:42.650175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:42.659322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efdb6db4-c4ba-490c-b33c-39e0186c44e7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.645525 Dec 25 21:10:42.659908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 584/1074] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:42 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:42.666266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:42.667533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:42.678295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.678295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.678295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.678295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.735834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95f89dbe-3073-487a-9e7a-55e68d37a256 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.074443 Dec 25 21:10:42.737644 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 585/1075] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:42 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:42.813653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:42.814816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:42.824453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.825211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:42.826280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:42.827536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.072655 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1fc3e84c-e413-4397-a6dc-6672b435d98c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 204 len: 0 microversion: 2.1 time: 0.765008 Dec 25 21:10:43.074213 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 491/1076] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:42 2021] DELETE /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:43.082065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:43.084414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:43.100078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.100534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.101599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.102239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.253003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:43.261777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2f7ebdd-82b0-4a24-9b4c-7b8b164e1c69 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1281 microversion: 2.1 time: 0.186289 Dec 25 21:10:43.263349 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 492/1077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:43 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1281 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:43.267796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:43.267965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:43.273816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.274416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.275226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.275666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.300998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:43.303861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:43.311336 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0336f457-0cbc-45e3-8a93-b5e7df239735 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.503382 Dec 25 21:10:43.312482 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 586/1078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:42 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:43.327543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:43.328744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:43.335312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.336091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.337113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.337736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.405063 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de95c516-6402-412a-bed5-a5a895c53cab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 8154 microversion: 2.1 time: 0.080943 Dec 25 21:10:43.410652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 587/1079] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:43 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 8154 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:43.552327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9549bf47-1e97-4350-90ec-d13a3fc45776 req-0d97ab1e-d33e-406c-b59d-3aa461a5530d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e327d55b-28ca-4bfa-bcf1-e4ed49240d52", "tag": "da0f28d9-3fef-4a56-9994-44b97466e1d4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:43.555782 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:43.555782 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:43.565793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9549bf47-1e97-4350-90ec-d13a3fc45776 req-0d97ab1e-d33e-406c-b59d-3aa461a5530d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.566782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9549bf47-1e97-4350-90ec-d13a3fc45776 req-0d97ab1e-d33e-406c-b59d-3aa461a5530d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.584006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9549bf47-1e97-4350-90ec-d13a3fc45776 req-0d97ab1e-d33e-406c-b59d-3aa461a5530d service nova] Creating event network-changed:da0f28d9-3fef-4a56-9994-44b97466e1d4 for instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 on nch1-master-1 Dec 25 21:10:43.589911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9549bf47-1e97-4350-90ec-d13a3fc45776 req-0d97ab1e-d33e-406c-b59d-3aa461a5530d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043720 Dec 25 21:10:43.591062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 588/1080] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:43.649948 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54b53995-9ddc-4757-92ad-a5d14fcad763 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 204 len: 0 microversion: 2.1 time: 0.386335 Dec 25 21:10:43.653398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 493/1081] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:43 2021] DELETE /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:43.659874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:43.660580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:43.667243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.668611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.669637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.670083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.677743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:43.678710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:43.685298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.686017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:43.687068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:43.687731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.204047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:44.212354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8bb0d609-fbc0-4a1a-8f42-e60076fc2e8c tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 200 len: 1474 microversion: 2.1 time: 0.556899 Dec 25 21:10:44.213233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 589/1082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:43 2021] GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 1474 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:44.217998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:44.229456 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea600be2-68f6-45c7-bd70-9f50ed08e66c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.554081 Dec 25 21:10:44.232624 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 494/1083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:43 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:44.233469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:44.235011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:44.242626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.243298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.244303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.244935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.278454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:44.279471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:44.291623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.291623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.291623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.291623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.327437 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4bc835c6-d05e-4b81-ae7e-00168bc09864 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.112663 Dec 25 21:10:44.331304 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 590/1084] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:44 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:44.336153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:44.336842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:44.343786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.344232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.345316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.345944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.575788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:44.584499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ace36371-d148-401b-acd7-1885400b887c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.309670 Dec 25 21:10:44.585323 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 495/1085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:44 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:44.594616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:44.599342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:44.600340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:44.602368 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6efe5752-b7ce-4c4d-aaf7-cd5131f91ccb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.271777 Dec 25 21:10:44.603130 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 591/1086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:44 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:44.608812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.609469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.616139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:44.616139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:44.661846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd85742d-1264-4162-aa97-ddea6a76941a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 8154 microversion: 2.1 time: 0.066410 Dec 25 21:10:44.662810 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 496/1087] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:44 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 8154 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:45.230391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:45.231412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:45.238144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:45.246876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:45.248167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:45.251406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:45.252612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:45.255886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:45.263231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:45.263932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:45.266050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:45.267328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.008984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:46.019349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bbe2023-68c4-4e2b-9c81-6b63b2c2fff7 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 200 len: 1474 microversion: 2.1 time: 0.792875 Dec 25 21:10:46.020921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 592/1088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:45 2021] GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 1474 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:46.040767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:46.043233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:46.065686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:46.075414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c2bc43d-3cca-4905-b69f-d22a92f9ced9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.832799 Dec 25 21:10:46.083400 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 497/1089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:45 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:46.087495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.090467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.091566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.095231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.099082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:46.103862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:46.118598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.125660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.126873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.127524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.217056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06d10982-d50b-430f-b8ca-8d16e3898d1a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.189671 Dec 25 21:10:46.228328 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 593/1090] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:46 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:46.246693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:46.246693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:46.261982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.262362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.263189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.265763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.614854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:46.625589 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2399319-ccd4-460e-ad75-bd74a2f9b9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.540874 Dec 25 21:10:46.628363 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 498/1091] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:46 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:46.639545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:46.640702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:46.653818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.654279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.655105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.655543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.703102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:46.710346 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d61cb56d-50a6-4047-a70d-c7d4f6a25796 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 16347 microversion: 2.1 time: 0.080473 Dec 25 21:10:46.711367 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 499/1092] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:46 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 16347 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:46.716162 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54279415-94e2-4b3e-9025-8d8e4c8fa932 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.486396 Dec 25 21:10:46.717216 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 594/1093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:46 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:46.718134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-adff2abd-f765-4f99-8f2a-3ebbd7d64eeb req-b2156b07-84b4-4078-928c-ce49796d17a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083a54e8-8841-4d6e-b720-a0e06409e0d4", "name": "network-vif-deleted", "tag": "2150b774-dd7c-4f45-910d-01e39333a0ce"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:46.719657 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:46.719657 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:46.730888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-adff2abd-f765-4f99-8f2a-3ebbd7d64eeb req-b2156b07-84b4-4078-928c-ce49796d17a4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.731346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-adff2abd-f765-4f99-8f2a-3ebbd7d64eeb req-b2156b07-84b4-4078-928c-ce49796d17a4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.748398 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-adff2abd-f765-4f99-8f2a-3ebbd7d64eeb req-b2156b07-84b4-4078-928c-ce49796d17a4 service nova] Creating event network-vif-deleted:2150b774-dd7c-4f45-910d-01e39333a0ce for instance 083a54e8-8841-4d6e-b720-a0e06409e0d4 on nch2-master-1 Dec 25 21:10:46.753731 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-adff2abd-f765-4f99-8f2a-3ebbd7d64eeb req-b2156b07-84b4-4078-928c-ce49796d17a4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040686 Dec 25 21:10:46.754511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 500/1094] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:46.860457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c07804b6-ed7c-4cc8-801b-fe101ac9a471 req-4cc0ebbd-ad4d-4422-bce0-6ebc9723d0dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1ea080-3600-4152-8bef-f30741212401", "tag": "03a8ec19-2525-4748-83ce-e5fe439b39e0"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:46.862346 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:46.862346 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:46.876955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c07804b6-ed7c-4cc8-801b-fe101ac9a471 req-4cc0ebbd-ad4d-4422-bce0-6ebc9723d0dd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:46.877756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c07804b6-ed7c-4cc8-801b-fe101ac9a471 req-4cc0ebbd-ad4d-4422-bce0-6ebc9723d0dd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:46.889147 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c07804b6-ed7c-4cc8-801b-fe101ac9a471 req-4cc0ebbd-ad4d-4422-bce0-6ebc9723d0dd service nova] Creating event network-changed:03a8ec19-2525-4748-83ce-e5fe439b39e0 for instance 3c1ea080-3600-4152-8bef-f30741212401 on nch2-master-1 Dec 25 21:10:46.895776 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c07804b6-ed7c-4cc8-801b-fe101ac9a471 req-4cc0ebbd-ad4d-4422-bce0-6ebc9723d0dd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038287 Dec 25 21:10:46.897102 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 595/1095] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:47.041221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:47.041431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:47.052959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.053418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.054224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.054771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.100139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:47.100837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:47.125275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.126104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.127118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.127711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.131263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.132008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.132654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lazy-loading 'fault' on Instance uuid 083a54e8-8841-4d6e-b720-a0e06409e0d4 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:10:47.268037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:47.282517 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9c31663-c6df-4020-a3eb-033367d61b0d tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 200 len: 1309 microversion: 2.1 time: 0.243941 Dec 25 21:10:47.285935 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 501/1096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:47 2021] GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:47.298518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:47.300463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:47.308330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.308738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.309572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.310009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.386657 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cb5966e-0ed7-4ce0-b2d9-4475c628ec66 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.098728 Dec 25 21:10:47.387314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 502/1097] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:47 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:47.644992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:47.654292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef0deccf-7eac-48c7-87cc-d6e8b45d2085 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.558908 Dec 25 21:10:47.665987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 596/1098] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:47 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:10:47.672819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:47.673649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:47.692732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.693627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.695947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:47.696584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:47.718274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-922839199", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "18cd81fa-8a8a-4568-b72f-9dfeb3958de1"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:47.790234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] validate_networks() for [('18cd81fa-8a8a-4568-b72f-9dfeb3958de1', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:48.094157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:48.130165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26bce345-b405-4125-8cf6-b011182e5713 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.462636 Dec 25 21:10:48.131236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 597/1099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:47 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:48.138406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:48.141092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:48.152334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.153203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.154250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.154867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.239425 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82ce36bf-5eb0-4d50-a193-5fd3b8a18be1 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 16347 microversion: 2.1 time: 0.106038 Dec 25 21:10:48.247251 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 598/1100] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:48 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 16347 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:48.249834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:48.250760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:48.259217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.259477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.260129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.260564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.625091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:48.638733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6218a4a1-7395-4e84-9bff-1304fec3ccc8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.394454 Dec 25 21:10:48.641695 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 599/1101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:48 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:48.646653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:48.647834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 083a54e8-8841-4d6e-b720-a0e06409e0d4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:48.654736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.655533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.656528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.657328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.678159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:48.678159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:48.678159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:48.678159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:48.678658 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance 083a54e8-8841-4d6e-b720-a0e06409e0d4 could not be found. Dec 25 21:10:48.678861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:48.678950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance 083a54e8-8841-4d6e-b720-a0e06409e0d4 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:48.678950 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a7bcba9-a08f-43c2-bcb5-08ba61026243 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4" status: 404 len: 111 microversion: 2.1 time: 0.036315 Dec 25 21:10:48.681763 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 600/1102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:48 2021] GET /compute/v2.1/servers/083a54e8-8841-4d6e-b720-a0e06409e0d4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:48.687712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:48.692707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.693463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.694312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.702578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.704076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:48.714717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.716213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.716213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.716552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.732262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Getting quotas for project b2a52fc668c14890989f5c2756094ba1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:48.742413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Getting quotas for user cf797406f5aa4ba792478c5af6eccb4f and project b2a52fc668c14890989f5c2756094ba1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:48.768563 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39a3469f-ec32-47df-a4f7-e501f9f76535 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.085160 Dec 25 21:10:48.768782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:48.772606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:48.779613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 601/1103] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:48 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:48.794855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:48.795833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:48.809920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.809920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.811665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.811665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.918053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f8b0e5f6-0161-4f10-9bc2-4460c37f8c13 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372720 Dec 25 21:10:48.930308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 503/1104] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:10:48.936640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:48.942346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: bfb762b4-175c-45df-b530-e2ac66bf96cf] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:48.945615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.946349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.947396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:48.948000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:48.982476 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance bfb762b4-175c-45df-b530-e2ac66bf96cf could not be found. Dec 25 21:10:48.984180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance bfb762b4-175c-45df-b530-e2ac66bf96cf could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:48.985649 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfb7fa3d-efb8-4d3f-93e3-2e29f8a574ac tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf" status: 404 len: 111 microversion: 2.1 time: 0.053941 Dec 25 21:10:48.986967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 504/1105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:48 2021] GET /compute/v2.1/servers/bfb762b4-175c-45df-b530-e2ac66bf96cf => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:48.993769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ae7c3d79-7eef-498f-ad7c-84639d113705 req-c87329d2-e5e4-43e7-9af7-ce27d76fe3ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfb762b4-175c-45df-b530-e2ac66bf96cf", "name": "network-vif-deleted", "tag": "b5c53dfd-8507-4f31-ba6b-58c68d41b36b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:48.996003 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:48.996003 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:49.018685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ae7c3d79-7eef-498f-ad7c-84639d113705 req-c87329d2-e5e4-43e7-9af7-ce27d76fe3ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.024301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ae7c3d79-7eef-498f-ad7c-84639d113705 req-c87329d2-e5e4-43e7-9af7-ce27d76fe3ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.042414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ae7c3d79-7eef-498f-ad7c-84639d113705 req-c87329d2-e5e4-43e7-9af7-ce27d76fe3ec service nova] Creating event network-vif-deleted:b5c53dfd-8507-4f31-ba6b-58c68d41b36b for instance bfb762b4-175c-45df-b530-e2ac66bf96cf on nch1-master-1 Dec 25 21:10:49.048308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ae7c3d79-7eef-498f-ad7c-84639d113705 req-c87329d2-e5e4-43e7-9af7-ce27d76fe3ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059669 Dec 25 21:10:49.050398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 505/1106] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:49.070450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3095c1b-27bb-4785-8e0a-0a4fa442f892 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:49.205961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:49.214466 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bee9ecc7-23b7-493d-aa8f-896485d66956 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.436103 Dec 25 21:10:49.223929 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 602/1107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:48 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:49.228097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3095c1b-27bb-4785-8e0a-0a4fa442f892 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/e7fc432d-11f1-400d-bcc5-e158a802484b" status: 204 len: 0 microversion: 2.1 time: 0.172931 Dec 25 21:10:49.228637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-383688770", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "18cd81fa-8a8a-4568-b72f-9dfeb3958de1"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:49.228973 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 506/1108] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:10:49 2021] DELETE /compute/v2.1/os-server-groups/e7fc432d-11f1-400d-bcc5-e158a802484b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:49.233322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:49.234720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:49.242073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.242523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.243327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.243769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.314803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] validate_networks() for [('18cd81fa-8a8a-4568-b72f-9dfeb3958de1', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:49.541291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:49.550024 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-562252d9-ab9e-42c1-b4bf-c54a2e18f21e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.319605 Dec 25 21:10:49.556512 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 507/1109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:49 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:49.556512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:49.557897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:49.576983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.577465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.581139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.581695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.621453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:49.802107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:49.802620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:49.802987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:49.803388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:49.803797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:49.813945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.814720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.815692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:49.816247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:49.841094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Getting quotas for project b2a52fc668c14890989f5c2756094ba1. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:49.848744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Getting quotas for user cf797406f5aa4ba792478c5af6eccb4f and project b2a52fc668c14890989f5c2756094ba1. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:49.861348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:49.863824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:50.045464 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f52c5e1-5536-4bb7-a4e0-bbc2730f4812 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820269 Dec 25 21:10:50.046119 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 603/1110] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:50.051570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:50.052821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:50.062642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.063106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.063915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.064351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.108107 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2ddb100-e413-45e0-8c21-12eadee72279 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 16347 microversion: 2.1 time: 0.060480 Dec 25 21:10:50.110106 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 604/1111] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:50 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 16347 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:50.116119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:50.116821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:50.123589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.124133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.125073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.125541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.177102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a985f19e-f07b-4b86-88ab-1c25154fd6e5 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 204 len: 0 microversion: 2.1 time: 0.622252 Dec 25 21:10:50.177102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 508/1112] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:49 2021] DELETE /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 0 bytes in 624 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:50.183072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:50.184294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:50.190648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.191178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.192784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.193703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.279425 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-828f112c-ebe6-4a08-ac64-3cf30cfde76f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.093256 Dec 25 21:10:50.279425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 509/1113] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:50 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:50.290860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-313881543", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "451", "networks": [{"uuid": "18cd81fa-8a8a-4568-b72f-9dfeb3958de1"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:50.367570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:50.381520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] validate_networks() for [('18cd81fa-8a8a-4568-b72f-9dfeb3958de1', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:50.386333 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-765e74a7-3d43-4243-9911-96bdeb437863 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1470 microversion: 2.1 time: 0.274021 Dec 25 21:10:50.395332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 605/1114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:50 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1470 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:50.413068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:50.413784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:50.423505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.424055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.424975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.425871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.461225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:50.845466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:50.845997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:50.846641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:50.847386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:50.848598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:50.867561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.870350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.871624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.872287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.877926 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e846eb77-adde-4b77-9eb6-7ae7ade01577 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 204 len: 0 microversion: 2.1 time: 0.480754 Dec 25 21:10:50.882125 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 606/1115] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:50 2021] DELETE /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:50.887406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:50.888115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:50.891532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Getting quotas for project b2a52fc668c14890989f5c2756094ba1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:50.895849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.896314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.896902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Getting quotas for user cf797406f5aa4ba792478c5af6eccb4f and project b2a52fc668c14890989f5c2756094ba1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:50.897145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:50.897588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:50.911067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:50.913615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:51.088497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:51.097280 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-646f0bda-2a77-4580-9deb-6aa10bddc7ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.213576 Dec 25 21:10:51.107461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 607/1116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:50 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:51.114837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:51.115486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:51.121674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.122130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.122922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.123360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.151856 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-763fd421-b661-4856-90c3-14d2646f9526 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874836 Dec 25 21:10:51.156974 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 510/1117] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:51.157429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-01397064-5252-4507-acb3-2ffdc9bc804f req-21da4cb7-996d-437a-aa6a-ebd5bead17a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e327d55b-28ca-4bfa-bcf1-e4ed49240d52", "name": "network-vif-plugged", "status": "completed", "tag": "da0f28d9-3fef-4a56-9994-44b97466e1d4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:51.158976 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:51.158976 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:51.171028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-01397064-5252-4507-acb3-2ffdc9bc804f req-21da4cb7-996d-437a-aa6a-ebd5bead17a7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.171471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-01397064-5252-4507-acb3-2ffdc9bc804f req-21da4cb7-996d-437a-aa6a-ebd5bead17a7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.184084 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-01397064-5252-4507-acb3-2ffdc9bc804f req-21da4cb7-996d-437a-aa6a-ebd5bead17a7 service nova] Creating event network-vif-plugged:da0f28d9-3fef-4a56-9994-44b97466e1d4 for instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 on nch1-master-1 Dec 25 21:10:51.192661 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-01397064-5252-4507-acb3-2ffdc9bc804f req-21da4cb7-996d-437a-aa6a-ebd5bead17a7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037245 Dec 25 21:10:51.193553 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 511/1118] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:51.198718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:51.202595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:51.218381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.219278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.220097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.220544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.408305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:51.418304 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-107a27f3-4b0e-4912-a388-6f1fccc0b5c0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.309438 Dec 25 21:10:51.428657 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 608/1119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:51 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:51.438656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:51.441519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:51.450344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.451275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.453923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.454588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.500491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:51.509315 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03da4e3d-d27b-4192-b175-1c2afb83ac74 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 200 len: 1474 microversion: 2.1 time: 0.314567 Dec 25 21:10:51.518862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 512/1120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:51 2021] GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 1474 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:51.518862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-72cc553c-1515-4198-b2e4-baa4cfc43388 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:51.518862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-72cc553c-1515-4198-b2e4-baa4cfc43388 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:51.522838 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab245042-cae4-4551-b10c-6c787f1c243e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.092249 Dec 25 21:10:51.524465 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 609/1121] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:51 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:51.535429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:51.539597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:51.551473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.552126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.552731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.553633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.570956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-72cc553c-1515-4198-b2e4-baa4cfc43388 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:51.578250 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-72cc553c-1515-4198-b2e4-baa4cfc43388 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1220 microversion: 2.1 time: 0.067136 Dec 25 21:10:51.579345 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 513/1122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:51 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1220 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:51.591477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:51.592338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:51.598749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.599205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.600003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:51.600443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:51.605786 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1871d09-a7ab-4290-a26a-cf3809900b78 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 32633 microversion: 2.1 time: 0.080484 Dec 25 21:10:51.606489 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 610/1123] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:51 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 32633 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:51.791285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:51.806328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb049ee7-4a56-4735-889d-5d669406b6c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1476 microversion: 2.1 time: 0.219281 Dec 25 21:10:51.806328 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 514/1124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:51 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:52.114768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:52.115521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:52.123352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.123807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.127229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.127229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.439537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:52.440146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:52.452923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.453838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.454671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.455103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.658800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:52.667417 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2c522897-bbb6-4bc9-8c19-57b86dd0b0dc tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1306 microversion: 2.1 time: 0.556677 Dec 25 21:10:52.668386 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 611/1125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:52 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1306 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:52.673180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:52.674038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:52.680433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.689376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.689376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.689376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.788864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:52.801062 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2bd82e6a-2dc8-4263-9b13-7e8b10d10a15 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 200 len: 1432 microversion: 2.1 time: 0.129482 Dec 25 21:10:52.803039 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 612/1126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:52 2021] GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 1432 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:52.808442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:52.809933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:52.830102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.833879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.836201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.836927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.902656 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e0180ac-17b1-4f39-b138-05333a338f1e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.097989 Dec 25 21:10:52.911890 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 613/1127] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:52 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:52.921620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:52.922342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:52.936459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.936953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.938313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:52.938313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:52.964292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:52.981675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc7c4dca-b975-4bd3-9a33-3a86a443317e tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.546726 Dec 25 21:10:52.992991 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 515/1128] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:52 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:53.000411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:53.002468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:53.010591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.011443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.013211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.013871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.044006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:53.051913 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef747f13-b5bc-44d8-b2e6-c1131012d4a3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1216 microversion: 2.1 time: 0.139568 Dec 25 21:10:53.071821 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 614/1129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:52 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:53.077322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:53.077949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:53.090955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.096219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.097247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.097704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.146076 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c0327e3-ad3b-4e3c-a82a-7ab16c3580cb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action" status: 200 len: 40777 microversion: 2.1 time: 0.149948 Dec 25 21:10:53.152931 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 516/1130] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:52 2021] POST /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d/action => generated 40777 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:53.181713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-357d5091-f611-4e85-95e8-d6bdea872239 req-9b74c551-dd79-4555-bcdd-9e8bcf025cc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f68f874-59f2-4c67-90f1-50665110bd4e", "name": "network-vif-deleted", "tag": "bf94d897-4956-441a-9897-be577975a8f7"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:53.184115 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:53.184115 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:53.241595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-357d5091-f611-4e85-95e8-d6bdea872239 req-9b74c551-dd79-4555-bcdd-9e8bcf025cc7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.242452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-357d5091-f611-4e85-95e8-d6bdea872239 req-9b74c551-dd79-4555-bcdd-9e8bcf025cc7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.279408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-357d5091-f611-4e85-95e8-d6bdea872239 req-9b74c551-dd79-4555-bcdd-9e8bcf025cc7 service nova] Creating event network-vif-deleted:bf94d897-4956-441a-9897-be577975a8f7 for instance 9f68f874-59f2-4c67-90f1-50665110bd4e on nch1-master-1 Dec 25 21:10:53.288033 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-357d5091-f611-4e85-95e8-d6bdea872239 req-9b74c551-dd79-4555-bcdd-9e8bcf025cc7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130634 Dec 25 21:10:53.289796 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 517/1131] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:53.310972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:53.312014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:53.322777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.323628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.324670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.325653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.603179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:53.610529 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24a96059-a5f1-4aff-9f44-d8f227e9c8ba tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1476 microversion: 2.1 time: 0.537611 Dec 25 21:10:53.611106 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 615/1132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:53 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1476 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:53.660330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:53.669530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8af33f8-5143-4946-93be-ccc5ddee0c54 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 200 len: 1704 microversion: 2.1 time: 0.376956 Dec 25 21:10:53.669530 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 518/1133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:53 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 1704 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:53.683464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:53.684414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:53.693485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.694376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.694723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.695386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.821772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:53.822260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:53.840701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.841191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.842007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:53.842452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:53.957255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:53.973351 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ae7b06a-4fe4-4618-95b2-de63883d8277 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 200 len: 1303 microversion: 2.1 time: 0.154663 Dec 25 21:10:53.985167 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 519/1134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:53 2021] GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:53.991227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-97aedb1c-0c3d-4d31-8542-c1453482c575 req-0c1bec1b-c692-4890-a076-bac01db9204a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e47b7882-0d9a-4469-b7aa-9ea14292ab12", "name": "network-vif-deleted", "tag": "bfee550f-dfee-43e5-88c3-be85d5ccff12"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:53.992805 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:53.992805 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:54.001528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-97aedb1c-0c3d-4d31-8542-c1453482c575 req-0c1bec1b-c692-4890-a076-bac01db9204a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.001985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-97aedb1c-0c3d-4d31-8542-c1453482c575 req-0c1bec1b-c692-4890-a076-bac01db9204a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.014019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-97aedb1c-0c3d-4d31-8542-c1453482c575 req-0c1bec1b-c692-4890-a076-bac01db9204a service nova] Creating event network-vif-deleted:bfee550f-dfee-43e5-88c3-be85d5ccff12 for instance e47b7882-0d9a-4469-b7aa-9ea14292ab12 on nch1-master-1 Dec 25 21:10:54.020053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-97aedb1c-0c3d-4d31-8542-c1453482c575 req-0c1bec1b-c692-4890-a076-bac01db9204a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033170 Dec 25 21:10:54.022659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 520/1135] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:54.027852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:54.029112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:54.039925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.040930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.042556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.043184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.043878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:54.057947 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50d1f646-dbc3-40a4-9e62-4419d336667c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1486 microversion: 2.1 time: 0.375957 Dec 25 21:10:54.058801 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 616/1136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:53 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1486 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:54.073321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:54.073940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:54.085206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.085206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.085206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.085206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.130015 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf67f8f1-e50e-470b-9efb-e5fe718b2a8b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.107234 Dec 25 21:10:54.130757 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 521/1137] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:54 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:54.136865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:54.138222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:54.146118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.146745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.147890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.148503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.340446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:54.352462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bba96c5-21b9-4b47-81ea-84553a51af07 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1272 microversion: 2.1 time: 0.220244 Dec 25 21:10:54.354186 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 522/1138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:54 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:54.376331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ed4c658-4d0d-42c4-b22e-7a9e96dc4df4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:54.384732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ed4c658-4d0d-42c4-b22e-7a9e96dc4df4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.385210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ed4c658-4d0d-42c4-b22e-7a9e96dc4df4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.479810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ed4c658-4d0d-42c4-b22e-7a9e96dc4df4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Going to try to stop instance {{(pid=136547) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:10:54.691899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:54.705112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b13b7608-8e55-4cd3-a3f2-39afab71f096 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.644423 Dec 25 21:10:54.705714 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 617/1139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:54 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:54.714040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3dfc50c2-93f8-44dc-8d82-faa486a26c06 req-a2b89e12-b63e-430e-bfc9-2a931823bc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ea080-3600-4152-8bef-f30741212401", "name": "network-vif-plugged", "status": "completed", "tag": "03a8ec19-2525-4748-83ce-e5fe439b39e0"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:54.715786 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:54.715786 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:54.724782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3dfc50c2-93f8-44dc-8d82-faa486a26c06 req-a2b89e12-b63e-430e-bfc9-2a931823bc63 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.725489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3dfc50c2-93f8-44dc-8d82-faa486a26c06 req-a2b89e12-b63e-430e-bfc9-2a931823bc63 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.745485 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3dfc50c2-93f8-44dc-8d82-faa486a26c06 req-a2b89e12-b63e-430e-bfc9-2a931823bc63 service nova] Creating event network-vif-plugged:03a8ec19-2525-4748-83ce-e5fe439b39e0 for instance 3c1ea080-3600-4152-8bef-f30741212401 on nch2-master-1 Dec 25 21:10:54.751458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3dfc50c2-93f8-44dc-8d82-faa486a26c06 req-a2b89e12-b63e-430e-bfc9-2a931823bc63 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044322 Dec 25 21:10:54.753529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 618/1140] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:54.768807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:54.772944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:54.782012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.782694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.785180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.786997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.832717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:54.861196 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ed4c658-4d0d-42c4-b22e-7a9e96dc4df4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52/action" status: 202 len: 0 microversion: 2.1 time: 0.505419 Dec 25 21:10:54.861825 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 523/1141] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:54 2021] POST /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:10:54.869148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:54.872636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:54.901359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.902128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:54.907517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:54.909502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.242630 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d81bd69-aa36-40c3-bcdf-323439412c80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 204 len: 0 microversion: 2.1 time: 0.486872 Dec 25 21:10:55.245008 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 619/1142] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:54 2021] DELETE /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:55.266716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:55.268149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:55.274849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.275480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.276476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.277602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.466164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:55.476903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-664b9815-a212-4500-9076-90922c5d590e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1476 microversion: 2.1 time: 0.613579 Dec 25 21:10:55.485052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 524/1143] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:54 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1476 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:55.492567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:55.493342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 9f68f874-59f2-4c67-90f1-50665110bd4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:55.500382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.500625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.502466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.502921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.529683 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance 9f68f874-59f2-4c67-90f1-50665110bd4e could not be found. Dec 25 21:10:55.530393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance 9f68f874-59f2-4c67-90f1-50665110bd4e could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:55.531576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9d75e68-0d83-4018-ac43-e185305f059a tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e" status: 404 len: 111 microversion: 2.1 time: 0.052275 Dec 25 21:10:55.532286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 525/1144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:55 2021] GET /compute/v2.1/servers/9f68f874-59f2-4c67-90f1-50665110bd4e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:55.543062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:55.544380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:55.553271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.553656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.554532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.554957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.609753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-081508b9-1291-495c-9c3c-e6e4ca1c454e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.070697 Dec 25 21:10:55.610403 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 526/1145] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:55 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:55.616316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:55.617155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:55.624805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.625418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.626422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:55.627038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:55.688930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:55.704001 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf8a73d0-d913-40c4-9169-da3846639872 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.443703 Dec 25 21:10:55.714884 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 620/1146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:55 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:55.728003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1003687517", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "1498146698", "adminPass": "***", "networks": [{"uuid": "629690dc-316c-48ba-b3f8-2395f5f041a6"}], "security_groups": [{"name": "tempest-securitygroup--1982068629"}], "key_name": "tempest-keypair-1535556607", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:55.978839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] validate_networks() for [('629690dc-316c-48ba-b3f8-2395f5f041a6', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:10:56.078683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:56.086680 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-832410dd-a9c8-4bc9-85d4-3fd78a0cdccf tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1320 microversion: 2.1 time: 0.474034 Dec 25 21:10:56.096004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 527/1147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:55 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1320 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:56.096004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:56.096004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: e47b7882-0d9a-4469-b7aa-9ea14292ab12] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:56.098202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:56.098657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:56.099495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:56.099936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:56.114959 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance e47b7882-0d9a-4469-b7aa-9ea14292ab12 could not be found. Dec 25 21:10:56.121088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance e47b7882-0d9a-4469-b7aa-9ea14292ab12 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:10:56.121088 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58cf8c45-5b93-42d8-b18d-5133afda2343 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12" status: 404 len: 111 microversion: 2.1 time: 0.028175 Dec 25 21:10:56.121088 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 528/1148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:56 2021] GET /compute/v2.1/servers/e47b7882-0d9a-4469-b7aa-9ea14292ab12 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:10:56.121344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:56.121957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:56.127808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:56.128265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:56.129691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:56.130135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:56.457046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:56.467806 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62080aa5-6808-4e52-9f70-a151a4ee5ed8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1311 microversion: 2.1 time: 0.349812 Dec 25 21:10:56.477329 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 529/1149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:56 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1311 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:56.477329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d494f0d2-ce39-427b-8549-0ba1cd947725 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:56.588355 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d494f0d2-ce39-427b-8549-0ba1cd947725 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/2a16c084-4364-4366-b497-ad95436a844d" status: 204 len: 0 microversion: 2.1 time: 0.118494 Dec 25 21:10:56.597057 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 530/1150] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:10:56 2021] DELETE /compute/v2.1/os-server-groups/2a16c084-4364-4366-b497-ad95436a844d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:56.601457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:56.607810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:56.654929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:56.663092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:56.671423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:56.672699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.234970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:10:57.235456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:10:57.236287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:10:57.236287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:10:57.236671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:10:57.246468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.246919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.247743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.248174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.270606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:10:57.274884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Getting quotas for user aa5e089e14854aec83cc6b1f9ca9fedc and project e25e5a44bb7e4ef7a38e961e6203b72b. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:10:57.288724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:10:57.291609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:10:57.392005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:57.401415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d37d89e2-6c3e-45ba-b867-3763e94c67a9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1476 microversion: 2.1 time: 0.811170 Dec 25 21:10:57.406148 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 531/1151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:56 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1476 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:57.414674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:57.425760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:57.434237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.435022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.436082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.437378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.510539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be7cf791-1aec-4a04-93b8-309fc6a2eb17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.794143 Dec 25 21:10:57.511207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 621/1152] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:10:55 2021] POST /compute/v2.1/servers => generated 402 bytes in 1796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:10:57.521284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:10:57.548511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:57.556180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:57.568349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.574973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.576063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.576665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.710819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-520eac2d-73b9-447d-bfd0-4a7907746cc4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.189744 Dec 25 21:10:57.711778 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 622/1153] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:57 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:57.718982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:57.725511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:57.762280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.763271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.764483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.765252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.895780 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ae6f6d3-bc4b-4f1b-a200-ce4517727104 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 204 len: 0 microversion: 2.1 time: 0.484443 Dec 25 21:10:57.897407 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 532/1154] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:10:57 2021] DELETE /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:10:57.904106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1c92953b-7063-4847-add0-21130059be50 req-6171153b-6883-4eb5-ae11-4185830cf9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ae83e38-943e-47ce-af1e-e5bef506ca7d", "tag": "9ec98fee-c19b-4539-9748-2eb705309dff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:57.905825 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:57.905825 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:10:57.916774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1c92953b-7063-4847-add0-21130059be50 req-6171153b-6883-4eb5-ae11-4185830cf9af service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.928951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1c92953b-7063-4847-add0-21130059be50 req-6171153b-6883-4eb5-ae11-4185830cf9af service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.930817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1c92953b-7063-4847-add0-21130059be50 req-6171153b-6883-4eb5-ae11-4185830cf9af service nova] Creating event network-changed:9ec98fee-c19b-4539-9748-2eb705309dff for instance 1ae83e38-943e-47ce-af1e-e5bef506ca7d on nch1-master-1 Dec 25 21:10:57.944787 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1c92953b-7063-4847-add0-21130059be50 req-6171153b-6883-4eb5-ae11-4185830cf9af service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038718 Dec 25 21:10:57.946417 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 533/1155] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:57.954539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:57.955433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:57.965939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.965939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:57.967090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:57.967727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:58.421875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:58.430795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e297df1b-b1b8-478b-b13d-2b2600fb0578 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.717571 Dec 25 21:10:58.435663 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 623/1156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:57 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:58.436765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-60bb20ec-92db-4d23-b88e-c5c2e611abc0 req-da840e8b-4111-4d7b-9718-9a932baf0a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d914c615-075b-48b0-bbd9-707f0b4e084d", "tag": "68318cac-8cb7-4fbd-94a8-563f01bdc7e4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:58.439629 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:58.439629 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:58.447507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-60bb20ec-92db-4d23-b88e-c5c2e611abc0 req-da840e8b-4111-4d7b-9718-9a932baf0a97 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:58.448487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-60bb20ec-92db-4d23-b88e-c5c2e611abc0 req-da840e8b-4111-4d7b-9718-9a932baf0a97 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:58.460819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-60bb20ec-92db-4d23-b88e-c5c2e611abc0 req-da840e8b-4111-4d7b-9718-9a932baf0a97 service nova] Creating event network-changed:68318cac-8cb7-4fbd-94a8-563f01bdc7e4 for instance d914c615-075b-48b0-bbd9-707f0b4e084d on nch1-master-1 Dec 25 21:10:58.466370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-60bb20ec-92db-4d23-b88e-c5c2e611abc0 req-da840e8b-4111-4d7b-9718-9a932baf0a97 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033282 Dec 25 21:10:58.469596 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 624/1157] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:58.472519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:58.473823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:58.478185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:58.480601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:58.481198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:58.482094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:58.482753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:58.493927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-15f6e423-841c-4e23-8cd8-a189e81e2516 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1320 microversion: 2.1 time: 0.545489 Dec 25 21:10:58.494543 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 534/1158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:57 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1320 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:58.508435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b181098b-0a9e-4971-bbef-15ac7281818c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:58.509132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b181098b-0a9e-4971-bbef-15ac7281818c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:58.662250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b181098b-0a9e-4971-bbef-15ac7281818c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:58.668980 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b181098b-0a9e-4971-bbef-15ac7281818c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1265 microversion: 2.1 time: 0.173389 Dec 25 21:10:58.669650 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 535/1159] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:58 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:58.683227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:58.683847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:58.690947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:58.691907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:58.693079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:58.693525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:58.985781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:58.993665 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed7cf3d0-6382-40e0-a739-57b8ef975850 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1494 microversion: 2.1 time: 0.525354 Dec 25 21:10:58.994458 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 625/1160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:58 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1494 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:58.998605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-036d15f0-6607-46b9-a179-329169f89eb6 req-2b6daed0-f6bb-4f04-80e7-50150a971b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8114c1-85b3-4e15-9e15-95159b456e41", "name": "network-vif-plugged", "status": "completed", "tag": "f465e7da-b12a-4235-8af5-b0f521da6640"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:59.000150 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:10:59.000150 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:10:59.007016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-036d15f0-6607-46b9-a179-329169f89eb6 req-2b6daed0-f6bb-4f04-80e7-50150a971b00 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.007462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-036d15f0-6607-46b9-a179-329169f89eb6 req-2b6daed0-f6bb-4f04-80e7-50150a971b00 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.018493 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-036d15f0-6607-46b9-a179-329169f89eb6 req-2b6daed0-f6bb-4f04-80e7-50150a971b00 service nova] Creating event network-vif-plugged:f465e7da-b12a-4235-8af5-b0f521da6640 for instance 9a8114c1-85b3-4e15-9e15-95159b456e41 on nch2-master-1 Dec 25 21:10:59.023778 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-036d15f0-6607-46b9-a179-329169f89eb6 req-2b6daed0-f6bb-4f04-80e7-50150a971b00 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028446 Dec 25 21:10:59.024366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 626/1161] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:10:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:10:59.029145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:59.029840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:59.036487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.036966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.037762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.038205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.104494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:59.112204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23810d67-6e9d-4a9a-98c3-d56d794da9dc tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1473 microversion: 2.1 time: 0.432443 Dec 25 21:10:59.113298 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 536/1162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:58 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:59.118073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:10:59.119141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:59.126131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.126721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.127616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.128122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.169543 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de45cc53-95c1-4e11-89ee-96eb50b95885 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.054706 Dec 25 21:10:59.171541 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 537/1163] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:10:59 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:10:59.178772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:59.180271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:59.188486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.188950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.189775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.190222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.275997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:10:59.283546 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ff9f587-c8c3-40d3-9262-85bd7e3030a6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1476 microversion: 2.1 time: 0.257949 Dec 25 21:10:59.284075 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 627/1164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:59 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1476 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:10:59.448094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:10:59.448724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:10:59.454568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.455007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:10:59.455776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:10:59.459353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.710912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:00.711488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0259fce1-1b8f-4646-a231-a9e70cb80926 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1645 microversion: 2.1 time: 1.538144 Dec 25 21:11:00.718984 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-617f1c99-0c30-40ee-8c6a-24494b78a52f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 1.274601 Dec 25 21:11:00.728931 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 628/1165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:59 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:00.729255 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 538/1166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:10:59 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1645 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:00.729366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:00.729366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:00.729550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f308309-5fed-434c-a869-bbc5569bf9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:00.729550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f308309-5fed-434c-a869-bbc5569bf9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:00.734600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.735207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.736036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.736484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.782223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f308309-5fed-434c-a869-bbc5569bf9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:00.789006 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f308309-5fed-434c-a869-bbc5569bf9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1265 microversion: 2.1 time: 0.065074 Dec 25 21:11:00.789579 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 539/1167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:00 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1265 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:00.794178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:00.794788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:00.800712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.801200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.801984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.802424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.911380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:00.918928 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48a42972-4106-4c95-8b51-4cd030985184 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1320 microversion: 2.1 time: 0.198327 Dec 25 21:11:00.919543 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 629/1168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:00 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:00.923881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:00.924860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:00.930734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.931189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.931997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.932442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.970936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:00.978332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4efa751-2a77-4eef-a07c-2674da1a6a54 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1473 microversion: 2.1 time: 0.187802 Dec 25 21:11:00.978902 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 540/1169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:00 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:00.983311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:00.983925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:00.984188 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84100eea-dd27-451a-a7d1-20cd0b0cb0d4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.063212 Dec 25 21:11:00.988887 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 630/1170] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:00 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:00.989855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c51c501a-88e6-42d5-aa0d-fad51d4689fe tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:00.991213 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:00.991213 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:00.991886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.992341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.992742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51c501a-88e6-42d5-aa0d-fad51d4689fe tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.993161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.993292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51c501a-88e6-42d5-aa0d-fad51d4689fe tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.993598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:00.994028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51c501a-88e6-42d5-aa0d-fad51d4689fe tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:00.994471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51c501a-88e6-42d5-aa0d-fad51d4689fe tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:01.020151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c51c501a-88e6-42d5-aa0d-fad51d4689fe tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033419 Dec 25 21:11:01.020762 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 631/1171] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:11:00 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:01.134042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:01.142133 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b74910a-9fac-45b6-92b2-e8148e5fb691 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1476 microversion: 2.1 time: 0.162163 Dec 25 21:11:01.142731 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 541/1172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:00 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:01.627440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-cc450e40-2ab1-4f6e-bd47-5631cb28388a req-658dbd15-e4c8-4f84-93f9-d3aebedceb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cadf356d-6fa7-4dcf-9dcf-515f67791639", "tag": "3147cbbc-6a59-4aed-93a8-d328bcb5240b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:01.631190 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:01.631190 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:01.680211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cc450e40-2ab1-4f6e-bd47-5631cb28388a req-658dbd15-e4c8-4f84-93f9-d3aebedceb71 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:01.686059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cc450e40-2ab1-4f6e-bd47-5631cb28388a req-658dbd15-e4c8-4f84-93f9-d3aebedceb71 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:01.701903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-79a33dae-a99d-46b7-acc8-8b4044fd2603 req-c94f6cc4-db48-43f6-836c-df4790b04c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b814523-70ff-4cb2-b14c-f77ae086c04f", "name": "network-vif-deleted", "tag": "1bcf9756-ed56-4846-ad16-befd4fd2f0e0"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:01.705018 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:01.705018 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:01.709764 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cc450e40-2ab1-4f6e-bd47-5631cb28388a req-658dbd15-e4c8-4f84-93f9-d3aebedceb71 service nova] Creating event network-changed:3147cbbc-6a59-4aed-93a8-d328bcb5240b for instance cadf356d-6fa7-4dcf-9dcf-515f67791639 on nch1-master-1 Dec 25 21:11:01.715348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-79a33dae-a99d-46b7-acc8-8b4044fd2603 req-c94f6cc4-db48-43f6-836c-df4790b04c24 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:01.720860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-79a33dae-a99d-46b7-acc8-8b4044fd2603 req-c94f6cc4-db48-43f6-836c-df4790b04c24 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:01.723586 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-cc450e40-2ab1-4f6e-bd47-5631cb28388a req-658dbd15-e4c8-4f84-93f9-d3aebedceb71 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100765 Dec 25 21:11:01.725043 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 632/1173] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:01.754128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:01.754128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:01.759719 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-79a33dae-a99d-46b7-acc8-8b4044fd2603 req-c94f6cc4-db48-43f6-836c-df4790b04c24 service nova] Creating event network-vif-deleted:1bcf9756-ed56-4846-ad16-befd4fd2f0e0 for instance 1b814523-70ff-4cb2-b14c-f77ae086c04f on nch2-master-1 Dec 25 21:11:01.761764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:01.762224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:01.763248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:01.763849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:01.769827 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-79a33dae-a99d-46b7-acc8-8b4044fd2603 req-c94f6cc4-db48-43f6-836c-df4790b04c24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073991 Dec 25 21:11:01.770922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 542/1174] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:01.807065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:01.808288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:01.826461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:01.827042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:01.827970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:01.828636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:02.323786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:02.342770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e86fec2e-131d-4ba4-bd6a-050e4911c1ca tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1269 microversion: 2.1 time: 0.540344 Dec 25 21:11:02.343772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 543/1175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:01 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1269 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:02.348431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:02.354217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:02.363937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:02.364390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:02.367468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:02.367970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:02.782933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:02.792375 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75246d19-a002-4e17-bdaa-16e5194ec6a1 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 1.059713 Dec 25 21:11:02.792988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 633/1176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:01 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:02.797741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:02.798490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:02.805398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:02.806855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:02.807074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:02.807526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:02.846341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:02.846829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:02.847497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lazy-loading 'fault' on Instance uuid 1b814523-70ff-4cb2-b14c-f77ae086c04f {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:11:02.980665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:02.981251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '491f06d5a64145919a6e4a9ec0fa9171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a16dcc3c214ac2a218d3758e551792', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:02.990430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcc2501f-e293-4ef8-aa5d-a90d103b1beb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1320 microversion: 2.1 time: 0.645488 Dec 25 21:11:02.992850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e6980a79-3e22-43bb-b4e2-ec2b48505043 tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 200 len: 1307 microversion: 2.1 time: 0.198362 Dec 25 21:11:02.995347 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 634/1177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:02 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 1307 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:02.999121 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 544/1178] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:02 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1320 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:03.006114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:03.008473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:03.016384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:03.018665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:03.023719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.026236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.026712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.026995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.027714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.027920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.028212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.028598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.075834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa7b2b43-2574-4d38-8868-04c0ecb3def3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.078856 Dec 25 21:11:03.077264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 635/1179] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:02 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:03.340178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:03.348984 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c42aab3b-76fd-4dbd-b898-926c67952af7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1462 microversion: 2.1 time: 0.339246 Dec 25 21:11:03.358864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 545/1180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:02 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1462 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:03.365956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:03.367275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:03.371947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:03.372721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:03.375168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.375860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.377251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.378295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.381236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.381916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.382781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.383237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.549464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:03.559042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c710900-4ae9-4588-ae4c-57552ae5a7ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1317 microversion: 2.1 time: 0.197592 Dec 25 21:11:03.559859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 636/1181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:03 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:03.716018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:03.726314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e4a918c-3d44-4cbd-beef-c281fc233d0a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1462 microversion: 2.1 time: 0.359153 Dec 25 21:11:03.727032 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 546/1182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:03 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1462 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:03.742755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:03.744174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:03.750516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.751446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.751741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.752174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.762533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6486f1cf-6dc6-4d0c-82ea-4da19545b300 req-3a9882a9-5276-4d28-9658-553e9f990664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a4cbf2d-cea7-4432-9264-6ac3fed9238d", "name": "network-vif-deleted", "tag": "7c429c38-cf37-4881-8541-dad894677bf4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:03.764640 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:03.764640 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:03.793412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6486f1cf-6dc6-4d0c-82ea-4da19545b300 req-3a9882a9-5276-4d28-9658-553e9f990664 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.794185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6486f1cf-6dc6-4d0c-82ea-4da19545b300 req-3a9882a9-5276-4d28-9658-553e9f990664 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.814364 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6486f1cf-6dc6-4d0c-82ea-4da19545b300 req-3a9882a9-5276-4d28-9658-553e9f990664 service nova] Creating event network-vif-deleted:7c429c38-cf37-4881-8541-dad894677bf4 for instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d on nch2-master-1 Dec 25 21:11:03.820616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6486f1cf-6dc6-4d0c-82ea-4da19545b300 req-3a9882a9-5276-4d28-9658-553e9f990664 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061671 Dec 25 21:11:03.821562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 547/1183] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:03.830488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:03.830488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:03.842210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.842521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.843598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:03.844048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:03.867456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:11:03.868482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:11:03.869144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:11:03.869730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:11:03.870298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:11:04.102500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:04.110317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bb68ee9-be00-4282-b11f-cfcba84d87dd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.287399 Dec 25 21:11:04.111528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 548/1184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:03 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:04.121294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:04.122150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:04.131423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.133426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:04.134283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.135276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.135873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.151455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.152088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.153387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.154005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.194195 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba338e2b-664c-45a8-aacf-b3b6c0b126ed tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 1066 microversion: 2.1 time: 0.455181 Dec 25 21:11:04.195500 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 637/1185] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:03 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 1066 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 25 21:11:04.200321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:04.201236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] [instance: 1b814523-70ff-4cb2-b14c-f77ae086c04f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:04.227691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.233456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.233456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.233456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.262080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] HTTP exception thrown: Instance 1b814523-70ff-4cb2-b14c-f77ae086c04f could not be found. Dec 25 21:11:04.268328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] Returning 404 to user: Instance 1b814523-70ff-4cb2-b14c-f77ae086c04f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:11:04.268328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd2f8266-972e-42af-8924-ec5753f6a7fd tempest-ServersOnMultiNodesTest-2058517507 tempest-ServersOnMultiNodesTest-2058517507-project] 10.222.0.32 "GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f" status: 404 len: 111 microversion: 2.1 time: 0.068674 Dec 25 21:11:04.268328 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 638/1186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:04 2021] GET /compute/v2.1/servers/1b814523-70ff-4cb2-b14c-f77ae086c04f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:11:04.274079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:04.275580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:04.281926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.282620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.283623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.284494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.338413 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c19701ed-a3e5-4289-bbfa-4d5866c3dc54 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.069896 Dec 25 21:11:04.342714 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 639/1187] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:04 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:04.344410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:04.345149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:04.362249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.362714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.370139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.370605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.441871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:04.450786 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd7aed75-3d5e-49c1-a84d-a02cdbec4f29 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1320 microversion: 2.1 time: 0.337625 Dec 25 21:11:04.461701 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 549/1188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:04 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1320 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:04.579813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:04.580609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:04.591043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.591372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.592187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.592626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.674182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:04.691996 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81bde51b-c2db-47db-93b0-79adffa67c23 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.349582 Dec 25 21:11:04.691996 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 640/1189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:04 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:04.714305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8b2d7eb4-c282-46b7-a7bd-6023f6641809 req-2746df3d-6135-481f-a5e5-05ab05f063d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae83e38-943e-47ce-af1e-e5bef506ca7d", "name": "network-vif-plugged", "status": "completed", "tag": "9ec98fee-c19b-4539-9748-2eb705309dff"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:04.721026 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:04.721026 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:04.721274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:04.733367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d03561dd-ca52-4b60-92e0-43d39869518a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1335 microversion: 2.1 time: 0.159145 Dec 25 21:11:04.733948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 550/1190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:04 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1335 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:04.745859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8b2d7eb4-c282-46b7-a7bd-6023f6641809 req-2746df3d-6135-481f-a5e5-05ab05f063d3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:04.746312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8b2d7eb4-c282-46b7-a7bd-6023f6641809 req-2746df3d-6135-481f-a5e5-05ab05f063d3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:04.758311 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8b2d7eb4-c282-46b7-a7bd-6023f6641809 req-2746df3d-6135-481f-a5e5-05ab05f063d3 service nova] Creating event network-vif-plugged:9ec98fee-c19b-4539-9748-2eb705309dff for instance 1ae83e38-943e-47ce-af1e-e5bef506ca7d on nch1-master-1 Dec 25 21:11:04.763767 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8b2d7eb4-c282-46b7-a7bd-6023f6641809 req-2746df3d-6135-481f-a5e5-05ab05f063d3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069585 Dec 25 21:11:04.764583 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 641/1191] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:05.127995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:05.129921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:05.136361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.137028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.138002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.138598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.289107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:05.297113 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09508f4a-187a-44ad-99ad-9df88e9eede5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.172972 Dec 25 21:11:05.297708 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 551/1192] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:05 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:05.351934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:05.352966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:05.374594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.375109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.377124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.377668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.430850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-676be928-d2a2-47f4-aa1e-973520896517 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.083886 Dec 25 21:11:05.437335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 642/1193] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:05 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:05.470594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:05.472821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:05.481093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.486959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.486959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.486959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.677665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:05.685226 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4cdbd6de-e97d-47d6-bc93-a8053b3f2a27 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1320 microversion: 2.1 time: 0.221311 Dec 25 21:11:05.686890 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 552/1194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:05 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1320 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:05.708295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:05.709104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:05.715971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.716496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.717633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.717892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.752600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:05.753699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:05.762105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.762703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:05.763602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:05.764142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.043449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:06.051927 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5df433b8-4fed-467c-88a5-0f8fee562820 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.348090 Dec 25 21:11:06.053349 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 643/1195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:05 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:06.061136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:06.070098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55ceffe2-3ff6-4dd2-876b-51f8f9bc6c85 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.322986 Dec 25 21:11:06.080964 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 553/1196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:05 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:06.314453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:06.315290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:06.322407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.322867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.323670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.327249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.444612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:06.447876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:06.456355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.458908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.460489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.461201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.515846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0db7da5a-fef0-43fd-a4f0-3a6492d60f9c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.074178 Dec 25 21:11:06.515846 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 554/1197] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:06 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:06.680268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:06.689919 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0cb06896-1a6c-4207-ad78-4b701d67fbb8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.379173 Dec 25 21:11:06.690499 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 644/1198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:06 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:06.705698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:06.706871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:06.720148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.721160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.722083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.723143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.786210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8b0e4376-ed91-413b-8493-e0a2397f769a req-46824bdb-843e-4a6c-adb6-0952f62d7fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d914c615-075b-48b0-bbd9-707f0b4e084d", "name": "network-vif-plugged", "status": "completed", "tag": "68318cac-8cb7-4fbd-94a8-563f01bdc7e4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:06.788100 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:06.788100 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:06.795155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8b0e4376-ed91-413b-8493-e0a2397f769a req-46824bdb-843e-4a6c-adb6-0952f62d7fb0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:06.795593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8b0e4376-ed91-413b-8493-e0a2397f769a req-46824bdb-843e-4a6c-adb6-0952f62d7fb0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:06.807161 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8b0e4376-ed91-413b-8493-e0a2397f769a req-46824bdb-843e-4a6c-adb6-0952f62d7fb0 service nova] Creating event network-vif-plugged:68318cac-8cb7-4fbd-94a8-563f01bdc7e4 for instance d914c615-075b-48b0-bbd9-707f0b4e084d on nch1-master-1 Dec 25 21:11:06.814790 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8b0e4376-ed91-413b-8493-e0a2397f769a req-46824bdb-843e-4a6c-adb6-0952f62d7fb0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031976 Dec 25 21:11:06.815526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 645/1199] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:07.073514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:07.074424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:07.083387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.086921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.086921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.086921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.311962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:07.320987 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06987793-7de1-4f0a-9573-06c3e732412d tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1509 microversion: 2.1 time: 0.619292 Dec 25 21:11:07.322119 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 555/1200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:06 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1509 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:07.327940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:07.328815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:07.338758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.339399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.340527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.341115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.507899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:07.515661 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c640a4e-42de-4469-9f90-d1def5669407 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.447382 Dec 25 21:11:07.516446 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 646/1201] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:07 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:07.521621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-226f2d0f-8182-48dc-9eec-2d1b90f3fffd req-50fbfb6a-3c0c-49ac-9f65-7b8d2c882e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df0e675-9617-49b5-bf06-c32adf655c9e", "tag": "53ff2af7-9bf4-4cb8-bafa-414f471bb1cb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:07.525846 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:07.525846 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:07.536480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-226f2d0f-8182-48dc-9eec-2d1b90f3fffd req-50fbfb6a-3c0c-49ac-9f65-7b8d2c882e10 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.536954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-226f2d0f-8182-48dc-9eec-2d1b90f3fffd req-50fbfb6a-3c0c-49ac-9f65-7b8d2c882e10 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.548106 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-226f2d0f-8182-48dc-9eec-2d1b90f3fffd req-50fbfb6a-3c0c-49ac-9f65-7b8d2c882e10 service nova] Creating event network-changed:53ff2af7-9bf4-4cb8-bafa-414f471bb1cb for instance 7df0e675-9617-49b5-bf06-c32adf655c9e on nch2-master-1 Dec 25 21:11:07.558972 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-226f2d0f-8182-48dc-9eec-2d1b90f3fffd req-50fbfb6a-3c0c-49ac-9f65-7b8d2c882e10 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036522 Dec 25 21:11:07.558972 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 647/1202] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:07.562321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:07.563177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:07.570530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.571353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.572187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.572599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.653368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:07.672019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02f93914-976a-4be2-920e-15f7e77447da tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.338937 Dec 25 21:11:07.674698 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 556/1203] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:07 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:07.682889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:07.685328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:07.695133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.695797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.696619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.697092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.748691 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25bfd8e7-1ea9-4cc6-b7fb-ffa52cea9304 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 24513 microversion: 2.1 time: 0.072823 Dec 25 21:11:07.749535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 557/1204] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:07 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 24513 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:07.757420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:07.758154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:07.765151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.765609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.766513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.767127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.799616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:07.807673 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c09be85c-69b6-401f-b4ac-c064f3df377e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1320 microversion: 2.1 time: 0.250391 Dec 25 21:11:07.821272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 648/1205] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:07 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:07.827841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ceac9d3a-b469-4d1c-92ba-9db241c60a47", "device": "/dev/xvdb"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:07.829486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:07.836087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.836742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:07.837609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:07.838050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.005875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:08.016306 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ca928b6-b239-4bd8-b654-162a28c47c7e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.265531 Dec 25 21:11:08.017041 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 558/1206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:07 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:08.535251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:08.535906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:08.542607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.544859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.544859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.544859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.807863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:08.819621 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40ef0659-ba93-4d83-b0a7-da2d65459d87 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.288123 Dec 25 21:11:08.833057 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 559/1207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:08 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:08.841396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:08.841396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:08.846139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.846601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.847440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.847909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.865542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c4d340b-2a98-40e8-b7ac-9ff74241e739 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "POST /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.042820 Dec 25 21:11:08.871552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 649/1208] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:11:07 2021] POST /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments => generated 194 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:08.872091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:08.873607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:08.881245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.881879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.883226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.883830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.953571 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0fdbe5d2-5c77-497e-88a4-65de5668d6f2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.085434 Dec 25 21:11:08.954342 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 650/1209] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:08 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:08.960949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:08.961738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:08.969195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.969728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:08.970615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:08.971138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.101864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:09.109587 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e1316562-45b7-4add-9f65-666c39533539 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.275014 Dec 25 21:11:09.119791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 560/1210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:08 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:09.124541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:09.125183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:09.132225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.132784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.133612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.134048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.148791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:09.161906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40bbab4f-1178-4835-96af-f8ce297398d8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1510 microversion: 2.1 time: 0.205884 Dec 25 21:11:09.162659 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 651/1211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:08 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1510 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:09.196701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:09.197605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:09.204950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.205633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.208029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.208685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.310956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:09.320060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66ceb20c-bdfc-45ba-b8b1-a28473f9de5e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.198992 Dec 25 21:11:09.321335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 561/1212] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:09 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:09.400162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:09.409894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad64a806-6ecc-4249-b5ba-f1367a127a46 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1320 microversion: 2.1 time: 0.223673 Dec 25 21:11:09.410387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 652/1213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:09 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1320 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:09.836385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:09.837083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:09.843861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.845238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.845238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.845648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.967769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:09.967769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:09.974665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.975112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.976172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:09.976749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:09.989417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:09.997212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-acf7fac9-59ff-407f-ba88-7631f79bf0c7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.165122 Dec 25 21:11:10.006685 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 562/1214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:09 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:10.026961 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0d0cc600-f47c-43b9-b44b-c6db8716cf35 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.064543 Dec 25 21:11:10.028762 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 653/1215] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:09 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:10.127338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:10.128467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:10.134775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.135322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.136340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.136776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.318009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:10.326596 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b64434d6-24d7-4aa5-9a7a-db087335b98c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.203071 Dec 25 21:11:10.327232 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 563/1216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:10 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:10.341840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:10.342546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:10.350047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.350500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.351355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.351792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.426762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:10.427612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:10.433890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.434560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.435797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.436425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.556965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:10.567240 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-061b6abe-3423-48ea-a056-4e19029eebb7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.231741 Dec 25 21:11:10.568744 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 654/1217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:10 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:10.601028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-469b478c-8c99-4b63-9c96-d51071f19f58 req-d59f9388-97d7-4a6f-81b2-fda8db0f0f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadf356d-6fa7-4dcf-9dcf-515f67791639", "name": "network-vif-plugged", "status": "completed", "tag": "3147cbbc-6a59-4aed-93a8-d328bcb5240b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:10.602815 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:10.602815 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:10.610044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-469b478c-8c99-4b63-9c96-d51071f19f58 req-d59f9388-97d7-4a6f-81b2-fda8db0f0f77 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:10.610565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-469b478c-8c99-4b63-9c96-d51071f19f58 req-d59f9388-97d7-4a6f-81b2-fda8db0f0f77 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:10.622260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-469b478c-8c99-4b63-9c96-d51071f19f58 req-d59f9388-97d7-4a6f-81b2-fda8db0f0f77 service nova] Creating event network-vif-plugged:3147cbbc-6a59-4aed-93a8-d328bcb5240b for instance cadf356d-6fa7-4dcf-9dcf-515f67791639 on nch1-master-1 Dec 25 21:11:10.627102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-469b478c-8c99-4b63-9c96-d51071f19f58 req-d59f9388-97d7-4a6f-81b2-fda8db0f0f77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030122 Dec 25 21:11:10.627705 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 655/1218] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:10.719272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:10.727468 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2c37c1a-b73b-428a-8fe0-476b86a8f696 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1320 microversion: 2.1 time: 0.304427 Dec 25 21:11:10.728283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 564/1219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:10 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:11.019973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:11.020769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:11.028406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.029151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.030975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.031714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.044950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:11.052537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:11.056508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.066207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.066207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.066207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.122266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77c33f05-32c7-4790-878c-c3f32fb1408f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.083974 Dec 25 21:11:11.127751 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 565/1220] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:11 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:11.300720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:11.326306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aed898af-9496-448b-b1ce-86b5bd61b4eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.315777 Dec 25 21:11:11.327034 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 656/1221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:11 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:11.347919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:11.348627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:11.355816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.356273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.357134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.357594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.557411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:11.565473 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f20d0e67-f5d6-45ac-9ebf-38c03419fe13 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.221627 Dec 25 21:11:11.566758 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 566/1222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:11 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:11.585191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:11.587451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:11.593164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.594107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.595057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.600270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.744032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:11.744817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:11.752308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.752767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.753646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:11.754094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:11.897953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:11.906276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83cef810-0c9a-4d8b-bbb9-99944f57c768 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.326274 Dec 25 21:11:11.906700 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 657/1223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:11 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:11.962285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:11.970026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e9ecb31-3e24-49bc-b18d-e2cb6ca58ff3 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1320 microversion: 2.1 time: 0.229740 Dec 25 21:11:11.970603 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 567/1224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:11 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:12.134872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:12.135969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:12.142287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.142839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.143746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.144788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.204204 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1be90b9e-654e-4e33-a35f-201fb7f5da78 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.072846 Dec 25 21:11:12.205739 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 658/1225] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:12 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:12.344297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:12.345119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:12.353561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.354177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.355106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.355794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.586168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:12.587007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:12.596042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.597024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.598413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.599098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.952684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:12.958508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:12.967555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c0671670-6d9d-433f-82ef-e9485de6265d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.626425 Dec 25 21:11:12.968766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e734b798-0c80-47d6-a90d-e060d82d4234 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.387019 Dec 25 21:11:12.973779 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 659/1226] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:12 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:12.977498 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 568/1227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:12 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:12.979977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:12.980594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:12.991945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.991945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.991945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.991945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:12.992363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:12.992363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:12.999179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:12.999853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.000776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.001371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.298444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:13.309572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:13.315267 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7bd9f44-c386-4924-9297-a646babcd853 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1510 microversion: 2.1 time: 0.331082 Dec 25 21:11:13.316742 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 569/1228] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:12 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1510 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:13.321913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:13.323459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:13.327010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48515a28-fc87-4d74-88ee-e93a06a3464b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.351012 Dec 25 21:11:13.327230 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 660/1229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:12 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:13.333336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:13.333948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:13.340407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.340602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.340894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.341023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.341752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.341861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.342205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.342330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.402340 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-996f7fa1-b353-49e7-a3ec-06d599dea3b5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.083758 Dec 25 21:11:13.406435 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 570/1230] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:13 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:13.409964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:13.412829 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:13.412829 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:13.414032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:13.415100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:13.431358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.431826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.432711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.433174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.531397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:13.606261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:13.612531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.613582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.637834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac899649-a53a-4be5-b84f-0c4d9ff533f2 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1691 microversion: 2.1 time: 0.308151 Dec 25 21:11:13.638614 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 661/1231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:13 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1691 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:13.654750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:13.655879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:13.663617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.664069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.664850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.665895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.754055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lazy-loading 'flavor' on Instance uuid 3c1ea080-3600-4152-8bef-f30741212401 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:11:13.804668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Going to try to live migrate instance to nch1-master-1 {{(pid=136548) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:11:13.864790 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6bec696f-f661-4028-ac6a-7b2366792f55 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1512 microversion: 2.1 time: 0.459858 Dec 25 21:11:13.865747 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 571/1232] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:11:13 2021] GET /compute/v2.1/servers/detail?flavor=451 => generated 1512 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:13.894698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:13.898789 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:13.898789 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:13.901618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:13.902288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-922839199', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:13.908005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.908466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:13.909431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:13.910538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.047017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:14.121328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:14.127615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.128082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.344860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c59c844-6364-4670-8c8d-e3f673bb7e67 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-922839199" status: 200 len: 1513 microversion: 2.1 time: 0.454792 Dec 25 21:11:14.346229 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 572/1233] 10.222.0.32 () {58 vars in 1260 bytes} [Sat Dec 25 21:11:13 2021] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-922839199 => generated 1513 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:14.352344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:14.353369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:14.364402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.364865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.366092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.366657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.570491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:14.584328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2cee2a6d-d1e4-4283-b795-cd9037ca10c8 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.236658 Dec 25 21:11:14.594264 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 573/1234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:14 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:14.594264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:14.594264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:14.600947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.601815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.602799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.603243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.884026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:14.896727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34f85904-8797-47ea-b583-973722a5c250 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.308531 Dec 25 21:11:14.897463 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 574/1235] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:14 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:14.912563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:14.913215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:14.920536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.924057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:14.924057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:14.924057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.135259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:15.155016 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89c9acb9-fece-4382-b585-7563189b0c7a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.242503 Dec 25 21:11:15.158005 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 575/1236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:14 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:15.164307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:15.167762 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:15.167762 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:15.168767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:15.170249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:15.176720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.177264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.178092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.178534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.283768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:15.370310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:15.377362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.378003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.671082 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a62c48cb-92c4-4cd8-881a-0b1d7132cc6c tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4512 microversion: 2.1 time: 0.511542 Dec 25 21:11:15.671765 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 576/1237] 10.222.0.32 () {58 vars in 1172 bytes} [Sat Dec 25 21:11:15 2021] GET /compute/v2.1/servers/detail?status=active => generated 4512 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:15.693867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:15.695189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:15.704735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.705228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.706039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.707140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.762144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d349e51b-254b-43fb-a8f7-c2e5530a0bf0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.079990 Dec 25 21:11:15.763233 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 577/1238] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:15 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:15.768439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:15.770336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:15.778036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.778494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:15.779320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:15.779776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.055383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:16.070615 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12637ef0-f136-421d-90c0-af7ed4997492 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.306090 Dec 25 21:11:16.080977 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 578/1239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:15 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:16.087195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-36fc4059-f9b2-40aa-b23c-7920be59e7d1 req-bdaa4a0a-6ff6-462d-8e3e-b45651a6b757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df0e675-9617-49b5-bf06-c32adf655c9e", "name": "network-vif-plugged", "status": "completed", "tag": "53ff2af7-9bf4-4cb8-bafa-414f471bb1cb"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:16.090698 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:16.090698 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:16.099252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-36fc4059-f9b2-40aa-b23c-7920be59e7d1 req-bdaa4a0a-6ff6-462d-8e3e-b45651a6b757 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.099699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-36fc4059-f9b2-40aa-b23c-7920be59e7d1 req-bdaa4a0a-6ff6-462d-8e3e-b45651a6b757 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.111196 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-36fc4059-f9b2-40aa-b23c-7920be59e7d1 req-bdaa4a0a-6ff6-462d-8e3e-b45651a6b757 service nova] Creating event network-vif-plugged:53ff2af7-9bf4-4cb8-bafa-414f471bb1cb for instance 7df0e675-9617-49b5-bf06-c32adf655c9e on nch2-master-1 Dec 25 21:11:16.122865 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-36fc4059-f9b2-40aa-b23c-7920be59e7d1 req-bdaa4a0a-6ff6-462d-8e3e-b45651a6b757 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035190 Dec 25 21:11:16.125256 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 579/1240] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:16.154970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:16.162602 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:16.162602 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:16.163816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:16.169669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.servers [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Removing options 'limit' from query {{(pid=136547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 25 21:11:16.169829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:16.184499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.184965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.185821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.189089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.245581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:16.255910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.256624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.537679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01ed06c6-84f2-4ec9-b419-8f786da587d9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1658 microversion: 2.1 time: 0.411259 Dec 25 21:11:16.538281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 580/1241] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:11:16 2021] GET /compute/v2.1/servers/detail?limit=1 => generated 1658 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:16.542968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:16.543834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:16.553511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.553511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.553511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.553511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.733113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:16.741086 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27ae8bfd-3183-4f16-8288-3a4574f77d0c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1391 microversion: 2.1 time: 0.201774 Dec 25 21:11:16.742734 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 581/1242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:16 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1391 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:16.746096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:16.746837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:16.752813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.753828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.754696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.755133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.895732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:16.903444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3618e039-bc1b-4e63-85bc-4c109b9d206d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.160804 Dec 25 21:11:16.904024 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 582/1243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:16 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:16.952317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee8b68c7-20d5-40ad-93af-cb444f7069c0 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/action" status: 202 len: 0 microversion: 2.1 time: 3.301830 Dec 25 21:11:16.953314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 662/1244] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:13 2021] POST /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/action => generated 0 bytes in 3304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:11:16.958383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:16.961764 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:16.961764 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:16.962787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:16.963587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:16.973950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.974396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:16.975214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:16.975655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.011813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:17.037917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-638543706", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "09af6274-7110-4e9c-83cc-51d4d54a1676"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:17.049795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a685f56-300e-4e94-9856-6f6f4972b6d0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.095052 Dec 25 21:11:17.057562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 663/1245] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:11:16 2021] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:17.059227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:17.060330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:17.068152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:17.069087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.070160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:17.070833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.115699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] validate_networks() for [('09af6274-7110-4e9c-83cc-51d4d54a1676', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:11:17.129657 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b87e5db-ccb8-4e17-89ec-04d8b6f3ec2f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.074701 Dec 25 21:11:17.130878 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 664/1246] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:17 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:17.138110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:17.138832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:17.148029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:17.148497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.150134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:17.150758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.788747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:17.798455 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cac92186-7bbb-44c2-9e3a-1f765f95f9ba tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.665696 Dec 25 21:11:17.799448 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 665/1247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:17 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:17.805736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:17.810146 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:17.810146 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:17.812465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:17.828737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.servers [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Removing options 'limit' from query {{(pid=136548) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 25 21:11:17.830092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:17.836515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:17.837003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.838484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:17.839106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:17.946714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:18.009722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d70eb0cd-53a5-4518-a2c4-d8e082fdbafe tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.209000 Dec 25 21:11:18.015659 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 666/1248] 10.222.0.32 () {58 vars in 1149 bytes} [Sat Dec 25 21:11:17 2021] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:18.021386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:18.022044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:18.028175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.028661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.029495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.029936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.299115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:11:18.299622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:11:18.301765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:11:18.302569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:11:18.303177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:11:18.312802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.313529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.314620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.315215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.334906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Getting quotas for project 188fe358c4684fce8fc912f48b3f186e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:11:18.339399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Getting quotas for user b58b521d0334474e9f919c5d75289c78 and project 188fe358c4684fce8fc912f48b3f186e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:11:18.350753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:11:18.353137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:11:18.364896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:18.377763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cad80bb1-5136-473a-b287-1df9855a4b3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.360874 Dec 25 21:11:18.378917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 667/1249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:18 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:18.394606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:18.401864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:18.414730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.418776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.419852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.420464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.662841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70065e1f-4cc9-42f7-8647-139e2b2edf35 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.757520 Dec 25 21:11:18.667834 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 583/1250] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:11:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:11:18.671865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:18.684942 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60116ca3-4a6c-4d4c-9cc0-635094269832 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1590 microversion: 2.1 time: 0.292883 Dec 25 21:11:18.687261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 668/1251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:18 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1590 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:18.698275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:18.701640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:18.702173 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:18.702173 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:18.702805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:18.703497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:18.712425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.713111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.714095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.714833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.721188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:18.729662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.730129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.731081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.731540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.787147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:18.835021 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9518bab-46e4-41f6-a62b-a064b638b131 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.146411 Dec 25 21:11:18.836242 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 669/1252] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:11:18 2021] GET /compute/v2.1/servers => generated 1009 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:18.845907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:18.847911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:18.860424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.860916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.865458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.865917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.950081 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5df5c06-d27a-41a9-af39-f3ca4e7597b2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.108076 Dec 25 21:11:18.950783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:18.954858 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 670/1253] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:18 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:18.964456 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1dd4facf-d817-4d6f-a111-b180f632a989 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.295128 Dec 25 21:11:18.965079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 584/1254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:18 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:18.967472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13d2744b-85ae-4573-8648-7e05a28493a8 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:18.968195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13d2744b-85ae-4573-8648-7e05a28493a8 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:18.994842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:18.994842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:18.994842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.996563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:18.997507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:18.997967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.061595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-13d2744b-85ae-4573-8648-7e05a28493a8 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:19.070225 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13d2744b-85ae-4573-8648-7e05a28493a8 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1223 microversion: 2.1 time: 0.115395 Dec 25 21:11:19.072943 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 671/1255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:18 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:19.076540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:19.077558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:19.084599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.085208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.086133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.086666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.161290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f475a05-fe5c-4727-b352-fa382a1f728f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.190456 Dec 25 21:11:19.162157 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 585/1256] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:11:18 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:19.167782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:19.171461 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:19.171461 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:19.173160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:19.174019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:19.194876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.195693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.196735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.197428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.302797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:19.319086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:19.331289 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7bdc2b8-3cd6-463d-b0a6-9053f9c99cc8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.258917 Dec 25 21:11:19.348766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 672/1257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:19 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:19.385899 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4ba2ed0-ab0f-4590-9f7f-4aee407d329b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.221498 Dec 25 21:11:19.386497 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 586/1258] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:11:19 2021] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:19.396808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:19.397460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:19.400419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:19.404703 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:19.404703 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:19.406348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:19.407083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.servers [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Removing options 'limit' from query {{(pid=136547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 25 21:11:19.407914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.408485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.408991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:19.409363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.409800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.420194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.421066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.422379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.423321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.457188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-96a299d3-9f83-4cd4-bf21-d460f17746c2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.062271 Dec 25 21:11:19.459558 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 587/1259] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Dec 25 21:11:19 2021] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:19.473278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:19.478080 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:19.478080 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:19.479986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:19.481235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-922839199', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:19.488307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.489425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.490821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.491500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.706716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:19.714482 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f3411d8e-255c-488f-832c-9137cb294922 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.321810 Dec 25 21:11:19.730290 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 673/1260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:19 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:19.923971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:19.963310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:19.964345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:19.975974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.976740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:19.979792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:19.980271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.020133 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a2d28eac-32dc-4615-a415-4d2498ea265a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-922839199" status: 200 len: 345 microversion: 2.1 time: 0.553233 Dec 25 21:11:20.027496 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 588/1261] 10.222.0.32 () {58 vars in 1239 bytes} [Sat Dec 25 21:11:19 2021] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-922839199 => generated 345 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:20.032260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:20.032915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:20.042807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.048317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.048317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.048317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.057244 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-370a4e41-2dbf-46b9-b13e-1258910add01 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.097754 Dec 25 21:11:20.060835 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 674/1262] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:19 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:20.063627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4aefb96a-99f0-49c9-afb4-5b95c86d00d2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:20.072409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4aefb96a-99f0-49c9-afb4-5b95c86d00d2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.072864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4aefb96a-99f0-49c9-afb4-5b95c86d00d2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.169594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4aefb96a-99f0-49c9-afb4-5b95c86d00d2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:11:20.250848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:20.275270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e42c789c-aad6-44e9-abc4-5a29e3e92da9 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.246653 Dec 25 21:11:20.276046 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 589/1263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:20 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:20.291795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:20.291795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:20.298106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.298617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.299426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.299980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.387691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:20.397295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b5392c86-20d1-485e-bb20-66ab8f28c09e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1227 microversion: 2.1 time: 0.120044 Dec 25 21:11:20.407605 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 590/1264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:20 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1227 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:20.413747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:20.414327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:20.428244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.428701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.429547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.429979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.461436 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4aefb96a-99f0-49c9-afb4-5b95c86d00d2 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "POST /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d/action" status: 202 len: 0 microversion: 2.1 time: 0.401522 Dec 25 21:11:20.462878 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 675/1265] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:20 2021] POST /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:11:20.486693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:20.500014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:20.514484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.514931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.515733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.516167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.757165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:20.773990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:20.782238 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64f57370-0839-4a9a-8c4f-c3c25773b268 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.299668 Dec 25 21:11:20.782499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0a5aef8d-4a08-46dd-9db8-db63c102739a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.362282 Dec 25 21:11:20.792765 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 591/1266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:20 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:20.795874 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 676/1267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:20 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:20.800565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:20.801586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:20.806761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5a3de004-fe2c-4771-9889-d297f2e0b298 req-c83d0d04-c8a9-4f3f-bf6f-b7fa5bc6fe3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df0e675-9617-49b5-bf06-c32adf655c9e", "tag": "53ff2af7-9bf4-4cb8-bafa-414f471bb1cb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:20.808282 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:20.808282 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:20.832037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5a3de004-fe2c-4771-9889-d297f2e0b298 req-c83d0d04-c8a9-4f3f-bf6f-b7fa5bc6fe3b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.832485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5a3de004-fe2c-4771-9889-d297f2e0b298 req-c83d0d04-c8a9-4f3f-bf6f-b7fa5bc6fe3b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.833522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.834088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.835507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.835958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.864684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5a3de004-fe2c-4771-9889-d297f2e0b298 req-c83d0d04-c8a9-4f3f-bf6f-b7fa5bc6fe3b service nova] Creating event network-changed:53ff2af7-9bf4-4cb8-bafa-414f471bb1cb for instance 7df0e675-9617-49b5-bf06-c32adf655c9e on nch2-master-1 Dec 25 21:11:20.869851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5a3de004-fe2c-4771-9889-d297f2e0b298 req-c83d0d04-c8a9-4f3f-bf6f-b7fa5bc6fe3b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072491 Dec 25 21:11:20.875415 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 677/1268] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:20.886872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:20.887594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:20.901100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11b6beb4-7628-4b71-ac18-aaf8ce9b9eb6 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.099453 Dec 25 21:11:20.901100 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 592/1269] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:20 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:20.901429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.901429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:20.901429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:20.901429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.071872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:21.073182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:21.091656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.091656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.091656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.091656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.197845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:21.205687 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a12bec98-8ee2-4dfa-aad4-e6ec7e2b5947 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.328471 Dec 25 21:11:21.214214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 678/1270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:20 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:21.291686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:21.292330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:21.298765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.299222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.300575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.301075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.333331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9125fd01-8ddc-476a-bec2-9545102f102b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.267007 Dec 25 21:11:21.334727 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 593/1271] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:21 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:21.415663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:21.416407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:21.424202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.424662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.425549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.425988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.515340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:21.525441 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9afb998c-4e26-4313-b8e8-35690ded2ff2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1219 microversion: 2.1 time: 0.114320 Dec 25 21:11:21.526594 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 594/1272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:21 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:21.578729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:21.589055 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3730ed30-cd8c-42d3-b2a3-9ea358e7983b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.301123 Dec 25 21:11:21.590011 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 679/1273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:21 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:21.799520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:21.800181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:21.807557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.807970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.808839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.809546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.820175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:21.821097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:21.833076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.833558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:21.834503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:21.834945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.024768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:22.041353 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8810ca72-3d97-444f-9911-e2dd89e27928 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.240903 Dec 25 21:11:22.041605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:22.041729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 595/1274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:21 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:22.052920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:22.053143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:22.055930 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9f7de49-e410-4511-a2ac-07ccda6fe580 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.243820 Dec 25 21:11:22.067582 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 680/1275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:21 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:22.071457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.071980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.072732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.073211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.117682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-571078d8-335a-4eae-8dab-127a67b7156c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.074520 Dec 25 21:11:22.118328 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 596/1276] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:22 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:22.222691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:22.223337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:22.233597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.233597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.233597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.233597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.345833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:22.346939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:22.354247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.354874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.355859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.356607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.413710 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-feb3d720-a83d-4aa0-94f3-b545175bbb39 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.071985 Dec 25 21:11:22.417570 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 597/1277] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:22 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:22.474844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:22.482603 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6065e9f-d8db-4c40-a18f-56935a5b332a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.263809 Dec 25 21:11:22.483173 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 681/1278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:22 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:22.543408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:22.544171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:22.552536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.558408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.558408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.558408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.610549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:22.611630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:22.623331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.624436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.626092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:22.635189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:22.635608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:22.638365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44d7e46d-b46d-4805-abe4-4d9955032a6c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1293 microversion: 2.1 time: 0.099191 Dec 25 21:11:22.638944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 598/1279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:22 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:22.856743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:22.866206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5e397df-d5ff-4b12-bfc8-6c5ca2b75d62 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.263062 Dec 25 21:11:22.867203 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 682/1280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:22 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:23.059075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:23.059696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.066149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.068954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.068954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.068954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.074284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:23.074874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.080624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.081653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.082439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.082872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.396826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:23.400221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:23.405423 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2de9155-7315-4fb9-adbd-816940dddfaf tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.349954 Dec 25 21:11:23.406120 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 599/1281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:23 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:23.408098 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-024b8295-c8af-407b-9a4c-50f3b1911957 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.337428 Dec 25 21:11:23.408664 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 683/1282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:23 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:23.411331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:23.412425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.418851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.419450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.420641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.421104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.429492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:23.431034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.436326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.437015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.437799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.438230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.468340 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66606ee6-e629-4c4e-b165-accd65427b68 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.060566 Dec 25 21:11:23.469473 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 600/1283] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:23 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:23.492461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a529f1d-49a5-4731-8a3e-78b29fbaaaff tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.066420 Dec 25 21:11:23.493140 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 684/1284] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:23 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:23.501969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:23.502264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.510793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.511337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.512193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.512720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.658767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:23.659489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.666591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.671855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.671855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.671855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.779177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:23.786671 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-69100be8-45eb-4e0c-9abb-dd4222dbcb3f tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.289595 Dec 25 21:11:23.787238 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 601/1285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:23 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:23.884082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:23.884709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:23.891613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.892072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.892902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:23.893393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:23.916603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:23.924313 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a264bb96-7f68-4c37-88f5-7b9be79be09c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.269695 Dec 25 21:11:23.925475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 685/1286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:23 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:24.171609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:24.184224 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f8f2920-b643-4762-b234-8315ef23c300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.303697 Dec 25 21:11:24.185414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 602/1287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:23 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:24.424407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:24.424407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:24.425634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:24.426788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:24.433814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.434513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.435601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.436197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.436557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.436983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.437794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.438229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.723735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:24.731385 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-040bbf1b-1d78-4431-bd5a-3fd3884fe933 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.310335 Dec 25 21:11:24.733910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 603/1288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:24 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:24.734700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:24.736583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:24.738228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:24.742997 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa1b1808-a30a-47a7-a42f-31e089dc3f8c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.324350 Dec 25 21:11:24.743570 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 686/1289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:24 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:24.744224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.744815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.745831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.746273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.747919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:24.748864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:24.755966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.756608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.757626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.758249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.805976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d76c6426-050e-4d3d-8bdd-d7dbba9e24da tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.061170 Dec 25 21:11:24.807226 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 687/1290] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:24 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:24.809547 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8353ea8a-9608-4a24-8861-5f54cffc2653 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.074247 Dec 25 21:11:24.811035 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 604/1291] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:24 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:24.817823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d0e81995-9c85-4170-b032-4f8efa360447 req-796c23c7-73bd-48fc-acec-1a0e49157ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ea080-3600-4152-8bef-f30741212401", "name": "network-vif-unplugged", "status": "completed", "tag": "03a8ec19-2525-4748-83ce-e5fe439b39e0"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:24.819864 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:24.819864 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:24.827887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:24.828500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d0e81995-9c85-4170-b032-4f8efa360447 req-796c23c7-73bd-48fc-acec-1a0e49157ae3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.828739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:24.829418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d0e81995-9c85-4170-b032-4f8efa360447 req-796c23c7-73bd-48fc-acec-1a0e49157ae3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.840701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.841211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.842023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.842473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.843618 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d0e81995-9c85-4170-b032-4f8efa360447 req-796c23c7-73bd-48fc-acec-1a0e49157ae3 service nova] Creating event network-vif-unplugged:03a8ec19-2525-4748-83ce-e5fe439b39e0 for instance 3c1ea080-3600-4152-8bef-f30741212401 on nch2-master-1 Dec 25 21:11:24.850577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d0e81995-9c85-4170-b032-4f8efa360447 req-796c23c7-73bd-48fc-acec-1a0e49157ae3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041463 Dec 25 21:11:24.851756 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 688/1292] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:24.945349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:24.946061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:24.953459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.953914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:24.954752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:24.955156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:25.509223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:25.517683 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a7c17ca-0698-4404-b969-bcc4133c588e tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.705274 Dec 25 21:11:25.518266 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 605/1293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:24 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:25.523999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:25.524632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:25.530558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:25.531085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:25.531870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:25.532305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:25.649053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:25.657333 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-507631ea-74f7-4128-a1e8-67be9fa4d73c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.717974 Dec 25 21:11:25.663434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 689/1294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:24 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:25.747886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:25.748431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:25.755727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:25.758172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:25.758172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:25.758172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:25.909319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:25.918264 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-adcae054-1bfe-45aa-b6ca-1b3fc7d7d69f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1496 microversion: 2.1 time: 0.397692 Dec 25 21:11:25.918864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 606/1295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:25 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1496 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:25.924143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:25.925522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:25.931523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:25.932573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:25.939152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:25.939152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.092844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:26.102584 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0eb4976-89f8-4ccd-b95a-f4d153ac6b81 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.358329 Dec 25 21:11:26.103883 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 690/1296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:25 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:26.109765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:26.112826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:26.130025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.130025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.130025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.130025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.177915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4267a6a1-66fe-42ff-ab3a-5e3c97c63406 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.072329 Dec 25 21:11:26.178986 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 691/1297] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:26 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:26.184112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:26.185033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:26.186251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:26.192219 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f7fd4fb-08e3-42e5-8600-d875e4278af8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.271411 Dec 25 21:11:26.192909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 607/1298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:25 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:26.194413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.194926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.195788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.196295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.242182 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-374cbff5-dc86-495a-9e99-9d075bd13526 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.061574 Dec 25 21:11:26.243607 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 692/1299] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:26 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:26.534954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:26.535576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:26.542179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.542613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.543487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.544257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.677642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:26.678395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:26.693825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.694278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.695074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.695510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.695941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:26.704190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3412a8f3-dcf0-451d-86c2-690a405b6958 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.173568 Dec 25 21:11:26.704767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 608/1300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:26 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:26.833436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:26.840697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-825197ff-9cf1-4b5b-a762-d9a3e4d22d88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.169379 Dec 25 21:11:26.841290 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 693/1301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:26 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:26.884159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c8d944cb-dab8-4cb9-a624-08b577ee1a57 req-40ae6974-2203-4988-b50d-4c25a150ebe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}, {"name": "network-changed", "server_uuid": "3c1ea080-3600-4152-8bef-f30741212401", "tag": "03a8ec19-2525-4748-83ce-e5fe439b39e0"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:26.885923 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:26.885923 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:26.894581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c8d944cb-dab8-4cb9-a624-08b577ee1a57 req-40ae6974-2203-4988-b50d-4c25a150ebe5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.895029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c8d944cb-dab8-4cb9-a624-08b577ee1a57 req-40ae6974-2203-4988-b50d-4c25a150ebe5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.907098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c8d944cb-dab8-4cb9-a624-08b577ee1a57 req-40ae6974-2203-4988-b50d-4c25a150ebe5 service nova] Creating event network-changed:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:11:26.907612 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c8d944cb-dab8-4cb9-a624-08b577ee1a57 req-40ae6974-2203-4988-b50d-4c25a150ebe5 service nova] Creating event network-changed:03a8ec19-2525-4748-83ce-e5fe439b39e0 for instance 3c1ea080-3600-4152-8bef-f30741212401 on nch2-master-1 Dec 25 21:11:26.914348 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c8d944cb-dab8-4cb9-a624-08b577ee1a57 req-40ae6974-2203-4988-b50d-4c25a150ebe5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033935 Dec 25 21:11:26.914928 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 609/1302] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:26 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:26.936248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:26.936906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:26.950467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.951350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:26.952308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:26.952758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.120148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:27.121111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:27.127336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.129018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.129137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.129573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.205612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:27.214593 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2614377f-9429-4c38-a85f-9c63fc0df3b4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 200 len: 1473 microversion: 2.1 time: 0.282910 Dec 25 21:11:27.215196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 694/1303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:26 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 1473 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:27.219707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:27.221062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:27.227140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.227629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.228428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.229083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.274817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-219ba8f4-2e35-4d4c-9020-1af9d2e9260b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.058298 Dec 25 21:11:27.277914 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 695/1304] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:27 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:27.280373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:27.281096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:27.289486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.289943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.290738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.291178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.399399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:27.407954 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ff10da9-5b77-4149-a595-7524e64ce5db tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.291977 Dec 25 21:11:27.408847 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 610/1305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:27 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:27.414720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-55787756"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:27.419721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:27.422492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.423063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.423886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.424338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.521728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:27.531018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c63339e6-fb99-403a-afc4-86dc8bdef1cd tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.254380 Dec 25 21:11:27.539397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 696/1306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:27 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:27.539397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:27.539397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:27.544337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.544907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.545797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.546338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.600673 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07b6ad84-bbfc-457e-9a29-3ac9a57ec6ea tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.066895 Dec 25 21:11:27.601743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 697/1307] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:27 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:27.722927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:27.723623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:27.730988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.731442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.732230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:27.732667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:27.985119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:27.996814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9322bf0a-2569-4e11-8e1f-32803a7761eb tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.278567 Dec 25 21:11:27.997660 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 698/1308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:27 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:27.999064 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d853407-56a9-4d7a-8513-82a0c627a6ef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52/action" status: 202 len: 0 microversion: 2.1 time: 0.588730 Dec 25 21:11:28.000001 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 611/1309] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:27 2021] POST /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:11:28.002496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:28.006270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:28.012991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ed24ee4-48ba-4573-be44-53f28eb15b44 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7027e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:28.021166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.021580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.022568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.023169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.061445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ed24ee4-48ba-4573-be44-53f28eb15b44 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.054498 Dec 25 21:11:28.062045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 612/1310] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:28 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:28.266360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:28.274194 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e2140a5-e49c-4904-a6a6-27fe5d75c25c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.275375 Dec 25 21:11:28.274769 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 699/1311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:27 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:28.286349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:28.287447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:28.294431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.294891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.295694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.296141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.333181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12a572b9-35e1-4688-8616-aec2f060f421 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.051053 Dec 25 21:11:28.336304 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 613/1312] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:28 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:28.425460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:28.426074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:28.432039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.432479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.433297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.433712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.547882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:28.548591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:28.556530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.557004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.557795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.558227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.571384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:28.579361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dd5ae4f-b516-45c8-b6b8-d4b0ce4ba011 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.158262 Dec 25 21:11:28.579936 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 700/1313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:28 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:28.612740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:28.613736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:28.620334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.620785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.621614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:28.622049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:28.670775 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c12e602-6469-4118-a946-9b1df0599254 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.062059 Dec 25 21:11:28.672181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 701/1314] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:28 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:28.697558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:28.707199 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc43055e-e911-4e0c-8ea7-0f51e3dd4f18 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.163383 Dec 25 21:11:28.707806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 614/1315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:28 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:29.014022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:29.014717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:29.022572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.023028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.023809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.024247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.075782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eab069da-6e19-4950-9593-b8369ca26057 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6ffce50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:29.124695 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eab069da-6e19-4950-9593-b8369ca26057 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.053189 Dec 25 21:11:29.134863 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 615/1316] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:29 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:29.164004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:29.171407 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-136c9312-56eb-4456-be40-e1eb27bd44fc tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.161466 Dec 25 21:11:29.173021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 702/1317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:29 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:29.290746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:29.291368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:29.297511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.297967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.298756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.299200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.343577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:29.344504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:29.351670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.352124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.352931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.353367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.392361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81f50349-3337-4e90-b13b-939bf6a6a990 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.052344 Dec 25 21:11:29.393132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 703/1318] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:29 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:11:29.431397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:29.440524 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8eac01b4-113f-460d-b711-3706aa396a8f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.152850 Dec 25 21:11:29.441171 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 616/1319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:29 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:29.596701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:29.597509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:29.606311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.606859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.607606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.608042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.683020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:29.684022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:29.691259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.692027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.692823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.699318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.747478 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62d308e4-77f9-498c-832c-48203748ad8f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.067609 Dec 25 21:11:29.751433 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 617/1320] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:29 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:29.753952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:29.755401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:29.763744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.764271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.765170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:29.765574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:29.772014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:29.782196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2df916c-faad-47e5-82d2-df592f1352ac tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.189719 Dec 25 21:11:29.782984 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 704/1321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:29 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:29.907197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:29.916581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f66c7e3-3a74-4e3a-bf09-90edd148ecf6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.166972 Dec 25 21:11:29.917215 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 618/1322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:29 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:30.137451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cef69c0e-c687-426d-af59-e1227faf3612 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6fdbb80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:30.186981 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cef69c0e-c687-426d-af59-e1227faf3612 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.052951 Dec 25 21:11:30.191087 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 705/1323] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:30 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:30.191233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:30.191233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:30.195553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.196002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.196787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.197275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.331674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:30.339957 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8a465a4-0d1e-439a-b8ff-825e697b9749 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.156140 Dec 25 21:11:30.340981 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 619/1324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:30 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:30.404099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:30.405258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:30.411977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.412507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.413394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.413915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.457486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:30.458211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:30.459471 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8706a81-0f09-4610-b233-97c97a11c2d3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.059121 Dec 25 21:11:30.462739 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 706/1325] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:30 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:30.465276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.465414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.466138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.466574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.609774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:30.617759 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb551ef4-59db-46f8-9160-102770a7bd92 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.164109 Dec 25 21:11:30.618642 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 620/1326] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:30 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:30.758896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:30.759888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:30.766830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.767286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.768067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.768505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.801461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:30.802071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:30.808264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d78e0da0-e901-447a-aab0-62058b44b7b4 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.053351 Dec 25 21:11:30.809510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 707/1327] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:30 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:30.809630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.809745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.810658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.811047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.934622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:30.937499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:30.942919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.943430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.946902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:30.949485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:30.950118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:30.956028 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5fefe679-03e1-43f0-ada0-538746c2e45f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.159221 Dec 25 21:11:30.966164 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 621/1328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:30 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:31.092900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:31.101402 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61de5214-6ed8-4575-8bcb-3490810c4a3b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.171221 Dec 25 21:11:31.101967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 708/1329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:30 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:31.200445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6efb4f2f-4cfe-4b36-a827-a655371f5f83 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f713bd30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:31.244018 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6efb4f2f-4cfe-4b36-a827-a655371f5f83 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.047271 Dec 25 21:11:31.244591 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 622/1330] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:31 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:31.357061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:31.357666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:31.365607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.377351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.377351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.377351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.470496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:31.472593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:31.481995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.482608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.483857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.484308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.508051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:31.520296 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85afc87a-5e80-4ef0-b45e-4565cbc1fee4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.166503 Dec 25 21:11:31.521661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 709/1331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:31 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:31.533397 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41120c0f-1d02-4bd3-8c3b-8b0726adc499 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.066526 Dec 25 21:11:31.534092 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 623/1332] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:31 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:11:31.634554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:31.635356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:31.641920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.642824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.643805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.644253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.789216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4aca2576-a1c2-48e7-9df0-7babd340de3e req-36518e77-7728-438c-a369-fb5ccc6125a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "name": "network-vif-plugged", "status": "completed", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:31.789783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:31.790743 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:31.790743 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:31.797675 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e61094d7-b625-45ed-98a7-ac31ada48524 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.166900 Dec 25 21:11:31.798314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 710/1333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:31 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:31.808588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4aca2576-a1c2-48e7-9df0-7babd340de3e req-36518e77-7728-438c-a369-fb5ccc6125a7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.809076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4aca2576-a1c2-48e7-9df0-7babd340de3e req-36518e77-7728-438c-a369-fb5ccc6125a7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.820775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:31.821886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:31.825158 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4aca2576-a1c2-48e7-9df0-7babd340de3e req-36518e77-7728-438c-a369-fb5ccc6125a7 service nova] Creating event network-vif-plugged:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:11:31.828165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.832251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.832251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.832251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.834444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4aca2576-a1c2-48e7-9df0-7babd340de3e req-36518e77-7728-438c-a369-fb5ccc6125a7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049461 Dec 25 21:11:31.835392 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 624/1334] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:31.879433 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ec5d7ce-624b-4698-a76b-4aacc963b1e7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.062477 Dec 25 21:11:31.880393 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 711/1335] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:31 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:31.974920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:31.975938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:31.982887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.983379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:31.984186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:31.984621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.117980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:32.118680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:32.125618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.127767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.128747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.128910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:32.129530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.136767 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d26399ff-10bd-4ef0-a030-d08a57f2d0c6 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.167246 Dec 25 21:11:32.139423 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 625/1336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:31 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:32.257386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de9dd09f-37c8-4978-99e0-425a33e604f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f70274c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:32.306203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de9dd09f-37c8-4978-99e0-425a33e604f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.052409 Dec 25 21:11:32.306907 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 626/1337] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:32 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:32.475667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:32.484077 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-982c0a1a-f77a-467d-ac0a-1a61ae101448 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.370014 Dec 25 21:11:32.493283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 712/1338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:32 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:32.538748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:32.539634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:32.543647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:32.544917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:32.546767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.547437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.548425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.549067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.551914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.552786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.553912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.554434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.596596 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee168d54-02e1-4e5c-9500-2456b63769b7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 14 microversion: 2.1 time: 0.056575 Dec 25 21:11:32.600238 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 713/1339] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:32 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:11:32.724164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:32.732786 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3bd73836-4059-4954-b20d-3aa9664f312d tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.198849 Dec 25 21:11:32.733528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 627/1340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:32 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:32.815754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:32.817090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:32.825834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.826304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.827471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.827922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.895092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:32.897469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:32.905969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.906422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.907476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:32.907943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:32.974829 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3dc6892b-11b1-4b38-993c-eb123e74ef65 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.087159 Dec 25 21:11:32.975871 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 628/1341] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:32 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:32.991720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:33.000956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-226fdbdd-db53-4e9e-bb84-3c397dda1296 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1323 microversion: 2.1 time: 0.189879 Dec 25 21:11:33.001903 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 714/1342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:32 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:33.156719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:33.158198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:33.165660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.166111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.166908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.167340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.325850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24611d3c-de88-4d0e-a97a-c46acc99aa93 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6df79d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:33.366411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:33.376709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c2291161-a2a1-4851-ac85-f7e79fc99616 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.224734 Dec 25 21:11:33.385168 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 629/1343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:33 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:33.397523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24611d3c-de88-4d0e-a97a-c46acc99aa93 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.078176 Dec 25 21:11:33.403040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 715/1344] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:33 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:33.504470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:33.505510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:33.512700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.513289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.514187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.514735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.607678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:33.609398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:33.617664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.618479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.619424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.619938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.695045 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35943a43-a9ca-4e16-abbf-94f7b7f886d0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 8200 microversion: 2.1 time: 0.090911 Dec 25 21:11:33.696445 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 716/1345] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:33 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 8200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:33.708734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:33.722618 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b285f02-34be-44af-9d2d-c39edb0c8b6c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.224805 Dec 25 21:11:33.724414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 630/1346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:33 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:33.753795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:33.753795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:33.767764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.768908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.769851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.770371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.853334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-772fab42-e64c-4cf3-92ea-08ed0b841b0f req-804ee40b-91f9-4a35-a607-2cb15508b76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e327d55b-28ca-4bfa-bcf1-e4ed49240d52", "name": "network-vif-plugged", "status": "completed", "tag": "da0f28d9-3fef-4a56-9994-44b97466e1d4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:33.855746 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:33.855746 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:33.866685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-772fab42-e64c-4cf3-92ea-08ed0b841b0f req-804ee40b-91f9-4a35-a607-2cb15508b76e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.867551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-772fab42-e64c-4cf3-92ea-08ed0b841b0f req-804ee40b-91f9-4a35-a607-2cb15508b76e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.886291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-772fab42-e64c-4cf3-92ea-08ed0b841b0f req-804ee40b-91f9-4a35-a607-2cb15508b76e service nova] Creating event network-vif-plugged:da0f28d9-3fef-4a56-9994-44b97466e1d4 for instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 on nch1-master-1 Dec 25 21:11:33.894566 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-772fab42-e64c-4cf3-92ea-08ed0b841b0f req-804ee40b-91f9-4a35-a607-2cb15508b76e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043408 Dec 25 21:11:33.895503 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 631/1347] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:33.935864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:33.948942 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6939e0f-a09b-4966-a6b8-b7b04e5adcc4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.199388 Dec 25 21:11:33.948942 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 717/1348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:33 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:33.988354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:33.989330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:33.999251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.999251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:33.999251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:33.999251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.017389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:34.021482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:34.042859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.044043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.045130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.045800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.069880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84b996eb-735c-47db-80ba-b95076c417d7 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.085591 Dec 25 21:11:34.077438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 632/1349] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:33 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:34.215299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:34.244864 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5fba992-2ce8-4c81-bcc2-59b2363fd717 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1519 microversion: 2.1 time: 0.231256 Dec 25 21:11:34.246096 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 718/1350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:34 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1519 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:34.265152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75945aa8-70ed-4e3d-83de-cfba3d914ff1 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'create', calling method: .version_select at 0x7fa4f70e6dc0>, body: {"pool": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:34.396218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:34.396852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:34.419376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.419888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.425270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.425812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.629572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:34.671976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f81addf-1083-4483-a189-638ff8f134f8 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.280713 Dec 25 21:11:34.676717 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 719/1351] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:34 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:34.686228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28df1be1-2a29-4634-9298-b86b8faafb51 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f70a4430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:34.743647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28df1be1-2a29-4634-9298-b86b8faafb51 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.065474 Dec 25 21:11:34.744343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 720/1352] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:34 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:34.766257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:34.794550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:34.806044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.808769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.812386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.812900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.890314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44f90da6-7557-4302-9502-456967f63051 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 16393 microversion: 2.1 time: 0.144474 Dec 25 21:11:34.894304 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 721/1353] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:34 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 16393 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:34.909340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:34.909340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:34.910312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.910762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:34.911555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:34.911989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.149105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:35.163692 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-77952617-3a48-407f-8eb5-dac06f131d0a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.267665 Dec 25 21:11:35.164199 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 722/1354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:34 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:35.169173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:35.169661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:35.176852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:35.177331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.178138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:35.178794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.481252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:35.482634 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1deaa34b-147f-4650-ba21-e432ef2f5c9c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.317454 Dec 25 21:11:35.483203 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 723/1355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:35 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:35.488350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:35.489428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:35.495246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:35.495737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.496517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:35.497012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.536209 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05846674-82d9-4812-a058-bdf498779625 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.051807 Dec 25 21:11:35.537161 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 724/1356] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:35 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:35.699656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:35.703040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:35.711549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:35.712034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.712855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:35.714056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:35.902190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:35.913452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0b2ad866-cdeb-4457-aaac-8d29caef6432 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.220760 Dec 25 21:11:35.914456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 725/1357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:35 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:35.919224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8abb455-ab0f-4de2-b1a1-6584a8663f48 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6fec160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:35.998044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8abb455-ab0f-4de2-b1a1-6584a8663f48 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.081663 Dec 25 21:11:35.998660 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 726/1358] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:35 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:36.007719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:36.009688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:36.021930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:36.022788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:36.024003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:36.025077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:36.088467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ddbd0a7-5ebc-4811-8646-a89fe3e8d8c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 16393 microversion: 2.1 time: 0.086126 Dec 25 21:11:36.090051 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 727/1359] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:35 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 16393 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:36.182392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:36.183123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:36.199622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:36.201002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:36.201133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:36.201668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:36.432427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75945aa8-70ed-4e3d-83de-cfba3d914ff1 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.171890 Dec 25 21:11:36.434260 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 633/1360] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:11:34 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:36.468453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:36.478080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92407d89-4034-4d29-9921-539c4234d7da tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.301104 Dec 25 21:11:36.478853 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 728/1361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:36 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:36.496588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-880516401", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "09af6274-7110-4e9c-83cc-51d4d54a1676"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:36.509721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:36.511008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:36.516505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:36.516985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:36.517778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:36.518282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:36.570758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] validate_networks() for [('09af6274-7110-4e9c-83cc-51d4d54a1676', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:11:37.093018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:37.102657 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a645337-3595-4347-9ad0-c84d5a7b1ad1 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1471 microversion: 2.1 time: 0.596533 Dec 25 21:11:37.103251 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 729/1362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:36 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1471 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:37.124270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:37.125288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:37.140306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.143563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.143563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.143563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.202885 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-afaf2536-b921-4b48-9f1b-6105ab07f81e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.082099 Dec 25 21:11:37.205124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 730/1363] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:37 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:37.213617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:37.214327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:37.222149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.222624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.223429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.223860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.478133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:37.496288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:11:37.496974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:11:37.497257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:11:37.497889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:11:37.498757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:11:37.509112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96667c7d-4ddf-44c1-8098-f6a36cf49c22 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.294598 Dec 25 21:11:37.510691 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 731/1364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:37 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:37.521374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.525068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49508d59-3105-4b52-9f2f-14c14e66e4d6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6df7700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:37.526523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.527615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.528305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.585617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Getting quotas for project 188fe358c4684fce8fc912f48b3f186e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:11:37.586201 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49508d59-3105-4b52-9f2f-14c14e66e4d6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.074383 Dec 25 21:11:37.587149 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 732/1365] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:37 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:37.591988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:37.593229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:37.595995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Getting quotas for user b58b521d0334474e9f919c5d75289c78 and project 188fe358c4684fce8fc912f48b3f186e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:11:37.600154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.605723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.605723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.605723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.613429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:11:37.616399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:11:37.655004 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d76c90f-56a2-4ed3-822f-2b446e5e3ac4 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 16393 microversion: 2.1 time: 0.066397 Dec 25 21:11:37.658969 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 733/1366] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:37 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 16393 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:37.661142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:37.661859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:37.672276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.673767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.673767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:37.674222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:37.792996 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1fcbc300-2a81-4a1f-a096-d814ab1009ab tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.302934 Dec 25 21:11:37.800857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 634/1367] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:11:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:11:37.814568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a89d4e28-6ccf-4f7e-892e-e1ecf9ab376f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:37.816158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a89d4e28-6ccf-4f7e-892e-e1ecf9ab376f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:37.868393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:37.886016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-054aa7cb-139d-493b-b7b0-fb0f75db651d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.222061 Dec 25 21:11:37.886016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 734/1368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:37 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:37.947321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a89d4e28-6ccf-4f7e-892e-e1ecf9ab376f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:37.998690 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a89d4e28-6ccf-4f7e-892e-e1ecf9ab376f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1223 microversion: 2.1 time: 0.193044 Dec 25 21:11:37.999381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 635/1369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:37 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1223 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:38.119383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:38.120194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:38.127384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.127812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.128696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.129899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.215984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:38.217516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:38.225824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.226476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.227565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.228166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.288248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:38.296302 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6b6a1937-2f0c-4d51-81cf-4727da4a37c4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1477 microversion: 2.1 time: 0.181301 Dec 25 21:11:38.300693 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 735/1370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:38 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1477 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:38.315885 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27db936e-7b37-4931-ba28-017da151cb5e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.103829 Dec 25 21:11:38.317037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 636/1371] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:38 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:38.528161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:38.529200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:38.549281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.549955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.551117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.551591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.608457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c49f40c6-10ca-4e8d-8704-7db34b8aa4ac tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7012e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:38.685792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c49f40c6-10ca-4e8d-8704-7db34b8aa4ac tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.089899 Dec 25 21:11:38.686383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 637/1372] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:38 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:38.692730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:38.694039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:38.701639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.702376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.703543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.706687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.763286 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-001c44f0-65bc-4aae-9566-3adbc24dcebb tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 16393 microversion: 2.1 time: 0.075452 Dec 25 21:11:38.764391 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 638/1373] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:38 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 16393 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:38.889955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:38.902839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:38.903222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3172936-edba-4dbc-8073-badd0b8ab664 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.379331 Dec 25 21:11:38.904055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 736/1374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:38 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:38.904698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:38.912293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.913007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:38.913806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:38.914273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.020751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b07d5b07-a8dc-4e07-a599-5e34c5c353ac tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:39.021433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b07d5b07-a8dc-4e07-a599-5e34c5c353ac tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:39.116617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b07d5b07-a8dc-4e07-a599-5e34c5c353ac tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:39.120841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b07d5b07-a8dc-4e07-a599-5e34c5c353ac tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1223 microversion: 2.1 time: 0.103622 Dec 25 21:11:39.121529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 737/1375] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:39 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:39.126813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:39.135974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af927b20-3dd3-49e7-ad3e-4123463eb1e0 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.238009 Dec 25 21:11:39.136992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 639/1376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:38 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:39.314356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:39.315899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:39.324483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.325221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.326441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.326880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.328232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:39.329583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:39.339268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.340121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.341347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.342012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.395024 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b85b3f46-2aae-47d4-ab07-dffff01a0891 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.071001 Dec 25 21:11:39.395949 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 640/1377] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:39 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:39.653065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:39.665447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb8a2ff3-cd69-4ac8-8253-30101f98223a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1477 microversion: 2.1 time: 0.355121 Dec 25 21:11:39.666388 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 738/1378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:39 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1477 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:39.699988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b277253a-89c3-4ad6-b123-036a488a4d0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f713d3a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:39.767825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b157b77e-824d-44fc-9aa1-bf3164883585 req-656dcc25-0263-453b-9e46-d4f3fcbd62f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8114c1-85b3-4e15-9e15-95159b456e41", "name": "network-vif-unplugged", "status": "completed", "tag": "f465e7da-b12a-4235-8af5-b0f521da6640"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:39.773009 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b277253a-89c3-4ad6-b123-036a488a4d0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.076757 Dec 25 21:11:39.779735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 641/1379] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:39 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:39.784470 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:39.784470 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:39.787568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:39.788728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:39.801195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.802195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.803879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.804723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.810049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b157b77e-824d-44fc-9aa1-bf3164883585 req-656dcc25-0263-453b-9e46-d4f3fcbd62f1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.810049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b157b77e-824d-44fc-9aa1-bf3164883585 req-656dcc25-0263-453b-9e46-d4f3fcbd62f1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.831109 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b157b77e-824d-44fc-9aa1-bf3164883585 req-656dcc25-0263-453b-9e46-d4f3fcbd62f1 service nova] Creating event network-vif-unplugged:f465e7da-b12a-4235-8af5-b0f521da6640 for instance 9a8114c1-85b3-4e15-9e15-95159b456e41 on nch2-master-1 Dec 25 21:11:39.842011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b157b77e-824d-44fc-9aa1-bf3164883585 req-656dcc25-0263-453b-9e46-d4f3fcbd62f1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081273 Dec 25 21:11:39.844538 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 739/1380] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:39 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:39.880997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22b0d393-f586-4b76-af70-d899198a0f5d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.099556 Dec 25 21:11:39.882509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 642/1381] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:39 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:39.920822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:39.921769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:39.935720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.937246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:39.938217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:39.938768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.142230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:40.143862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:40.169328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.170137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.171947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.173888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.314189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:40.323715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-851cd945-ec3a-4bc6-aa8c-9c4f9553d600 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1520 microversion: 2.1 time: 0.407361 Dec 25 21:11:40.334004 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 740/1382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:39 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:40.340224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:40.341399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:40.352325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.353355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.354944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.356027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.392640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:40.403717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71bba5cf-e71d-435f-8fde-997855135ae4 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1227 microversion: 2.1 time: 0.269279 Dec 25 21:11:40.409961 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 643/1383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:40 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1227 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:40.410628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:40.411766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:40.425547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.426249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.427266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.427866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.499684 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa9d9141-48d2-4fb6-8117-b3b51ad6d58c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.093844 Dec 25 21:11:40.506345 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 644/1384] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:40 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:40.673770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:40.686749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:40.686880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:40.687264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d2ec116-3f6b-433f-bb3b-4781dd87d78c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.348239 Dec 25 21:11:40.688423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 741/1385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:40 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:40.700201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.700821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.701263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.701729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.786841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-191e8b6d-d99b-470a-b767-8c69dd89e44e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6f78550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:40.841957 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-191e8b6d-d99b-470a-b767-8c69dd89e44e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.059232 Dec 25 21:11:40.848646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 742/1386] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:40 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:40.896369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:40.902627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:40.907196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.908029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.909692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:40.910364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:40.941628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:40.960255 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf1b5d12-b0da-4cd2-b2e5-3c4a34069f7a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1477 microversion: 2.1 time: 0.277257 Dec 25 21:11:40.962131 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e93ad77-0328-460f-bbb9-1f5739ed34bd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.065850 Dec 25 21:11:40.969691 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 743/1387] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:40 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:40.972255 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 645/1388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:40 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:41.342594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:41.343972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:41.355945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.359698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.362307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.364112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.421390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:41.422011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:41.428322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.432278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.434416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.434874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.534156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:41.548084 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94b4bc0e-aaba-4f26-a15e-a98acfcfac88 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1283 microversion: 2.1 time: 0.130414 Dec 25 21:11:41.549570 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 646/1389] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:41 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1283 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:41.556320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:41.558039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:41.569317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.569969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.571201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.571807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.643146 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06b4f6a6-7f4d-488f-9cac-c1f512356049 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.091179 Dec 25 21:11:41.650252 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 647/1390] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:41 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:41.697150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:41.708916 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-879caf66-fb6d-4d38-bf64-698dadbcc28e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1497 microversion: 2.1 time: 0.370526 Dec 25 21:11:41.713860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:41.715199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:41.718676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 744/1391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:41 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1497 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:41.726625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:41.730155 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:41.730155 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:41.731572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:41.732657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:41.734868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.735343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.736144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.739814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.740279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.741594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.741594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.749251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.791848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:41.864560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cb70126-4d37-4c21-aa53-7f2e6caebfc1 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.141571 Dec 25 21:11:41.865209 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 745/1392] 10.222.0.32 () {58 vars in 1153 bytes} [Sat Dec 25 21:11:41 2021] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:41.872147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3041417-dc0a-48f6-8c46-624431345717 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f719d9d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:41.926219 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3041417-dc0a-48f6-8c46-624431345717 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.059880 Dec 25 21:11:41.928181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 746/1393] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:41 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:41.933100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f897a800-49f6-444f-8691-b5f3965b09c9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:41.941871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f897a800-49f6-444f-8691-b5f3965b09c9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:41.942879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f897a800-49f6-444f-8691-b5f3965b09c9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:41.988306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f897a800-49f6-444f-8691-b5f3965b09c9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Going to try to start instance {{(pid=136548) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 21:11:42.030454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39172443-3d60-4936-8d9a-66c5612722a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1550 microversion: 2.1 time: 0.349668 Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 648/1394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:41 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1550 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.099808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.385255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:42.394446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f897a800-49f6-444f-8691-b5f3965b09c9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "POST /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d/action" status: 202 len: 0 microversion: 2.1 time: 0.464726 Dec 25 21:11:42.405976 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4417d345-4d6a-43ae-8c13-7c2381be1f81 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1477 microversion: 2.1 time: 0.340979 Dec 25 21:11:42.415907 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 649/1396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:42 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1477 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:42.415907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:42.415907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:42.416933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 747/1396] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:41 2021] POST /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:11:42.423116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.425459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.430267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.430267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.433668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:42.434700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:42.442593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.443410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.445261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.448969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.495803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-429c920c-61dc-4d30-bc8e-7da44cf7ace3 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.087714 Dec 25 21:11:42.499794 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 650/1397] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:42 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:42.579136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:42.588925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:42.606124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.606622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.607993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.611793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.769157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:42.784795 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7aa3a1b0-9411-42c5-b324-c1634ffcdf50 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1281 microversion: 2.1 time: 0.207346 Dec 25 21:11:42.784795 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 651/1398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:42 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1281 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:42.789216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:42.790375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:42.798705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.799268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.800290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:42.800891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:42.824084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:42.838558 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3aae3af8-97ee-4014-97ae-f28265a678a9 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1506 microversion: 2.1 time: 0.418653 Dec 25 21:11:42.845095 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 748/1399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:42 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1506 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:42.861656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7278c5d6-b0ae-4ca5-b2ca-056e6e88ded0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.076393 Dec 25 21:11:42.863487 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 652/1400] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:42 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:42.942750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-76e51820-20d5-4509-a26d-9f8dd9b716ac tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6e909d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.009806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-76e51820-20d5-4509-a26d-9f8dd9b716ac tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.073156 Dec 25 21:11:43.011457 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 749/1401] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:42 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:43.073305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.074948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:43.086919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.087694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.089430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.090000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.290000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:43.300032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baa05104-114c-4cab-b884-6702516a8135 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1540 microversion: 2.1 time: 0.230622 Dec 25 21:11:43.300864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 653/1402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:43 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1540 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:43.320054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-439464a1-edfc-4b32-bb0b-6943f5012993 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '.version_select at 0x7fa4f70ba670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.320054 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:43.320054 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:43.320054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-439464a1-edfc-4b32-bb0b-6943f5012993 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.320514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-439464a1-edfc-4b32-bb0b-6943f5012993 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.331461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-439464a1-edfc-4b32-bb0b-6943f5012993 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.019061 Dec 25 21:11:43.336560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 750/1403] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:11:43 2021] GET /compute/v2.1/os-migrations => generated 2318 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:43.349363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.349363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:43.357850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.358306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.359107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.359543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.429131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.429131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:43.433767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.434463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.436679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.441915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.641485 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5d3f639-c9f0-4935-bbba-f210372f077a tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1691 microversion: 2.1 time: 0.299781 Dec 25 21:11:43.656702 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 654/1404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:43 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1691 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:43.672026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:43.675455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:43.699998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.699998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.699998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.699998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.769998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:43.787930 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cf4be3e7-5e80-4f10-a0cc-40e3bdd9d9c9 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1477 microversion: 2.1 time: 0.367842 Dec 25 21:11:43.791674 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 751/1405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:43 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1477 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:43.797002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.797798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:43.805830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.806559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.807539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.808220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.809805 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3250b755-b0ec-4292-8a9f-a724c4a42abc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.151410 Dec 25 21:11:43.814378 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 655/1406] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:43 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:43.826848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-791009e9-e3a0-4f6d-ad37-59a57211243b req-2603f674-2ba9-40c6-9487-712e99a8e4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8114c1-85b3-4e15-9e15-95159b456e41", "name": "network-vif-plugged", "status": "completed", "tag": "f465e7da-b12a-4235-8af5-b0f521da6640"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:43.828609 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:43.828609 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:43.847248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-791009e9-e3a0-4f6d-ad37-59a57211243b req-2603f674-2ba9-40c6-9487-712e99a8e4b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.847863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-791009e9-e3a0-4f6d-ad37-59a57211243b req-2603f674-2ba9-40c6-9487-712e99a8e4b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.865103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-791009e9-e3a0-4f6d-ad37-59a57211243b req-2603f674-2ba9-40c6-9487-712e99a8e4b3 service nova] Creating event network-vif-plugged:f465e7da-b12a-4235-8af5-b0f521da6640 for instance 9a8114c1-85b3-4e15-9e15-95159b456e41 on nch2-master-1 Dec 25 21:11:43.872178 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-791009e9-e3a0-4f6d-ad37-59a57211243b req-2603f674-2ba9-40c6-9487-712e99a8e4b3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054119 Dec 25 21:11:43.873340 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 656/1407] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:43.920911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:43.925657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:43.949266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.950000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:43.951103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:43.953318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.367121 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce48a11f-c9b6-4bc2-8faf-decaaecbe152 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1691 microversion: 2.1 time: 0.553055 Dec 25 21:11:44.367121 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 752/1408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:43 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1691 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:44.371653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:44.371850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:44.372452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:44.382591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.383133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.384168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.384834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.391052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1cead9bf-cffd-46df-bbf6-ae3da914de2b tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.501066 Dec 25 21:11:44.391686 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 657/1409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:43 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:44.417923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:44.419081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:44.434803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.435263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.436181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.437016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.517323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3942d7df-802a-4f82-84f8-106f3b1f32e2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.113334 Dec 25 21:11:44.521428 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 658/1410] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:44 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:44.523838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9dfd0c0-9bfe-4927-bfd8-4d4ea7e2c857 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f728b5e0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:44.586803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9dfd0c0-9bfe-4927-bfd8-4d4ea7e2c857 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1412 microversion: 2.1 time: 0.067378 Dec 25 21:11:44.587468 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 659/1411] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:44 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1412 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:44.597503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:44.598339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:44.613082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.613541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.614515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.614951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.703779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:44.712758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae1eba9c-6f5c-4b49-8942-3997657f58bb tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1506 microversion: 2.1 time: 0.352107 Dec 25 21:11:44.726242 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 753/1412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:44 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:44.809780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:44.810410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:44.833815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lazy-loading 'services' on Instance uuid 3c1ea080-3600-4152-8bef-f30741212401 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:11:44.840346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.844978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:44.849883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:44.855766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.198656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:45.206794 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-035716f4-de08-4a93-bd26-7bb91468f51a tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1477 microversion: 2.1 time: 0.402989 Dec 25 21:11:45.207364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 754/1413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:44 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:45.211731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:45.212709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:45.218384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.220569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.220569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.220569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.261648 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd1105a2-0c09-43a3-8761-739a1a5307c7 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.053093 Dec 25 21:11:45.262268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 755/1414] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:45 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:45.273777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b990315-b001-4290-b312-bd994eeffdff tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments/ceac9d3a-b469-4d1c-92ba-9db241c60a47" status: 202 len: 0 microversion: 2.1 time: 0.681109 Dec 25 21:11:45.274437 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 660/1415] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:11:44 2021] DELETE /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments/ceac9d3a-b469-4d1c-92ba-9db241c60a47 => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:11:45.282969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:45.284057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:45.291502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.295536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.295536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.295536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.327504 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-10565a6c-750f-41f7-8900-b814f9d630d8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048467 Dec 25 21:11:45.328337 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 756/1416] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:11:45 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:11:45.343276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9833e7ba-3034-4e3c-bd4e-a06dddd8a429 req-7c3969ed-5936-456f-9ea9-312dc42d37e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad65377-4997-4c49-831e-c82240e86031", "tag": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:45.344826 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:45.344826 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:45.352643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9833e7ba-3034-4e3c-bd4e-a06dddd8a429 req-7c3969ed-5936-456f-9ea9-312dc42d37e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.352992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9833e7ba-3034-4e3c-bd4e-a06dddd8a429 req-7c3969ed-5936-456f-9ea9-312dc42d37e9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.365158 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9833e7ba-3034-4e3c-bd4e-a06dddd8a429 req-7c3969ed-5936-456f-9ea9-312dc42d37e9 service nova] Creating event network-changed:220d3bdf-7e80-4005-ba6c-054bbbffc8b7 for instance 3ad65377-4997-4c49-831e-c82240e86031 on nch1-master-1 Dec 25 21:11:45.370621 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9833e7ba-3034-4e3c-bd4e-a06dddd8a429 req-7c3969ed-5936-456f-9ea9-312dc42d37e9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030710 Dec 25 21:11:45.373804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 661/1417] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:45.407887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:45.409609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:45.415398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.416176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.416986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.417626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.529553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:45.530565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:45.549442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.549903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.550715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.551345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.607555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0effb47b-2437-436e-8bf3-c5aead7cf4c5 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.081740 Dec 25 21:11:45.609104 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 662/1418] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:45 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:45.615183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2cce2571-b789-4f38-896d-f41934e574af tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6ffcb80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:45.679460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2cce2571-b789-4f38-896d-f41934e574af tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1421 microversion: 2.1 time: 0.068912 Dec 25 21:11:45.680376 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 663/1419] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:45 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1421 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:45.692137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3822695c-bc28-418b-a301-89e33bd15c6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f70e5940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:45.740811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3822695c-bc28-418b-a301-89e33bd15c6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 200 len: 1421 microversion: 2.1 time: 0.052813 Dec 25 21:11:45.741427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 664/1420] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:11:45 2021] GET /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 1421 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:45.748012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:45.748327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:45.755601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.756116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:45.756953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:45.757403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.032696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:46.040731 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2437325f-701b-4457-91b0-c919b3b9bbd2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.636654 Dec 25 21:11:46.041344 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 757/1421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:45 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:46.050062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-063ffac4-9471-4fe8-a0c5-4a665104474e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7037550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:46.158263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:46.166763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b04bc32-941e-45c5-9385-b4e2b320842a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1510 microversion: 2.1 time: 0.424277 Dec 25 21:11:46.168616 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 665/1422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:45 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1510 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:46.185789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:46.189310 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:46.189310 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:46.191676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:46.191676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.servers [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Removing options 'limit' from query {{(pid=136547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 25 21:11:46.192342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:46.193699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.194143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.194956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.195385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.196816 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87573e6a-50e3-4269-a1c1-27efa4986fef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.014888 Dec 25 21:11:46.197888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 666/1423] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Dec 25 21:11:46 2021] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:11:46.208784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:46.213034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:46.219569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.220254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.220869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.221335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.441642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:46.449235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-902f9a24-4a87-46e2-a4bb-1c25b2671c90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1510 microversion: 2.1 time: 0.243948 Dec 25 21:11:46.459655 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 667/1424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:46 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:46.464529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:46.465174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:46.471617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.472072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.477256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.477256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.721299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:46.729445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c6a850cf-56ae-4098-9783-9a2f81ec9fb4 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1462 microversion: 2.1 time: 0.268358 Dec 25 21:11:46.730146 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 668/1425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:46 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1462 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:46.737282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:46.739809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:46.747775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.748604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.749791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.750384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.790121 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eada21bd-1053-471b-8943-11ad26d9a202 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.057653 Dec 25 21:11:46.791031 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 669/1426] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:46 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:46.796195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:46.797213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:46.804392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.806275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.806275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.806275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.836762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1e2f83a-4357-4614-a00a-ebfdee4a80f7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044652 Dec 25 21:11:46.837343 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 670/1427] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:11:46 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:11:46.842202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:46.842825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:46.852941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.852941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.852941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:46.852941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:46.994751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:47.003742 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfba6398-5dfd-47b9-aa8a-c489ea35bfb4 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1510 microversion: 2.1 time: 0.165404 Dec 25 21:11:47.004309 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 671/1428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:46 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:47.008702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:47.009624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.015791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.016246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.017120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.020683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.066751 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f6e51e9-1976-4046-ba16-f32c97b6a87f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.060703 Dec 25 21:11:47.067307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 672/1429] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:47 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:47.072841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:47.073954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.083993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.084619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.086183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.086780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.376351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-063ffac4-9471-4fe8-a0c5-4a665104474e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 204 len: 0 microversion: 2.1 time: 1.333857 Dec 25 21:11:47.377323 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 758/1430] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:46 2021] DELETE /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 0 bytes in 1335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:11:47.381793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:47.382447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.389817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.390270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.391063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.391511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.471151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71d30946-33d1-49e8-9327-6cb96344d34f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 0 microversion: 2.1 time: 0.401714 Dec 25 21:11:47.471931 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 673/1431] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:47 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:11:47.476774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:47.477423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.483648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.484167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.485008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.485448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.540138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:47.548007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60ae3ecb-d004-4544-8c27-83e0b4d06a72 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1509 microversion: 2.1 time: 0.169806 Dec 25 21:11:47.548557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 759/1432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:47 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:47.558685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:47.559206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.565473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.566704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.567015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.567448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.593005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:11:47.637331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:47.645958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e05c1f3-01aa-45a5-984f-ddfe91751e3a tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.172816 Dec 25 21:11:47.646525 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 674/1433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:47 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:47.651704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:47.652491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.659020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.659499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.660305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.660736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.692601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.693084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.693539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lazy-loading 'fault' on Instance uuid 9a8114c1-85b3-4e15-9e15-95159b456e41 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:11:47.803575 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e19c448-a85d-4d25-a173-0a6e4b62ee9a tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1596 microversion: 2.1 time: 0.155315 Dec 25 21:11:47.804460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 675/1434] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:47 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1596 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:47.808490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:47.812096 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:47.812096 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:47.813152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:47.813904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:47.923534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.924012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.924910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.925338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.950956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e58b7d3-7fa2-4360-88ca-e38ff0ed5af2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 204 len: 0 microversion: 2.1 time: 0.399957 Dec 25 21:11:47.951718 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 760/1435] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:11:47 2021] DELETE /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:11:47.958348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:47.959840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:47.967704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.972324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:47.972324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:47.972324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.017134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41fab7cc-ef40-4412-89a2-735a902b690a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.063964 Dec 25 21:11:48.018383 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 761/1436] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:47 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:48.023711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:48.025538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:48.031686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.032381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.033286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.033405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:48.033739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.103361 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcfdb611-7939-4223-bf97-5c7db7eb31c0 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 345 microversion: 2.1 time: 0.296484 Dec 25 21:11:48.103361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 676/1437] 10.222.0.32 () {58 vars in 1153 bytes} [Sat Dec 25 21:11:47 2021] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 345 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:48.108672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-226445438", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "6dded111-84d7-4606-bd1c-e9369354dff9"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:48.162516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] validate_networks() for [('6dded111-84d7-4606-bd1c-e9369354dff9', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:11:48.425112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-121e203a-fc09-4e90-be26-58ff619f215f tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action" status: 202 len: 0 microversion: 2.1 time: 0.405254 Dec 25 21:11:48.428908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 762/1438] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:48 2021] POST /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:11:48.430479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:48.431395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:48.437439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.437805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.438591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.439023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.488176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a122579-b3be-47ae-82f5-4b7524bb2c7b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.060864 Dec 25 21:11:48.492333 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 763/1439] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:48 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:48.494089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:48.494778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:48.501403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.502572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.503522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.503960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.545353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:11:48.546492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:11:48.547054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:11:48.547537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:11:48.548022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:11:48.558859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.559329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.560364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.560933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.579564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:11:48.583769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for user 613e2533f4e04cca8fafc3ea463accd9 and project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:11:48.594874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:11:48.597181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:11:48.645796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:48.653540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e72c0048-a424-4831-a38f-5b7e7e16f3ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1510 microversion: 2.1 time: 0.163495 Dec 25 21:11:48.654113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 764/1440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:48 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:48.662833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:48.663601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:48.669990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.670436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.671222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.671652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.761956 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b50cdacf-9031-4426-a27d-e88e4714f1aa tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658455 Dec 25 21:11:48.767186 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 677/1441] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:11:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:11:48.767558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-812166c8-9660-4dce-970a-6a63eb7598d9 req-b3f292ca-130f-40c9-b85b-19a614913b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e327d55b-28ca-4bfa-bcf1-e4ed49240d52", "name": "network-vif-unplugged", "status": "completed", "tag": "da0f28d9-3fef-4a56-9994-44b97466e1d4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:48.769216 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:48.769216 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:48.777419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-812166c8-9660-4dce-970a-6a63eb7598d9 req-b3f292ca-130f-40c9-b85b-19a614913b34 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.779067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-812166c8-9660-4dce-970a-6a63eb7598d9 req-b3f292ca-130f-40c9-b85b-19a614913b34 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.809580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-812166c8-9660-4dce-970a-6a63eb7598d9 req-b3f292ca-130f-40c9-b85b-19a614913b34 service nova] Creating event network-vif-unplugged:da0f28d9-3fef-4a56-9994-44b97466e1d4 for instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 on nch1-master-1 Dec 25 21:11:48.815281 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-812166c8-9660-4dce-970a-6a63eb7598d9 req-b3f292ca-130f-40c9-b85b-19a614913b34 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051335 Dec 25 21:11:48.816668 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 678/1442] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:48.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:48.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:48.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.835582 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b1b64b2-8114-47b2-a213-cc4383eded93 tempest-ServersAdminTestJSON-1283496532 tempest-ServersAdminTestJSON-1283496532-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1613 microversion: 2.1 time: 0.176222 Dec 25 21:11:48.836307 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 765/1443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:48 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1613 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:48.842445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:48.843932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:48.853986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.855654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:48.857290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:48.858482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.040207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.047894 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-57d88f09-191a-44aa-b4c3-655e8e8e74e7 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.229893 Dec 25 21:11:49.048466 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 679/1444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:48 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:49.057846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-243c2583-22bc-45d6-a83f-32f043c6c7bd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.057846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-243c2583-22bc-45d6-a83f-32f043c6c7bd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:49.058189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.062377 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41d8fa0d-2544-45c4-9327-55c184deb109 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1510 microversion: 2.1 time: 0.224713 Dec 25 21:11:49.062964 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 766/1445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:48 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:49.067599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.068151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:49.074079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.074541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.075335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.075777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.102960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:11:49.110046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-243c2583-22bc-45d6-a83f-32f043c6c7bd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.117093 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-243c2583-22bc-45d6-a83f-32f043c6c7bd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1207 microversion: 2.1 time: 0.067016 Dec 25 21:11:49.117688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 680/1446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:49 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1207 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:49.122685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:49.123751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:49.131829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.132282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.133103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.133537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.175750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a566fc0e-0394-4f18-b43d-4e932f6af354 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.056700 Dec 25 21:11:49.176634 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 681/1447] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:49 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:49.181475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.182229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:49.189204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.189941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.190553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.190996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.332615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.339962 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b5cdc17-7d80-40bc-96e4-f2e70bca1b90 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1509 microversion: 2.1 time: 0.162282 Dec 25 21:11:49.340521 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 682/1448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:49 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:49.355866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.359527 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:49.359527 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:49.362205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.362205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:49.366667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.367114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.368027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.368499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.379662 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b01b0cc5-8387-47c7-8350-ac13ecf588f2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 204 len: 0 microversion: 2.1 time: 0.315443 Dec 25 21:11:49.380720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 767/1449] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:11:49 2021] DELETE /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:11:49.389383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.390197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:49.397664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.398226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.399088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.399636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.404972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:49.439789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.447619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.448085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.603765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.611855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26eb3982-9f9f-4163-9694-a49b54e353ca tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1470 microversion: 2.1 time: 0.226376 Dec 25 21:11:49.612440 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 768/1450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:49 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1470 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:49.616819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:49.617990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:49.627173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.627747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.628585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.629048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.652844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77ca4993-fe56-4ee6-b77b-bae41be35f9b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 4512 microversion: 2.1 time: 0.300326 Dec 25 21:11:49.664968 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 683/1451] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:11:49 2021] GET /compute/v2.1/servers/detail => generated 4512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:49.671377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.674843 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:49.674843 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:49.676056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.677914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:49.680158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-246f7f2d-920f-4e96-a6a6-3afb79e29726 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.066454 Dec 25 21:11:49.685034 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 769/1452] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:49 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:49.792023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.792487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.793437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.793879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.824174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:49.857943 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a776e3f-0c9e-4454-85c6-e79ace8e69ef tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.190065 Dec 25 21:11:49.863211 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 684/1453] 10.222.0.32 () {58 vars in 1149 bytes} [Sat Dec 25 21:11:49 2021] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:49.874541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:49.888579 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:49.888579 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:49.890056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:49.890847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:49.897400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.897855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.898682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:49.899124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:49.994776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:50.056231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c2da6eb-bc32-4687-9dc4-a3a989c3ee52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.187302 Dec 25 21:11:50.056749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 770/1454] 10.222.0.32 () {58 vars in 1211 bytes} [Sat Dec 25 21:11:49 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:50.064112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.065393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:50.067899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.071444 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:50.071444 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:50.072029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.072755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.072904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.073209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:50.073449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.073902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.078355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.078813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.079698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.080166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.180480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:50.242932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7e674dc-617e-4868-ac11-fd305582b90e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.179436 Dec 25 21:11:50.244015 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 771/1455] 10.222.0.32 () {58 vars in 1195 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:50.252721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.253515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:50.263273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.263743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.264552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.265139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.299949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.307761 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9f45761-47b3-4dc3-8000-63c4aaff7a8c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.247332 Dec 25 21:11:50.310203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 685/1456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:50.321466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:50.322443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:50.328351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.328802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.329632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.330103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.343706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.353351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87b6a5a8-a420-4a75-975d-aac061606f78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1211 microversion: 2.1 time: 0.108212 Dec 25 21:11:50.354617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 772/1457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1211 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:50.359908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.364380 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:50.364380 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:50.365464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.366248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': '-922839199', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:50.371430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a620f22-e090-4d82-85f4-33fd211b4683 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.059637 Dec 25 21:11:50.374903 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 686/1458] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:50 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:50.375026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.375026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.375026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.375026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.377324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fcc5ee1b-1340-4c47-9611-8755d66ec552 req-ed419f02-8314-4c41-b5fe-9c9782b92564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e327d55b-28ca-4bfa-bcf1-e4ed49240d52", "name": "network-vif-deleted", "tag": "da0f28d9-3fef-4a56-9994-44b97466e1d4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:50.378886 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:50.378886 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:50.387055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fcc5ee1b-1340-4c47-9611-8755d66ec552 req-ed419f02-8314-4c41-b5fe-9c9782b92564 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.387697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fcc5ee1b-1340-4c47-9611-8755d66ec552 req-ed419f02-8314-4c41-b5fe-9c9782b92564 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.399288 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fcc5ee1b-1340-4c47-9611-8755d66ec552 req-ed419f02-8314-4c41-b5fe-9c9782b92564 service nova] Creating event network-vif-deleted:da0f28d9-3fef-4a56-9994-44b97466e1d4 for instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 on nch1-master-1 Dec 25 21:11:50.404345 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fcc5ee1b-1340-4c47-9611-8755d66ec552 req-ed419f02-8314-4c41-b5fe-9c9782b92564 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030991 Dec 25 21:11:50.405152 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 687/1459] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:50.466801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:50.533575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3f7b354-eda6-4ae8-a339-bc52ac3e3b52 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?name=-922839199" status: 200 len: 345 microversion: 2.1 time: 0.177092 Dec 25 21:11:50.534109 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 773/1460] 10.222.0.32 () {58 vars in 1155 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers?name=-922839199 => generated 345 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:50.546937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.551255 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:50.551255 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:50.552445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.553626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:50.566969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.567650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.579071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.579071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.628718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.629374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:50.635451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.635916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.636716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.637181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.656757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:50.811091 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c710841-8cc4-417e-94af-485c0a99900e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.264796 Dec 25 21:11:50.820409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 688/1461] 10.222.0.32 () {58 vars in 1153 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:50.824484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:50.827150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:50.835693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.836481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.837604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.838233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.888685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-946c3a25-5a8c-444d-bcab-e9c6c8fc10ce tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.070227 Dec 25 21:11:50.888837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.891349 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 689/1462] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:50 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:50.897881 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d979b6f6-2a7b-490b-aca9-6bfe1097cff6 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1470 microversion: 2.1 time: 0.272852 Dec 25 21:11:50.899248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 774/1463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:50.899365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:50.902765 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:50.902765 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:50.903800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:50.904553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-92283919', 'deleted': False, 'project_id': 'b2a52fc668c14890989f5c2756094ba1'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:11:50.911034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.911485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:50.912302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:50.912744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.000584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:11:51.057924 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86770bf7-724f-4acf-93fe-5ef676e11a9f tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-92283919" status: 200 len: 345 microversion: 2.1 time: 0.167260 Dec 25 21:11:51.058514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 690/1464] 10.222.0.32 () {58 vars in 1225 bytes} [Sat Dec 25 21:11:50 2021] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-92283919 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:51.073616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:51.074602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.088294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.089162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.090226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.090905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.122102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:11:51.327132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:51.328017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.335209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.342372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.342372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.342372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.503154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:51.522052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-088fe4d6-e898-4bd9-84d9-7945c5bc4003 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.197288 Dec 25 21:11:51.523361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 691/1465] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:51 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:51.529778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:51.534192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.539791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.540934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.569130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.570048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.590937 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de644436-dae0-4e4e-b1ee-4d97687e2c6b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 204 len: 0 microversion: 2.1 time: 0.524377 Dec 25 21:11:51.591651 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 775/1466] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:11:51 2021] DELETE /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:11:51.599936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:51.602068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.624334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.625446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.626400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.627658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.669399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:51.678208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2de8d3a4-eb64-4c7c-8862-3513c456ccc5 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1267 microversion: 2.1 time: 0.153327 Dec 25 21:11:51.678806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 692/1467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:51 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:51.684123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b178a0b-1931-492b-9592-e1de74eb5b81 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.090555 Dec 25 21:11:51.685800 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 776/1468] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:51 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:51.693468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:51.694545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.700204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.700901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.701697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.702131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.867607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:51.878494 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10f5bf94-4bd6-4cf9-bbbc-8aa3596f3efd tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1515 microversion: 2.1 time: 0.188272 Dec 25 21:11:51.878494 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 693/1469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:51 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1515 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:51.904750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:51.905871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.913411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.913960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.914772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.914886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:51.915215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.915447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:51.922541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.922999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.925373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:51.925373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:51.966938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a14f4b8f-bb13-4f1d-8818-6a01d32e919d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.067469 Dec 25 21:11:51.971364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 777/1470] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:51 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:52.015495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:52.023330 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9695d54d-fc18-44fd-b49e-4a6ca8f43285 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 200 len: 1299 microversion: 2.1 time: 0.112076 Dec 25 21:11:52.037107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 694/1471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:51 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 1299 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:52.419678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7b045bc0-78ba-4c9f-93a4-43afe1a4fccb req-4eb0cccb-e598-4185-bd7d-2dba836295ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4af366-b80d-4609-babc-fa7e67fc184a", "name": "network-vif-deleted", "tag": "0452d256-fbe5-43b7-9bfc-ff41873d27cd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:52.421282 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:52.421282 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:52.429823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7b045bc0-78ba-4c9f-93a4-43afe1a4fccb req-4eb0cccb-e598-4185-bd7d-2dba836295ea service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.430277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7b045bc0-78ba-4c9f-93a4-43afe1a4fccb req-4eb0cccb-e598-4185-bd7d-2dba836295ea service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.444153 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7b045bc0-78ba-4c9f-93a4-43afe1a4fccb req-4eb0cccb-e598-4185-bd7d-2dba836295ea service nova] Creating event network-vif-deleted:0452d256-fbe5-43b7-9bfc-ff41873d27cd for instance 4c4af366-b80d-4609-babc-fa7e67fc184a on nch2-master-1 Dec 25 21:11:52.449160 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7b045bc0-78ba-4c9f-93a4-43afe1a4fccb req-4eb0cccb-e598-4185-bd7d-2dba836295ea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Dec 25 21:11:52.449948 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 778/1472] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:52.546140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:52.546742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:52.553729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.554177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.554962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.555425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.692059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:52.700968 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a1568e92-bd7d-4e55-8bde-08b64b9c2a85 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.158748 Dec 25 21:11:52.701897 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 695/1473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:52 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:52.711011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:52.711011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:52.711231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:52.711658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:52.718059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.719083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.719739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.720189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.720354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.721911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.723990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.725211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.781681 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e940a123-5380-4e53-b958-5bdc6ab95960 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 24578 microversion: 2.1 time: 0.081267 Dec 25 21:11:52.782609 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 779/1474] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:52 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 24578 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:52.872939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1146dc4a-236b-40b8-94dd-dbd4da033f8f req-02cf143e-5ddf-48ed-94ed-0539268d08a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad65377-4997-4c49-831e-c82240e86031", "name": "network-vif-plugged", "status": "completed", "tag": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:52.874941 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:52.874941 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:52.884246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1146dc4a-236b-40b8-94dd-dbd4da033f8f req-02cf143e-5ddf-48ed-94ed-0539268d08a8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.884722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1146dc4a-236b-40b8-94dd-dbd4da033f8f req-02cf143e-5ddf-48ed-94ed-0539268d08a8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.892062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:52.896337 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1146dc4a-236b-40b8-94dd-dbd4da033f8f req-02cf143e-5ddf-48ed-94ed-0539268d08a8 service nova] Creating event network-vif-plugged:220d3bdf-7e80-4005-ba6c-054bbbffc8b7 for instance 3ad65377-4997-4c49-831e-c82240e86031 on nch1-master-1 Dec 25 21:11:52.900020 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bda6a973-c869-49fd-91a0-db4fbfc1098c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.196006 Dec 25 21:11:52.900020 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 696/1475] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:52 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:52.901733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1146dc4a-236b-40b8-94dd-dbd4da033f8f req-02cf143e-5ddf-48ed-94ed-0539268d08a8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035664 Dec 25 21:11:52.907023 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 780/1476] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:52.913612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:52.924496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:52.944489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.944976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.945798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:52.946237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:52.980992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:52.982488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.016113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.016571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.018582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.019035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.075900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8be70884-c526-437a-ad45-30fc3120bbab tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.099712 Dec 25 21:11:53.077680 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 781/1477] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:52 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:53.083849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:53.084575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 4c4af366-b80d-4609-babc-fa7e67fc184a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.091833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.092290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.093210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.093658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.108780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] HTTP exception thrown: Instance 4c4af366-b80d-4609-babc-fa7e67fc184a could not be found. Dec 25 21:11:53.109416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Returning 404 to user: Instance 4c4af366-b80d-4609-babc-fa7e67fc184a could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:11:53.110775 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecbd42b9-21aa-46f1-941b-a7ce56692f26 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a" status: 404 len: 111 microversion: 2.1 time: 0.031485 Dec 25 21:11:53.110903 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 782/1478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:53 2021] GET /compute/v2.1/servers/4c4af366-b80d-4609-babc-fa7e67fc184a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:11:53.118506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:53.119101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.126549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.127017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.127878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.128342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.162926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:11:53.172630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:53.182070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a23104f6-5a21-4d12-84a1-587d90e5a59b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1515 microversion: 2.1 time: 0.272284 Dec 25 21:11:53.182942 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 697/1479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:52 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1515 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:53.513117 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a11e0804-6150-4945-b8b2-03556f765842 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 204 len: 0 microversion: 2.1 time: 0.397004 Dec 25 21:11:53.513706 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 783/1480] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:11:53 2021] DELETE /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:11:53.524725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:53.525146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.531912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.532518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.533336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.533824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.679901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:53.687785 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7bfb10b6-b336-48d2-b6a5-fd1c8e9b8109 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1469 microversion: 2.1 time: 0.169099 Dec 25 21:11:53.688450 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 698/1481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:53 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:53.719054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:53.719667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.727339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.727794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.728642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.729191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.793752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:53.794928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.802715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.802715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.808431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.808431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.873604 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-64337a0a-ac0d-49f3-9c66-5a0305718f18 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.083320 Dec 25 21:11:53.879994 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 699/1482] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:53 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:53.886390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3eecb164-e7a3-4f43-bb42-5faf6ff6923d req-102e3499-ed87-4602-81d4-507411a0fbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01ef47d-effa-4511-a9b2-27108542948c", "tag": "9b84f1ce-b047-4065-9144-b2767da8f6e2"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:53.888166 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:53.888166 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:53.895296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:53.899642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3eecb164-e7a3-4f43-bb42-5faf6ff6923d req-102e3499-ed87-4602-81d4-507411a0fbba service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.900388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3eecb164-e7a3-4f43-bb42-5faf6ff6923d req-102e3499-ed87-4602-81d4-507411a0fbba service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.908088 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c94f3187-4572-4d1d-9798-2ebebda5a210 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1323 microversion: 2.1 time: 0.189360 Dec 25 21:11:53.908088 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 784/1483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:53 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:53.921421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:53.922035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:53.929127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.929637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.930617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:53.931285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:53.933487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3eecb164-e7a3-4f43-bb42-5faf6ff6923d req-102e3499-ed87-4602-81d4-507411a0fbba service nova] Creating event network-changed:9b84f1ce-b047-4065-9144-b2767da8f6e2 for instance c01ef47d-effa-4511-a9b2-27108542948c on nch2-master-1 Dec 25 21:11:53.939043 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3eecb164-e7a3-4f43-bb42-5faf6ff6923d req-102e3499-ed87-4602-81d4-507411a0fbba service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057239 Dec 25 21:11:53.940359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 700/1484] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:54.083185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:54.088364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:54.089773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:54.093709 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cdb572c6-1ce4-43d7-9f80-9c49e3ebea0c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.174527 Dec 25 21:11:54.093709 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 785/1485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:53 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:54.099530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.101217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.102084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.102551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.146481 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8d5034a-748a-42ce-ae5b-e6a456bdd63c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.061874 Dec 25 21:11:54.147373 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 701/1486] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:54 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:11:54.201864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:54.203004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:54.210444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.210890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.211686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.217081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.276383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:54.284988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-deb043d3-821e-467d-b88f-6de7bc1172ca tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1473 microversion: 2.1 time: 0.088859 Dec 25 21:11:54.285567 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 786/1487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:54 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1473 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:54.709135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:54.710669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:54.718365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.718967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.719792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.720248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.873409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:54.881596 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46cf8895-bc23-4cb8-84ef-3e57b6f319b7 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1469 microversion: 2.1 time: 0.179461 Dec 25 21:11:54.882389 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 702/1488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:54 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1469 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:54.888377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:54.890242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:54.898630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.899105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.899887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.900466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.925974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:54.925974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:54.930558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.931029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.931837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:54.932295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:54.955560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-093f6078-6a42-4067-ae24-91291058d3fc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.060729 Dec 25 21:11:54.955560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 787/1489] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:54 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:55.074056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:55.086940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c6ada742-1cc0-427f-9aaf-938273acfedf tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 200 len: 1520 microversion: 2.1 time: 0.165212 Dec 25 21:11:55.095971 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 703/1490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:54 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:55.104495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.174"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:55.105691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:55.107519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:55.108334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:55.113179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.113827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.115137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.115689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.116655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.117304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.118434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.118941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.192897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Acquired lock "refresh_cache-b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:11:55.360102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:55.369507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e32f544c-ed68-4ae9-8eef-18909271ed7d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.265720 Dec 25 21:11:55.370207 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 704/1491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:55 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:55.375041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:55.376103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:55.382163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.382730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.383612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.384153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.437044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-092ebb29-66ba-4474-8712-0981ae16afc2 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.065369 Dec 25 21:11:55.441956 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 705/1492] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:55 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:55.446221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:55.447016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:55.456041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.456664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.457579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.458120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.493865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.494858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.495561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lazy-loading 'fault' on Instance uuid 1ae83e38-943e-47ce-af1e-e5bef506ca7d {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:11:55.554707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:55.564783 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75bd3afb-45b5-4142-a30e-876a6139f233 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 200 len: 1310 microversion: 2.1 time: 0.125254 Dec 25 21:11:55.565511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 706/1493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:55 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 1310 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:55.898796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:55.900170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:55.907526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.908549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.909382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:55.909821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:55.991537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:55.999070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e7ae5d2-b3cb-4506-828a-981b3e2df6d2 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 200 len: 1427 microversion: 2.1 time: 0.104250 Dec 25 21:11:55.999641 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 707/1494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:55 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:56.004209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:56.005223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:56.011277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.011679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.012511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.012984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.060709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3458c2ab-2ad1-40fe-947e-a09e79e4abb2 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.059691 Dec 25 21:11:56.070258 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 708/1495] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:55 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:56.070258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a4ae5df9-aebf-472e-ae00-8e5885f8d48f req-7986baf3-4325-4cd2-9538-0a1cf6f2275c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ae83e38-943e-47ce-af1e-e5bef506ca7d", "name": "network-vif-deleted", "tag": "9ec98fee-c19b-4539-9748-2eb705309dff"}, {"server_uuid": "7a96da32-1c68-4f60-8164-56d8ced8b069", "name": "network-vif-deleted", "tag": "6e1c9c71-c87a-4d1b-aa9b-dbbcce58234a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:56.070258 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:56.070258 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:56.076684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a4ae5df9-aebf-472e-ae00-8e5885f8d48f req-7986baf3-4325-4cd2-9538-0a1cf6f2275c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.077163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a4ae5df9-aebf-472e-ae00-8e5885f8d48f req-7986baf3-4325-4cd2-9538-0a1cf6f2275c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.090036 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a4ae5df9-aebf-472e-ae00-8e5885f8d48f req-7986baf3-4325-4cd2-9538-0a1cf6f2275c service nova] Creating event network-vif-deleted:9ec98fee-c19b-4539-9748-2eb705309dff for instance 1ae83e38-943e-47ce-af1e-e5bef506ca7d on nch1-master-1 Dec 25 21:11:56.090547 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a4ae5df9-aebf-472e-ae00-8e5885f8d48f req-7986baf3-4325-4cd2-9538-0a1cf6f2275c service nova] Creating event network-vif-deleted:6e1c9c71-c87a-4d1b-aa9b-dbbcce58234a for instance 7a96da32-1c68-4f60-8164-56d8ced8b069 on nch2-master-1 Dec 25 21:11:56.101732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a4ae5df9-aebf-472e-ae00-8e5885f8d48f req-7986baf3-4325-4cd2-9538-0a1cf6f2275c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039046 Dec 25 21:11:56.102555 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 709/1496] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:56.386881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:56.387614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:56.394582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.406135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.406135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.406135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.613486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:56.621667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70d19ce1-7338-42d0-8e87-508625009a6e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.239489 Dec 25 21:11:56.622240 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 710/1497] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:56 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:56.636275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:56.637228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:56.643216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.643673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.644575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.645059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.691159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Building network info cache for instance {{(pid=136548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:11:56.693023 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f6e8be8-a72c-4beb-ba11-6e7b8e42274c tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.060455 Dec 25 21:11:56.694073 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 711/1498] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:56 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:56.700975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:56.701674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: 1ae83e38-943e-47ce-af1e-e5bef506ca7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:56.723238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.723711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.724533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.725032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.745412 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] HTTP exception thrown: Instance 1ae83e38-943e-47ce-af1e-e5bef506ca7d could not be found. Dec 25 21:11:56.746468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Returning 404 to user: Instance 1ae83e38-943e-47ce-af1e-e5bef506ca7d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:11:56.747787 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7578bc62-f998-4a25-a586-2049dd49c523 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d" status: 404 len: 111 microversion: 2.1 time: 0.052472 Dec 25 21:11:56.748467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 712/1499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:56 2021] GET /compute/v2.1/servers/1ae83e38-943e-47ce-af1e-e5bef506ca7d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:11:56.755533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7cceaed5-009f-4400-96fc-4e8cf61356ba req-dbb710e8-eadb-4416-a6dd-0ae5c3f4be87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:56.758055 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:56.758055 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:11:56.771222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7cceaed5-009f-4400-96fc-4e8cf61356ba req-dbb710e8-eadb-4416-a6dd-0ae5c3f4be87 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.771603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7cceaed5-009f-4400-96fc-4e8cf61356ba req-dbb710e8-eadb-4416-a6dd-0ae5c3f4be87 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.784071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7cceaed5-009f-4400-96fc-4e8cf61356ba req-dbb710e8-eadb-4416-a6dd-0ae5c3f4be87 service nova] Creating event network-changed:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:11:56.792069 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7cceaed5-009f-4400-96fc-4e8cf61356ba req-dbb710e8-eadb-4416-a6dd-0ae5c3f4be87 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040423 Dec 25 21:11:56.794360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 713/1500] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:56.800194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:56.800836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:56.809357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.810039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.816555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:56.816555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:56.841306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:11:57.193880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88203f4d-ab63-4964-9c78-789512b60c7a tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 204 len: 0 microversion: 2.1 time: 0.395621 Dec 25 21:11:57.195620 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 714/1501] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:11:56 2021] DELETE /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:11:57.202220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:57.204182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 7a96da32-1c68-4f60-8164-56d8ced8b069] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:57.217525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.227990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.227990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.227990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.241870 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] HTTP exception thrown: Instance 7a96da32-1c68-4f60-8164-56d8ced8b069 could not be found. Dec 25 21:11:57.242482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Returning 404 to user: Instance 7a96da32-1c68-4f60-8164-56d8ced8b069 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:11:57.245244 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbb20ce0-33d1-45a7-8015-389340a1223c tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069" status: 404 len: 111 microversion: 2.1 time: 0.048070 Dec 25 21:11:57.250548 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 715/1502] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:57 2021] GET /compute/v2.1/servers/7a96da32-1c68-4f60-8164-56d8ced8b069 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:11:57.259657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:57.260849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:57.268597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.269086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.269949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.270763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.321676 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0a30ae10-f970-49da-80ce-0bea49a3eeb5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.068453 Dec 25 21:11:57.321676 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 716/1503] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:57 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:57.338044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:57.338739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:57.346307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.346769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.347570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.348008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.732398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Updating instance_info_cache with network_info: [{"id": "ad82f3ef-690a-49c9-b46f-74d324ed0682", "address": "fa:16:3e:9b:16:c3", "network": {"id": "09af6274-7110-4e9c-83cc-51d4d54a1676", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1365984648-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "188fe358c4684fce8fc912f48b3f186e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad82f3ef-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:11:57.740951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Releasing lock "refresh_cache-b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:11:57.742524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1cab2f8-5305-48c2-b4b8-d966a2a17d1c tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action" status: 202 len: 0 microversion: 2.1 time: 2.642115 Dec 25 21:11:57.743194 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 788/1504] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:55 2021] POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action => generated 0 bytes in 2644 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:11:57.749162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:57.749835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:57.763266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.764021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.766313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.766763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.793839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:11:57.812265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:57.821432 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52f28e1e-95e9-4803-a5a0-ad79156c6a18 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1516 microversion: 2.1 time: 0.498340 Dec 25 21:11:57.822409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 717/1505] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:57 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:57.827017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:57.827694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:57.835667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.836197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:57.837125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:57.837637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.005737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:58.016610 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03ca76c0-4f4e-449d-b0e2-a3c6992280b2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.192569 Dec 25 21:11:58.018462 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 718/1506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:57 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:58.023189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:58.024464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:58.031992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.032550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.033506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.034083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.092866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6efd58b9-c922-4eb3-8594-c84bc9ebb663 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.072849 Dec 25 21:11:58.093788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 719/1507] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:58 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:58.099096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.174"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:58.100376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:58.107633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.108085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.108859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.109321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.135910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Acquired lock "refresh_cache-3ad65377-4997-4c49-831e-c82240e86031" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:11:58.179801 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-928c0c50-6e30-49fe-8cc6-552c312b93dd tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 204 len: 0 microversion: 2.1 time: 0.435178 Dec 25 21:11:58.183236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 789/1508] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:11:57 2021] DELETE /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:11:58.197850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:58.198911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:58.208726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.209314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.213832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.214283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.448532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:58.456589 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cea1c04-d34b-42be-8be3-61af238e2015 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1468 microversion: 2.1 time: 0.264794 Dec 25 21:11:58.457224 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 790/1509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:58 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:58.461620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:58.467185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:58.468632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.469120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.469907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.470879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.518701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a249726-f189-4a77-bcf3-52d09b5b1a45 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.060224 Dec 25 21:11:58.519623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 791/1510] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:58 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:58.840209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:58.841162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:58.848646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.849153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:58.849950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:58.850385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.021721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:59.029208 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-789d91e4-863a-49de-93f8-a3719887ce85 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1516 microversion: 2.1 time: 0.193289 Dec 25 21:11:59.029780 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 792/1511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:58 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:59.034636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:59.035241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:59.040965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.044945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.044945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.044945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.281140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:59.289734 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db191263-e8d7-413d-8fcc-ff754f0eff0a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.258945 Dec 25 21:11:59.290688 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 793/1512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:59 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:11:59.302605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:59.302605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:59.309433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.309890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.310746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.311353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.356322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7d69c83-432a-4324-9a7d-e13782269f97 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.064239 Dec 25 21:11:59.356999 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 794/1513] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:59 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:11:59.361920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d234c65a-387c-4f08-823c-290bae2cf99b req-10b1dbdd-9dcd-40e8-a03d-62e9c946a5bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cadf356d-6fa7-4dcf-9dcf-515f67791639", "name": "network-vif-deleted", "tag": "3147cbbc-6a59-4aed-93a8-d328bcb5240b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:59.363398 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:11:59.363398 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:11:59.371284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d234c65a-387c-4f08-823c-290bae2cf99b req-10b1dbdd-9dcd-40e8-a03d-62e9c946a5bf service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.371734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d234c65a-387c-4f08-823c-290bae2cf99b req-10b1dbdd-9dcd-40e8-a03d-62e9c946a5bf service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.383347 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d234c65a-387c-4f08-823c-290bae2cf99b req-10b1dbdd-9dcd-40e8-a03d-62e9c946a5bf service nova] Creating event network-vif-deleted:3147cbbc-6a59-4aed-93a8-d328bcb5240b for instance cadf356d-6fa7-4dcf-9dcf-515f67791639 on nch1-master-1 Dec 25 21:11:59.388462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d234c65a-387c-4f08-823c-290bae2cf99b req-10b1dbdd-9dcd-40e8-a03d-62e9c946a5bf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030170 Dec 25 21:11:59.389402 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 795/1514] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:11:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:11:59.474020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:11:59.474689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:59.481344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.482266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.483237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.484044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.763474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:11:59.774420 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7960aa6-0a9c-49b5-a9ea-fadbecabfb97 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1468 microversion: 2.1 time: 0.304787 Dec 25 21:11:59.775769 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 796/1515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:11:59 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:11:59.781193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:11:59.786189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:11:59.794469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.794922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.795741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:11:59.796182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:11:59.845966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e0895ed-25f8-4060-8506-42e5d3442433 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.067741 Dec 25 21:11:59.846823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 797/1516] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:59 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:00.052296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:00.053460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:00.060974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.061965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.062987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.063635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.112716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.113578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.114250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lazy-loading 'fault' on Instance uuid cadf356d-6fa7-4dcf-9dcf-515f67791639 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:00.186626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:00.197816 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a35ff25-27f0-4b38-a2fc-d948169d82ea tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 200 len: 1310 microversion: 2.1 time: 0.149564 Dec 25 21:12:00.210677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 798/1517] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:00 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 1310 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:00.216338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7a094b2f-54e5-43f1-b5cc-005b75669a92 req-83963202-f151-44dc-a673-178f008923e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:00.219528 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:00.219528 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:00.231722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7a094b2f-54e5-43f1-b5cc-005b75669a92 req-83963202-f151-44dc-a673-178f008923e2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.232439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7a094b2f-54e5-43f1-b5cc-005b75669a92 req-83963202-f151-44dc-a673-178f008923e2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.249544 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7a094b2f-54e5-43f1-b5cc-005b75669a92 req-83963202-f151-44dc-a673-178f008923e2 service nova] Creating event network-changed:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:12:00.259060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7a094b2f-54e5-43f1-b5cc-005b75669a92 req-83963202-f151-44dc-a673-178f008923e2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047040 Dec 25 21:12:00.261897 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 799/1518] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:00.273854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9d18010b-7eda-4051-b332-17ce41f4c2be req-6491abab-1bae-4486-82fe-36eb2f865cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01ef47d-effa-4511-a9b2-27108542948c", "name": "network-vif-plugged", "status": "completed", "tag": "9b84f1ce-b047-4065-9144-b2767da8f6e2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:00.276292 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:00.276292 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:00.288696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9d18010b-7eda-4051-b332-17ce41f4c2be req-6491abab-1bae-4486-82fe-36eb2f865cfb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.289330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9d18010b-7eda-4051-b332-17ce41f4c2be req-6491abab-1bae-4486-82fe-36eb2f865cfb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.297236 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.neutron [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] re-assign floating IP 172.35.3.174 from instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 Dec 25 21:12:00.321702 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9d18010b-7eda-4051-b332-17ce41f4c2be req-6491abab-1bae-4486-82fe-36eb2f865cfb service nova] Creating event network-vif-plugged:9b84f1ce-b047-4065-9144-b2767da8f6e2 for instance c01ef47d-effa-4511-a9b2-27108542948c on nch2-master-1 Dec 25 21:12:00.354816 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9d18010b-7eda-4051-b332-17ce41f4c2be req-6491abab-1bae-4486-82fe-36eb2f865cfb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089775 Dec 25 21:12:00.359647 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 800/1519] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:00.372334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:00.378733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:00.400430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.404634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.405607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.406049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.448589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Building network info cache for instance {{(pid=136547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:12:00.738091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:00.746316 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6239eb7-bb4a-441a-9b9c-91cbc67963f8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1307 microversion: 2.1 time: 0.382668 Dec 25 21:12:00.747363 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 801/1520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:00 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1307 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:00.752140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:00.753261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:00.762504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.763165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.764254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.768326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.841295 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ab57ba5-fd69-4333-83a1-61aa133f9a6d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.092467 Dec 25 21:12:00.842389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 802/1521] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:00 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:00.848279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:00.849744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:00.858099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.858798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.859829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.860472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.949313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6c295b9814d44efba37e7a37df6fa9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c70df2525137490a9e18b5e4af25a7b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:00.956647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2eb1336-ca09-49b1-b9a5-efcf4542c49b tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 200 len: 1426 microversion: 2.1 time: 0.112837 Dec 25 21:12:00.957327 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 803/1522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:00 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 1426 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:00.962296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:00.963542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:00.970161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.970690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:00.971630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:00.972233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:01.019056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99a20b47-7c43-4e25-84fc-ed7cfd90d9be tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.060482 Dec 25 21:12:01.020089 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 804/1523] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:00 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:01.221322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:01.221718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: cadf356d-6fa7-4dcf-9dcf-515f67791639] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:01.241042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:01.242077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:01.242981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:01.243427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:01.267140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] HTTP exception thrown: Instance cadf356d-6fa7-4dcf-9dcf-515f67791639 could not be found. Dec 25 21:12:01.267824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Returning 404 to user: Instance cadf356d-6fa7-4dcf-9dcf-515f67791639 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:01.268660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88574436-6e34-44a8-8242-f5dbb6bcb91e tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639" status: 404 len: 111 microversion: 2.1 time: 0.052035 Dec 25 21:12:01.272707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 805/1524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:01 2021] GET /compute/v2.1/servers/cadf356d-6fa7-4dcf-9dcf-515f67791639 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:01.278509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:01.279013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:01.286401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:01.290439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:01.290439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:01.290439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:01.325233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:01.397543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Updating instance_info_cache with network_info: [{"id": "ad82f3ef-690a-49c9-b46f-74d324ed0682", "address": "fa:16:3e:9b:16:c3", "network": {"id": "09af6274-7110-4e9c-83cc-51d4d54a1676", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1365984648-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "188fe358c4684fce8fc912f48b3f186e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad82f3ef-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:12:01.542625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Building network info cache for instance {{(pid=136547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:12:01.791154 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c33020a8-7400-42d3-9570-7dc657c79629 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 204 len: 0 microversion: 2.1 time: 0.516595 Dec 25 21:12:01.792560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 806/1525] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:01 2021] DELETE /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:01.799069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6e575399-07ed-4128-8b3b-9f3a3c231457 req-1ca5f6e8-c8f9-482a-b7ee-f2653a348591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a8114c1-85b3-4e15-9e15-95159b456e41", "name": "network-vif-deleted", "tag": "f465e7da-b12a-4235-8af5-b0f521da6640"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:01.800629 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:01.800629 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:01.808762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6e575399-07ed-4128-8b3b-9f3a3c231457 req-1ca5f6e8-c8f9-482a-b7ee-f2653a348591 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:01.809259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6e575399-07ed-4128-8b3b-9f3a3c231457 req-1ca5f6e8-c8f9-482a-b7ee-f2653a348591 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:01.820760 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6e575399-07ed-4128-8b3b-9f3a3c231457 req-1ca5f6e8-c8f9-482a-b7ee-f2653a348591 service nova] Creating event network-vif-deleted:f465e7da-b12a-4235-8af5-b0f521da6640 for instance 9a8114c1-85b3-4e15-9e15-95159b456e41 on nch2-master-1 Dec 25 21:12:01.825915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6e575399-07ed-4128-8b3b-9f3a3c231457 req-1ca5f6e8-c8f9-482a-b7ee-f2653a348591 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031898 Dec 25 21:12:01.826642 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 807/1526] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:01.832412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1435587034", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "1e137e86-76be-493f-9b25-1d17756925b5"}], "block_device_mapping_v2": [{"uuid": "98b6d31e-e760-499e-8962-7b22479c1e9a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:01.908965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] validate_networks() for [('1e137e86-76be-493f-9b25-1d17756925b5', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:12:02.628389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:12:02.628905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:12:02.636785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:12:02.636785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:12:02.636785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:12:02.641126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:02.641581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:02.642988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:02.643473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:02.656756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Updating instance_info_cache with network_info: [{"id": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7", "address": "fa:16:3e:4b:d1:01", "network": {"id": "09af6274-7110-4e9c-83cc-51d4d54a1676", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1365984648-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "188fe358c4684fce8fc912f48b3f186e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap220d3bdf-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:12:02.661556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:12:02.665674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Getting quotas for user 2cb2a59c7c9b4a13964c78ff0fb1a8f4 and project 276a36e6a97d46a78b7e483daa26cc2e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:12:02.724905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:12:02.727242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='98b6d31e-e760-499e-8962-7b22479c1e9a',volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:02.805339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Releasing lock "refresh_cache-3ad65377-4997-4c49-831e-c82240e86031" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:12:02.806221 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b03e64b-3078-458c-8170-a25ca78f0243 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031/action" status: 202 len: 0 microversion: 2.1 time: 4.711129 Dec 25 21:12:02.806860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 720/1527] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:11:58 2021] POST /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031/action => generated 0 bytes in 4713 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:12:02.811357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:02.811962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:02.818224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:02.818672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:02.819457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:02.819894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:02.958571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:02.966266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf1d4b7c-107f-4591-bb60-98308cdd2ec2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1488 microversion: 2.1 time: 0.158380 Dec 25 21:12:02.966851 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 721/1528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:02 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1488 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:02.971827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:02.972440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:02.978313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:02.978776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:02.979565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:02.980009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.095172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af2a4f7c-4f87-46dd-bdcc-fa2a17440517 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.267255 Dec 25 21:12:03.100661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 808/1529] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:12:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 1269 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:12:03.100661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:03.104483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.109493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.111001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.112133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.112542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.119978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:03.129146 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04942ebc-7841-4866-9c3b-02344f6e529b tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1516 microversion: 2.1 time: 0.161240 Dec 25 21:12:03.130642 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 722/1530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:02 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:03.134501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:03.135288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] [instance: 9a8114c1-85b3-4e15-9e15-95159b456e41] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.141686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.142943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.143930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.144532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.161798 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] HTTP exception thrown: Instance 9a8114c1-85b3-4e15-9e15-95159b456e41 could not be found. Dec 25 21:12:03.162403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] Returning 404 to user: Instance 9a8114c1-85b3-4e15-9e15-95159b456e41 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:03.162540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26023950-e39d-4efa-9f11-42d8b1e3bd0e tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.064951 Dec 25 21:12:03.163799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62b217d2-9e4c-4a49-9ecd-0f44fb15be90 tempest-ServersAdminTestJSON-305048221 tempest-ServersAdminTestJSON-305048221-project] 10.222.0.32 "GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41" status: 404 len: 111 microversion: 2.1 time: 0.032454 Dec 25 21:12:03.163939 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 809/1531] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:03 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:03.164264 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 723/1532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:03 2021] GET /compute/v2.1/servers/9a8114c1-85b3-4e15-9e15-95159b456e41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:03.182601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7b2dfd02-1ff0-4bf2-8352-84a60c25da0d req-2743a983-9088-4c09-b4cc-34f5e7635e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad65377-4997-4c49-831e-c82240e86031", "tag": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:03.183227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:03.183338 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:03.183338 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:03.183524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.183524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.183710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7b2dfd02-1ff0-4bf2-8352-84a60c25da0d req-2743a983-9088-4c09-b4cc-34f5e7635e47 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.183815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.183913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7b2dfd02-1ff0-4bf2-8352-84a60c25da0d req-2743a983-9088-4c09-b4cc-34f5e7635e47 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.184013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.184013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.197184 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7b2dfd02-1ff0-4bf2-8352-84a60c25da0d req-2743a983-9088-4c09-b4cc-34f5e7635e47 service nova] Creating event network-changed:220d3bdf-7e80-4005-ba6c-054bbbffc8b7 for instance 3ad65377-4997-4c49-831e-c82240e86031 on nch1-master-1 Dec 25 21:12:03.203295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7b2dfd02-1ff0-4bf2-8352-84a60c25da0d req-2743a983-9088-4c09-b4cc-34f5e7635e47 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037077 Dec 25 21:12:03.204187 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 724/1533] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:03.210607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.174"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:03.259220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-31d35a04-3e01-4cf1-a2b3-15153035a907 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.091211 Dec 25 21:12:03.260589 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 810/1534] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:03 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:03.265145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:03.265800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.273652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.274054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.275121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.275576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.301557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lazy-loading 'flavor' on Instance uuid c01ef47d-effa-4511-a9b2-27108542948c {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:03.363881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.371833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.372293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.373203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.373654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.696856 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce254f0c-4c22-458b-b1b5-a81366eff2b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c/action" status: 202 len: 0 microversion: 2.1 time: 0.435300 Dec 25 21:12:03.701411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 811/1535] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:03 2021] POST /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:12:03.708905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fce86d7-4ddd-4b1e-aaa4-69d569272bb2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:03.710800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fce86d7-4ddd-4b1e-aaa4-69d569272bb2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.725963 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] HTTP exception thrown: Floating IP 172.35.3.174 is not associated with instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653. Dec 25 21:12:03.733096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Returning 409 to user: Floating IP 172.35.3.174 is not associated with instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:03.733096 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ee288ec-f582-4a97-b5d4-0aab156a8bf2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action" status: 409 len: 146 microversion: 2.1 time: 0.522582 Dec 25 21:12:03.733096 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 725/1536] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:03 2021] POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action => generated 146 bytes in 525 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:12:03.747847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:03.749567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:03.759661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.760256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.761598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:03.762881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:03.805895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fce86d7-4ddd-4b1e-aaa4-69d569272bb2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:03.820354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fce86d7-4ddd-4b1e-aaa4-69d569272bb2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:03.823319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fce86d7-4ddd-4b1e-aaa4-69d569272bb2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:03.825489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fce86d7-4ddd-4b1e-aaa4-69d569272bb2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1104 microversion: 2.25 time: 0.122277 Dec 25 21:12:03.832198 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 812/1537] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:03 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1104 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:03.837046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.174"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:04.117297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:04.127359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.128911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.129740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.130722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.157483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:04.166484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f394733-deca-4599-954c-9be6a5e13c76 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1496 microversion: 2.1 time: 0.435547 Dec 25 21:12:04.171769 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 726/1538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:03 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1496 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:04.171769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:04.172258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:04.179183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.179628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.180445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.180913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.491006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:04.503873 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85ea09f3-8c43-45a7-9018-cc6ebd42f4ad tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1516 microversion: 2.1 time: 0.335667 Dec 25 21:12:04.504539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 727/1539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:04 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1516 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:04.522793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:04.523827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:04.530894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.531621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.533316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.534543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.567829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Acquired lock "refresh_cache-3ad65377-4997-4c49-831e-c82240e86031" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:12:04.604651 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e1f51796-8643-4c3a-ba3b-51ca541e1047 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.098539 Dec 25 21:12:04.611138 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 728/1540] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:04 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:04.615081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:04.621717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:04.636180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.636666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.642836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.643302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.714021 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-33f58907-4843-4ebc-af5d-1d81f8e4d7ae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.105627 Dec 25 21:12:04.714669 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 729/1541] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:04 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:04.850986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:04.851811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:04.859013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.859536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:04.860375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:04.860982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:05.113173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:05.122922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:05.124734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:05.125960 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1487c1d6-9e15-4ec5-9963-a8e693bee21b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1177 microversion: 2.25 time: 0.279306 Dec 25 21:12:05.126527 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 730/1542] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:04 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1177 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:12:05.183685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:05.185755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:05.193259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:05.193719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:05.194551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:05.194986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:05.467369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:05.476286 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a44ca8cc-ad54-48a1-9ca1-9dfef79a670c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 200 len: 1479 microversion: 2.1 time: 0.296410 Dec 25 21:12:05.487381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 731/1543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:05 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 1479 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:05.491491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-743990c7-bedc-49f9-a6b1-ec3801ea121e req-12d6f058-1b42-432a-a641-8fb098ea2b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d914c615-075b-48b0-bbd9-707f0b4e084d", "name": "network-vif-deleted", "tag": "68318cac-8cb7-4fbd-94a8-563f01bdc7e4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:05.493346 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:05.493346 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:05.502793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-743990c7-bedc-49f9-a6b1-ec3801ea121e req-12d6f058-1b42-432a-a641-8fb098ea2b9d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:05.503383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-743990c7-bedc-49f9-a6b1-ec3801ea121e req-12d6f058-1b42-432a-a641-8fb098ea2b9d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:05.514995 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-743990c7-bedc-49f9-a6b1-ec3801ea121e req-12d6f058-1b42-432a-a641-8fb098ea2b9d service nova] Creating event network-vif-deleted:68318cac-8cb7-4fbd-94a8-563f01bdc7e4 for instance d914c615-075b-48b0-bbd9-707f0b4e084d on nch1-master-1 Dec 25 21:12:05.521253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-743990c7-bedc-49f9-a6b1-ec3801ea121e req-12d6f058-1b42-432a-a641-8fb098ea2b9d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034250 Dec 25 21:12:05.522957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 732/1544] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:05.529851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1020558730"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:05.533084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:05.541234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:05.544262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:05.544991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:05.545520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:05.608093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Building network info cache for instance {{(pid=136548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:12:06.380948 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d1c0f7f-48f8-4f50-8c61-c1aaae53aa74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c/action" status: 202 len: 0 microversion: 2.1 time: 0.838274 Dec 25 21:12:06.380948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 733/1545] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:05 2021] POST /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c/action => generated 0 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:12:06.396992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:06.399410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:06.420492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.421417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.422809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.424217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.514971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.515577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.516229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lazy-loading 'fault' on Instance uuid d914c615-075b-48b0-bbd9-707f0b4e084d {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:06.611457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf797406f5aa4ba792478c5af6eccb4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2a52fc668c14890989f5c2756094ba1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:06.629091 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14b6d0dc-f32b-4be1-8bc0-8d534cdba351 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 200 len: 1310 microversion: 2.1 time: 0.249268 Dec 25 21:12:06.630052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 734/1546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:06 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 1310 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:06.639328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:06.645133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:06.656970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.662927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.664029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.664639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.739811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae513ad0-212d-4171-9f51-336d613eac19 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.107848 Dec 25 21:12:06.740737 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 735/1547] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:06 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:06.747851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:06.749570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:06.771815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.781409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.782424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.782882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.879202 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-134b9e8b-e32e-498c-9520-e938021c7897 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.132268 Dec 25 21:12:06.882262 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 736/1548] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:06 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:06.891293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Updating instance_info_cache with network_info: [{"id": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7", "address": "fa:16:3e:4b:d1:01", "network": {"id": "09af6274-7110-4e9c-83cc-51d4d54a1676", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1365984648-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "188fe358c4684fce8fc912f48b3f186e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap220d3bdf-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:12:06.897749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:06.899262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:06.908742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.909468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.911574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:06.912033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:06.979242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Releasing lock "refresh_cache-3ad65377-4997-4c49-831e-c82240e86031" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:12:06.981691 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51365133-242a-43ef-9f2c-9945ad573809 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031/action" status: 202 len: 0 microversion: 2.1 time: 3.148489 Dec 25 21:12:06.985493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 813/1549] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:03 2021] POST /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031/action => generated 0 bytes in 3151 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:12:06.992568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68623a5e-930a-47e3-bcd8-0cac3fb02c41 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f7498e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:07.020399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:07.033039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:07.038034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:07.040472 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8793e864-dbe3-42b2-aa73-3c86411eb640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1251 microversion: 2.25 time: 0.156578 Dec 25 21:12:07.054648 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 737/1550] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:06 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1251 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:07.061447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-818467884", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "2332d558-39bb-411c-88af-b74bee7e32ab"}], "block_device_mapping_v2": [{"uuid": "a4054058-9bcb-4981-a993-8da409df7a33", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:07.193091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] validate_networks() for [('2332d558-39bb-411c-88af-b74bee7e32ab', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:12:07.429384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68623a5e-930a-47e3-bcd8-0cac3fb02c41 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.444317 Dec 25 21:12:07.438203 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 814/1551] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:06 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:07.446388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:07.448498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:07.461628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.462088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.462904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.463352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.502157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:07.795463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e1250f7-774b-4d5c-966b-4edc89fb7b5f tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 204 len: 0 microversion: 2.1 time: 0.354559 Dec 25 21:12:07.796694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 815/1552] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:07 2021] DELETE /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:07.804045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e2cfde01-48e9-4ddd-8cf5-3d600a56235f req-00d5c08a-4a83-4823-aa88-ec4c826db335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ad65377-4997-4c49-831e-c82240e86031", "tag": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:07.806792 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:07.806792 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:07.816577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e2cfde01-48e9-4ddd-8cf5-3d600a56235f req-00d5c08a-4a83-4823-aa88-ec4c826db335 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.817191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e2cfde01-48e9-4ddd-8cf5-3d600a56235f req-00d5c08a-4a83-4823-aa88-ec4c826db335 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.831258 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e2cfde01-48e9-4ddd-8cf5-3d600a56235f req-00d5c08a-4a83-4823-aa88-ec4c826db335 service nova] Creating event network-changed:220d3bdf-7e80-4005-ba6c-054bbbffc8b7 for instance 3ad65377-4997-4c49-831e-c82240e86031 on nch1-master-1 Dec 25 21:12:07.836583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e2cfde01-48e9-4ddd-8cf5-3d600a56235f req-00d5c08a-4a83-4823-aa88-ec4c826db335 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037455 Dec 25 21:12:07.837651 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 816/1553] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:07.845241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:07.846176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] [instance: d914c615-075b-48b0-bbd9-707f0b4e084d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:07.859853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.859853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.859853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.859853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.918819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:12:07.920740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:12:07.921292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:12:07.923324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:12:07.924057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:12:07.924945 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] HTTP exception thrown: Instance d914c615-075b-48b0-bbd9-707f0b4e084d could not be found. Dec 25 21:12:07.925597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] Returning 404 to user: Instance d914c615-075b-48b0-bbd9-707f0b4e084d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:07.926463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e44f643f-d3d9-4900-84fc-a6c012ec7745 tempest-ListServerFiltersTestJSON-1422081367 tempest-ListServerFiltersTestJSON-1422081367-project] 10.222.0.32 "GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d" status: 404 len: 111 microversion: 2.1 time: 0.087499 Dec 25 21:12:07.931030 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 817/1554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:07 2021] GET /compute/v2.1/servers/d914c615-075b-48b0-bbd9-707f0b4e084d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:07.952479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.953287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.954083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:07.955317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.959422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:07.968901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.978169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.978627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:07.979437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:07.979875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:08.004561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:12:08.011399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Getting quotas for user 9bf2eefd87de409785735fc802bc95ed and project bc19d38e80ce426fa6d268838d133f13. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:12:08.044270 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75553a24-d5a0-4e7d-b99b-b07784e4409a tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.109981 Dec 25 21:12:08.045338 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 818/1555] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:07 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:08.065873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.174"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:08.065873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:08.065873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:08.065873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:08.065873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:08.065873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:08.090338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:12:08.091002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Acquired lock "refresh_cache-b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:12:08.093853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a4054058-9bcb-4981-a993-8da409df7a33',volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:08.546170 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e43d1935-dfc5-47c5-a094-a409d833ec97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.488759 Dec 25 21:12:08.547026 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 738/1556] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:12:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:12:08.552151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:08.553176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:08.562302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:08.562769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:08.563623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:08.564100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:08.618654 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-727baaac-2439-4b4a-b75f-d754a9003d6d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.070476 Dec 25 21:12:08.623095 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 739/1557] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:08 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:08.625857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:08.626769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:08.634611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:08.635144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:08.636040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:08.636712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.106791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:09.115508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:09.118210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:09.120226 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53b05242-551c-4569-8f7a-e246f45d348c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 0.499564 Dec 25 21:12:09.135018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 740/1558] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:08 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:09.371180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f730f3a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:09.373970 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:09.373970 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:09.375674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.377153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.399273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.400041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.415052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] HTTP exception thrown: Service 4ec0457a-c915-4e7d-9330-f202322ee8a3 could not be found. Dec 25 21:12:09.416077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Returning 404 to user: Service 4ec0457a-c915-4e7d-9330-f202322ee8a3 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:09.422253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a44c7c98-8da8-4a54-9cd7-4105fef4f432 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-services/4ec0457a-c915-4e7d-9330-f202322ee8a3" status: 404 len: 110 microversion: 2.53 time: 0.282655 Dec 25 21:12:09.422574 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 741/1559] 10.222.0.32 () {62 vars in 1308 bytes} [Sat Dec 25 21:12:09 2021] PUT /compute/v2.1/os-services/4ec0457a-c915-4e7d-9330-f202322ee8a3 => generated 110 bytes in 289 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:12:09.429379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4be52f9e-22b7-49da-a3de-70313278ea45 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f752b820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:09.487732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4be52f9e-22b7-49da-a3de-70313278ea45 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.062127 Dec 25 21:12:09.488488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 742/1560] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:09 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:09.497929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5348c664-3131-4883-8cbb-6f55de329a97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:09.498866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5348c664-3131-4883-8cbb-6f55de329a97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:09.570735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5348c664-3131-4883-8cbb-6f55de329a97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:09.577544 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5348c664-3131-4883-8cbb-6f55de329a97 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1052 microversion: 2.1 time: 0.087873 Dec 25 21:12:09.587232 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 743/1561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:09 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1052 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:09.592241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:09.593468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:09.600002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.600474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.601450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.601887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.665618 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51be62a1-9124-4363-a559-03e92e53ae1f tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.076745 Dec 25 21:12:09.669309 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 744/1562] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:09 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:09.676608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f6d49160>, body: {"status": "disabled"} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:09.678059 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:09.678059 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:09.680856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.681529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.692550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.693406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.712921 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] HTTP exception thrown: Service 4ec0457a-c915-4e7d-9330-f202322ee8a3 could not be found. Dec 25 21:12:09.714076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Returning 404 to user: Service 4ec0457a-c915-4e7d-9330-f202322ee8a3 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:09.716580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d639bbd1-51f8-43d5-86cf-3c87cdf624d9 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-services/4ec0457a-c915-4e7d-9330-f202322ee8a3" status: 404 len: 110 microversion: 2.53 time: 0.045426 Dec 25 21:12:09.718624 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 745/1563] 10.222.0.32 () {62 vars in 1308 bytes} [Sat Dec 25 21:12:09 2021] PUT /compute/v2.1/os-services/4ec0457a-c915-4e7d-9330-f202322ee8a3 => generated 110 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:12:09.727991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:09.730667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:09.742166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.742166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.743595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.744276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.802813 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46f52dcb-0509-4260-b4fc-3fb6e68bca19 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.080390 Dec 25 21:12:09.806440 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 746/1564] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:09 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:09.815973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f76303a0>, body: {"status": "enabled"} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:09.817774 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:09.817774 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:09.820354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.821138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.828910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.830726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.838436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] HTTP exception thrown: Service 4ec0457a-c915-4e7d-9330-f202322ee8a3 could not be found. Dec 25 21:12:09.839217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Returning 404 to user: Service 4ec0457a-c915-4e7d-9330-f202322ee8a3 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:09.841047 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e63f5e62-0596-421f-9fab-b85dc455aad8 tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-services/4ec0457a-c915-4e7d-9330-f202322ee8a3" status: 404 len: 110 microversion: 2.53 time: 0.030935 Dec 25 21:12:09.842126 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 747/1565] 10.222.0.32 () {62 vars in 1308 bytes} [Sat Dec 25 21:12:09 2021] PUT /compute/v2.1/os-services/4ec0457a-c915-4e7d-9330-f202322ee8a3 => generated 110 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:12:09.867504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da592dee-4bce-448e-8b36-150205f8b15c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:09.868783 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:09.868783 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:09.875508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da592dee-4bce-448e-8b36-150205f8b15c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.876807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da592dee-4bce-448e-8b36-150205f8b15c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.877846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da592dee-4bce-448e-8b36-150205f8b15c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.878457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da592dee-4bce-448e-8b36-150205f8b15c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.911103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da592dee-4bce-448e-8b36-150205f8b15c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.061755 Dec 25 21:12:09.912401 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 748/1566] 10.222.0.32 () {60 vars in 1177 bytes} [Sat Dec 25 21:12:09 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:09.928984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-07d62a10-f7d4-48e4-828c-689e1b0d68ec tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:09.930681 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:09.930681 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:09.934505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07d62a10-f7d4-48e4-828c-689e1b0d68ec tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.935157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07d62a10-f7d4-48e4-828c-689e1b0d68ec tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.936367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07d62a10-f7d4-48e4-828c-689e1b0d68ec tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:09.937059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07d62a10-f7d4-48e4-828c-689e1b0d68ec tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:09.992261 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-07d62a10-f7d4-48e4-828c-689e1b0d68ec tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.070934 Dec 25 21:12:09.993465 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 749/1567] 10.222.0.32 () {60 vars in 1210 bytes} [Sat Dec 25 21:12:09 2021] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:10.009093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-983dcbe4-fd97-4988-b5a7-8e50e19ad20a tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:10.010664 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:10.010664 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:10.012729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-983dcbe4-fd97-4988-b5a7-8e50e19ad20a tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.013515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-983dcbe4-fd97-4988-b5a7-8e50e19ad20a tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.014957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-983dcbe4-fd97-4988-b5a7-8e50e19ad20a tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.015676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-983dcbe4-fd97-4988-b5a7-8e50e19ad20a tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.053989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-983dcbe4-fd97-4988-b5a7-8e50e19ad20a tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.051292 Dec 25 21:12:10.055261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 750/1568] 10.222.0.32 () {60 vars in 1177 bytes} [Sat Dec 25 21:12:10 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:10.067271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20297381-9ffa-443c-9cac-08ab48758c7c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:10.071063 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:10.071063 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:10.071063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20297381-9ffa-443c-9cac-08ab48758c7c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.071063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20297381-9ffa-443c-9cac-08ab48758c7c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.071742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20297381-9ffa-443c-9cac-08ab48758c7c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.072187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20297381-9ffa-443c-9cac-08ab48758c7c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.100899 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20297381-9ffa-443c-9cac-08ab48758c7c tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.038403 Dec 25 21:12:10.101795 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 751/1569] 10.222.0.32 () {60 vars in 1236 bytes} [Sat Dec 25 21:12:10 2021] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:10.125008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d4a0fbf-5bd0-4311-98aa-812e588989ae tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:10.129437 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:10.129437 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:10.132249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a0fbf-5bd0-4311-98aa-812e588989ae tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.132731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a0fbf-5bd0-4311-98aa-812e588989ae tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.135219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a0fbf-5bd0-4311-98aa-812e588989ae tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.135780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a0fbf-5bd0-4311-98aa-812e588989ae tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.190034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d4a0fbf-5bd0-4311-98aa-812e588989ae tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.070699 Dec 25 21:12:10.196700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 752/1570] 10.222.0.32 () {60 vars in 1177 bytes} [Sat Dec 25 21:12:10 2021] GET /compute/v2.1/os-services => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:10.209182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:10.210694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:10.225825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.226265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.227264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:10.229231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:10.983322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Building network info cache for instance {{(pid=136548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:12:11.176764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:11.186706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:11.200612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:11.202099 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-509af126-454e-4015-9108-99dc21709441 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 1.004212 Dec 25 21:12:11.203165 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 753/1571] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:10 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:11.208230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b1e65f9-a60e-4292-9a98-2036dab310ca tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:11.209970 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:11.209970 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:11.217188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1e65f9-a60e-4292-9a98-2036dab310ca tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.217823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1e65f9-a60e-4292-9a98-2036dab310ca tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.218815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1e65f9-a60e-4292-9a98-2036dab310ca tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.219615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1e65f9-a60e-4292-9a98-2036dab310ca tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.273827 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b1e65f9-a60e-4292-9a98-2036dab310ca tempest-ServicesAdminNegativeV253TestJSON-1902378933 tempest-ServicesAdminNegativeV253TestJSON-1902378933-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.068491 Dec 25 21:12:11.282796 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 754/1572] 10.222.0.32 () {60 vars in 1238 bytes} [Sat Dec 25 21:12:11 2021] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:11.292333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bca86ebb-7259-451a-8c52-b0955ba48189 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f728b040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:11.405024 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bca86ebb-7259-451a-8c52-b0955ba48189 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.116697 Dec 25 21:12:11.412700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 755/1573] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:11 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:11.418904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:11.421611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:11.437874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.439160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.442051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.442667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.645200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:11.682133 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa409e87-d239-4405-b1eb-8b6b6093b5c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1158 microversion: 2.1 time: 0.266828 Dec 25 21:12:11.682133 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 756/1574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:11 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1158 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:11.701030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-85baee71-3646-4a45-87d3-5bb83b66400b req-1cb9b857-c957-4820-a2f6-9bcaeefee182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ad65377-4997-4c49-831e-c82240e86031", "name": "network-vif-deleted", "tag": "220d3bdf-7e80-4005-ba6c-054bbbffc8b7"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:11.702808 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:11.702808 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:11.733146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-85baee71-3646-4a45-87d3-5bb83b66400b req-1cb9b857-c957-4820-a2f6-9bcaeefee182 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.733590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-85baee71-3646-4a45-87d3-5bb83b66400b req-1cb9b857-c957-4820-a2f6-9bcaeefee182 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.772720 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-85baee71-3646-4a45-87d3-5bb83b66400b req-1cb9b857-c957-4820-a2f6-9bcaeefee182 service nova] Creating event network-vif-deleted:220d3bdf-7e80-4005-ba6c-054bbbffc8b7 for instance 3ad65377-4997-4c49-831e-c82240e86031 on nch1-master-1 Dec 25 21:12:11.789979 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-85baee71-3646-4a45-87d3-5bb83b66400b req-1cb9b857-c957-4820-a2f6-9bcaeefee182 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104635 Dec 25 21:12:11.791041 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 757/1575] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:11.808412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2fe83e17-4072-42a2-80b7-66d39180bff7 req-3391b617-4c6e-449d-86b2-e2be3f366f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "866da8ae-83ec-48f9-bfc8-b1a55df72844", "tag": "228dbe3e-2fc1-491d-915f-a92d1ec6406f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:11.820756 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:11.820756 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:11.846413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2fe83e17-4072-42a2-80b7-66d39180bff7 req-3391b617-4c6e-449d-86b2-e2be3f366f0a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.847239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2fe83e17-4072-42a2-80b7-66d39180bff7 req-3391b617-4c6e-449d-86b2-e2be3f366f0a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.865386 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2fe83e17-4072-42a2-80b7-66d39180bff7 req-3391b617-4c6e-449d-86b2-e2be3f366f0a service nova] Creating event network-changed:228dbe3e-2fc1-491d-915f-a92d1ec6406f for instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 on nch1-master-1 Dec 25 21:12:11.878555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2fe83e17-4072-42a2-80b7-66d39180bff7 req-3391b617-4c6e-449d-86b2-e2be3f366f0a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085946 Dec 25 21:12:11.885685 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 758/1576] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:11.896150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:11.899244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:11.926927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.927850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:11.928920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:11.931234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:12.015434 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5890970c-3727-45fe-bf6d-3f06d0c42cd0 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.128080 Dec 25 21:12:12.019131 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 759/1577] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:11 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:12.033887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:12.046169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:12.059644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:12.065733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:12.067555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:12.069165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:12.142176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac209178-f89d-436f-96cb-34e58883d1cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.121378 Dec 25 21:12:12.147772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 760/1578] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:12 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:12.524186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e55aa3db-a043-4162-88f0-ebb6989b8166 tempest-ServicesAdminNegativeV253TestJSON-256881721 tempest-ServicesAdminNegativeV253TestJSON-256881721-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:12.525575 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:12.525575 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:12.527282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e55aa3db-a043-4162-88f0-ebb6989b8166 tempest-ServicesAdminNegativeV253TestJSON-256881721 tempest-ServicesAdminNegativeV253TestJSON-256881721-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'ad9c82fc541e484cbbd8eb85ea84cb18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c4f20967bf64eaa81819ba3d4f2e37b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:12.528129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e55aa3db-a043-4162-88f0-ebb6989b8166 tempest-ServicesAdminNegativeV253TestJSON-256881721 tempest-ServicesAdminNegativeV253TestJSON-256881721-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:12.530134 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e55aa3db-a043-4162-88f0-ebb6989b8166 tempest-ServicesAdminNegativeV253TestJSON-256881721 tempest-ServicesAdminNegativeV253TestJSON-256881721-project] 10.222.0.32 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.385895 Dec 25 21:12:12.533628 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 761/1579] 10.222.0.32 () {60 vars in 1177 bytes} [Sat Dec 25 21:12:12 2021] GET /compute/v2.1/os-services => generated 112 bytes in 390 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:12:12.544763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8fb562ea-6e3f-43c8-bf6c-d1037b6093cc req-0d3d1d0b-db83-4275-b4df-60d420f1edc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01ef47d-effa-4511-a9b2-27108542948c", "name": "network-vif-plugged", "status": "completed", "tag": "9b84f1ce-b047-4065-9144-b2767da8f6e2"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:12.555140 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:12.555140 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:12.579883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8fb562ea-6e3f-43c8-bf6c-d1037b6093cc req-0d3d1d0b-db83-4275-b4df-60d420f1edc6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:12.580339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8fb562ea-6e3f-43c8-bf6c-d1037b6093cc req-0d3d1d0b-db83-4275-b4df-60d420f1edc6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:12.599931 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8fb562ea-6e3f-43c8-bf6c-d1037b6093cc req-0d3d1d0b-db83-4275-b4df-60d420f1edc6 service nova] Creating event network-vif-plugged:9b84f1ce-b047-4065-9144-b2767da8f6e2 for instance c01ef47d-effa-4511-a9b2-27108542948c on nch2-master-1 Dec 25 21:12:12.606229 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8fb562ea-6e3f-43c8-bf6c-d1037b6093cc req-0d3d1d0b-db83-4275-b4df-60d420f1edc6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071212 Dec 25 21:12:12.611191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 762/1580] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:12.616904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:12.618490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:12.631246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:12.632946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:12.633966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:12.639185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.311206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:13.320977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:13.322797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:13.324149 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc0dcd67-2636-4fac-8780-aa66b9cf35c3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 0.711373 Dec 25 21:12:13.325397 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 763/1581] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:12 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:13.330020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35fd773a-c9fb-46a8-9403-bc653b00ef94 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6935ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:13.414332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35fd773a-c9fb-46a8-9403-bc653b00ef94 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.087593 Dec 25 21:12:13.415207 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 764/1582] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:13 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:13.428318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:13.431021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:13.444392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:13.444958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.451422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:13.451422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.476310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Updating instance_info_cache with network_info: [{"id": "ad82f3ef-690a-49c9-b46f-74d324ed0682", "address": "fa:16:3e:9b:16:c3", "network": {"id": "09af6274-7110-4e9c-83cc-51d4d54a1676", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1365984648-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "188fe358c4684fce8fc912f48b3f186e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad82f3ef-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:12:13.555994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Releasing lock "refresh_cache-b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:12:13.556755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f07982eb-d2a4-435f-8277-0fe7bd5191ae tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action" status: 202 len: 0 microversion: 2.1 time: 5.510241 Dec 25 21:12:13.557602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 819/1583] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:08 2021] POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action => generated 0 bytes in 5512 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:12:13.565861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:13.565861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:13.591036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:13.591036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.591277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:13.591958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.662189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:13.674676 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-483fcbf4-9cbc-4f0d-a20b-3d0924bc0c25 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1168 microversion: 2.1 time: 0.258162 Dec 25 21:12:13.688904 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 765/1584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:13 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1168 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:13.692575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00e7172c-4e29-45ee-b864-428989afe174 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.133008 Dec 25 21:12:13.697055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 820/1585] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:13 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:13.704859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7f3df0b-3190-4545-bac0-2ddeba86a90d tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '.version_select at 0x7fa4f6b70ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:13.706010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:13.713904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:13.745820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:13.750572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.756974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:13.757545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:13.851700 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58328ea2-fcba-48d1-a3c1-30eb992ac568 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.170975 Dec 25 21:12:13.855768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 766/1586] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:13 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:14.075828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f271102c-c491-4954-9387-da6f01bde36a req-4b20fdb4-aced-4ae3-b770-b7df275579ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:14.078556 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:14.078556 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:14.094802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f271102c-c491-4954-9387-da6f01bde36a req-4b20fdb4-aced-4ae3-b770-b7df275579ff service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:14.095540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f271102c-c491-4954-9387-da6f01bde36a req-4b20fdb4-aced-4ae3-b770-b7df275579ff service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:14.114874 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f271102c-c491-4954-9387-da6f01bde36a req-4b20fdb4-aced-4ae3-b770-b7df275579ff service nova] Creating event network-changed:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:12:14.131022 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f271102c-c491-4954-9387-da6f01bde36a req-4b20fdb4-aced-4ae3-b770-b7df275579ff service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057515 Dec 25 21:12:14.133999 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 767/1587] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:12:14.325970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e7f3df0b-3190-4545-bac0-2ddeba86a90d tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/e25f6cbe-d3dd-47c7-b3a5-60e95e3624cc" status: 200 len: 184 microversion: 2.1 time: 0.621755 Dec 25 21:12:14.325970 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 821/1588] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:12:13 2021] GET /compute/v2.1/os-floating-ips/e25f6cbe-d3dd-47c7-b3a5-60e95e3624cc => generated 184 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:14.335522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.174"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:14.341967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:14.342791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:14.350564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:14.356010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:14.356010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:14.356010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:14.802060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:14.808388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:14.809147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:14.813748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:14.814373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:14.883861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:14.892795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:14.894507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:14.895688 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f3b22245-a4e9-4425-a7a1-433799c02ea8 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 0.557614 Dec 25 21:12:14.896265 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 822/1589] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:14 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:14.917776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e62cb8b4-68b0-403e-a823-1db4a8346e7f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6dc1430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:15.022850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e62cb8b4-68b0-403e-a823-1db4a8346e7f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.103723 Dec 25 21:12:15.023493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 823/1590] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:14 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:15.036789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:15.037455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:15.054509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:15.054937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:15.055759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:15.056213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:15.848406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Acquired lock "refresh_cache-b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:12:15.935977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:15.947287 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8600e1ee-9c66-47ea-b431-a9ca95c06299 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.918365 Dec 25 21:12:15.947898 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 824/1591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:15 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:15.953793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:15.955358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:15.977954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:15.978324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:15.979131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:15.980411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:16.035981 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24b18809-a124-4444-a601-8fc6be86736d tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 32579 microversion: 2.1 time: 0.080018 Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 825/1592] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:15 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 32579 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22a83542-247c-45f4-86e3-cf83e320baff tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.064690 Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 826/1593] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:16 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:16.161010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:16.162535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:16.162535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:16.818941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:16.839325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:16.847048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:16.852187 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02586c96-f488-43ec-9364-d0c3ede74369 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 0.747198 Dec 25 21:12:16.858430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 827/1594] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:16 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:16.880834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c736963-b07d-42cf-a30a-2760632d4a3b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6b12a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:16.990851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c736963-b07d-42cf-a30a-2760632d4a3b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.126948 Dec 25 21:12:16.999575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 828/1595] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:16 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:17.026986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:17.033497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:17.043785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:17.053026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:17.055541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:17.058321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:17.461526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:17.473103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ec85bef-dd1d-45fb-bd4f-ac03e13a8ca7 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.472217 Dec 25 21:12:17.473929 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 829/1596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:16 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:17.760271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Building network info cache for instance {{(pid=136547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:12:17.790694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-411499928", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "f8afa1db-6032-4635-a1fd-6997d067d021"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:17.881633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] validate_networks() for [('f8afa1db-6032-4635-a1fd-6997d067d021', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:12:18.655371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:12:18.655371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:12:18.655371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:12:18.655371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:12:18.655371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:12:18.669051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:18.674181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:18.676995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:18.678421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:18.714125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Getting quotas for project 576fa0b7a73d45bc86b799bb25424c30. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:12:18.719893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Getting quotas for user f157276b2f2845258ce93423249ed74d and project 576fa0b7a73d45bc86b799bb25424c30. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:12:18.746075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Going to run 2 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:12:18.748953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: e6e849be-8c7b-429d-b691-8ec676c68caa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:18.865587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=e6e849be-8c7b-429d-b691-8ec676c68caa,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:19.058736 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ef24a3d-8c4b-4994-ac12-727f515c2adc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.583513 Dec 25 21:12:19.066674 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 830/1597] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:12:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:12:19.087488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:19.088502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:19.102944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.105603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.109033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.112805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.203726 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a8b30d46-51e3-4f24-b59c-4b6063dfc770 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action" status: 200 len: 40730 microversion: 2.1 time: 0.135610 Dec 25 21:12:19.209630 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 831/1598] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:19 2021] POST /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5/action => generated 40730 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:19.220480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:19.221829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:19.229871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.230559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.231590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.232244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.329388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Updating instance_info_cache with network_info: [{"id": "ad82f3ef-690a-49c9-b46f-74d324ed0682", "address": "fa:16:3e:9b:16:c3", "network": {"id": "09af6274-7110-4e9c-83cc-51d4d54a1676", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1365984648-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "188fe358c4684fce8fc912f48b3f186e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tapad82f3ef-69", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:12:19.331785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2d159ae-ae41-460e-b4c9-9c4592bc0887 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.118463 Dec 25 21:12:19.335362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 832/1599] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:19 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:19.343985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4cb85315-4f35-48a1-9bf0-ee29074c17a0 req-096cc7c0-5b44-4090-a753-a0fa46b7e608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:19.346389 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:19.346389 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:19.376161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4cb85315-4f35-48a1-9bf0-ee29074c17a0 req-096cc7c0-5b44-4090-a753-a0fa46b7e608 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.377582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4cb85315-4f35-48a1-9bf0-ee29074c17a0 req-096cc7c0-5b44-4090-a753-a0fa46b7e608 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.395513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4cb85315-4f35-48a1-9bf0-ee29074c17a0 req-096cc7c0-5b44-4090-a753-a0fa46b7e608 service nova] Creating event network-changed:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:12:19.405534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4cb85315-4f35-48a1-9bf0-ee29074c17a0 req-096cc7c0-5b44-4090-a753-a0fa46b7e608 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063231 Dec 25 21:12:19.406300 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 833/1600] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:19.419934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:19.421215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:19.430609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.431140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.432150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.439780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Releasing lock "refresh_cache-b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:12:19.441409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-749660f2-490a-4545-80f3-c8f476d9f112 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action" status: 202 len: 0 microversion: 2.1 time: 5.111677 Dec 25 21:12:19.443608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 768/1601] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:14 2021] POST /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653/action => generated 0 bytes in 5115 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:12:19.450226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.455041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21830020-3058-4a9d-800f-3f8b3f5a0779 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f752bf70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:19.527288 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21830020-3058-4a9d-800f-3f8b3f5a0779 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.082064 Dec 25 21:12:19.528281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 769/1602] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:19 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:19.534293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:19.535185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:19.542712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.546460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:19.547628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:19.548210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.226205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.228974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.236515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.238938 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87b4b7ae-ae3b-4519-9c35-2efd3e689977 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.707587 Dec 25 21:12:20.239222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.239350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 770/1603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:19 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:20.240468 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f2031b2-1016-47c9-9d17-494cadbead83 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 0.832956 Dec 25 21:12:20.241570 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 834/1604] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:19 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:20.246132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:20.247235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4d3db0f9-5c57-41be-bb6b-cd3350670308 req-ed67eb07-5c18-4414-b6a3-9be0b992f2ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866da8ae-83ec-48f9-bfc8-b1a55df72844", "name": "network-vif-plugged", "status": "completed", "tag": "228dbe3e-2fc1-491d-915f-a92d1ec6406f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:20.250951 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:20.250951 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:20.251875 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:20.251875 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:20.252510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.253466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Searching by: {'deleted': False, 'project_id': '576fa0b7a73d45bc86b799bb25424c30'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:12:20.274319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.279839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.279839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.279839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.280124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4d3db0f9-5c57-41be-bb6b-cd3350670308 req-ed67eb07-5c18-4414-b6a3-9be0b992f2ae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.280124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4d3db0f9-5c57-41be-bb6b-cd3350670308 req-ed67eb07-5c18-4414-b6a3-9be0b992f2ae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.309572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4d3db0f9-5c57-41be-bb6b-cd3350670308 req-ed67eb07-5c18-4414-b6a3-9be0b992f2ae service nova] Creating event network-vif-plugged:228dbe3e-2fc1-491d-915f-a92d1ec6406f for instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 on nch1-master-1 Dec 25 21:12:20.317003 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4d3db0f9-5c57-41be-bb6b-cd3350670308 req-ed67eb07-5c18-4414-b6a3-9be0b992f2ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076941 Dec 25 21:12:20.323176 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 771/1605] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:20.323318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-759b9538-e097-4aee-99d2-21a1fe09abc3 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.079283 Dec 25 21:12:20.324759 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 835/1606] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:12:20 2021] GET /compute/v2.1/servers => generated 675 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:20.331123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:20.332044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:20.339772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.340582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.341888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.342555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.351373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:20.354974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:20.376354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.386466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.386466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:20.386466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:20.386755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] HTTP exception thrown: Instance 3ad65377-4997-4c49-831e-c82240e86031 could not be found. Dec 25 21:12:20.386755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Returning 404 to user: Instance 3ad65377-4997-4c49-831e-c82240e86031 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:20.386755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-999b4c91-ea4f-4f25-84d9-95b7965e2435 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 404 len: 111 microversion: 2.1 time: 0.055137 Dec 25 21:12:20.387947 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 836/1607] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:20 2021] DELETE /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:20.593423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-867628064", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:20.670691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:12:20.825921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.838018 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19ddf377-f183-4a6a-a6e6-e79e1c939e36 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1706 microversion: 2.1 time: 0.500144 Dec 25 21:12:20.842065 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 772/1608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:20 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1706 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:20.847975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81d0e013-5349-4d2e-8d4d-d7351fad3637 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:20.848813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81d0e013-5349-4d2e-8d4d-d7351fad3637 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:20.982199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81d0e013-5349-4d2e-8d4d-d7351fad3637 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:20.993572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81d0e013-5349-4d2e-8d4d-d7351fad3637 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1219 microversion: 2.1 time: 0.150045 Dec 25 21:12:20.994399 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 773/1609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:20 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:21.001546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:21.002762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:21.011403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.012212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.013142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.013917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.088788 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ffabf195-63f5-4029-ab52-5f00666dea70 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.092813 Dec 25 21:12:21.093460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 774/1610] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:20 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:21.099360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:21.100449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: 3ad65377-4997-4c49-831e-c82240e86031] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:21.108642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.109427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.111635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.112667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.132025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] HTTP exception thrown: Instance 3ad65377-4997-4c49-831e-c82240e86031 could not be found. Dec 25 21:12:21.132641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Returning 404 to user: Instance 3ad65377-4997-4c49-831e-c82240e86031 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:21.133750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0087310-ad9e-4894-832c-5b406812ad0e tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031" status: 404 len: 111 microversion: 2.1 time: 0.038535 Dec 25 21:12:21.134099 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 775/1611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:21 2021] GET /compute/v2.1/servers/3ad65377-4997-4c49-831e-c82240e86031 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:21.135396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:12:21.136027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:12:21.136748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:12:21.137868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:12:21.138333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:12:21.142172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-175709b8-a086-43c3-aceb-d6a863a3f598 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6881e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:21.150066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.150816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.152702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.160099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.174980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Getting quotas for project 8b80d743dc6342a689968320db7836a0. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:12:21.181737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Getting quotas for user 8987227b269944619441e94b3876d311 and project 8b80d743dc6342a689968320db7836a0. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:12:21.197012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:12:21.199696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:21.209054 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-175709b8-a086-43c3-aceb-d6a863a3f598 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.073764 Dec 25 21:12:21.214884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 776/1612] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:21 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:21.214884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab119561-c7ac-431a-a4e8-a02277fd24dd tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '.version_select at 0x7fa4f6da9160>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:21.770417 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7f02214-7485-4c10-9ea1-0b57c3e4e6ad tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.381180 Dec 25 21:12:21.773011 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 837/1613] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:12:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:12:21.785388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:21.786223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:21.800581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.802658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:21.807669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:21.808369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.068044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.084846 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03874861-ba77-414d-b7de-bfebd56cec8f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.304290 Dec 25 21:12:22.085930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 838/1614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:21 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:22.093817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.098355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:22.106583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.106979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.107806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.108248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.300213 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab119561-c7ac-431a-a4e8-a02277fd24dd tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/e25f6cbe-d3dd-47c7-b3a5-60e95e3624cc" status: 202 len: 0 microversion: 2.1 time: 1.089002 Dec 25 21:12:22.301225 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 777/1615] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:12:21 2021] DELETE /compute/v2.1/os-floating-ips/e25f6cbe-d3dd-47c7-b3a5-60e95e3624cc => generated 0 bytes in 1091 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:12:22.306306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-101fa12c-d776-4351-b2c5-475da78ec73e req-a6ad118d-5922-4dd7-b0a0-d71c1028e246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9cb266-1a4b-41a7-b9c4-55bc33979d91", "tag": "665e512c-6adc-4461-b6ed-9ce93d1fdeee"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:22.307947 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:22.307947 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:22.320073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-101fa12c-d776-4351-b2c5-475da78ec73e req-a6ad118d-5922-4dd7-b0a0-d71c1028e246 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.320522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-101fa12c-d776-4351-b2c5-475da78ec73e req-a6ad118d-5922-4dd7-b0a0-d71c1028e246 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.332403 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-101fa12c-d776-4351-b2c5-475da78ec73e req-a6ad118d-5922-4dd7-b0a0-d71c1028e246 service nova] Creating event network-changed:665e512c-6adc-4461-b6ed-9ce93d1fdeee for instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 on nch2-master-1 Dec 25 21:12:22.338198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-101fa12c-d776-4351-b2c5-475da78ec73e req-a6ad118d-5922-4dd7-b0a0-d71c1028e246 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035592 Dec 25 21:12:22.338952 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 778/1616] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:22.343990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.347669 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:22.347669 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:22.349100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.350035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Searching by: {'deleted': False, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:12:22.355881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.356554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.357592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.358201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.398552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:12:22.430713 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-890b37b9-be07-472a-b64f-e70f1c90dfb3 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.090387 Dec 25 21:12:22.431627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 779/1617] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:12:22 2021] GET /compute/v2.1/servers => generated 339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:22.444443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6487805d-61b6-4ec2-9785-5d22af09fd8d tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.445227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6487805d-61b6-4ec2-9785-5d22af09fd8d tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:22.445414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.463019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.463019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.463019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ffa7a84c-29ec-4372-9993-bacef5ffaa57 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1281 microversion: 2.25 time: 0.371857 Dec 25 21:12:22.463019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 839/1618] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:22 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:22.484593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.485812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:22.501069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.501528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.502375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.503567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.544219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6487805d-61b6-4ec2-9785-5d22af09fd8d tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.551877 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6487805d-61b6-4ec2-9785-5d22af09fd8d tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1213 microversion: 2.1 time: 0.119109 Dec 25 21:12:22.552628 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 780/1619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:22 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:22.557683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:22.558716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:22.568122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.568720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.569612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.570279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.613247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.614610 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-678df151-c146-4256-9a2a-25dfcdbeab1d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.060627 Dec 25 21:12:22.618560 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 781/1620] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:22 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:22.623681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3535ba60-f5fb-4cc5-b291-7f235f4197d3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f68811f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.626039 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b44c4ecc-87c7-40fd-ae32-f3e037169b29 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1215 microversion: 2.1 time: 0.161780 Dec 25 21:12:22.627712 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 840/1621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:22 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1215 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:22.650781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.650900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:22.664443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.664901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.671285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.672088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.693270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3535ba60-f5fb-4cc5-b291-7f235f4197d3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.074152 Dec 25 21:12:22.699766 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 782/1622] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:22 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:22.707558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:22.717145 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:22.717145 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:22.718839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.721657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Searching by: {'deleted': False, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:12:22.729107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.729801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.732045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.737006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:22.754281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:22.769984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:12:22.819999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:22.828170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:22.829518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.141718 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-72605e97-aeed-4f7a-be8c-7a82fd5539b6 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 0.442868 Dec 25 21:12:23.142460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 783/1623] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:12:22 2021] GET /compute/v2.1/servers/detail => generated 1709 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:23.147101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:23.148077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:23.157846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:23.158299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.159606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:23.160232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.297005 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45dc65ef-c109-424a-9964-1f35baca21e5 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 204 len: 0 microversion: 2.1 time: 0.667374 Dec 25 21:12:23.297867 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 841/1624] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:22 2021] DELETE /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:23.304182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f2d547a-685b-48b4-b7db-7d787508687b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:23.318931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f2d547a-685b-48b4-b7db-7d787508687b tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019418 Dec 25 21:12:23.325216 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 842/1625] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:12:23 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:23.325748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:23.337112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:23.366001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:23.366523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.367597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:23.368244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.847767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:23.871511 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-100af3c2-fe71-4ef8-93f6-9aa1b59a4957 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.727722 Dec 25 21:12:23.872935 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 784/1626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:23 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:23.895605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:23.903294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:23.915386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:23.917475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.924184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:23.924951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:23.941743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:23.961506 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d746b77c-e23a-4a51-bad7-90725eafc4b3 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1525 microversion: 2.1 time: 0.639319 Dec 25 21:12:23.965301 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 843/1627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:23 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1525 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:23.980403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:23.981138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:24.000195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.000685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.001538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.001974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.122873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:24.130722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b2c51ba-e586-4cf9-8c22-ae1ba0b528d9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1265 microversion: 2.1 time: 0.163722 Dec 25 21:12:24.131511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 844/1628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:23 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:24.140148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:24.142695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:24.167035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.167510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.168515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.168980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.217455 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-16b4fcb7-e613-483d-9a1f-7b12dc9d243c tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.082786 Dec 25 21:12:24.221977 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 845/1629] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:24 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:24.235937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:24.240508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:24.241415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:24.253235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:24.258160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:24.271960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.272418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.273456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.273811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.276434 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ae340a3-5488-46d7-87f6-2546315d77cb tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1476 microversion: 2.25 time: 0.388385 Dec 25 21:12:24.277476 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 785/1630] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:23 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:24.283836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:24.284813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:24.294110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.300111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.301320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.310264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.371421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:24.400063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:24.416029 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40491c72-af12-4b92-b15a-9e641048ded8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1277 microversion: 2.1 time: 0.195493 Dec 25 21:12:24.428378 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 846/1631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:24 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:24.433551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f887da50-e692-43c7-9de7-01050ccb6938 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6b02ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:24.530986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f887da50-e692-43c7-9de7-01050ccb6938 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.101160 Dec 25 21:12:24.533115 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 847/1632] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:24 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:24.538061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:24.539716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:24.546190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.546850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.559326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.561000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.816103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f3cfb9d-abac-4ed8-b667-4017372c9700 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 204 len: 0 microversion: 2.1 time: 0.537244 Dec 25 21:12:24.817398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 786/1633] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:24 2021] DELETE /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:24.826908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:24.827883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:24.835365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.835876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:24.836683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:24.837162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:25.534874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 866da8ae-83ec-48f9-bfc8-b1a55df72844 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:25.550592 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48f264c0-d42b-4c2b-8e54-c2b0b0e2ee7b tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1969 microversion: 2.25 time: 1.016212 Dec 25 21:12:25.551345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 848/1634] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:24 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1969 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:25.555781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:25.556392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:25.563654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:25.564112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:25.565196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:25.565637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:25.746358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:25.755451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-660e9b95-4f42-4ec4-b19d-03a32e6dad40 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1712 microversion: 2.1 time: 0.933585 Dec 25 21:12:25.766745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 787/1635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:24 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1712 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:25.766745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:25.766745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:25.769719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:25.770267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:25.771078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:25.771519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.087755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:26.096443 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e10ecb8-d7c0-4e0f-a89c-fc07b294eb60 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.543868 Dec 25 21:12:26.097965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 849/1636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:25 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:26.103579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:26.104405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:26.111998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.112656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.113783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.114386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.262844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:26.275448 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-59489a99-03d7-4d83-a008-e2f293730cda tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1271 microversion: 2.1 time: 0.175305 Dec 25 21:12:26.276050 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 850/1637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:26 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:26.280399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:26.290555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:26.296720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.297771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.298571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.299003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.372956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fbca7c2a-57c2-4a24-97ac-7a9932554258 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.095628 Dec 25 21:12:26.373901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 851/1638] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:26 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:26.385194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:26.386199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:26.397956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.399193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.399193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.399606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.532574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:26.547180 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9bd7f529-7da2-44fe-9cfb-d41715155f41 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1525 microversion: 2.1 time: 0.789755 Dec 25 21:12:26.548136 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 788/1639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:25 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1525 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:26.559592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:26.566142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-784cab28-9eca-4ccb-bce4-472cb05ef65a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6d49940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:26.570226 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-594a80c9-eb2c-438b-b2a8-451e464f996e tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1277 microversion: 2.1 time: 0.194962 Dec 25 21:12:26.585780 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 852/1640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:26 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:26.590607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:26.597026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:26.606598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.610520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.612490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.613311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.647744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-784cab28-9eca-4ccb-bce4-472cb05ef65a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1440 microversion: 2.1 time: 0.098216 Dec 25 21:12:26.648687 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 789/1641] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:26 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1440 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:26.654791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e9c77d38-a7af-4f21-a27e-999f50919519 req-22f8aab1-0b45-4183-bbd4-69235483c9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9cb266-1a4b-41a7-b9c4-55bc33979d91", "name": "network-vif-plugged", "status": "completed", "tag": "665e512c-6adc-4461-b6ed-9ce93d1fdeee"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:26.657153 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:26.657153 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:26.676508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e9c77d38-a7af-4f21-a27e-999f50919519 req-22f8aab1-0b45-4183-bbd4-69235483c9aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.676508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e9c77d38-a7af-4f21-a27e-999f50919519 req-22f8aab1-0b45-4183-bbd4-69235483c9aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.693552 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e9c77d38-a7af-4f21-a27e-999f50919519 req-22f8aab1-0b45-4183-bbd4-69235483c9aa service nova] Creating event network-vif-plugged:665e512c-6adc-4461-b6ed-9ce93d1fdeee for instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 on nch2-master-1 Dec 25 21:12:26.700053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e9c77d38-a7af-4f21-a27e-999f50919519 req-22f8aab1-0b45-4183-bbd4-69235483c9aa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049750 Dec 25 21:12:26.701998 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 790/1642] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:26.776405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:26.778656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:26.807031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.807489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:26.808310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:26.808714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.135294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 866da8ae-83ec-48f9-bfc8-b1a55df72844 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:27.152378 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b20b425a-fd32-456f-b3a0-0110e9596eb0 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1969 microversion: 2.25 time: 0.565263 Dec 25 21:12:27.164634 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 853/1643] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:26 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1969 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:27.173876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:27.175406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:27.182458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.183195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.184273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.184851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.265621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:27.272997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-699cdfee-9d45-45ba-9014-17203b046278 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1712 microversion: 2.1 time: 0.503498 Dec 25 21:12:27.273616 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 791/1644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:26 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1712 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:27.283364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6774cc3d-691a-4ecf-b734-edeab59fa13e req-cc8f78b7-67e4-456e-9975-566d06cfc4a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "name": "network-vif-deleted", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:27.284955 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:27.284955 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:27.295648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6774cc3d-691a-4ecf-b734-edeab59fa13e req-cc8f78b7-67e4-456e-9975-566d06cfc4a3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.295648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6774cc3d-691a-4ecf-b734-edeab59fa13e req-cc8f78b7-67e4-456e-9975-566d06cfc4a3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.304218 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6774cc3d-691a-4ecf-b734-edeab59fa13e req-cc8f78b7-67e4-456e-9975-566d06cfc4a3 service nova] Creating event network-vif-deleted:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:12:27.309235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6774cc3d-691a-4ecf-b734-edeab59fa13e req-cc8f78b7-67e4-456e-9975-566d06cfc4a3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030257 Dec 25 21:12:27.309933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 792/1645] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:27.315384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf3d7dd2-8b6c-4d9c-9554-fa168eeff559 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:27.316719 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:27.316719 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:27.318965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf3d7dd2-8b6c-4d9c-9554-fa168eeff559 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.319428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf3d7dd2-8b6c-4d9c-9554-fa168eeff559 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.320267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf3d7dd2-8b6c-4d9c-9554-fa168eeff559 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.320708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf3d7dd2-8b6c-4d9c-9554-fa168eeff559 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.345228 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf3d7dd2-8b6c-4d9c-9554-fa168eeff559 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.034063 Dec 25 21:12:27.345826 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 793/1646] 10.222.0.32 () {60 vars in 1216 bytes} [Sat Dec 25 21:12:27 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:27.350294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:27.351009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:27.357585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.358117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.359007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.359669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.475198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:27.482758 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5f8d3d5-bb19-46f4-914c-ed632b021b47 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1271 microversion: 2.1 time: 0.135701 Dec 25 21:12:27.491713 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 794/1647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:27 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:27.505034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": "auto"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:27.507547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:27.519461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.519915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.520721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.521258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.564010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'flavor' on Instance uuid 866da8ae-83ec-48f9-bfc8-b1a55df72844 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:27.567084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:27.583889 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-310bf5f4-4d6e-43b5-9062-a38eb0d47140 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1198 microversion: 2.1 time: 0.414368 Dec 25 21:12:27.588766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 854/1648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:27 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1198 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:27.601699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:27.605256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:27.605466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Going to try to live migrate instance to nch2-master-1 {{(pid=136547) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:12:27.634540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.635265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.637496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.638162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.693290 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4727c4ca-ce86-4557-be8a-3d2a60295713 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.102829 Dec 25 21:12:27.694490 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 855/1649] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:27 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:27.699642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:27.700670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:27.710725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.713427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.714550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.715172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.754925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.755571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.756187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lazy-loading 'fault' on Instance uuid b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:27.848842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b58b521d0334474e9f919c5d75289c78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '188fe358c4684fce8fc912f48b3f186e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:27.861182 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0aebf811-0e56-4d54-aae4-9a9698df2175 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 200 len: 1313 microversion: 2.1 time: 0.165292 Dec 25 21:12:27.862181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 856/1650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:27 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:27.867575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:27.880309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:27.880309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.880309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:27.880309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:27.882505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:28.259432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:28.267730 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c224898b-3638-4ae4-91c1-6a3bfaf64fd9 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 0.404484 Dec 25 21:12:28.278126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 857/1651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:27 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:28.281656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3da6071-c34b-425d-bf77-5ebd826566ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6dc1550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:28.398275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3da6071-c34b-425d-bf77-5ebd826566ec tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1449 microversion: 2.1 time: 0.118457 Dec 25 21:12:28.410849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 858/1652] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:28 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1449 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:28.575122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-43c2b51b-cade-4d34-b323-6a2e1c22deb9 req-e4734caf-ca3a-4d8e-ab08-3dd76b1ea584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e17b1ffc-cea0-4158-9ac3-273da9149cd5", "name": "network-vif-deleted", "tag": "d2192e86-fcbc-467e-974d-50439566abff"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:28.576722 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:28.576722 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:28.587837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-43c2b51b-cade-4d34-b323-6a2e1c22deb9 req-e4734caf-ca3a-4d8e-ab08-3dd76b1ea584 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:28.590663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-43c2b51b-cade-4d34-b323-6a2e1c22deb9 req-e4734caf-ca3a-4d8e-ab08-3dd76b1ea584 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:28.617326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-43c2b51b-cade-4d34-b323-6a2e1c22deb9 req-e4734caf-ca3a-4d8e-ab08-3dd76b1ea584 service nova] Creating event network-vif-deleted:d2192e86-fcbc-467e-974d-50439566abff for instance e17b1ffc-cea0-4158-9ac3-273da9149cd5 on nch2-master-1 Dec 25 21:12:28.628787 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-43c2b51b-cade-4d34-b323-6a2e1c22deb9 req-e4734caf-ca3a-4d8e-ab08-3dd76b1ea584 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214745 Dec 25 21:12:28.635623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 859/1653] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:28.648635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:28.650087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:28.672709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:28.673409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:28.674838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:28.675854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:28.720619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:28.721554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:28.722270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lazy-loading 'fault' on Instance uuid e17b1ffc-cea0-4158-9ac3-273da9149cd5 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:28.790936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888bca4c195e4f3185e32e956e256b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa6a09f9e43475e8a7f5639f59b1654', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:28.813767 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-382a5267-c2f8-48a1-bcaf-4ac53451b7e8 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 200 len: 1367 microversion: 2.1 time: 0.162298 Dec 25 21:12:28.819254 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 860/1654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:28 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:28.828852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-081e083e-e63e-4f22-85ec-c293c7ca5078 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6d8b790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:28.909117 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-081e083e-e63e-4f22-85ec-c293c7ca5078 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 200 len: 1449 microversion: 2.1 time: 0.088596 Dec 25 21:12:28.919748 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 861/1655] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:28 2021] GET /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 1449 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:28.923452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:28.924952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:28.941691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:28.942124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:28.943062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:28.943737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.297305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:29.309374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-77e61451-f303-4f98-9892-9512fbcb60ba tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.392365 Dec 25 21:12:29.315302 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 862/1656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:28 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:29.325401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:29.327466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:29.348358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.350273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.352956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.353581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.758961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:29.776402 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-34f9b048-06d8-48b5-b81e-1e799b63a8a8 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1381 microversion: 2.1 time: 0.459965 Dec 25 21:12:29.777305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 863/1657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:29 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1381 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:29.794899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:29.796290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:29.806426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.806891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.813395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.813395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.858314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fcb507fd-7fc8-4ad5-9d19-a54e804b7a37 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.068125 Dec 25 21:12:29.865714 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 864/1658] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:29 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:29.876477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-79c96168-5192-4b6c-ae55-dd6925780526 req-9906701f-504f-4646-8950-97f173433cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b82ed20c-bbfc-4030-a8bc-ab9fae2d2653", "name": "network-vif-unplugged", "status": "completed", "tag": "ad82f3ef-690a-49c9-b46f-74d324ed0682"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:29.878943 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:29.878943 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:29.887184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-79c96168-5192-4b6c-ae55-dd6925780526 req-9906701f-504f-4646-8950-97f173433cb9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.887634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-79c96168-5192-4b6c-ae55-dd6925780526 req-9906701f-504f-4646-8950-97f173433cb9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.900223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-79c96168-5192-4b6c-ae55-dd6925780526 req-9906701f-504f-4646-8950-97f173433cb9 service nova] Creating event network-vif-unplugged:ad82f3ef-690a-49c9-b46f-74d324ed0682 for instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 on nch2-master-1 Dec 25 21:12:29.905459 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-79c96168-5192-4b6c-ae55-dd6925780526 req-9906701f-504f-4646-8950-97f173433cb9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038518 Dec 25 21:12:29.906661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 865/1659] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:29.913680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:29.915029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] [instance: b82ed20c-bbfc-4030-a8bc-ab9fae2d2653] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:29.922600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.923477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.924928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:29.925434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:29.942809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] HTTP exception thrown: Instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 could not be found. Dec 25 21:12:29.949651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] Returning 404 to user: Instance b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:29.950642 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b75f2dc1-6d97-4d98-bc15-aff3c5ef74f2 tempest-FloatingIPsAssociationTestJSON-622699030 tempest-FloatingIPsAssociationTestJSON-622699030-project] 10.222.0.32 "GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653" status: 404 len: 111 microversion: 2.1 time: 0.042707 Dec 25 21:12:29.955315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 866/1660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:29 2021] GET /compute/v2.1/servers/b82ed20c-bbfc-4030-a8bc-ab9fae2d2653 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:29.960711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13179006-0d16-4f4e-939e-781b25f118f7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f70864c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.337006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13179006-0d16-4f4e-939e-781b25f118f7 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 204 len: 0 microversion: 2.1 time: 1.380075 Dec 25 21:12:31.337694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 867/1661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:29 2021] DELETE /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 0 bytes in 1382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:31.342359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.343004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.349158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.349684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.350564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.351081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.459648 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87657091-00c5-474f-a913-bd9f4b17de66 tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844/action" status: 202 len: 0 microversion: 2.25 time: 3.966474 Dec 25 21:12:31.460497 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 795/1662] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:12:27 2021] POST /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844/action => generated 0 bytes in 3968 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:31.465349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-75543c1f-5669-412a-a8f3-0f0f6a845dfa req-decd9935-2bae-4df2-8609-76e7f9b6725b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e849be-8c7b-429d-b691-8ec676c68caa", "tag": "f2815b7b-7409-4ce5-8cb9-55075ef4d0f3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:31.466765 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:31.466765 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:31.480376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-75543c1f-5669-412a-a8f3-0f0f6a845dfa req-decd9935-2bae-4df2-8609-76e7f9b6725b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.480819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-75543c1f-5669-412a-a8f3-0f0f6a845dfa req-decd9935-2bae-4df2-8609-76e7f9b6725b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.496662 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-75543c1f-5669-412a-a8f3-0f0f6a845dfa req-decd9935-2bae-4df2-8609-76e7f9b6725b service nova] Creating event network-changed:f2815b7b-7409-4ce5-8cb9-55075ef4d0f3 for instance e6e849be-8c7b-429d-b691-8ec676c68caa on nch1-master-1 Dec 25 21:12:31.497238 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-75543c1f-5669-412a-a8f3-0f0f6a845dfa req-decd9935-2bae-4df2-8609-76e7f9b6725b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Dec 25 21:12:31.497842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 796/1663] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:31.502541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.503209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.509217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.509661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.510448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.510924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.619819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:31.628990 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea8f4e90-c647-42d4-909c-a62fb5473920 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 0.290363 Dec 25 21:12:31.629581 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 868/1664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:31 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:31.634034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.634648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] [instance: e17b1ffc-cea0-4158-9ac3-273da9149cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.640496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.640990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.641787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.642227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.656725 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] HTTP exception thrown: Instance e17b1ffc-cea0-4158-9ac3-273da9149cd5 could not be found. Dec 25 21:12:31.657470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Returning 404 to user: Instance e17b1ffc-cea0-4158-9ac3-273da9149cd5 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:31.658376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3036a869-a2a1-416d-b7e4-5c803316ec04 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5" status: 404 len: 111 microversion: 2.1 time: 0.027881 Dec 25 21:12:31.661998 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 869/1665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:31 2021] GET /compute/v2.1/servers/e17b1ffc-cea0-4158-9ac3-273da9149cd5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:31.664029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.664796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.670582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.671031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.671814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.672909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.842418 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea09d208-6502-4af1-a7c6-ba58399ce9b1 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1532 microversion: 2.1 time: 0.343340 Dec 25 21:12:31.853535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 797/1666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:31 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1532 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:31.858377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-10bc384e-d0c1-4f76-be42-ea0be8dd0122 req-3fdc8483-ae92-499d-a007-8bfd569fc41f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c12cba1c-049e-4a5a-8f24-4f33cf7df89c", "tag": "9423691b-100e-4a18-9d2b-f2b8781dd071"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:31.859932 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:31.859932 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:31.867250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-10bc384e-d0c1-4f76-be42-ea0be8dd0122 req-3fdc8483-ae92-499d-a007-8bfd569fc41f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.867540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-10bc384e-d0c1-4f76-be42-ea0be8dd0122 req-3fdc8483-ae92-499d-a007-8bfd569fc41f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.882390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-10bc384e-d0c1-4f76-be42-ea0be8dd0122 req-3fdc8483-ae92-499d-a007-8bfd569fc41f service nova] Creating event network-changed:9423691b-100e-4a18-9d2b-f2b8781dd071 for instance c12cba1c-049e-4a5a-8f24-4f33cf7df89c on nch1-master-1 Dec 25 21:12:31.883930 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-10bc384e-d0c1-4f76-be42-ea0be8dd0122 req-3fdc8483-ae92-499d-a007-8bfd569fc41f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029177 Dec 25 21:12:31.884529 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 798/1667] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:31.890193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:31.891475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.897708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.898401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.899138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.900564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.946744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-163ccd07-4262-4697-acac-e41bdf3adc6f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.060545 Dec 25 21:12:31.951774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 799/1668] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:31 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:31.958431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.959317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.964169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:31.968350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.969726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.970755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.971412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.977569 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08f626dd-bb39-4429-af2e-aa51084d63ea tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.317499 Dec 25 21:12:31.984050 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 870/1669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:31 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:31.989926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:31.990647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:31.996742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.997720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:31.998280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:31.998821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:32.017224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:32.338554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:32.351776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:32.355531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:32.358429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-271a1e12-d7e5-46b9-98f1-dec1ca54ea9a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.372964 Dec 25 21:12:32.359655 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 871/1670] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:31 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:32.365261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e4c29fc-f870-45d4-8fbc-a19071269fd9 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] Calling method '.version_select at 0x7fa4f6acdf70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:32.422775 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a7d399a-45e8-49b5-bc4b-6831d97caef8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 204 len: 0 microversion: 2.1 time: 0.468764 Dec 25 21:12:32.423385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 800/1671] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:31 2021] DELETE /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:32.428616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:32.429552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:32.446106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:32.447754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:32.448830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:32.449291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:32.528550 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e4c29fc-f870-45d4-8fbc-a19071269fd9 tempest-ServersTestManualDisk-494677233 tempest-ServersTestManualDisk-494677233-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900331492" status: 202 len: 0 microversion: 2.1 time: 0.166735 Dec 25 21:12:32.529551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 872/1672] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:12:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900331492 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:12:32.616737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e345d5f4-4736-4555-8839-56d83b4d1289 req-3d0a7176-85f0-43f5-8c83-3b97f932192a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01ef47d-effa-4511-a9b2-27108542948c", "name": "network-vif-unplugged", "status": "completed", "tag": "9b84f1ce-b047-4065-9144-b2767da8f6e2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:32.616737 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:32.616737 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:32.623964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e345d5f4-4736-4555-8839-56d83b4d1289 req-3d0a7176-85f0-43f5-8c83-3b97f932192a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:32.624644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e345d5f4-4736-4555-8839-56d83b4d1289 req-3d0a7176-85f0-43f5-8c83-3b97f932192a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:32.643208 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e345d5f4-4736-4555-8839-56d83b4d1289 req-3d0a7176-85f0-43f5-8c83-3b97f932192a service nova] Creating event network-vif-unplugged:9b84f1ce-b047-4065-9144-b2767da8f6e2 for instance c01ef47d-effa-4511-a9b2-27108542948c on nch2-master-1 Dec 25 21:12:32.650104 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e345d5f4-4736-4555-8839-56d83b4d1289 req-3d0a7176-85f0-43f5-8c83-3b97f932192a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118762 Dec 25 21:12:32.651126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 873/1673] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:32 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:32.661616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-32527846", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "6dded111-84d7-4606-bd1c-e9369354dff9"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:32.738553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] validate_networks() for [('6dded111-84d7-4606-bd1c-e9369354dff9', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:12:33.036455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a808b7e2-896c-4fb9-beee-f922c048cb62 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1532 microversion: 2.1 time: 0.611682 Dec 25 21:12:33.037546 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 801/1674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:32 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1532 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:33.042251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:33.043127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:33.050413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.051205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.052012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.052601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.730461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:33.740976 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89751239-055a-4732-b436-32fdd66438b6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 0.701907 Dec 25 21:12:33.742339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 802/1675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:33 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:33.755975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:33.761901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:33.773994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.774728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.776146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.776748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.865414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-149b0034-3af2-4074-b6a0-a2f5cf09a3f1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.120394 Dec 25 21:12:33.866850 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 803/1676] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:33 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:33.872761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:33.877263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:33.894626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.898061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.899133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.900452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.941816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:12:33.942671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:12:33.942782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:12:33.943457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:12:33.944127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:12:33.959235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.963738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:33.967855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:33.971436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.009293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:12:34.022511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Getting quotas for user 613e2533f4e04cca8fafc3ea463accd9 and project 74b18f04a1eb470bac90f3df16ec5170. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:12:34.035972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:12:34.038949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:34.221981 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5135e6ee-f6d0-41ca-832c-abb64366ff55 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.569643 Dec 25 21:12:34.223518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 874/1677] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:12:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 1572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:12:34.228463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aaeea6e5-4347-4edd-b72d-1cfb5b424f12 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:34.229977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:34.231019 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:34.231019 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:34.233140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaeea6e5-4347-4edd-b72d-1cfb5b424f12 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.235337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaeea6e5-4347-4edd-b72d-1cfb5b424f12 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.236596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaeea6e5-4347-4edd-b72d-1cfb5b424f12 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.237266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaeea6e5-4347-4edd-b72d-1cfb5b424f12 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.244773 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c868aa53-c803-4b0b-b09a-326b30694d9c tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.375246 Dec 25 21:12:34.248323 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 804/1678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:33 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:34.277937 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aaeea6e5-4347-4edd-b72d-1cfb5b424f12 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.053080 Dec 25 21:12:34.304335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 875/1679] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:12:34 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:34.323137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b929aa86-68f8-4be8-b7c0-dff71ad24936 req-3bd8c78c-e947-4812-b248-a26c9d90a6ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578a1ae1-faad-4593-b3a9-d1d4c134431c", "tag": "406da12e-abe8-4471-83ca-f6e5af8cbcd0"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:34.338322 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:34.338322 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:34.357731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b929aa86-68f8-4be8-b7c0-dff71ad24936 req-3bd8c78c-e947-4812-b248-a26c9d90a6ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.360271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b929aa86-68f8-4be8-b7c0-dff71ad24936 req-3bd8c78c-e947-4812-b248-a26c9d90a6ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.388060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b929aa86-68f8-4be8-b7c0-dff71ad24936 req-3bd8c78c-e947-4812-b248-a26c9d90a6ad service nova] Creating event network-changed:406da12e-abe8-4471-83ca-f6e5af8cbcd0 for instance 578a1ae1-faad-4593-b3a9-d1d4c134431c on nch1-master-1 Dec 25 21:12:34.402598 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b929aa86-68f8-4be8-b7c0-dff71ad24936 req-3bd8c78c-e947-4812-b248-a26c9d90a6ad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093664 Dec 25 21:12:34.409063 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 876/1680] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:34.425403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c78469a-cc9f-4d92-813c-d17d649b0176 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:34.426174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c78469a-cc9f-4d92-813c-d17d649b0176 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:34.505054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c78469a-cc9f-4d92-813c-d17d649b0176 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:34.519041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:34.519664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:34.523071 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c78469a-cc9f-4d92-813c-d17d649b0176 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1206 microversion: 2.1 time: 0.097377 Dec 25 21:12:34.526617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 877/1681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:34 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1206 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:34.531794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:34.534731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.535194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.536489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.537149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.540572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:34.551794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.552353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.553543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.554054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.600952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lazy-loading 'flavor' on Instance uuid 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:34.650651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Going to try to live migrate instance to nch1-master-1 {{(pid=136548) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:12:34.762584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:34.773804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:34.775466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:34.776862 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-760d10df-0a47-43f5-b5e3-742f0a4470ca tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.527221 Dec 25 21:12:34.778143 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 805/1682] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:34 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:34.783090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:34.783948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:34.793709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.794476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.795540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:34.796548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:34.990925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:35.000658 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef353339-c848-406a-93fe-498b811d98a2 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 0.220471 Dec 25 21:12:35.003562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 806/1683] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:34 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:35.012468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:35.014826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:35.029183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.033715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.034690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.035277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.092110 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b2d178b-9e59-4c67-9b6e-a65a94d25803 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.081016 Dec 25 21:12:35.093097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 807/1684] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:35 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:35.277841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:35.282103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:35.301509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.302258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.303454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.304117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.469181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:35.478173 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-79c90357-0647-4eec-9293-a005ed7cd79f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.216759 Dec 25 21:12:35.479499 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 808/1685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:35 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:35.539655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:35.540317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:35.548646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.549193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.550182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.551065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.622745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:35.633404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8aff69e1-a5c3-4cc4-9d40-c0125659c4b6 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1210 microversion: 2.1 time: 0.097279 Dec 25 21:12:35.643950 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 809/1686] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:35 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:35.798558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:35.802154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:35.806727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.807831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:35.808979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:35.809686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.008902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:36.019175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:36.020706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:36.022224 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-faf6c7d6-b8e9-4851-87dc-88013cc76020 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.230882 Dec 25 21:12:36.022888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 810/1687] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:35 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:12:36.027294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:36.027908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:36.034095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.038826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.038826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.038826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.176477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:36.184356 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32d3620c-da35-4576-90e8-9bd822ab11f0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 0.160505 Dec 25 21:12:36.184959 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 811/1688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:36 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:36.194692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:36.194692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:36.197709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.198170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.199113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.200096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.243144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-376a162f-c6e6-4b06-9f02-3d3487f8213d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.056911 Dec 25 21:12:36.244913 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 812/1689] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:36 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:36.496003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:36.496708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:36.504386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.504909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.505715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.506156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.679982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:36.688674 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f73e78b0-3f22-400d-814a-85891dd2551f tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.196733 Dec 25 21:12:36.689280 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 813/1690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:36 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:36.698493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-94af4ca3-83f9-4ffd-ad99-363827e06fc3 req-891c8716-cea3-49c7-91c0-dad0762d8993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01ef47d-effa-4511-a9b2-27108542948c", "name": "network-vif-deleted", "tag": "9b84f1ce-b047-4065-9144-b2767da8f6e2"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:36.700056 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:36.700056 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:36.707611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-94af4ca3-83f9-4ffd-ad99-363827e06fc3 req-891c8716-cea3-49c7-91c0-dad0762d8993 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.708065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-94af4ca3-83f9-4ffd-ad99-363827e06fc3 req-891c8716-cea3-49c7-91c0-dad0762d8993 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.723386 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-94af4ca3-83f9-4ffd-ad99-363827e06fc3 req-891c8716-cea3-49c7-91c0-dad0762d8993 service nova] Creating event network-vif-deleted:9b84f1ce-b047-4065-9144-b2767da8f6e2 for instance c01ef47d-effa-4511-a9b2-27108542948c on nch2-master-1 Dec 25 21:12:36.728452 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-94af4ca3-83f9-4ffd-ad99-363827e06fc3 req-891c8716-cea3-49c7-91c0-dad0762d8993 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037158 Dec 25 21:12:36.729501 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 814/1691] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:36.735142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:36.735948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:36.748225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.748992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.753945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:36.753945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:36.829199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:36.839308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4658cdf6-fa9a-448c-aafd-f384aefc8c8c tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1258 microversion: 2.1 time: 0.108524 Dec 25 21:12:36.856481 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 815/1692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:36 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1258 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:37.023242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d68c8ac7-e9cd-4f09-b9d5-7c61952862be req-0d461edb-d6c6-49d6-aa4a-9296149794b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c12cba1c-049e-4a5a-8f24-4f33cf7df89c", "name": "network-vif-plugged", "status": "completed", "tag": "9423691b-100e-4a18-9d2b-f2b8781dd071"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:37.025060 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:37.025060 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:37.033301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d68c8ac7-e9cd-4f09-b9d5-7c61952862be req-0d461edb-d6c6-49d6-aa4a-9296149794b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.033971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d68c8ac7-e9cd-4f09-b9d5-7c61952862be req-0d461edb-d6c6-49d6-aa4a-9296149794b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.048012 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d68c8ac7-e9cd-4f09-b9d5-7c61952862be req-0d461edb-d6c6-49d6-aa4a-9296149794b5 service nova] Creating event network-vif-plugged:9423691b-100e-4a18-9d2b-f2b8781dd071 for instance c12cba1c-049e-4a5a-8f24-4f33cf7df89c on nch1-master-1 Dec 25 21:12:37.053044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d68c8ac7-e9cd-4f09-b9d5-7c61952862be req-0d461edb-d6c6-49d6-aa4a-9296149794b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033315 Dec 25 21:12:37.054172 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 816/1693] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:12:37.061370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:37.062843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:37.068774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.069256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.070064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.070532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.404454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:37.422624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:37.427284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:37.430844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ffee657-24b1-4c74-ba22-465d2ba4daf5 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.373537 Dec 25 21:12:37.446507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 817/1694] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:37 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:37.452391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:37.454354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:37.461261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.461969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.462952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.463556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.919387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:37.927134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60e0cdc3-1da5-4eb9-a1e0-e232155ba7ad tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91/action" status: 202 len: 0 microversion: 2.1 time: 3.398593 Dec 25 21:12:37.928017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 878/1695] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:34 2021] POST /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91/action => generated 0 bytes in 3401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:12:37.938130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09a1a4ff-ee5e-4f8f-8d3a-5cc783c3e388 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 0.490189 Dec 25 21:12:37.938971 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 818/1696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:37 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:37.943778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:37.946035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:37.969075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.969796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.971007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:37.972017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:37.972841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.974225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:37.984055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:37.984867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.001206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.003850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.084366 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-233fc84f-d73f-40dd-b6eb-7115f7617346 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.147825 Dec 25 21:12:38.085546 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 879/1697] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:37 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:38.105549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:38.107205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:38.117517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.118067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.119226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.119733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.246027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:38.264451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1556f0df-b133-4460-b07e-26e88f31a14b tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1264 microversion: 2.1 time: 0.177209 Dec 25 21:12:38.267661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 880/1698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:38 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:38.281419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:38.282291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:38.298131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.300720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.303312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.316317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.379059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:38.391961 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80e0a2c4-6381-4dfa-9520-c0a76008925e tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.449254 Dec 25 21:12:38.395682 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 819/1699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:37 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:38.452380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:38.461008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:38.483137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.483771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.490550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.492953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.838550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:38.854414 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-645d9047-5003-48c3-9058-21b2b05d57e4 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.585602 Dec 25 21:12:38.855613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 881/1700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:38 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:38.958885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:38.960328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:38.973944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.977782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:38.978389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:38.980523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:39.028328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:39.038957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:39.044991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:39.048331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c63fa292-cd8c-4d88-b9dd-521f2a215463 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.600511 Dec 25 21:12:39.053540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 820/1701] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:38 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:39.069983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c760d816-9b64-44c1-993e-a2d5ac1b365a req-a4903fe7-eec1-42be-b4ba-18f3365134ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866da8ae-83ec-48f9-bfc8-b1a55df72844", "name": "network-vif-unplugged", "status": "completed", "tag": "228dbe3e-2fc1-491d-915f-a92d1ec6406f"}, {"name": "network-changed", "server_uuid": "866da8ae-83ec-48f9-bfc8-b1a55df72844", "tag": "228dbe3e-2fc1-491d-915f-a92d1ec6406f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:39.072272 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:39.072272 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:39.084838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c760d816-9b64-44c1-993e-a2d5ac1b365a req-a4903fe7-eec1-42be-b4ba-18f3365134ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:39.091304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c760d816-9b64-44c1-993e-a2d5ac1b365a req-a4903fe7-eec1-42be-b4ba-18f3365134ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:39.112034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c760d816-9b64-44c1-993e-a2d5ac1b365a req-a4903fe7-eec1-42be-b4ba-18f3365134ec service nova] Creating event network-vif-unplugged:228dbe3e-2fc1-491d-915f-a92d1ec6406f for instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 on nch1-master-1 Dec 25 21:12:39.122971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c760d816-9b64-44c1-993e-a2d5ac1b365a req-a4903fe7-eec1-42be-b4ba-18f3365134ec service nova] Creating event network-changed:228dbe3e-2fc1-491d-915f-a92d1ec6406f for instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 on nch1-master-1 Dec 25 21:12:39.134019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c760d816-9b64-44c1-993e-a2d5ac1b365a req-a4903fe7-eec1-42be-b4ba-18f3365134ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.067913 Dec 25 21:12:39.137020 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 821/1702] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:12:39.172124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-48c32bbc-0e48-4b84-8e15-b7f5b22dc9e8 req-ae39b262-5c66-4039-9df1-da9dece7b024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e849be-8c7b-429d-b691-8ec676c68caa", "name": "network-vif-plugged", "status": "completed", "tag": "f2815b7b-7409-4ce5-8cb9-55075ef4d0f3"}, {"server_uuid": "578a1ae1-faad-4593-b3a9-d1d4c134431c", "name": "network-vif-plugged", "status": "completed", "tag": "406da12e-abe8-4471-83ca-f6e5af8cbcd0"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:39.178660 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:39.178660 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:39.196152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-48c32bbc-0e48-4b84-8e15-b7f5b22dc9e8 req-ae39b262-5c66-4039-9df1-da9dece7b024 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:39.196597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-48c32bbc-0e48-4b84-8e15-b7f5b22dc9e8 req-ae39b262-5c66-4039-9df1-da9dece7b024 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:39.222337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-48c32bbc-0e48-4b84-8e15-b7f5b22dc9e8 req-ae39b262-5c66-4039-9df1-da9dece7b024 service nova] Creating event network-vif-plugged:f2815b7b-7409-4ce5-8cb9-55075ef4d0f3 for instance e6e849be-8c7b-429d-b691-8ec676c68caa on nch1-master-1 Dec 25 21:12:39.223106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-48c32bbc-0e48-4b84-8e15-b7f5b22dc9e8 req-ae39b262-5c66-4039-9df1-da9dece7b024 service nova] Creating event network-vif-plugged:406da12e-abe8-4471-83ca-f6e5af8cbcd0 for instance 578a1ae1-faad-4593-b3a9-d1d4c134431c on nch1-master-1 Dec 25 21:12:39.229764 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-48c32bbc-0e48-4b84-8e15-b7f5b22dc9e8 req-ae39b262-5c66-4039-9df1-da9dece7b024 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.091196 Dec 25 21:12:39.230915 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 822/1703] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:39 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:39.237582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:39.238787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:39.248590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:39.249449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:39.251400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:39.253143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:39.304704 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65bb9435-62fb-4487-ae47-6e0b9bfd6e1b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.072175 Dec 25 21:12:39.308106 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 823/1704] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:39 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:39.320481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:39.323427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:39.341357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:39.344835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:39.345742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:39.346190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:40.028564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:40.043597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd31e935-f64c-4a4f-adb8-b62a00b95823 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1319 microversion: 2.1 time: 1.086768 Dec 25 21:12:40.048604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 882/1705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:38 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1319 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:40.056589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:40.057593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:40.072735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:40.073799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:40.074865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:40.075730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:40.768165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:40.778241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f7c65d6-f50c-47d9-b404-a45b1237789f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 1.467785 Dec 25 21:12:40.779192 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 824/1706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:39 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:40.791190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:40.792070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:40.799197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:40.799736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:40.800865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:40.801694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:40.983628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:40.992073 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70b5c741-3afd-4639-ba39-5826c63267d0 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1313 microversion: 2.1 time: 0.939205 Dec 25 21:12:41.001580 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 883/1707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:40 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1313 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:41.006366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:41.006973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:41.013197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.013669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.014530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.015007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.190388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:41.201500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5fed5642-226c-42e4-9eec-d290a63a1033 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.420659 Dec 25 21:12:41.202134 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 825/1708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:40 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:41.224112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:41.226637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:41.242937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.247955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.247955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.247955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.314911 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7784b66b-ebc3-4959-ac59-2c0911663aae tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.111157 Dec 25 21:12:41.320473 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 826/1709] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:41 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:41.332248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:41.334438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:41.346988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.347921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.348929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.349534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.598477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:41.606822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:41.608457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:41.609679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8040408e-a52e-4204-8dc5-1d8f9a4d259c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.607072 Dec 25 21:12:41.610420 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 884/1710] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:41 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:41.795380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:41.796004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:41.802636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.804205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.804205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.804469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.842930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:41.858295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6406501f-db39-4fa6-b5c5-565d4e548c87 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 200 len: 1506 microversion: 2.1 time: 0.536314 Dec 25 21:12:41.858956 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 827/1711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:41 2021] GET /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 1506 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:41.874452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:41.875561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: e6e849be-8c7b-429d-b691-8ec676c68caa] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:41.884314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.884698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:41.885628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:41.886211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:42.592983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:42.619155 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87ceeff2-c912-47dd-8a89-a567361d531e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.826353 Dec 25 21:12:42.620138 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 885/1712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:41 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:42.638627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:42.639490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:42.644168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:42.655595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c2fa25c-8f46-4300-b2f6-dce6b8d7cf6c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/e6e849be-8c7b-429d-b691-8ec676c68caa" status: 200 len: 1319 microversion: 2.1 time: 0.785086 Dec 25 21:12:42.656817 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 828/1713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:41 2021] GET /compute/v2.1/servers/e6e849be-8c7b-429d-b691-8ec676c68caa => generated 1319 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:42.663591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:42.664400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:42.664543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:42.665392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:42.666578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:42.667119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:42.674338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:42.674806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:42.675626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:42.676730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.218290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:43.231601 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-529e167d-f9c5-433f-ab27-64dec9b35bc7 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1463 microversion: 2.1 time: 0.597857 Dec 25 21:12:43.235761 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 886/1714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:42 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1463 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:43.245840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:43.249094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:43.264037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.264262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:43.265924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.269170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.271233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.276587 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cacd8f90-8510-47c1-a1f7-3533239812a9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.618494 Dec 25 21:12:43.277212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 829/1715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:42 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:43.355814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf26df28-81d8-46f6-a6a3-ab903a09b25d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.118398 Dec 25 21:12:43.357159 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 887/1716] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:43 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:43.365646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:43.366735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:43.375609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.376357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.377370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.377972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.496967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f3740f8a-c705-4ba2-9852-1504ad4c1a5d req-d47f77d7-3f96-481d-a42f-c629b3851ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f6f0ff-5388-463f-95ad-bb8a5b36da5d", "tag": "0a669f5e-5fef-4866-bd8e-e6cac72b1152"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:43.498957 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:43.498957 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:43.506972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f3740f8a-c705-4ba2-9852-1504ad4c1a5d req-d47f77d7-3f96-481d-a42f-c629b3851ae9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.507859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f3740f8a-c705-4ba2-9852-1504ad4c1a5d req-d47f77d7-3f96-481d-a42f-c629b3851ae9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.521638 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f3740f8a-c705-4ba2-9852-1504ad4c1a5d req-d47f77d7-3f96-481d-a42f-c629b3851ae9 service nova] Creating event network-changed:0a669f5e-5fef-4866-bd8e-e6cac72b1152 for instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d on nch2-master-1 Dec 25 21:12:43.527160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f3740f8a-c705-4ba2-9852-1504ad4c1a5d req-d47f77d7-3f96-481d-a42f-c629b3851ae9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239511 Dec 25 21:12:43.528007 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 830/1717] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:43.649729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00ae351d-4405-4396-952a-7c4074c25c44 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Calling method '.version_select at 0x7fa4f6851c10>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:43.660439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ae351d-4405-4396-952a-7c4074c25c44 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.666171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ae351d-4405-4396-952a-7c4074c25c44 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.684852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ae351d-4405-4396-952a-7c4074c25c44 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.685594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ae351d-4405-4396-952a-7c4074c25c44 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.707789 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00ae351d-4405-4396-952a-7c4074c25c44 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/8b80d743dc6342a689968320db7836a0?start=2021-12-24T21%3A12%3A43.242341&end=2021-12-26T21%3A12%3A43.242341" status: 200 len: 694 microversion: 2.1 time: 0.178276 Dec 25 21:12:43.709508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 831/1718] 10.222.0.32 () {58 vars in 1411 bytes} [Sat Dec 25 21:12:43 2021] GET /compute/v2.1/os-simple-tenant-usage/8b80d743dc6342a689968320db7836a0?start=2021-12-24T21%3A12%3A43.242341&end=2021-12-26T21%3A12%3A43.242341 => generated 694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:43.727012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:43.728501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:43.736950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.738273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.739096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.740057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.829322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:43.842522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:43.844665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:43.846099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efefcd32-eb88-4b1d-8de2-5143468da457 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.487688 Dec 25 21:12:43.846859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 888/1719] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:43 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:43.852086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:43.852892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: e6e849be-8c7b-429d-b691-8ec676c68caa] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:43.861756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.863056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:43.864460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:43.865594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.382594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:44.392263 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43d1066d-678c-4ed5-8778-c543b817ec78 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.681430 Dec 25 21:12:44.393476 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 832/1720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:43 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:44.407681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9614bcc-f8d5-4e32-a442-c83634f3ab8a tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '.version_select at 0x7fa4f68aaca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:44.429577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9614bcc-f8d5-4e32-a442-c83634f3ab8a tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.430249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9614bcc-f8d5-4e32-a442-c83634f3ab8a tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.442725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9614bcc-f8d5-4e32-a442-c83634f3ab8a tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.443599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9614bcc-f8d5-4e32-a442-c83634f3ab8a tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.457629 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9614bcc-f8d5-4e32-a442-c83634f3ab8a tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/8b80d743dc6342a689968320db7836a0?start=2021-12-24T21%3A12%3A43.242341&end=2021-12-26T21%3A12%3A43.242341" status: 200 len: 694 microversion: 2.1 time: 0.062970 Dec 25 21:12:44.466382 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 833/1721] 10.222.0.32 () {58 vars in 1411 bytes} [Sat Dec 25 21:12:44 2021] GET /compute/v2.1/os-simple-tenant-usage/8b80d743dc6342a689968320db7836a0?start=2021-12-24T21%3A12%3A43.242341&end=2021-12-26T21%3A12%3A43.242341 => generated 694 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:44.474984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:44.475857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:44.484506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.485052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.486070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.486808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.610423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:44.623801 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c12d08a5-523d-42c6-b7cc-ecfdc8ff0f50 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/e6e849be-8c7b-429d-b691-8ec676c68caa" status: 200 len: 1507 microversion: 2.1 time: 0.775723 Dec 25 21:12:44.625319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 889/1722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:43 2021] GET /compute/v2.1/servers/e6e849be-8c7b-429d-b691-8ec676c68caa => generated 1507 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:44.631636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:44.633204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:44.640830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.641696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.642981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.643996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.705735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4395ce94-a4a8-47af-89a5-da2932a68e31 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.076769 Dec 25 21:12:44.709477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 890/1723] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:44 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:44.715222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b51d3ab0-edd3-4033-8263-9661ed8de963 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Calling method '.version_select at 0x7fa4f6acd700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:44.719667 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:44.719667 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:44.736893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51d3ab0-edd3-4033-8263-9661ed8de963 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.738189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51d3ab0-edd3-4033-8263-9661ed8de963 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.770836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51d3ab0-edd3-4033-8263-9661ed8de963 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.771448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51d3ab0-edd3-4033-8263-9661ed8de963 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.882464 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b51d3ab0-edd3-4033-8263-9661ed8de963 tempest-TenantUsagesTestJSON-74615129 tempest-TenantUsagesTestJSON-74615129-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-24T21%3A12%3A43.242341&end=2021-12-26T21%3A12%3A43.242341&detailed=1" status: 200 len: 18000 microversion: 2.1 time: 0.172940 Dec 25 21:12:44.889016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 891/1724] 10.222.0.32 () {58 vars in 1334 bytes} [Sat Dec 25 21:12:44 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-24T21%3A12%3A43.242341&end=2021-12-26T21%3A12%3A43.242341&detailed=1 => generated 18000 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:44.895677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:44.896473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: e6e849be-8c7b-429d-b691-8ec676c68caa] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:44.909814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.910294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.911350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:44.911799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:44.947404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: e6e849be-8c7b-429d-b691-8ec676c68caa] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:45.275654 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c217f68-82f9-44a3-8ede-3efbcc67a475 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e6e849be-8c7b-429d-b691-8ec676c68caa" status: 204 len: 0 microversion: 2.1 time: 0.384984 Dec 25 21:12:45.280402 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 892/1725] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:44 2021] DELETE /compute/v2.1/servers/e6e849be-8c7b-429d-b691-8ec676c68caa => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:45.285193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:45.286518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:45.293844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:45.294304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:45.295103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:45.295539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:45.313225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:45.327090 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a27c1c4-ac91-488f-a735-740e7b6ae2f9 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.859219 Dec 25 21:12:45.333191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 834/1726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:44 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:45.338849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:45.339463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:45.346266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:45.346717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:45.347729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:45.348127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:45.376350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:45.709868 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd2d6788-ea32-40be-bcb7-5d9b66f82ef9 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "DELETE /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 204 len: 0 microversion: 2.1 time: 0.374813 Dec 25 21:12:45.710632 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 835/1727] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:45 2021] DELETE /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:45.716556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:45.717118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:45.723776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:45.724857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:45.725682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:45.726116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:45.754055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: c12cba1c-049e-4a5a-8f24-4f33cf7df89c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:46.162183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-05dbef51-fba8-4665-98f3-b2d132a0b2ce tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c" status: 204 len: 0 microversion: 2.1 time: 0.448178 Dec 25 21:12:46.169516 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 836/1728] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:12:45 2021] DELETE /compute/v2.1/servers/c12cba1c-049e-4a5a-8f24-4f33cf7df89c => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:46.170245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:46.172368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:46.182202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.184103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.186332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.188935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.213632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:46.224606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:46.226375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:46.228822 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da305a69-23b9-4440-a6b3-c780f9ccde27 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.949093 Dec 25 21:12:46.229746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 893/1729] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:45 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:46.255418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:46.257200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:46.269441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.270116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.271089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.271685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.324080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b5664b7a-edd5-4d0a-a843-e6cb76ae4123 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.092904 Dec 25 21:12:46.336264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 894/1730] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:46 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:46.344089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:46.349178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:46.359960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.361433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.362523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.363653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.686960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:46.704643 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23d03df6-537a-4e42-8235-301b51ba550e tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.532701 Dec 25 21:12:46.715407 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 837/1731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:46 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:46.723324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d4c1e071-349e-426a-8dc3-1d5ebd08d050 req-d46f36cf-da4a-490f-aca2-acad6ba03abe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9cb266-1a4b-41a7-b9c4-55bc33979d91", "name": "network-vif-unplugged", "status": "completed", "tag": "665e512c-6adc-4461-b6ed-9ce93d1fdeee"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:46.726357 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:46.726357 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:46.740946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d4c1e071-349e-426a-8dc3-1d5ebd08d050 req-d46f36cf-da4a-490f-aca2-acad6ba03abe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.741655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d4c1e071-349e-426a-8dc3-1d5ebd08d050 req-d46f36cf-da4a-490f-aca2-acad6ba03abe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.764126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:46.769232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d4c1e071-349e-426a-8dc3-1d5ebd08d050 req-d46f36cf-da4a-490f-aca2-acad6ba03abe service nova] Creating event network-vif-unplugged:665e512c-6adc-4461-b6ed-9ce93d1fdeee for instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 on nch2-master-1 Dec 25 21:12:46.776686 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d4c1e071-349e-426a-8dc3-1d5ebd08d050 req-d46f36cf-da4a-490f-aca2-acad6ba03abe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058350 Dec 25 21:12:46.783778 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 838/1732] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:46.789253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:46.790042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:46.800176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90ebe11e-d33e-48d3-a18f-19f25a7609dd tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1469 microversion: 2.1 time: 0.460145 Dec 25 21:12:46.801850 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 895/1733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:46 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1469 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:46.806961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-905550109", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "f8afa1db-6032-4635-a1fd-6997d067d021"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:46.846476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.847558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.847748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:46.848180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:46.910717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] validate_networks() for [('f8afa1db-6032-4635-a1fd-6997d067d021', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:12:47.367524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:47.386689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd230b0a-f0d7-461b-9f8b-4d487ec2ab86 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.601382 Dec 25 21:12:47.392102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 839/1734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:46 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:47.402815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:47.406480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:47.445070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:47.445070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:47.445070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:47.445070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:47.833297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:47.850394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:47.851951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:47.853205 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19ddfe4a-762f-4259-a135-c28e68b27644 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1486 microversion: 2.25 time: 0.459312 Dec 25 21:12:47.854438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 840/1735] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:47 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1486 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:47.867855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:47.868860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:47.878309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:47.879433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:47.881061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:47.881830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:47.941275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-104a75c5-10e9-44c6-b4f0-46f8009d2a80 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.084968 Dec 25 21:12:47.970831 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 841/1736] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:47 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:47.978777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:47.979922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:47.989870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:47.990669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:47.991744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:47.992366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:48.389277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:12:48.389780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:12:48.390188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:12:48.390780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:12:48.391357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:12:48.407649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:48.414663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:48.414663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:48.414663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:48.435341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Getting quotas for project 576fa0b7a73d45bc86b799bb25424c30. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:12:48.440673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Getting quotas for user f157276b2f2845258ce93423249ed74d and project 576fa0b7a73d45bc86b799bb25424c30. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:12:48.453079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Going to run 2 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:12:48.455758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:48.493364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:48.502746 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8196301-b728-4327-b4a7-a1ec2715aeef tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.529632 Dec 25 21:12:48.503841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 842/1737] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:47 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:48.509405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:48.510735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:48.519169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:48.519834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:48.521051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:48.521732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:48.625147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=52a010e5-bcbf-43a3-8e08-f1b8c0bdde01,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:12:48.886838 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-201e7569-9a2b-4ecf-a276-d79046b4db79 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.083790 Dec 25 21:12:48.888059 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 896/1738] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:12:46 2021] POST /compute/v2.1/servers => generated 32 bytes in 2086 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Dec 25 21:12:48.897233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:48.900706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:48.916505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:48.917817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:48.922115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:48.924616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:49.362916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:49.380084 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0147a439-6b9d-409b-95cc-648cfed31d03 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1469 microversion: 2.1 time: 0.873008 Dec 25 21:12:49.382612 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 843/1739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:48 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1469 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:49.415430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e5529f54-d62e-4827-9b9c-406f5aacb0a3 req-776632f9-10cf-476b-8581-6ac37ace17ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c9cb266-1a4b-41a7-b9c4-55bc33979d91", "tag": "665e512c-6adc-4461-b6ed-9ce93d1fdeee"}, {"server_uuid": "e6e849be-8c7b-429d-b691-8ec676c68caa", "name": "network-vif-deleted", "tag": "f2815b7b-7409-4ce5-8cb9-55075ef4d0f3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:49.421278 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:49.421278 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:49.456189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e5529f54-d62e-4827-9b9c-406f5aacb0a3 req-776632f9-10cf-476b-8581-6ac37ace17ca service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:49.456972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e5529f54-d62e-4827-9b9c-406f5aacb0a3 req-776632f9-10cf-476b-8581-6ac37ace17ca service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:49.477965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e5529f54-d62e-4827-9b9c-406f5aacb0a3 req-776632f9-10cf-476b-8581-6ac37ace17ca service nova] Creating event network-changed:665e512c-6adc-4461-b6ed-9ce93d1fdeee for instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 on nch2-master-1 Dec 25 21:12:49.478640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e5529f54-d62e-4827-9b9c-406f5aacb0a3 req-776632f9-10cf-476b-8581-6ac37ace17ca service nova] Creating event network-vif-deleted:f2815b7b-7409-4ce5-8cb9-55075ef4d0f3 for instance e6e849be-8c7b-429d-b691-8ec676c68caa on nch1-master-1 Dec 25 21:12:49.493268 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e5529f54-d62e-4827-9b9c-406f5aacb0a3 req-776632f9-10cf-476b-8581-6ac37ace17ca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.108711 Dec 25 21:12:49.493773 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 844/1740] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:49 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:49.500319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:49.501369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:49.522275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:49.522670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:49.523658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:49.524261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.131259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.163185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63a3149d-f76d-4e14-be5f-08c4d824ab4a tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 1.273550 Dec 25 21:12:50.166688 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 897/1741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:48 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:50.176172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:50.199891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.207619 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:50.207619 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:50.211737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.212014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.213645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Searching by: {'deleted': False, 'project_id': '576fa0b7a73d45bc86b799bb25424c30'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:12:50.216866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.220578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-378dcbae-d938-446b-a7bf-0fc17be7c4c2 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1476 microversion: 2.25 time: 0.725560 Dec 25 21:12:50.224308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 845/1742] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:49 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1476 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:50.237779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:50.239243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:50.250785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.253739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.254893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.255562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.269210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.271422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.275115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.276854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.323525 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cc48006-ce0b-4f07-b8b0-a35489d6da17 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.096485 Dec 25 21:12:50.325423 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 846/1743] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:50 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:50.334398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:50.335760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:50.345921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.345921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.349387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.350287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.351959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:12:50.455287 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf5c9370-1861-4b2f-b969-50ddb2087326 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1002 microversion: 2.1 time: 0.286052 Dec 25 21:12:50.461577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 898/1744] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:12:50 2021] GET /compute/v2.1/servers => generated 1002 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:50.461577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9425b8ba-dbe5-4e85-a383-1942bf10f87e tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '.version_select at 0x7fa4f73b4d30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:50.463146 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:50.463146 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:50.465256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9425b8ba-dbe5-4e85-a383-1942bf10f87e tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.465829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9425b8ba-dbe5-4e85-a383-1942bf10f87e tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.513520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9425b8ba-dbe5-4e85-a383-1942bf10f87e tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 3864 microversion: 2.25 time: 0.055854 Dec 25 21:12:50.516204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 899/1745] 10.222.0.32 () {60 vars in 1183 bytes} [Sat Dec 25 21:12:50 2021] GET /compute/v2.1/os-migrations => generated 3864 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:50.530090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:50.530848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:50.548116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.548902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.554738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.554738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.633982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.634451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.634910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lazy-loading 'fault' on Instance uuid 578a1ae1-faad-4593-b3a9-d1d4c134431c {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:50.657513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.665878 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-920af1b2-5a0f-4c6b-8fd8-316816b8e9a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.338457 Dec 25 21:12:50.672002 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 847/1746] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:50 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:50.683929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7ff1b97-61cc-4c85-a7a4-c0b348644940 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:50.683929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7ff1b97-61cc-4c85-a7a4-c0b348644940 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:50.710568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8987227b269944619441e94b3876d311', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b80d743dc6342a689968320db7836a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.722352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f740074f-3f14-4c52-8fdd-0c6e33f51c21 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 200 len: 1303 microversion: 2.1 time: 0.204793 Dec 25 21:12:50.724186 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 900/1747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:50 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:50.730363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:50.731850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:50.740118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.741601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.742731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:50.743495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:50.852568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7ff1b97-61cc-4c85-a7a4-c0b348644940 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:50.866490 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7ff1b97-61cc-4c85-a7a4-c0b348644940 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1217 microversion: 2.1 time: 0.186899 Dec 25 21:12:50.866490 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 848/1748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:50 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1217 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:50.969195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] Lazy-loading 'services' on Instance uuid 866da8ae-83ec-48f9-bfc8-b1a55df72844 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:50.992857 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01907455-e616-4750-86a3-c9b8be71f73a tempest-LiveAutoBlockMigrationV225Test-952394939 tempest-LiveAutoBlockMigrationV225Test-952394939-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1969 microversion: 2.25 time: 0.265807 Dec 25 21:12:51.007248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 901/1749] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:50 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1969 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:51.028557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:51.029082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.038537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.038991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.039797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.041505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.080706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:12:51.182893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:51.183514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.190952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.191411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.192203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.192702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.380675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:51.403124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bbf98da-847d-436e-8984-d567cf0aa7fe tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.223676 Dec 25 21:12:51.406138 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 902/1750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:51 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:51.412800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:51.428483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.435633 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfe14295-df88-45fd-8e14-a708056ef996 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "DELETE /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 204 len: 0 microversion: 2.25 time: 0.410769 Dec 25 21:12:51.438127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 849/1751] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:12:51 2021] DELETE /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:12:51.438733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.439630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.440653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.441330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.450147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:51.450861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.465502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.466813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.468511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.470962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.492358 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3cd99e2a-db8e-476a-abca-592c7cab90ac tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.084398 Dec 25 21:12:51.493952 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 903/1752] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:51 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:51.689914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:51.690617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.702556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.703002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.703809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.708663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.744699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:51.764472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:51.770256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:51.771475 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32680990-40ba-4375-8026-5cb511958640 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1482 microversion: 2.25 time: 0.326272 Dec 25 21:12:51.774128 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 850/1753] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:51 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1482 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:51.787403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:51.794479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] [instance: 578a1ae1-faad-4593-b3a9-d1d4c134431c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.810022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.810831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.813237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.813757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.857084 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] HTTP exception thrown: Instance 578a1ae1-faad-4593-b3a9-d1d4c134431c could not be found. Dec 25 21:12:51.858230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] Returning 404 to user: Instance 578a1ae1-faad-4593-b3a9-d1d4c134431c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:51.861435 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd68a125-c2ca-479c-9084-505b07e48da5 tempest-TenantUsagesTestJSON-459875834 tempest-TenantUsagesTestJSON-459875834-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c" status: 404 len: 111 microversion: 2.1 time: 0.085845 Dec 25 21:12:51.862778 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 851/1754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:51 2021] GET /compute/v2.1/servers/578a1ae1-faad-4593-b3a9-d1d4c134431c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:12:51.891589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:51.892245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:51.918397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.922025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:51.922025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:51.922215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.085635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:52.096076 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1ef5d6d4-b1be-48bf-97c0-82e8ea2bfd8a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1221 microversion: 2.1 time: 0.218085 Dec 25 21:12:52.097391 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 852/1755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:51 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1221 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:52.102964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7c75ea3c-935f-43a4-aa3e-1891d878bb61 req-397035a4-1b13-4872-a476-3c2b8679f6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578a1ae1-faad-4593-b3a9-d1d4c134431c", "name": "network-vif-deleted", "tag": "406da12e-abe8-4471-83ca-f6e5af8cbcd0"}, {"server_uuid": "c12cba1c-049e-4a5a-8f24-4f33cf7df89c", "name": "network-vif-deleted", "tag": "9423691b-100e-4a18-9d2b-f2b8781dd071"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:52.104821 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:52.104821 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:52.116053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7c75ea3c-935f-43a4-aa3e-1891d878bb61 req-397035a4-1b13-4872-a476-3c2b8679f6a6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.116760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7c75ea3c-935f-43a4-aa3e-1891d878bb61 req-397035a4-1b13-4872-a476-3c2b8679f6a6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.117624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:52.127949 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a87ca105-bfa3-4b4d-a68b-e5fbe656d617 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.443875 Dec 25 21:12:52.132029 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7c75ea3c-935f-43a4-aa3e-1891d878bb61 req-397035a4-1b13-4872-a476-3c2b8679f6a6 service nova] Creating event network-vif-deleted:406da12e-abe8-4471-83ca-f6e5af8cbcd0 for instance 578a1ae1-faad-4593-b3a9-d1d4c134431c on nch1-master-1 Dec 25 21:12:52.132745 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7c75ea3c-935f-43a4-aa3e-1891d878bb61 req-397035a4-1b13-4872-a476-3c2b8679f6a6 service nova] Creating event network-vif-deleted:9423691b-100e-4a18-9d2b-f2b8781dd071 for instance c12cba1c-049e-4a5a-8f24-4f33cf7df89c on nch1-master-1 Dec 25 21:12:52.138183 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 904/1756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:51 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:52.140751 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7c75ea3c-935f-43a4-aa3e-1891d878bb61 req-397035a4-1b13-4872-a476-3c2b8679f6a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041008 Dec 25 21:12:52.141498 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 853/1757] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:52 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:52.425051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:52.426681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:52.435336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.447058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.448436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.449366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.507905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:52.512859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:52.522588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.523380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.524495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.525193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.587127 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80e4a429-8be7-4852-839f-ee520841035f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.085485 Dec 25 21:12:52.592782 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 854/1758] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:52 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:12:52.703938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d5005bfd-690e-4eb8-a85e-54db7761f3e6 req-a12a5da1-7014-496c-a11d-cee0cc576ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f6f0ff-5388-463f-95ad-bb8a5b36da5d", "name": "network-vif-plugged", "status": "completed", "tag": "0a669f5e-5fef-4866-bd8e-e6cac72b1152"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:52.706526 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:52.706526 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:52.728963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d5005bfd-690e-4eb8-a85e-54db7761f3e6 req-a12a5da1-7014-496c-a11d-cee0cc576ceb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.729720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d5005bfd-690e-4eb8-a85e-54db7761f3e6 req-a12a5da1-7014-496c-a11d-cee0cc576ceb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.746989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d5005bfd-690e-4eb8-a85e-54db7761f3e6 req-a12a5da1-7014-496c-a11d-cee0cc576ceb service nova] Creating event network-vif-plugged:0a669f5e-5fef-4866-bd8e-e6cac72b1152 for instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d on nch2-master-1 Dec 25 21:12:52.755399 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d5005bfd-690e-4eb8-a85e-54db7761f3e6 req-a12a5da1-7014-496c-a11d-cee0cc576ceb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055318 Dec 25 21:12:52.757232 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 855/1759] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:52.794649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:52.795962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:52.816148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.817032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.821384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:52.822560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:52.965545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:52.977885 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d12f170-8838-4472-ab1d-f2abbb1eb4db tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.559847 Dec 25 21:12:52.980903 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 905/1760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:52 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:53.114118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:53.114875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:53.126283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:53.129778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:53.136152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:53.136152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:53.449733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:53.460389 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-232bfc53-c6bc-42ed-9645-707ff90631cc tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1269 microversion: 2.1 time: 0.350536 Dec 25 21:12:53.461037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 906/1761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:53 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1269 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:53.471614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:53.472210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:53.493136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:53.504445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:53.504445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:53.504445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.029076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:54.040060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:54.042065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:54.043428 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d073a360-3b31-4287-bad7-21c457b80b14 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1482 microversion: 2.25 time: 1.257158 Dec 25 21:12:54.054331 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 856/1762] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:52 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1482 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:12:54.062391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:54.063224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:54.071059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:54.072163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.073042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:54.073725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.148708 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ceed5fe9-cf3b-4d5a-81e6-bea646ac9be5 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.088219 Dec 25 21:12:54.154457 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 857/1763] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:54 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:54.160982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:54.162053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:54.169449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:54.170378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.171376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:54.172172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.291498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:54.304513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1cceefb8-f3de-49fc-b067-c45da52f9d4f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1306 microversion: 2.1 time: 0.842115 Dec 25 21:12:54.305490 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 907/1764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:53 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1306 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:54.478132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:54.478825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:54.490767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:54.491250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.492090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:54.492532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:54.781115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:54.791780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54ebd753-1c83-4c92-875a-0d6e0c8844be tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1275 microversion: 2.1 time: 0.316221 Dec 25 21:12:54.804272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 908/1765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:54 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1275 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:55.060904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:55.061805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:55.071400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.075357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.076447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.077609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.191255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:55.207495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-680670fa-b73a-4783-b42f-a50b08c9ac6f tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 1.048517 Dec 25 21:12:55.220786 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 858/1766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:54 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:55.234234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:55.235472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:55.262842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:55.269284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.269932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.270884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.271482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.293979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:55.297784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:55.300665 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0bb7f01-0562-45b8-828a-a98672661b1e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1440 microversion: 2.25 time: 0.242745 Dec 25 21:12:55.303979 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 909/1767] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:55 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1440 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:12:55.312594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-138de5c1-5776-42a3-b65c-6f3bf98925db req-903ab840-b4c0-4426-92b6-9660d1035dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "866da8ae-83ec-48f9-bfc8-b1a55df72844", "name": "network-vif-deleted", "tag": "228dbe3e-2fc1-491d-915f-a92d1ec6406f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:55.318954 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:55.318954 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:12:55.331398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-138de5c1-5776-42a3-b65c-6f3bf98925db req-903ab840-b4c0-4426-92b6-9660d1035dc2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.332058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-138de5c1-5776-42a3-b65c-6f3bf98925db req-903ab840-b4c0-4426-92b6-9660d1035dc2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.362824 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-138de5c1-5776-42a3-b65c-6f3bf98925db req-903ab840-b4c0-4426-92b6-9660d1035dc2 service nova] Creating event network-vif-deleted:228dbe3e-2fc1-491d-915f-a92d1ec6406f for instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 on nch2-master-1 Dec 25 21:12:55.376230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-138de5c1-5776-42a3-b65c-6f3bf98925db req-903ab840-b4c0-4426-92b6-9660d1035dc2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070760 Dec 25 21:12:55.378151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 910/1768] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:12:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:12:55.396482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:55.400200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:55.410375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.411128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.412412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.413474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.428599 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af8d5f8c-6e55-4520-83c2-1aeef1db4b0e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.206060 Dec 25 21:12:55.430113 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 859/1769] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:55 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:55.751666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:55.761441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed284d13-2601-4612-849a-d1933c6dc71d tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1486 microversion: 2.1 time: 0.381357 Dec 25 21:12:55.762015 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 911/1770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:55 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1486 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:55.779252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1075726226"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:55.795524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:55.802280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.802963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.803960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.804404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.814721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:55.815949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:55.824826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.826090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:55.830506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:55.830506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.130939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:56.140955 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b8a11be-f064-47d9-a62e-ed18accae7a8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1275 microversion: 2.1 time: 0.333231 Dec 25 21:12:56.149987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 912/1771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:55 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1275 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:56.235483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:56.238802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:56.253962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.254235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.255039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.255538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.664121 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b431fe7c-eb1e-45fc-84d5-6c648662dff2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "POST /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d/action" status: 202 len: 0 microversion: 2.1 time: 0.888928 Dec 25 21:12:56.672073 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 860/1772] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:55 2021] POST /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d/action => generated 0 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:12:56.679177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:56.680225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:56.688264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.688714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.690644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.691084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.732928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.733955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.734645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lazy-loading 'fault' on Instance uuid 866da8ae-83ec-48f9-bfc8-b1a55df72844 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:12:56.758791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:56.771818 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aeea0e73-5cf7-4d23-96ca-85afe1ccf23d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1391 microversion: 2.1 time: 0.551449 Dec 25 21:12:56.773734 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 913/1773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:56 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1391 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:56.779863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:56.781353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:56.796671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.797921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.799271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:56.799900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:56.818823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:56.831165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:56.839997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:56.841582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2634611c-ac7a-42d8-931a-56df2b47371b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 200 len: 1271 microversion: 2.25 time: 0.167474 Dec 25 21:12:56.843475 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 861/1774] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:56 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:12:56.862540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f791114-7a44-4a18-90be-c25e270507b0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6870b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:56.872831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bbb6fefe-e2f6-4dc2-9785-a51e3f9e44cd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.097535 Dec 25 21:12:56.892477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 914/1775] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:56 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:56.956818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f791114-7a44-4a18-90be-c25e270507b0 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670" status: 200 len: 1414 microversion: 2.1 time: 0.100354 Dec 25 21:12:56.957997 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 862/1776] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:56 2021] GET /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:56.973670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7287a60-0773-4d3e-adb0-5350f6926860 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6ac6d30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:57.068797 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7287a60-0773-4d3e-adb0-5350f6926860 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670" status: 200 len: 1414 microversion: 2.1 time: 0.099228 Dec 25 21:12:57.069771 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 915/1777] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:56 2021] GET /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:57.082691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2115c7ea-5e09-4ed0-8ae7-f32b4727605a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f67c0790>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:57.157904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:57.158789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:57.169792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:57.170628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:57.174305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:57.175170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:57.491838 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2115c7ea-5e09-4ed0-8ae7-f32b4727605a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670" status: 204 len: 0 microversion: 2.1 time: 0.413552 Dec 25 21:12:57.493004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 863/1778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:57 2021] DELETE /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:12:57.513007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ed5fccb-3c69-4beb-9917-de575e4b8227 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f67c0ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:57.562805 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-8ed5fccb-3c69-4beb-9917-de575e4b8227 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Image not found. Dec 25 21:12:57.566789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ed5fccb-3c69-4beb-9917-de575e4b8227 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:57.567777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ed5fccb-3c69-4beb-9917-de575e4b8227 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670" status: 404 len: 62 microversion: 2.1 time: 0.070618 Dec 25 21:12:57.568424 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 864/1779] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:12:57 2021] GET /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 25 21:12:57.578553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:57.591132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:57.602008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:57.603684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:57.609001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:57.612172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:57.985037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:57.994645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6a7ff06-3197-48d1-acac-ccbc684a63e5 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.841443 Dec 25 21:12:57.998505 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 916/1780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:57 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:58.003917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:58.004072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:58.020328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.025932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:58.026790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.027231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:58.037311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:58.058054 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee350d05-777f-4bb1-9ea6-dac913645be8 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1498 microversion: 2.1 time: 0.476583 Dec 25 21:12:58.059489 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 865/1781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:57 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1498 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:12:58.065148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:58.065993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 866da8ae-83ec-48f9-bfc8-b1a55df72844] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:58.094912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.095370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:58.096186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.096620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:58.133103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] HTTP exception thrown: Instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 could not be found. Dec 25 21:12:58.134057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Returning 404 to user: Instance 866da8ae-83ec-48f9-bfc8-b1a55df72844 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:12:58.138231 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac4e23d7-3f0d-4d16-b8d9-f920ad964a5a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844" status: 404 len: 111 microversion: 2.25 time: 0.077084 Dec 25 21:12:58.139683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 866/1782] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:12:58 2021] GET /compute/v2.1/servers/866da8ae-83ec-48f9-bfc8-b1a55df72844 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:12:58.146611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:12:58.148720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:58.160145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.161364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:58.162581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.163996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:58.257794 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a1ff87b-34f0-4acd-b1bc-39651372724b tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.113898 Dec 25 21:12:58.260946 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 867/1783] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:12:58 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:12:58.918949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:58.926765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3974d900-8bda-4d4c-9f3d-738e5de56594 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1381 microversion: 2.1 time: 0.926655 Dec 25 21:12:58.927354 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 917/1784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:57 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1381 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:58.950560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af352fd0-4893-4688-ac4b-2e24a812512b tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '.version_select at 0x7fa4f6851280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:58.952744 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:12:58.952744 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:12:58.957421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af352fd0-4893-4688-ac4b-2e24a812512b tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:58.958229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af352fd0-4893-4688-ac4b-2e24a812512b tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.002385 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af352fd0-4893-4688-ac4b-2e24a812512b tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 2702 microversion: 2.1 time: 0.062463 Dec 25 21:12:59.011585 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 868/1785] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:12:58 2021] GET /compute/v2.1/os-migrations => generated 2702 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:59.014951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:59.018465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:59.019579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:59.020787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:59.024289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:59.024736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.025733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:59.028239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.029764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:59.031065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.032235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:59.033392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.381295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:12:59.397856 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-994d36ef-61f9-4406-98b2-a35fd71f2815 tempest-LiveMigrationTest-1605081009 tempest-LiveMigrationTest-1605081009-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1532 microversion: 2.1 time: 0.384170 Dec 25 21:12:59.405242 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 869/1786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:59 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1532 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:59.405408 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f754a53e-bd0e-43de-a1d3-4f5a61bac6de tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.387339 Dec 25 21:12:59.413016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 918/1787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:59 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:12:59.419626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:12:59.420243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:12:59.448548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:59.449024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.449840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:12:59.450455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:12:59.864620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2943727-106e-4db6-bcfe-602244ab3215 tempest-FloatingIPDetailsNegativeTestJSON-432817184 tempest-FloatingIPDetailsNegativeTestJSON-432817184-project] Calling method '.version_select at 0x7fa4f6d8baf0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:00.042869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-a2943727-106e-4db6-bcfe-602244ab3215 tempest-FloatingIPDetailsNegativeTestJSON-432817184 tempest-FloatingIPDetailsNegativeTestJSON-432817184-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP f2e4ba63-f863-4707-87f3-b32ea2de8ac9 could not be found", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:13:00.044483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a2943727-106e-4db6-bcfe-602244ab3215 tempest-FloatingIPDetailsNegativeTestJSON-432817184 tempest-FloatingIPDetailsNegativeTestJSON-432817184-project] HTTP exception thrown: Floating IP not found for ID f2e4ba63-f863-4707-87f3-b32ea2de8ac9 Dec 25 21:13:00.045386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2943727-106e-4db6-bcfe-602244ab3215 tempest-FloatingIPDetailsNegativeTestJSON-432817184 tempest-FloatingIPDetailsNegativeTestJSON-432817184-project] Returning 404 to user: Floating IP not found for ID f2e4ba63-f863-4707-87f3-b32ea2de8ac9 {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:00.047904 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a2943727-106e-4db6-bcfe-602244ab3215 tempest-FloatingIPDetailsNegativeTestJSON-432817184 tempest-FloatingIPDetailsNegativeTestJSON-432817184-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips/f2e4ba63-f863-4707-87f3-b32ea2de8ac9" status: 404 len: 111 microversion: 2.1 time: 0.633140 Dec 25 21:13:00.048865 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 919/1788] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:12:59 2021] GET /compute/v2.1/os-floating-ips/f2e4ba63-f863-4707-87f3-b32ea2de8ac9 => generated 111 bytes in 635 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:00.068795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:00.070731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:00.085996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.098853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.099780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.101998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.139286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:00.152744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46a1ab25-aa2b-4243-937f-7a42129ef3b3 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1504 microversion: 2.1 time: 0.746334 Dec 25 21:13:00.153876 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 870/1789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:12:59 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1504 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:00.156745 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd960d02-8a4a-49a7-be35-ff14e68bfbdd tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.106032 Dec 25 21:13:00.158304 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 920/1790] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:13:00 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:13:00.165138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:00.166747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:00.172666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fdf1b77c-2630-4ad1-a903-b0927176dcd2 req-25e836d2-560d-4f6e-8cea-7d697ac5857a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52a010e5-bcbf-43a3-8e08-f1b8c0bdde01", "tag": "5efcdb31-93a6-4522-8ad1-d57b10fea80d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:00.176679 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:00.176679 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:00.179534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.183821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.185376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.193135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.203883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fdf1b77c-2630-4ad1-a903-b0927176dcd2 req-25e836d2-560d-4f6e-8cea-7d697ac5857a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.204398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fdf1b77c-2630-4ad1-a903-b0927176dcd2 req-25e836d2-560d-4f6e-8cea-7d697ac5857a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.232591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:00.241380 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fdf1b77c-2630-4ad1-a903-b0927176dcd2 req-25e836d2-560d-4f6e-8cea-7d697ac5857a service nova] Creating event network-changed:5efcdb31-93a6-4522-8ad1-d57b10fea80d for instance 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 on nch1-master-1 Dec 25 21:13:00.277811 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fdf1b77c-2630-4ad1-a903-b0927176dcd2 req-25e836d2-560d-4f6e-8cea-7d697ac5857a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109652 Dec 25 21:13:00.278768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 921/1791] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:00.439420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:00.440818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:00.458313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.458775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.459588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.460025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.734630 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd58a5a2-17a4-4782-82f3-e5401bae8382 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 204 len: 0 microversion: 2.1 time: 0.575664 Dec 25 21:13:00.757356 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 871/1792] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:00 2021] DELETE /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:00.764178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:00.765613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:00.773662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.775401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:00.776417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:00.777576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.237154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:01.251809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f48e8247-7558-4e4b-ab63-5b2531728258 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.817921 Dec 25 21:13:01.253475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 922/1793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:00 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:01.263753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:01.270241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:01.284032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:01.286951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.289426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:01.305844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.366384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-702d37e0-ac1b-478e-bf85-ecea51a30053 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.107903 Dec 25 21:13:01.369697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 923/1794] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:13:01 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:13:01.375865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:01.379067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:01.389805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:01.390521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.391723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:01.392325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.451149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:01.461275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-460b2650-8490-4619-80dc-7246a293b02d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1387 microversion: 2.1 time: 0.702400 Dec 25 21:13:01.486497 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 872/1795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:00 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1387 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:01.852032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:01.866083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a6f152d5-82e6-4f37-922c-edac405cbc63 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1486 microversion: 2.1 time: 0.491589 Dec 25 21:13:01.866083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 924/1796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:01 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1486 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:01.879803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:01.880468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:01.898391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:01.899038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.899948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:01.900600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:01.998210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:02.269531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:02.270499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:02.283685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.284320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.286352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.287153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.542537 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa5ef81b-baa0-4c48-a744-ba265bb62e74 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 204 len: 0 microversion: 2.1 time: 0.665993 Dec 25 21:13:02.543144 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 873/1797] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:01 2021] DELETE /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:02.559725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-117751ca-ec0e-4c77-8d1c-6ab7b471a987 req-01d4dc9a-e0ae-4d1e-9f67-28a0dba99484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f", "tag": "1615d351-b877-4433-a0e3-10b0d89051ce"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:02.566914 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:02.566914 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:02.574296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-117751ca-ec0e-4c77-8d1c-6ab7b471a987 req-01d4dc9a-e0ae-4d1e-9f67-28a0dba99484 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.574747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-117751ca-ec0e-4c77-8d1c-6ab7b471a987 req-01d4dc9a-e0ae-4d1e-9f67-28a0dba99484 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.587408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-117751ca-ec0e-4c77-8d1c-6ab7b471a987 req-01d4dc9a-e0ae-4d1e-9f67-28a0dba99484 service nova] Creating event network-changed:1615d351-b877-4433-a0e3-10b0d89051ce for instance 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f on nch2-master-1 Dec 25 21:13:02.593866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-117751ca-ec0e-4c77-8d1c-6ab7b471a987 req-01d4dc9a-e0ae-4d1e-9f67-28a0dba99484 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041653 Dec 25 21:13:02.594873 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 874/1798] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:02.601624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:02.603044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:02.612101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.613061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.614063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.614667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.681035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c1b6d85-9a4b-40fa-a4c7-0e15bf589c12 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.084137 Dec 25 21:13:02.681733 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 875/1799] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:13:02 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:13:02.701568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-140e88b0-f1a0-44ac-8d76-c55a236be9dc req-69a4605c-d491-4ff5-abd8-b135385e1ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f6f0ff-5388-463f-95ad-bb8a5b36da5d", "name": "network-vif-plugged", "status": "completed", "tag": "0a669f5e-5fef-4866-bd8e-e6cac72b1152"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:02.705875 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:02.705875 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:02.713905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-140e88b0-f1a0-44ac-8d76-c55a236be9dc req-69a4605c-d491-4ff5-abd8-b135385e1ee6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.715083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-140e88b0-f1a0-44ac-8d76-c55a236be9dc req-69a4605c-d491-4ff5-abd8-b135385e1ee6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.743969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-140e88b0-f1a0-44ac-8d76-c55a236be9dc req-69a4605c-d491-4ff5-abd8-b135385e1ee6 service nova] Creating event network-vif-plugged:0a669f5e-5fef-4866-bd8e-e6cac72b1152 for instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d on nch2-master-1 Dec 25 21:13:02.752307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-140e88b0-f1a0-44ac-8d76-c55a236be9dc req-69a4605c-d491-4ff5-abd8-b135385e1ee6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065427 Dec 25 21:13:02.756371 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 876/1800] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:02.770116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:02.777133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:02.787748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.789204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:02.792539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:02.793300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.526501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:03.549185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dcf476af-6d25-4463-984b-4e88a67be0ac tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 1.280802 Dec 25 21:13:03.550379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 925/1801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:02 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:03.558588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-caa83c03-37f9-4217-bdc7-9ff72a57d2de tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6b29f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:03.642486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-caa83c03-37f9-4217-bdc7-9ff72a57d2de tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Image not found. Dec 25 21:13:03.644423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-caa83c03-37f9-4217-bdc7-9ff72a57d2de tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:03.645747 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-caa83c03-37f9-4217-bdc7-9ff72a57d2de tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670" status: 404 len: 62 microversion: 2.1 time: 0.092243 Dec 25 21:13:03.646788 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 926/1802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:03 2021] DELETE /compute/v2.1/images/7f33cfc5-54fc-497e-a79a-b15027720670 => generated 62 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:13:03.656226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:03.658827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:03.672856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:03.674839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.675849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:03.677849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.729609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:03.846374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:03.861483 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09b922b9-b98b-448a-921c-deeaaf029784 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1387 microversion: 2.1 time: 1.094104 Dec 25 21:13:03.862408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 877/1803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:02 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1387 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:03.878555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:03.879818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:03.897005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:03.899566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.901663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:03.902133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.922708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.compute.api [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Instance is already in deleting state, ignoring this request Dec 25 21:13:03.924133 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-012d9330-4363-4373-b842-4614389e66ad tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 204 len: 0 microversion: 2.1 time: 0.273036 Dec 25 21:13:03.925745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 927/1804] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:03 2021] DELETE /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:03.934095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:03.934713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:03.968126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:03.968804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.969807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:03.970624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:03.995762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48f58c38-d36a-4cfd-b130-4cb471d1aae0 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 32662 microversion: 2.1 time: 0.124567 Dec 25 21:13:03.995762 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 878/1805] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:13:03 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 32662 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:13:04.301445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:04.326609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49a511fe-3c94-45e3-91c8-54a67e365a3f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1492 microversion: 2.1 time: 0.397544 Dec 25 21:13:04.339649 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 928/1806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:03 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1492 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:04.579423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:04.585628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:04.598804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:04.599577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:04.600633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:04.601366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:04.788363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:04.801507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1b0b2af-9aeb-4acb-b233-608b42bf06fe tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.231526 Dec 25 21:13:04.801921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4d29ab7a-129c-4bdf-a3a8-4c0c0161d410 req-79e04f8f-b070-4be0-84b8-8dda02e326da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f6f0ff-5388-463f-95ad-bb8a5b36da5d", "name": "network-vif-unplugged", "status": "completed", "tag": "0a669f5e-5fef-4866-bd8e-e6cac72b1152"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:04.803661 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:04.803661 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:04.804418 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 879/1807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:04 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:04.821360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4d29ab7a-129c-4bdf-a3a8-4c0c0161d410 req-79e04f8f-b070-4be0-84b8-8dda02e326da service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:04.822063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4d29ab7a-129c-4bdf-a3a8-4c0c0161d410 req-79e04f8f-b070-4be0-84b8-8dda02e326da service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:04.836378 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4d29ab7a-129c-4bdf-a3a8-4c0c0161d410 req-79e04f8f-b070-4be0-84b8-8dda02e326da service nova] Creating event network-vif-unplugged:0a669f5e-5fef-4866-bd8e-e6cac72b1152 for instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d on nch2-master-1 Dec 25 21:13:04.842873 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4d29ab7a-129c-4bdf-a3a8-4c0c0161d410 req-79e04f8f-b070-4be0-84b8-8dda02e326da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044055 Dec 25 21:13:04.844460 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 929/1808] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:04.878639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:04.879896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:04.887710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:04.888161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:04.889184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:04.889620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.025331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:05.025331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:05.025331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.025331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.025331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.025331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.096408 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2c02aa2a-0e9e-4c55-b479-f0126c38e9c9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action" status: 200 len: 40789 microversion: 2.1 time: 0.095112 Dec 25 21:13:05.100128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 930/1809] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:13:04 2021] POST /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e/action => generated 40789 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:13:05.108730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:05.109744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:05.117175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.128803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.131010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.131682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.206534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:05.215987 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68ec1aa1-3243-43ff-a3a7-1039462545c3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1387 microversion: 2.1 time: 0.339040 Dec 25 21:13:05.217201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 880/1810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:04 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1387 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:05.356732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:05.362540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:05.371287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.371742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.372557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.377710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.468024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:05.480027 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-edbbd5be-238e-4f60-9e9d-8c599b934d3d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1709 microversion: 2.1 time: 0.375521 Dec 25 21:13:05.505712 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 931/1811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:05 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1709 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:05.516175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:05.529556 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfe1b30f-03ab-4bd9-96f6-a715f2ea2b01 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1450 microversion: 2.1 time: 0.176649 Dec 25 21:13:05.530622 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 881/1812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:05 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1450 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:05.822784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:05.823550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:05.842343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.843374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.844509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.846862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.888310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f439f477-1d56-444b-8ef7-65712c26e1ba req-e336cf83-838e-48e5-bae3-e5ada425d8cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f6f0ff-5388-463f-95ad-bb8a5b36da5d", "name": "network-vif-deleted", "tag": "0a669f5e-5fef-4866-bd8e-e6cac72b1152"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:05.891294 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:05.891294 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:05.899851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f439f477-1d56-444b-8ef7-65712c26e1ba req-e336cf83-838e-48e5-bae3-e5ada425d8cf service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:05.900627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f439f477-1d56-444b-8ef7-65712c26e1ba req-e336cf83-838e-48e5-bae3-e5ada425d8cf service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:05.933518 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f439f477-1d56-444b-8ef7-65712c26e1ba req-e336cf83-838e-48e5-bae3-e5ada425d8cf service nova] Creating event network-vif-deleted:0a669f5e-5fef-4866-bd8e-e6cac72b1152 for instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d on nch2-master-1 Dec 25 21:13:05.968081 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f439f477-1d56-444b-8ef7-65712c26e1ba req-e336cf83-838e-48e5-bae3-e5ada425d8cf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083018 Dec 25 21:13:05.971982 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 882/1813] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:13:06.234901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:06.235612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:06.250045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.250766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.251820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.252437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.408340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:06.420953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4c08162-bb93-46b7-9275-1d34caceda56 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.603573 Dec 25 21:13:06.435116 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 932/1814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:05 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:06.442466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:06.446480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:06.460243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.461301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.462429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.463113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.526662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:06.666035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:06.683026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5345508a-86ea-40ca-a815-057827100ea6 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1387 microversion: 2.1 time: 0.452992 Dec 25 21:13:06.694040 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 883/1815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:06 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1387 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:06.695720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:06.696518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:06.709479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.709937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.710736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.711170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.804421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:06.804787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:06.805281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lazy-loading 'fault' on Instance uuid 80f6f0ff-5388-463f-95ad-bb8a5b36da5d {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:06.872467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '613e2533f4e04cca8fafc3ea463accd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74b18f04a1eb470bac90f3df16ec5170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:06.892263 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f13dfc2b-3712-4fc1-8ea6-f3a7557ff484 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 200 len: 1296 microversion: 2.1 time: 0.200047 Dec 25 21:13:06.892966 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 884/1816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:06 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:07.093517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09a9bf8a-85cf-4f21-8422-7495ff884ae9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 204 len: 0 microversion: 2.1 time: 0.654958 Dec 25 21:13:07.095042 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 933/1817] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:06 2021] DELETE /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:07.102541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:07.103169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:07.112863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.117854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.118717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.119157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.203904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fa1af07f-04a2-4016-9c0f-55b3cfbb1ac3 req-566d5f76-f33d-4894-8d31-20422389b973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c9cb266-1a4b-41a7-b9c4-55bc33979d91", "name": "network-vif-deleted", "tag": "665e512c-6adc-4461-b6ed-9ce93d1fdeee"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:07.206106 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:07.206106 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:07.224298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fa1af07f-04a2-4016-9c0f-55b3cfbb1ac3 req-566d5f76-f33d-4894-8d31-20422389b973 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.224846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fa1af07f-04a2-4016-9c0f-55b3cfbb1ac3 req-566d5f76-f33d-4894-8d31-20422389b973 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.238127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fa1af07f-04a2-4016-9c0f-55b3cfbb1ac3 req-566d5f76-f33d-4894-8d31-20422389b973 service nova] Creating event network-vif-deleted:665e512c-6adc-4461-b6ed-9ce93d1fdeee for instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 on nch1-master-1 Dec 25 21:13:07.258092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fa1af07f-04a2-4016-9c0f-55b3cfbb1ac3 req-566d5f76-f33d-4894-8d31-20422389b973 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050326 Dec 25 21:13:07.258092 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 934/1818] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:13:07.452139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:07.453998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:07.465023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.466307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.468411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.469503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.541522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:07.552297 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6db90a86-0905-4640-852c-90e02d1360d1 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1715 microversion: 2.1 time: 0.453729 Dec 25 21:13:07.568138 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 885/1819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:07 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1715 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:07.689343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:07.703404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:07.704146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:07.709900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d6640bd-1fcc-4c84-a05a-a92c970f7cca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.274734 Dec 25 21:13:07.715055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 935/1820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:07 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:07.718140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.720648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.722148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.725466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.860345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:07.871824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c634100c-4d84-40d2-ab70-6cd6cceebf72 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 200 len: 1183 microversion: 2.1 time: 0.174429 Dec 25 21:13:07.876957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 886/1821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:07 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 1183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:07.910973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:07.911915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: 80f6f0ff-5388-463f-95ad-bb8a5b36da5d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:07.922810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.923579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.924802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:07.925503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:07.942705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d could not be found. Dec 25 21:13:07.943529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance 80f6f0ff-5388-463f-95ad-bb8a5b36da5d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:07.944556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43df002d-2551-48b6-b8e7-f9063b36fed2 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d" status: 404 len: 111 microversion: 2.1 time: 0.037915 Dec 25 21:13:07.945641 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 936/1822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:07 2021] GET /compute/v2.1/servers/80f6f0ff-5388-463f-95ad-bb8a5b36da5d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:13:07.955078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb9a8199-24fd-47b9-9cc2-6a08bd883669 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f68b7ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:07.983997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-eb9a8199-24fd-47b9-9cc2-6a08bd883669 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Image not found. Dec 25 21:13:07.984990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb9a8199-24fd-47b9-9cc2-6a08bd883669 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:07.986060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb9a8199-24fd-47b9-9cc2-6a08bd883669 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89" status: 404 len: 62 microversion: 2.1 time: 0.035181 Dec 25 21:13:07.990662 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 887/1823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:07 2021] DELETE /compute/v2.1/images/f8218aee-4845-45c7-9a84-d3cfbf30da89 => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:13:07.998012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:07.998613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.006415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.009123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.010128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.010738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.028215 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance c01ef47d-effa-4511-a9b2-27108542948c could not be found. Dec 25 21:13:08.029206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance c01ef47d-effa-4511-a9b2-27108542948c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.030868 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7977a383-19b7-4695-a381-0c1f32638086 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 404 len: 111 microversion: 2.1 time: 0.036688 Dec 25 21:13:08.032080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 937/1824] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:07 2021] DELETE /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:08.039581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.040511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: c01ef47d-effa-4511-a9b2-27108542948c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.049579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.050362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.051438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.052123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.072211 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance c01ef47d-effa-4511-a9b2-27108542948c could not be found. Dec 25 21:13:08.073110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance c01ef47d-effa-4511-a9b2-27108542948c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.074194 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d3e5e32-ea1a-4b1d-a498-cec84070bfdd tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c" status: 404 len: 111 microversion: 2.1 time: 0.038230 Dec 25 21:13:08.078573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 888/1825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] GET /compute/v2.1/servers/c01ef47d-effa-4511-a9b2-27108542948c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:08.084493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4907ca75-bded-4dd9-a74e-b1e512e8d806 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6acd1f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.124190 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4907ca75-bded-4dd9-a74e-b1e512e8d806 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Image not found. Dec 25 21:13:08.124800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4907ca75-bded-4dd9-a74e-b1e512e8d806 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.125882 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4907ca75-bded-4dd9-a74e-b1e512e8d806 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a" status: 404 len: 62 microversion: 2.1 time: 0.046315 Dec 25 21:13:08.126640 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 938/1826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] DELETE /compute/v2.1/images/f1ac02e1-1660-4808-ac56-96214fde437a => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:13:08.135706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.136203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.146260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.146880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.147702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.148147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.177649 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 could not be found. Dec 25 21:13:08.179733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.181555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9cb2cc5-9c5a-4362-8084-e931c190c75a tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 404 len: 111 microversion: 2.1 time: 0.050053 Dec 25 21:13:08.186613 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 889/1827] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:08 2021] DELETE /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:08.195624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.196527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: e327d55b-28ca-4bfa-bcf1-e4ed49240d52] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.218703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.219845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.220853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.222543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.242811 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 could not be found. Dec 25 21:13:08.243785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance e327d55b-28ca-4bfa-bcf1-e4ed49240d52 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.245051 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da4a99d5-74e2-4641-883d-ce0eab5606a4 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52" status: 404 len: 111 microversion: 2.1 time: 0.058026 Dec 25 21:13:08.247696 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 939/1828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] GET /compute/v2.1/servers/e327d55b-28ca-4bfa-bcf1-e4ed49240d52 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:08.256081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59d28d04-61da-476a-95b0-7ef73f218e47 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '.version_select at 0x7fa4f6834ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.344624 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-59d28d04-61da-476a-95b0-7ef73f218e47 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Image not found. Dec 25 21:13:08.345470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59d28d04-61da-476a-95b0-7ef73f218e47 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.346318 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-59d28d04-61da-476a-95b0-7ef73f218e47 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd" status: 404 len: 62 microversion: 2.1 time: 0.094195 Dec 25 21:13:08.349461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 890/1829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] DELETE /compute/v2.1/images/86b952eb-dbfe-45cd-9078-9f1137b088dd => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:13:08.357886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.358690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.377273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.392239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.400920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.401077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.401190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.402846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.418898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.419355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.420426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.421076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.454325 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance ed1843d1-a627-404e-adf4-56974bcaa614 could not be found. Dec 25 21:13:08.458560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance ed1843d1-a627-404e-adf4-56974bcaa614 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.460046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f46945cb-176b-428a-9f00-4b1ba4940300 tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 404 len: 111 microversion: 2.1 time: 0.107682 Dec 25 21:13:08.461126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 940/1830] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:08 2021] DELETE /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:08.469896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.470762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] [instance: ed1843d1-a627-404e-adf4-56974bcaa614] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.478153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.484985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.484985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.484985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.485297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:08.503982 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] HTTP exception thrown: Instance ed1843d1-a627-404e-adf4-56974bcaa614 could not be found. Dec 25 21:13:08.504912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] Returning 404 to user: Instance ed1843d1-a627-404e-adf4-56974bcaa614 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:08.506233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a88c745-6621-47d8-938f-de347faa2a1f tempest-ImagesTestJSON-1757783933 tempest-ImagesTestJSON-1757783933-project] 10.222.0.32 "GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614" status: 404 len: 111 microversion: 2.1 time: 0.040822 Dec 25 21:13:08.508646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 941/1831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] GET /compute/v2.1/servers/ed1843d1-a627-404e-adf4-56974bcaa614 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:13:08.573900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.574867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.583336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.583995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.585090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.585606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.950838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:08.975397 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed92ca02-2ee8-4acb-bf2d-336c1e2db988 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1715 microversion: 2.1 time: 0.408545 Dec 25 21:13:08.976324 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 942/1832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1715 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:08.981189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:08.981804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:08.990972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.991568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:08.992371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:08.993542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:09.030309 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d8d8a1a-2ce4-41bc-9121-5d82046e287c tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "DELETE /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 204 len: 0 microversion: 2.25 time: 0.635339 Dec 25 21:13:09.031201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 891/1833] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:13:08 2021] DELETE /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:13:09.043288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:09.043850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 6c9cb266-1a4b-41a7-b9c4-55bc33979d91] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:09.057424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:09.058022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:09.059088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:09.065675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:09.094162 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] HTTP exception thrown: Instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 could not be found. Dec 25 21:13:09.095186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Returning 404 to user: Instance 6c9cb266-1a4b-41a7-b9c4-55bc33979d91 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:09.096060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e655f7d3-7f20-4722-bbcd-3827b4eae2e5 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91" status: 404 len: 111 microversion: 2.1 time: 0.063941 Dec 25 21:13:09.099800 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 892/1834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:09 2021] GET /compute/v2.1/servers/6c9cb266-1a4b-41a7-b9c4-55bc33979d91 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:09.124384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-823830477", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "fe8d65f9-00af-4751-929a-992529d61f28"}, {"uuid": "db6bf08b-3b26-4dda-a3c4-b7642bb36e68"}, {"uuid": "fe8d65f9-00af-4751-929a-992529d61f28"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:09.231993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] validate_networks() for [('fe8d65f9-00af-4751-929a-992529d61f28', None, None, None, None, None), ('db6bf08b-3b26-4dda-a3c4-b7642bb36e68', None, None, None, None, None), ('fe8d65f9-00af-4751-929a-992529d61f28', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:13:09.843296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:09.858730 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4db45cff-0930-4519-8d24-2ee4ac4eed59 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.880625 Dec 25 21:13:09.859799 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 943/1835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:08 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:09.864503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:09.865438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:09.872604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:09.873946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:09.878156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:09.878787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:10.845683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:10.854162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:10.855677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:10.856864 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b6886fdc-6351-4d4c-8cd1-9fca8fb1ec92 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1563 microversion: 2.25 time: 0.995904 Dec 25 21:13:10.857491 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 944/1836] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:09 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1563 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:10.873004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:10.879415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:10.896105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:10.896858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:10.897856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:10.898539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:11.035888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:11.044496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6f3fa96-cc58-4115-b47b-44c490788449 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1647 microversion: 2.1 time: 0.175179 Dec 25 21:13:11.057297 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 945/1837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:10 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1647 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:11.062076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:11.070609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:11.083082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:11.085375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:11.086413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:11.087905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.327615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:12.345046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d091344f-dea4-4e99-99e2-ceb3f22e4908 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 1.285507 Dec 25 21:13:12.346505 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 946/1838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:11 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:12.353344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-dcc55215-f7a8-482d-9c13-f66bd612d9c8 req-1ab50040-6c06-4fd2-82ea-792b92cd9bfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df0e675-9617-49b5-bf06-c32adf655c9e", "name": "network-vif-deleted", "tag": "53ff2af7-9bf4-4cb8-bafa-414f471bb1cb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:12.355183 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:12.355183 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:12.364240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dcc55215-f7a8-482d-9c13-f66bd612d9c8 req-1ab50040-6c06-4fd2-82ea-792b92cd9bfe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.366379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dcc55215-f7a8-482d-9c13-f66bd612d9c8 req-1ab50040-6c06-4fd2-82ea-792b92cd9bfe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.383636 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-dcc55215-f7a8-482d-9c13-f66bd612d9c8 req-1ab50040-6c06-4fd2-82ea-792b92cd9bfe service nova] Creating event network-vif-deleted:53ff2af7-9bf4-4cb8-bafa-414f471bb1cb for instance 7df0e675-9617-49b5-bf06-c32adf655c9e on nch2-master-1 Dec 25 21:13:12.391322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-dcc55215-f7a8-482d-9c13-f66bd612d9c8 req-1ab50040-6c06-4fd2-82ea-792b92cd9bfe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043300 Dec 25 21:13:12.392162 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 947/1839] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:12.403932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:12.405000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:12.415745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.416523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.418094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.418953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.661664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:13:12.662139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:13:12.662561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:13:12.663291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:13:12.663715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:13:12.681454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.681972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.685492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.689273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.700689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:12.710049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:12.714873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:12.722788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-056ce661-c365-44d0-96af-57f0800608b3 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1521 microversion: 2.25 time: 0.324708 Dec 25 21:13:12.723684 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 948/1840] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:12 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:12.746704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Getting quotas for project af3f5665f009477385c524a3e23aedc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:12.752830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:12.753987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:12.761737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Getting quotas for user 6015b6dc2cbd4171a690602866d50ace and project af3f5665f009477385c524a3e23aedc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:12.765251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.776573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.777665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.778262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.793058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:13:12.798057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:13:12.880509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.881350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.882028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lazy-loading 'fault' on Instance uuid 7df0e675-9617-49b5-bf06-c32adf655c9e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:12.957535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa5e089e14854aec83cc6b1f9ca9fedc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e25e5a44bb7e4ef7a38e961e6203b72b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:12.974843 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-787705c1-4bde-4cc7-a048-37d3734cd42e tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 200 len: 1355 microversion: 2.1 time: 0.239359 Dec 25 21:13:12.975648 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 949/1841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:12 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 1355 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:12.980396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9ac443a8-a8c7-4021-8852-86914334589a req-2e70e743-bf20-4b1d-ae03-193dd6db7236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a010e5-bcbf-43a3-8e08-f1b8c0bdde01", "name": "network-vif-plugged", "status": "completed", "tag": "5efcdb31-93a6-4522-8ad1-d57b10fea80d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:12.982180 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:12.982180 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:12.990815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9ac443a8-a8c7-4021-8852-86914334589a req-2e70e743-bf20-4b1d-ae03-193dd6db7236 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:12.991555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9ac443a8-a8c7-4021-8852-86914334589a req-2e70e743-bf20-4b1d-ae03-193dd6db7236 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:12.997311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7759283d-9dd8-4a3e-b508-595b7cb6fc84 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.898268 Dec 25 21:13:12.999035 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 893/1842] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:13:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 3900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:13:13.005383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7ae35ee5-ada9-40df-a8c0-dd30543f2f07 req-75316cfa-361b-43f9-b192-bb447918b062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34088aa4-5622-46a6-a155-94ef62f87546", "name": "network-vif-deleted", "tag": "1f34074e-0a6d-4eef-a7d5-cef1f7f400f3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:13.007728 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:13.007728 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:13.009513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9ac443a8-a8c7-4021-8852-86914334589a req-2e70e743-bf20-4b1d-ae03-193dd6db7236 service nova] Creating event network-vif-plugged:5efcdb31-93a6-4522-8ad1-d57b10fea80d for instance 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 on nch1-master-1 Dec 25 21:13:13.017624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7ae35ee5-ada9-40df-a8c0-dd30543f2f07 req-75316cfa-361b-43f9-b192-bb447918b062 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:13.018682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7ae35ee5-ada9-40df-a8c0-dd30543f2f07 req-75316cfa-361b-43f9-b192-bb447918b062 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:13.024165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9ac443a8-a8c7-4021-8852-86914334589a req-2e70e743-bf20-4b1d-ae03-193dd6db7236 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047095 Dec 25 21:13:13.032493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 950/1843] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:13.038296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d25300ec-8bba-4b0b-8c1c-6a75ebc87e05 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:13.039231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d25300ec-8bba-4b0b-8c1c-6a75ebc87e05 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:13.049934 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7ae35ee5-ada9-40df-a8c0-dd30543f2f07 req-75316cfa-361b-43f9-b192-bb447918b062 service nova] Creating event network-vif-deleted:1f34074e-0a6d-4eef-a7d5-cef1f7f400f3 for instance 34088aa4-5622-46a6-a155-94ef62f87546 on nch1-master-1 Dec 25 21:13:13.072800 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7ae35ee5-ada9-40df-a8c0-dd30543f2f07 req-75316cfa-361b-43f9-b192-bb447918b062 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072051 Dec 25 21:13:13.078184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 894/1844] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:13.224681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d25300ec-8bba-4b0b-8c1c-6a75ebc87e05 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:13.240438 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d25300ec-8bba-4b0b-8c1c-6a75ebc87e05 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1212 microversion: 2.1 time: 0.206276 Dec 25 21:13:13.254932 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 951/1845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:13 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1212 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:13.377735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:13.377735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:13.412090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:13.423837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:13.431624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:13.431624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:13.752791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:13.755302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:13.790426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:13.792528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:13.798885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:13.799890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:13.887590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:13.888064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:13.888521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lazy-loading 'fault' on Instance uuid 34088aa4-5622-46a6-a155-94ef62f87546 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:14.005721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:14.020971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:14.021096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:14.022233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f89176c3-b120-4196-a5e9-7e7d012e940b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 200 len: 1351 microversion: 2.25 time: 0.282946 Dec 25 21:13:14.023063 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 952/1846] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:13 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 1351 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:14.027657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:14.028474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:14.052401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:14.055097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:14.055097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:14.055097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:14.090116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 7df0e675-9617-49b5-bf06-c32adf655c9e could not be found. Dec 25 21:13:14.090116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 7df0e675-9617-49b5-bf06-c32adf655c9e could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:14.090116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e5b09c78-9981-4417-bea6-01e305f8ed3a tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 404 len: 111 microversion: 2.1 time: 0.062468 Dec 25 21:13:14.090116 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 953/1847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:14 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:14.142465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:14.150617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31b54f24-2636-4109-b4a2-01a80da039b0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.790437 Dec 25 21:13:14.164799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 895/1848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:13 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:14.172808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:14.176297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:14.180289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:14.180957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:14.181937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:14.182674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:14.206551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. Dec 25 21:13:14.207625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:14.209087 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9812db3e-212b-4cde-8ddc-33d18429e7e8 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 404 len: 111 microversion: 2.1 time: 0.041332 Dec 25 21:13:14.213557 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 896/1849] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:14 2021] DELETE /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:14.220094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:14.221414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:14.232413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:14.237481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:14.238444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:14.239677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:14.261990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. Dec 25 21:13:14.262737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:14.265204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20eeb552-2017-4332-803f-1a151c7f881d tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 404 len: 111 microversion: 2.1 time: 0.050242 Dec 25 21:13:14.272344 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 897/1850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:14 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:14.278709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1faeac60-d1ef-465c-bb13-645cbf846864 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:14.280613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1faeac60-d1ef-465c-bb13-645cbf846864 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:14.338242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7b52990-0841-49c3-9460-14196ccec290 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f6aaa430>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:14.351022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c7b52990-0841-49c3-9460-14196ccec290 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Dec 25 21:13:14.351022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7b52990-0841-49c3-9460-14196ccec290 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:14.351022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7b52990-0841-49c3-9460-14196ccec290 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.260539 Dec 25 21:13:14.354113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 954/1851] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:14 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:13:14.364523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2504718-00c4-4d55-bc03-56c95df1d69f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '.version_select at 0x7fa4f6b12820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:14.430546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1faeac60-d1ef-465c-bb13-645cbf846864 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:14.457819 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1faeac60-d1ef-465c-bb13-645cbf846864 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1212 microversion: 2.1 time: 0.184077 Dec 25 21:13:14.458406 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 898/1852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:14 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1212 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:14.463229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa500761e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-394497161", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:14.484628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2504718-00c4-4d55-bc03-56c95df1d69f tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535556607" status: 202 len: 0 microversion: 2.1 time: 0.125166 Dec 25 21:13:14.491549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:14.493237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 955/1853] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:13:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1535556607 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:13:14.499008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for user 883c40c7de2a4666897b157078d704e6 and project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:14.534228 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] [f642f573-f303-4342-b3fc-1ae94e6cc0eb] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 21:13:14.891569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49d263c7-8408-49d5-bfd5-8ccea0388f51 tempest-ListImageFiltersNegativeTestJSON-1705890037 tempest-ListImageFiltersNegativeTestJSON-1705890037-project] Calling method '.version_select at 0x7fa4f6ad7700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:14.974074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-49d263c7-8408-49d5-bfd5-8ccea0388f51 tempest-ListImageFiltersNegativeTestJSON-1705890037 tempest-ListImageFiltersNegativeTestJSON-1705890037-project] HTTP exception thrown: Image not found. Dec 25 21:13:14.974758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49d263c7-8408-49d5-bfd5-8ccea0388f51 tempest-ListImageFiltersNegativeTestJSON-1705890037 tempest-ListImageFiltersNegativeTestJSON-1705890037-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:14.975823 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49d263c7-8408-49d5-bfd5-8ccea0388f51 tempest-ListImageFiltersNegativeTestJSON-1705890037 tempest-ListImageFiltersNegativeTestJSON-1705890037-project] 10.222.0.32 "GET /compute/v2.1/images/9f3336c1-6ce8-4aa4-a7ed-d85be218c5c0" status: 404 len: 62 microversion: 2.1 time: 0.263315 Dec 25 21:13:14.979414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 956/1854] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:13:14 2021] GET /compute/v2.1/images/9f3336c1-6ce8-4aa4-a7ed-d85be218c5c0 => generated 62 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:13:15.047038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:15.047667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 34088aa4-5622-46a6-a155-94ef62f87546] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:15.065395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.065890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.070068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.071254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.110650 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] HTTP exception thrown: Instance 34088aa4-5622-46a6-a155-94ef62f87546 could not be found. Dec 25 21:13:15.111265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Returning 404 to user: Instance 34088aa4-5622-46a6-a155-94ef62f87546 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:15.112113 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8247d53a-0364-48fa-babf-f299118f3d1b tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546" status: 404 len: 111 microversion: 2.25 time: 0.069698 Dec 25 21:13:15.125493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 957/1855] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:15 2021] GET /compute/v2.1/servers/34088aa4-5622-46a6-a155-94ef62f87546 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:13:15.130686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:15.131183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:15.153649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.154812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.157615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.158253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.251613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:15.542048 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] [f642f573-f303-4342-b3fc-1ae94e6cc0eb] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 37662. Dec 25 21:13:15.560130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Dec 25 21:13:15.561876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:15.562875 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0bd8eebb-2d15-4d27-816c-bc5d504f3706 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 1.103540 Dec 25 21:13:15.563927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 899/1856] 10.222.0.32 () {60 vars in 1159 bytes} [Sat Dec 25 21:13:14 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 1105 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:15.568809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:15.569702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:15.577869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.578658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.579535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.580043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.934906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b7b1df8-ac8e-4e54-816b-05c5278a023a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 204 len: 0 microversion: 2.25 time: 0.808005 Dec 25 21:13:15.939695 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 958/1857] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:13:15 2021] DELETE /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 0 bytes in 809 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:13:15.941712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-37886bec-3dd6-4db7-be8a-f0ad7bd76c80 req-31a7535f-9eaa-4480-bd32-041297ab24c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f", "name": "network-vif-plugged", "status": "completed", "tag": "1615d351-b877-4433-a0e3-10b0d89051ce"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:15.943307 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:15.943307 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:15.963294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-37886bec-3dd6-4db7-be8a-f0ad7bd76c80 req-31a7535f-9eaa-4480-bd32-041297ab24c4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:15.964231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-37886bec-3dd6-4db7-be8a-f0ad7bd76c80 req-31a7535f-9eaa-4480-bd32-041297ab24c4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:15.992510 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-37886bec-3dd6-4db7-be8a-f0ad7bd76c80 req-31a7535f-9eaa-4480-bd32-041297ab24c4 service nova] Creating event network-vif-plugged:1615d351-b877-4433-a0e3-10b0d89051ce for instance 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f on nch2-master-1 Dec 25 21:13:15.998004 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-37886bec-3dd6-4db7-be8a-f0ad7bd76c80 req-31a7535f-9eaa-4480-bd32-041297ab24c4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060963 Dec 25 21:13:15.998617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 959/1858] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:16.015932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:16.018267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:16.028006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:16.028458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:16.030347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:16.030980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:16.084907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:16.092522 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-364754b7-26e1-45d9-9fd9-41b69ef4ffe8 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.527323 Dec 25 21:13:16.096087 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 900/1859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:15 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:16.109609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd787a2a-2780-478a-82f7-648a75be3957 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f68705e0>, body: {"keypair": {"name": "tempest-keypair-1545786266"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:16.165552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dd787a2a-2780-478a-82f7-648a75be3957 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:16.177861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dd787a2a-2780-478a-82f7-648a75be3957 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for user 883c40c7de2a4666897b157078d704e6 and project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:16.202033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:16.211708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ff9ed96-058a-49a2-b15d-1c999bb339c1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1208 microversion: 2.1 time: 0.202196 Dec 25 21:13:16.215192 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 960/1860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:16 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1208 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:16.236404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:16.246659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:16.274680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:16.275554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:16.283421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:16.284217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:16.809549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dd787a2a-2780-478a-82f7-648a75be3957 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:16.821758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-dd787a2a-2780-478a-82f7-648a75be3957 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for user 883c40c7de2a4666897b157078d704e6 and project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:16.852318 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd787a2a-2780-478a-82f7-648a75be3957 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.753232 Dec 25 21:13:16.853039 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 901/1861] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:16 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:16.870518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da52a4c5-43e2-46af-ae1e-7f72c76b1ccc tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:16.871897 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:16.871897 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:16.921090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:16.933765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:16.936327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:16.940435 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b15e2e86-62bd-4584-a900-30d31fb0d4de tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1549 microversion: 2.25 time: 0.708473 Dec 25 21:13:16.948134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 961/1862] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:16 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1549 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:16.955116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0498013-5be5-47b7-b17e-36858cb1bc4e tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f6aac8b0>, body: {"keypair": {"name": "tempest-keypair-1545786266"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:16.997148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f0498013-5be5-47b7-b17e-36858cb1bc4e tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:17.005733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f0498013-5be5-47b7-b17e-36858cb1bc4e tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for user 883c40c7de2a4666897b157078d704e6 and project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:17.009080 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da52a4c5-43e2-46af-ae1e-7f72c76b1ccc tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/146250592" status: 202 len: 0 microversion: 2.1 time: 0.152790 Dec 25 21:13:17.009080 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 902/1863] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:13:16 2021] DELETE /compute/v2.1/flavors/146250592 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:13:17.017406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a480202-a199-4cf4-bccf-2a3cf6a1e321 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:17.078740 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a480202-a199-4cf4-bccf-2a3cf6a1e321 tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.065580 Dec 25 21:13:17.078740 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 903/1864] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:13:17 2021] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:17.105161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02d57f7e-76a0-4d8c-a781-de5131e6e3de tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:17.366470 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02d57f7e-76a0-4d8c-a781-de5131e6e3de tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1498146698" status: 202 len: 0 microversion: 2.1 time: 0.275883 Dec 25 21:13:17.368262 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 904/1865] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:13:17 2021] DELETE /compute/v2.1/flavors/1498146698 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:13:17.373538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:17.374414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:17.396933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:17.397965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:17.405993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:17.406701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:17.731338 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-f0498013-5be5-47b7-b17e-36858cb1bc4e tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] HTTP exception thrown: Key pair 'tempest-keypair-1545786266' already exists. Dec 25 21:13:17.732280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0498013-5be5-47b7-b17e-36858cb1bc4e tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 409 to user: Key pair 'tempest-keypair-1545786266' already exists. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:17.734290 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f0498013-5be5-47b7-b17e-36858cb1bc4e tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.784850 Dec 25 21:13:17.735151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 962/1866] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:16 2021] POST /compute/v2.1/os-keypairs => generated 105 bytes in 786 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:13:17.741207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:17.747725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:17.763312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:17.764339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:17.765941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:17.766399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:17.960284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:17.992116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a82c547f-8898-47f1-a614-407b1fe1d480 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1282 microversion: 2.1 time: 0.255289 Dec 25 21:13:18.005272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 963/1867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:17 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1282 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:18.020808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0d51f1b6-4ec4-4654-9b49-a295ae74a8ec tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.066447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0d51f1b6-4ec4-4654-9b49-a295ae74a8ec tempest-ServersWithSpecificFlavorTestJSON-1841073584 tempest-ServersWithSpecificFlavorTestJSON-1841073584-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059564 Dec 25 21:13:18.067074 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 964/1868] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:13:18 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:18.100589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6aa1fcbc-f06c-4d95-bc55-886942e07ca9 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Calling method '.version_select at 0x7fa4f6aac4c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.119609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:18.138795 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac2194e5-04fb-4839-906a-092a17ddcdd6 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1317 microversion: 2.1 time: 0.770367 Dec 25 21:13:18.141451 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 905/1869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:17 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:18.166320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.167245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:18.182838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.183646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.184653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.185501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.268208 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6aa1fcbc-f06c-4d95-bc55-886942e07ca9 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545786266" status: 202 len: 0 microversion: 2.1 time: 0.200011 Dec 25 21:13:18.273188 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 965/1870] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:13:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1545786266 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:13:18.278146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.278650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:18.299752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.300216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.301109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.306745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.351542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 7df0e675-9617-49b5-bf06-c32adf655c9e could not be found. Dec 25 21:13:18.352151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 7df0e675-9617-49b5-bf06-c32adf655c9e could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.353019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-acf6fc6f-eef7-4724-a05e-92e4a7d39597 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 404 len: 111 microversion: 2.1 time: 0.078829 Dec 25 21:13:18.360331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 966/1871] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:18 2021] DELETE /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:18.376669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b965c7de-1773-4a74-9b08-4c8b2186a1cb tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f6a44d30>, body: {"keypair": {"name": ""}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:18.377669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b965c7de-1773-4a74-9b08-4c8b2186a1cb tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.378699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b965c7de-1773-4a74-9b08-4c8b2186a1cb tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.017303 Dec 25 21:13:18.386335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 967/1872] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:18 2021] POST /compute/v2.1/os-keypairs => generated 108 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:13:18.393831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.398679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 7df0e675-9617-49b5-bf06-c32adf655c9e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:18.418897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.419450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.420297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.420745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.443902 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 7df0e675-9617-49b5-bf06-c32adf655c9e could not be found. Dec 25 21:13:18.444555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 7df0e675-9617-49b5-bf06-c32adf655c9e could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.445448 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-683f846f-7423-44cd-b08a-9ef5234c5ccc tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e" status: 404 len: 111 microversion: 2.1 time: 0.057790 Dec 25 21:13:18.449022 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 968/1873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:18 2021] GET /compute/v2.1/servers/7df0e675-9617-49b5-bf06-c32adf655c9e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:18.458293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38a2530b-63f8-4c05-91b1-34d663e2d982 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f6b5fc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-967297962", "public_key": " "}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:18.478969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-38a2530b-63f8-4c05-91b1-34d663e2d982 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:18.484060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-38a2530b-63f8-4c05-91b1-34d663e2d982 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for user 883c40c7de2a4666897b157078d704e6 and project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:18.504389 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-38a2530b-63f8-4c05-91b1-34d663e2d982 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Dec 25 21:13:18.505181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38a2530b-63f8-4c05-91b1-34d663e2d982 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.506094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-38a2530b-63f8-4c05-91b1-34d663e2d982 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.055861 Dec 25 21:13:18.506831 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 969/1874] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:18 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:18.516781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.517643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:18.526459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.526925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.527966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.530045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.545718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:18.557162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:18.559028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:18.564728 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf92e5c8-a429-4df5-876f-a9245e04337a tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1549 microversion: 2.25 time: 0.414355 Dec 25 21:13:18.564728 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 906/1875] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:18 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1549 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:18.569353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-125a2621-21c9-4d67-ae24-ea64e5467c0a tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f67e8ca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:18.577424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-125a2621-21c9-4d67-ae24-ea64e5467c0a tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.577424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-125a2621-21c9-4d67-ae24-ea64e5467c0a tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009043 Dec 25 21:13:18.577424 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 907/1876] 10.222.0.32 () {60 vars in 1158 bytes} [Sat Dec 25 21:13:18 2021] POST /compute/v2.1/os-keypairs => generated 627 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:13:18.578922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. Dec 25 21:13:18.580597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.581585 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4af2e4dd-fb2d-497a-a3db-0798818a1680 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 404 len: 111 microversion: 2.1 time: 0.073186 Dec 25 21:13:18.581715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f299e792-6e0e-4999-9c05-a08e88aeb8ae req-29ce924f-1470-4469-a019-65b7cb9c0154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e370ad00-0f15-4014-99c2-3ecd6b33849e", "name": "network-vif-deleted", "tag": "9026d1d6-3da8-4905-baa7-966ecb80b10a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:18.582512 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 970/1877] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:18 2021] DELETE /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:18.583589 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:18.583589 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:18.588108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e91e63f-cbbe-4462-af33-369ebeb055b6 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Action: 'create', calling method: .version_select at 0x7fa4f6aacee0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2088361373", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:18.599572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f299e792-6e0e-4999-9c05-a08e88aeb8ae req-29ce924f-1470-4469-a019-65b7cb9c0154 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.608847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5e91e63f-cbbe-4462-af33-369ebeb055b6 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:18.609429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f299e792-6e0e-4999-9c05-a08e88aeb8ae req-29ce924f-1470-4469-a019-65b7cb9c0154 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.612947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5e91e63f-cbbe-4462-af33-369ebeb055b6 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Getting quotas for user 883c40c7de2a4666897b157078d704e6 and project e0db74de806d4042916906036a29323b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:18.629684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5e91e63f-cbbe-4462-af33-369ebeb055b6 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Dec 25 21:13:18.630507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e91e63f-cbbe-4462-af33-369ebeb055b6 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.631545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e91e63f-cbbe-4462-af33-369ebeb055b6 tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.047888 Dec 25 21:13:18.632304 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 971/1878] 10.222.0.32 () {60 vars in 1158 bytes} [Sat Dec 25 21:13:18 2021] POST /compute/v2.1/os-keypairs => generated 99 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:13:18.636018 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f299e792-6e0e-4999-9c05-a08e88aeb8ae req-29ce924f-1470-4469-a019-65b7cb9c0154 service nova] Creating event network-vif-deleted:9026d1d6-3da8-4905-baa7-966ecb80b10a for instance e370ad00-0f15-4014-99c2-3ecd6b33849e on nch1-master-1 Dec 25 21:13:18.641103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.641851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f299e792-6e0e-4999-9c05-a08e88aeb8ae req-29ce924f-1470-4469-a019-65b7cb9c0154 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067697 Dec 25 21:13:18.642143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] [instance: 1a4cbf2d-cea7-4432-9264-6ac3fed9238d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:18.646697 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 908/1879] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:18.652171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.652625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8db5c7a-3348-44d8-8d26-33670921304d tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Calling method '.version_select at 0x7fa5007615e0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:18.653106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.655076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:18.655707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:18.675322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] HTTP exception thrown: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. Dec 25 21:13:18.681576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a8db5c7a-3348-44d8-8d26-33670921304d tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-794061814 not found for user 883c40c7de2a4666897b157078d704e6 Dec 25 21:13:18.682419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8db5c7a-3348-44d8-8d26-33670921304d tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] Returning 404 to user: Keypair tempest-keypair-non-existent-794061814 not found for user 883c40c7de2a4666897b157078d704e6 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.683506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] Returning 404 to user: Instance 1a4cbf2d-cea7-4432-9264-6ac3fed9238d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:18.685620 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8db5c7a-3348-44d8-8d26-33670921304d tempest-KeyPairsNegativeTestJSON-677394596 tempest-KeyPairsNegativeTestJSON-677394596-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-794061814" status: 404 len: 144 microversion: 2.1 time: 0.037210 Dec 25 21:13:18.692093 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6116164e-aefb-4a04-a968-3d7b3f2e52a9 tempest-ServersWithSpecificFlavorTestJSON-439149936 tempest-ServersWithSpecificFlavorTestJSON-439149936-project] 10.222.0.32 "GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d" status: 404 len: 111 microversion: 2.1 time: 0.052313 Dec 25 21:13:18.692093 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 972/1880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:18 2021] GET /compute/v2.1/servers/1a4cbf2d-cea7-4432-9264-6ac3fed9238d => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:18.693804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 909/1881] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:13:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-794061814 => generated 144 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:19.010258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:19.011028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:19.022601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.024005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.030140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.031971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.179317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:19.181443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:19.190468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.191194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.192440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.193165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.300177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:19.308821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfd9b513-131c-4770-878a-10f760046538 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1312 microversion: 2.1 time: 0.303102 Dec 25 21:13:19.315581 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 973/1882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:19 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:19.568292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:19.579281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:19.580484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:19.585324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b4ffb5d-9da2-4a84-8fe1-55f44e376cba tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 200 len: 1504 microversion: 2.1 time: 0.418797 Dec 25 21:13:19.587682 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 910/1883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:19 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 1504 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:19.601035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:19.602166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:19.611157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.612755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.615216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.615736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.616839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.621484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.622756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.623910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.686530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:19.686530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:19.686759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lazy-loading 'fault' on Instance uuid e370ad00-0f15-4014-99c2-3ecd6b33849e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:19.796957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:19.805333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:19.811184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:19.814341 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c3d70c7-1b52-4e3c-81b4-943fbbea72ff tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 200 len: 1352 microversion: 2.25 time: 0.237365 Dec 25 21:13:19.827510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 974/1884] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:19 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 1352 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:20.024795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:20.033266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a89b7a24-0c09-4f0f-bad7-5819006b96d0 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 200 len: 1505 microversion: 2.1 time: 0.435850 Dec 25 21:13:20.041490 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 911/1885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:19 2021] GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 1505 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:20.052010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:20.053110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:20.059895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.060625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.061603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.062195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.089436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:20.330773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:20.331404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:20.339589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.340044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.341682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.341682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.365308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60a54a94-f0d4-4da2-b8e9-498a4b87c1d7 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "DELETE /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 204 len: 0 microversion: 2.1 time: 0.315933 Dec 25 21:13:20.369249 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 975/1886] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:20 2021] DELETE /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:20.377877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:20.378687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:20.396906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.397894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.400136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.401921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.445736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:20.552953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:20.561785 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6cf78d21-ecbf-42b3-80ed-b59558eccf36 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1333 microversion: 2.1 time: 0.236209 Dec 25 21:13:20.562791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 912/1887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:20 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1333 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:20.833588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:20.834157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: e370ad00-0f15-4014-99c2-3ecd6b33849e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:20.842249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.842725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.843862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.845138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.862364 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] HTTP exception thrown: Instance e370ad00-0f15-4014-99c2-3ecd6b33849e could not be found. Dec 25 21:13:20.863052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Returning 404 to user: Instance e370ad00-0f15-4014-99c2-3ecd6b33849e could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:20.863973 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-385714ce-8278-4809-a65c-095630f648b6 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e" status: 404 len: 111 microversion: 2.25 time: 0.034317 Dec 25 21:13:20.864954 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 913/1888] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:20 2021] GET /compute/v2.1/servers/e370ad00-0f15-4014-99c2-3ecd6b33849e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:13:20.874205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:20.875052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:20.882269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.883145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.884175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.884623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.914874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:20.920423 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c30bcff-f4d2-42e8-8e08-04402333fa3c tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 204 len: 0 microversion: 2.1 time: 0.547829 Dec 25 21:13:20.927390 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 976/1889] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:20 2021] DELETE /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:20.932455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:20.933336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:20.945073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.952636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:20.952636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:20.952636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:21.140680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:21.150117 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d537060c-21ad-4f62-a92e-cd38b59c78ca tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 200 len: 1511 microversion: 2.1 time: 0.224277 Dec 25 21:13:21.160661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 977/1890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:20 2021] GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:21.362823 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f465d1ed-3dbe-45d3-bc37-a7d2ab8210cd tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 204 len: 0 microversion: 2.25 time: 0.493858 Dec 25 21:13:21.364656 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 914/1891] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:13:20 2021] DELETE /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:13:21.372331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:21.373859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:21.381474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:21.382386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:21.383338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:21.384008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:21.582621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:21.582621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:21.592892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:21.593355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:21.594147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:21.594660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:21.839682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:21.850622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:21.858789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:21.860063 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed558536-b3be-4581-9c91-b9dcc2b29307 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1563 microversion: 2.25 time: 0.491633 Dec 25 21:13:21.864786 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 978/1892] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:21 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1563 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:22.163860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:22.173127 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9732f0f-8dad-409d-9222-ae0ecad69d1b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1333 microversion: 2.1 time: 0.597548 Dec 25 21:13:22.173539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:22.174436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:22.178181 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 915/1893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:21 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1333 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:22.202526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:22.203467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:22.205282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:22.206458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:22.741065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:22.741648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:22.750913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:22.751655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:22.752726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:22.753426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:22.790190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:23.061850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:23.074219 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba28ada3-eba5-4912-a047-6142d20a3431 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 200 len: 1511 microversion: 2.1 time: 0.910122 Dec 25 21:13:23.083993 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 979/1894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:22 2021] GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 1511 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:23.091171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:23.091822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:23.127493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:23.128030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:23.130458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:23.131083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:23.197453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e4d21ef-6234-412d-b8b5-a14b4096c091 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 204 len: 0 microversion: 2.1 time: 0.460171 Dec 25 21:13:23.198525 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 916/1895] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:22 2021] DELETE /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:23.204019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:23.205418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:23.230384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:23.231181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:23.232731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:23.235494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:24.358599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:24.368693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:24.380206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:24.381784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:24.382969 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-46d02cf0-0e22-46a5-949d-e6b988927f2e tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1563 microversion: 2.25 time: 1.297882 Dec 25 21:13:24.383535 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 980/1896] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:23 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1563 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:24.386993 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a97439b-d64f-41d5-9cf7-f99fd6539c0b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1333 microversion: 2.1 time: 1.187074 Dec 25 21:13:24.402686 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 917/1897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:23 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1333 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:24.408954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:24.409591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:24.415997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:24.416697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:24.423233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:24.423233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:24.423483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:24.423483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:24.453550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:24.454247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:24.455480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:24.456162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:25.145600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:25.173023 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-daca7bff-703a-4e90-a5af-c4f54b69cf36 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 200 len: 1511 microversion: 2.1 time: 0.764489 Dec 25 21:13:25.182890 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 918/1898] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:24 2021] GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:25.191331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-75942442-a012-4eac-b996-ba0661314070 req-cdb5f10a-c087-4cb6-9d4d-657ac7f2eef1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52a010e5-bcbf-43a3-8e08-f1b8c0bdde01", "name": "network-vif-deleted", "tag": "5efcdb31-93a6-4522-8ad1-d57b10fea80d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:25.208910 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:25.208910 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:25.249748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-75942442-a012-4eac-b996-ba0661314070 req-cdb5f10a-c087-4cb6-9d4d-657ac7f2eef1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:25.250594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-75942442-a012-4eac-b996-ba0661314070 req-cdb5f10a-c087-4cb6-9d4d-657ac7f2eef1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:25.266675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-75942442-a012-4eac-b996-ba0661314070 req-cdb5f10a-c087-4cb6-9d4d-657ac7f2eef1 service nova] Creating event network-vif-deleted:5efcdb31-93a6-4522-8ad1-d57b10fea80d for instance 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 on nch1-master-1 Dec 25 21:13:25.273029 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-75942442-a012-4eac-b996-ba0661314070 req-cdb5f10a-c087-4cb6-9d4d-657ac7f2eef1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088288 Dec 25 21:13:25.274806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 919/1899] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:25.316815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:25.332119 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d086699-e354-482e-a06b-80bf8e568787 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1500 microversion: 2.1 time: 0.947289 Dec 25 21:13:25.334175 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 981/1900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:24 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1500 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:25.415064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:25.418358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:25.419191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:25.421905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:25.439076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:25.439552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:25.440379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:25.442451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:25.458991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:25.458991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:25.458991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:25.458991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:25.648117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:25.664645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:25.667780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:25.689142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35947dc9-8464-4ac5-be88-b58e40734c48 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1347 microversion: 2.25 time: 0.270228 Dec 25 21:13:25.690027 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 920/1901] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:25 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1347 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:25.977541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:25.987473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8968a6be-8606-4bfe-94f5-3907661cb06b tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.577580 Dec 25 21:13:25.999705 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 982/1902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:25 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:26.190854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:26.191879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:26.212375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.213214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.224637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.224637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.328252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.329154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.329878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lazy-loading 'fault' on Instance uuid 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:26.351509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:26.352710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:26.366846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.367323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.368201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.368628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.650540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f157276b2f2845258ce93423249ed74d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576fa0b7a73d45bc86b799bb25424c30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:26.658273 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c0c59d61-4fee-4b6b-ae8e-66545fbf40ea tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 200 len: 1307 microversion: 2.1 time: 0.472790 Dec 25 21:13:26.667832 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 921/1903] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:26 2021] GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:26.668019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-776f5e3d-fe33-41c5-91bf-4aa560eb3a32 req-5c4ff658-456c-4cd7-af59-d44587173259 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "tag": "702d4dce-1add-43eb-a25b-3025bf9405db"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:26.677180 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:26.677180 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:26.701224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:26.706658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-776f5e3d-fe33-41c5-91bf-4aa560eb3a32 req-5c4ff658-456c-4cd7-af59-d44587173259 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.709446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-776f5e3d-fe33-41c5-91bf-4aa560eb3a32 req-5c4ff658-456c-4cd7-af59-d44587173259 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.710010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-66e000de-6f6a-4410-b457-05d7dd261844 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1458 microversion: 2.1 time: 0.363874 Dec 25 21:13:26.716544 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 983/1904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:26 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1458 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:26.730489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:26.731633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:26.743902 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-776f5e3d-fe33-41c5-91bf-4aa560eb3a32 req-5c4ff658-456c-4cd7-af59-d44587173259 service nova] Creating event network-changed:702d4dce-1add-43eb-a25b-3025bf9405db for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:13:26.749148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.749148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.752786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.753595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.780453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-776f5e3d-fe33-41c5-91bf-4aa560eb3a32 req-5c4ff658-456c-4cd7-af59-d44587173259 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115504 Dec 25 21:13:26.781493 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 922/1905] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:26.860679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:26.861415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:26.862511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lazy-loading 'fault' on Instance uuid 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:26.970835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:26.989760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:26.991311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2cb2a59c7c9b4a13964c78ff0fb1a8f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '276a36e6a97d46a78b7e483daa26cc2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:26.992524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a6e871e1-8508-4074-8acc-c4fab4df9462 tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 200 len: 1352 microversion: 2.25 time: 0.274856 Dec 25 21:13:26.995283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 984/1906] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:26 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 1352 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:27.006417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:27.007397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:27.014779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.019571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.021416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.023641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.477933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cd2be37-78a6-4e40-813d-8e2478ea8dc2", "name": "network-vif-deleted", "tag": "ddbefb64-c371-4875-871e-5d999ff82a14"}, {"server_uuid": "9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f", "name": "network-vif-deleted", "tag": "1615d351-b877-4433-a0e3-10b0d89051ce"}, {"server_uuid": "3c1ea080-3600-4152-8bef-f30741212401", "name": "network-vif-deleted", "tag": "03a8ec19-2525-4748-83ce-e5fe439b39e0"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:27.491224 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:27.491224 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:27.551476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.551812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.575173 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] Creating event network-vif-deleted:ddbefb64-c371-4875-871e-5d999ff82a14 for instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 on nch1-master-1 Dec 25 21:13:27.576321 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] Creating event network-vif-deleted:1615d351-b877-4433-a0e3-10b0d89051ce for instance 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f on nch2-master-1 Dec 25 21:13:27.576820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] Creating event network-vif-deleted:03a8ec19-2525-4748-83ce-e5fe439b39e0 for instance 3c1ea080-3600-4152-8bef-f30741212401 on nch1-master-1 Dec 25 21:13:27.580648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:27.590317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ce8fd5a-57c2-4308-a1ff-6ce64176f88d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.587340 Dec 25 21:13:27.593120 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-76487a24-b1b2-4754-bd9e-3fe7f81e5e11 req-c1e2d5b1-f653-45f3-8580-4591c3e86915 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.130729 Dec 25 21:13:27.594314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 985/1907] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:27 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:27.596419 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 923/1908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:27 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:27.677622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:27.678342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:27.693484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.699413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.703999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.705100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.727802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:27.730704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:27.742066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.742861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.743967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.744722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.753930 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] HTTP exception thrown: Instance 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 could not be found. Dec 25 21:13:27.757294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Returning 404 to user: Instance 52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:27.758288 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78f12b56-8047-4a8a-af4a-991f05fb9e44 tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01" status: 404 len: 111 microversion: 2.1 time: 0.086682 Dec 25 21:13:27.765813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 986/1909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:27 2021] GET /compute/v2.1/servers/52a010e5-bcbf-43a3-8e08-f1b8c0bdde01 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:27.770720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:27.771513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] [instance: 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:27.787996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.788817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.795625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.796460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.831142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] HTTP exception thrown: Instance 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f could not be found. Dec 25 21:13:27.832125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] Returning 404 to user: Instance 9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:27.833230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b20e17fa-7101-446f-a096-9a3b5c38804a tempest-MultipleCreateTestJSON-716196898 tempest-MultipleCreateTestJSON-716196898-project] 10.222.0.32 "GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f" status: 404 len: 111 microversion: 2.1 time: 0.066206 Dec 25 21:13:27.834312 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 987/1910] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:27 2021] GET /compute/v2.1/servers/9a17fe35-e90f-4c0c-9f2a-d5a3e950f16f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:27.868658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:27.869770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:27.870398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lazy-loading 'fault' on Instance uuid 3c1ea080-3600-4152-8bef-f30741212401 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:13:28.004856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:28.011552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:28.012507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] [instance: 7cd2be37-78a6-4e40-813d-8e2478ea8dc2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:28.017555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-559eabb9-e883-468e-899e-869ab8313ad3 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 200 len: 1301 microversion: 2.1 time: 0.293619 Dec 25 21:13:28.021882 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 924/1911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:27 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 1301 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:28.039091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:28.039711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:28.041170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:28.045837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:28.093915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] HTTP exception thrown: Instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 could not be found. Dec 25 21:13:28.096406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] Returning 404 to user: Instance 7cd2be37-78a6-4e40-813d-8e2478ea8dc2 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:28.097605 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b1776fb5-cc19-4a3f-805c-cb8b1736afaa tempest-LiveAutoBlockMigrationV225Test-1233279863 tempest-LiveAutoBlockMigrationV225Test-1233279863-project] 10.222.0.32 "GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2" status: 404 len: 111 microversion: 2.25 time: 0.089894 Dec 25 21:13:28.105730 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 988/1912] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:28 2021] GET /compute/v2.1/servers/7cd2be37-78a6-4e40-813d-8e2478ea8dc2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:13:28.608017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:28.610127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:28.620559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:28.621339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:28.624087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:28.624904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:29.041307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:29.042481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: 3c1ea080-3600-4152-8bef-f30741212401] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:29.111654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:29.113475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:29.116210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:29.116779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:29.178791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] HTTP exception thrown: Instance 3c1ea080-3600-4152-8bef-f30741212401 could not be found. Dec 25 21:13:29.179402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Returning 404 to user: Instance 3c1ea080-3600-4152-8bef-f30741212401 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:29.183375 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae52c2ba-c401-42d5-9e8f-bf5bfd331313 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401" status: 404 len: 111 microversion: 2.1 time: 0.149498 Dec 25 21:13:29.183958 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 989/1913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:29 2021] GET /compute/v2.1/servers/3c1ea080-3600-4152-8bef-f30741212401 => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:13:29.188570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:29.200972 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4264eb9d-a581-443d-8106-440840582531 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.593201 Dec 25 21:13:29.202180 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 925/1914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:28 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:29.223286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:29.229925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:29.244485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:29.246067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:29.247165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:29.247545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:29.302857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:29.707660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba8ebaea-3add-4245-b205-906bee79cede tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 204 len: 0 microversion: 2.1 time: 0.511304 Dec 25 21:13:29.708319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 990/1915] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:29 2021] DELETE /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:29.717779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:29.718707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:29.733156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:29.733930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:29.735001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:29.735677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:30.224411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:30.226024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:30.235029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:30.249545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:30.250743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:30.251391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:30.758839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:30.773217 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-631c04ca-76fa-47b4-ab7d-5621c815961d tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1486 microversion: 2.1 time: 1.060058 Dec 25 21:13:30.785582 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 926/1916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:29 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1486 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:30.791329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9086a148-6fc9-46b9-a085-73ef10b769d5 req-84ecac86-d179-47ad-9803-8606f26e85d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "tag": "366d8f19-dd34-4b42-bdcc-07b862818e7f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:30.795212 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:30.795212 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:30.811003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9086a148-6fc9-46b9-a085-73ef10b769d5 req-84ecac86-d179-47ad-9803-8606f26e85d2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:30.811607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9086a148-6fc9-46b9-a085-73ef10b769d5 req-84ecac86-d179-47ad-9803-8606f26e85d2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:30.838583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9086a148-6fc9-46b9-a085-73ef10b769d5 req-84ecac86-d179-47ad-9803-8606f26e85d2 service nova] Creating event network-changed:366d8f19-dd34-4b42-bdcc-07b862818e7f for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:13:30.852982 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9086a148-6fc9-46b9-a085-73ef10b769d5 req-84ecac86-d179-47ad-9803-8606f26e85d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071806 Dec 25 21:13:30.853769 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 927/1917] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:31.618017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:31.635958 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e9eb13da-559c-4e05-9e28-4fbe1676ee87 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 1.415560 Dec 25 21:13:31.636842 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 991/1918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:30 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:31.794828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:31.796582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:31.804419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:31.805123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:31.806132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:31.806741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:32.659707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:32.662269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:32.675734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:32.676448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:32.677470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:32.678320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:33.104013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:33.119513 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-347de3b2-b552-438b-a58a-807d17648834 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1486 microversion: 2.1 time: 1.328625 Dec 25 21:13:33.123183 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 928/1919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:31 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1486 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:33.152785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fcd6da10-57e9-483b-962d-ead34c9465fa req-2ac827c1-8fb5-4f15-ae05-aa3af0dde8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "tag": "1536694c-1fd6-4641-92f9-9f25849ec588"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:33.164619 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:33.164619 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:33.186375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fcd6da10-57e9-483b-962d-ead34c9465fa req-2ac827c1-8fb5-4f15-ae05-aa3af0dde8b1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:33.186834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fcd6da10-57e9-483b-962d-ead34c9465fa req-2ac827c1-8fb5-4f15-ae05-aa3af0dde8b1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:33.217066 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fcd6da10-57e9-483b-962d-ead34c9465fa req-2ac827c1-8fb5-4f15-ae05-aa3af0dde8b1 service nova] Creating event network-changed:1536694c-1fd6-4641-92f9-9f25849ec588 for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:13:33.230568 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fcd6da10-57e9-483b-962d-ead34c9465fa req-2ac827c1-8fb5-4f15-ae05-aa3af0dde8b1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106025 Dec 25 21:13:33.231534 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 929/1920] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:33.512797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:33.521769 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e4676c55-81b6-4a53-884c-bcc91b5c02f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.870654 Dec 25 21:13:33.534075 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 992/1921] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:32 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:34.060240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1f7f5784-772c-4eea-a757-62406ae40d11 req-a78d5237-6a2a-4874-9498-76359a800129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dee5cf04-7b9e-46fd-b317-75a118617c96", "name": "network-vif-deleted", "tag": "5576e36d-eb31-4f83-b0d9-b502678406cc"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:34.063349 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:34.063349 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:34.099523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1f7f5784-772c-4eea-a757-62406ae40d11 req-a78d5237-6a2a-4874-9498-76359a800129 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:34.118627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1f7f5784-772c-4eea-a757-62406ae40d11 req-a78d5237-6a2a-4874-9498-76359a800129 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:34.145188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:34.145851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:34.158048 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1f7f5784-772c-4eea-a757-62406ae40d11 req-a78d5237-6a2a-4874-9498-76359a800129 service nova] Creating event network-vif-deleted:5576e36d-eb31-4f83-b0d9-b502678406cc for instance dee5cf04-7b9e-46fd-b317-75a118617c96 on nch2-master-1 Dec 25 21:13:34.162798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:34.165686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:34.166764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:34.169196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:34.177604 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1f7f5784-772c-4eea-a757-62406ae40d11 req-a78d5237-6a2a-4874-9498-76359a800129 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126895 Dec 25 21:13:34.178852 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 930/1922] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:34.322811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:34.333878 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12a70668-0e0a-42a6-b50e-968cf471a325 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 200 len: 1444 microversion: 2.1 time: 0.193397 Dec 25 21:13:34.336100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 993/1923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:34 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 1444 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:34.552096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:34.553407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:34.591989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:34.593595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:34.595534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:34.596543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:35.308362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:35.327447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-425f42e9-3ea3-4f18-b370-c046a9d959fe tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.779200 Dec 25 21:13:35.329767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 931/1924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:34 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:35.352852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:35.354550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: dee5cf04-7b9e-46fd-b317-75a118617c96] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:35.361845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:35.364713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:35.365854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:35.369517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:35.396140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] HTTP exception thrown: Instance dee5cf04-7b9e-46fd-b317-75a118617c96 could not be found. Dec 25 21:13:35.397046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Returning 404 to user: Instance dee5cf04-7b9e-46fd-b317-75a118617c96 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:35.398295 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ba76f91-b781-4bcf-853f-96246214e25c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96" status: 404 len: 111 microversion: 2.1 time: 0.050136 Dec 25 21:13:35.399481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 994/1925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:35 2021] GET /compute/v2.1/servers/dee5cf04-7b9e-46fd-b317-75a118617c96 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:35.407985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:35.408636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:35.418282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:35.418892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:35.420572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:35.421283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:35.467741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:13:35.946147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0a65903-0197-4792-8577-9b78d5033f91 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 204 len: 0 microversion: 2.1 time: 0.542445 Dec 25 21:13:35.946757 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 932/1926] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:13:35 2021] DELETE /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:13:35.956643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:35.957793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:35.974321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:35.976051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:35.977258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:35.979678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:36.346008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:36.347479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:36.362563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:36.366252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:36.367300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:36.369111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:37.174439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:37.184228 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89166bd9-313d-4224-a321-249d086939f0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.840983 Dec 25 21:13:37.187794 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 933/1927] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:36 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:37.362192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:37.383921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39dc59a0-0f26-4670-a01c-be73f295bb2c tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1500 microversion: 2.1 time: 1.432202 Dec 25 21:13:37.385343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 995/1928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:35 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1500 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:38.203407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:38.204015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:38.221623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:38.221623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:38.221623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:38.221623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:38.402654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:38.403337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:38.423334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:38.423334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:38.423334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:38.423334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:38.649023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:38.675613 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83db71eb-fb29-4ff1-bc62-865242b4e86b tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1458 microversion: 2.1 time: 0.268052 Dec 25 21:13:38.675613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 996/1929] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:38 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1458 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:39.691173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:39.692695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:39.710215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:39.715422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:39.718119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:39.721005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:40.198350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:40.202366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9bf2eefd87de409785735fc802bc95ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc19d38e80ce426fa6d268838d133f13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:40.219427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4334a31-114c-4949-be21-b1bad659434d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 2.019565 Dec 25 21:13:40.228615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2811a4a4-3909-449c-b792-7aa2d45320ca tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 200 len: 1458 microversion: 2.1 time: 0.539145 Dec 25 21:13:40.231221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 934/1930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:38 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:40.236298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c8e9fbf8-67f2-4810-9706-5c66d01764c3 req-302270b7-3f2c-4652-9747-7cabca200036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe", "name": "network-vif-deleted", "tag": "d3279f41-5733-434c-babe-c0306203f4fa"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:40.249180 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 997/1931] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:39 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 1458 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:40.252090 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:40.252090 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:13:40.271929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c8e9fbf8-67f2-4810-9706-5c66d01764c3 req-302270b7-3f2c-4652-9747-7cabca200036 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:40.272746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c8e9fbf8-67f2-4810-9706-5c66d01764c3 req-302270b7-3f2c-4652-9747-7cabca200036 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:40.302442 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c8e9fbf8-67f2-4810-9706-5c66d01764c3 req-302270b7-3f2c-4652-9747-7cabca200036 service nova] Creating event network-vif-deleted:d3279f41-5733-434c-babe-c0306203f4fa for instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe on nch2-master-1 Dec 25 21:13:40.314032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c8e9fbf8-67f2-4810-9706-5c66d01764c3 req-302270b7-3f2c-4652-9747-7cabca200036 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078519 Dec 25 21:13:40.316836 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 935/1932] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:41.239431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:41.240163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:41.260607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:41.263678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:41.265752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:41.269483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:41.424113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-325594a3-0e9f-4da8-8192-9cadc1a6f579 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'create', calling method: .version_select at 0x7fa4f6a52160>, body: {"keypair": {"name": "tempest-keypair-2137071604"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:41.475187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-325594a3-0e9f-4da8-8192-9cadc1a6f579 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for project 00414bfe9d194c88b02d9664fdeaa217. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:41.483703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-325594a3-0e9f-4da8-8192-9cadc1a6f579 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for user 30652e6248664267895369366201816e and project 00414bfe9d194c88b02d9664fdeaa217. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:42.350226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-325594a3-0e9f-4da8-8192-9cadc1a6f579 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for project 00414bfe9d194c88b02d9664fdeaa217. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:42.358520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-325594a3-0e9f-4da8-8192-9cadc1a6f579 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for user 30652e6248664267895369366201816e and project 00414bfe9d194c88b02d9664fdeaa217. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:42.388598 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-325594a3-0e9f-4da8-8192-9cadc1a6f579 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.756362 Dec 25 21:13:42.406129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 998/1933] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:40 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:42.415430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:42.417231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:42.421746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] [instance: c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:42.423545 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-24a6b8b0-f730-45d1-866b-aba4dc329161 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 1.188968 Dec 25 21:13:42.424139 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 936/1934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:41 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:42.457234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:42.457708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:42.458422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:42.468468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:42.511691 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] HTTP exception thrown: Instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe could not be found. Dec 25 21:13:42.514991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] Returning 404 to user: Instance c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:13:42.516064 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c045ce79-7b4c-4cbe-9990-f96040846486 tempest-LiveMigrationTest-920359968 tempest-LiveMigrationTest-920359968-project] 10.222.0.32 "GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe" status: 404 len: 111 microversion: 2.1 time: 0.108528 Dec 25 21:13:42.524104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 999/1935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:42 2021] GET /compute/v2.1/servers/c1ec0b9c-fad0-4ce2-97fb-bd518f21b5fe => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:13:43.056498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-505214188", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "4a560a61-f82a-40d7-af48-0eb411fdd40a"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:43.231908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] validate_networks() for [('4a560a61-f82a-40d7-af48-0eb411fdd40a', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:13:43.626084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-392579630", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:43.776130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:13:45.341337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:13:45.341960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:13:45.342220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:13:45.342625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:13:45.343191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:13:45.360572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:45.361058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:45.361891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:45.364503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:45.410811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:45.423384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for user f9e59d219fa640e48533e0efdf150b16 and project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:45.446827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:13:45.451688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:13:45.704346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d35d24e0-e266-4ec0-bea2-5ed0e60ea77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.368317 Dec 25 21:13:45.710974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1000/1936] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:13:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 2376 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:13:45.720790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:45.725050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:45.750772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:45.754067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:45.757062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:45.757062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:47.354502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:13:47.356966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:13:47.357858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:13:47.367172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:13:47.368051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:13:47.416804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:47.417835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:47.421258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:47.422658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:47.495883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Getting quotas for project c86857b4629c4cdbbd6a4664d499fb87. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:47.516025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Getting quotas for user d5e4a505ed3847588a7f577f2e607afd and project c86857b4629c4cdbbd6a4664d499fb87. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:47.561421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:13:47.576620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:13:47.641746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:47.660778 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18e6b815-a5ef-4df4-a616-9f32b3614154 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 1.945625 Dec 25 21:13:47.670824 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1001/1937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:45 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 1959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:47.688435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:47.693660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:47.729794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:47.730665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:47.732348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:47.733445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:47.853582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f22da25-ecc0-4009-94b0-b8b8d570c779 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 5.415309 Dec 25 21:13:47.861681 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 937/1938] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:13:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 5437 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:13:47.876514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-246962988", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "92c154ff-54f2-4280-b0a5-61ec0db10729"}], "security_groups": [{"name": "tempest-securitygroup--2041212482"}], "key_name": "tempest-keypair-2137071604", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:47.913931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:47.930986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b998aa1-aa61-4a29-94b0-ed3211e90e26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1216 microversion: 2.1 time: 0.256004 Dec 25 21:13:47.934113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1002/1939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:47 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1216 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:48.207369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-71b24e17-3901-420a-9884-f0ec6cf55fd9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'create', calling method: .version_select at 0x7fa4f6a66ee0>, body: {"keypair": {"name": "tempest-keypair-1954652495"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:48.262184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] validate_networks() for [('92c154ff-54f2-4280-b0a5-61ec0db10729', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:13:48.296971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-71b24e17-3901-420a-9884-f0ec6cf55fd9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Getting quotas for project f5ed5c4fc23d460e8d63226986b549bd. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:48.322746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-71b24e17-3901-420a-9884-f0ec6cf55fd9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Getting quotas for user 3d55f68c111b4a388351c18551dd43ce and project f5ed5c4fc23d460e8d63226986b549bd. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:49.298437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-71b24e17-3901-420a-9884-f0ec6cf55fd9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Getting quotas for project f5ed5c4fc23d460e8d63226986b549bd. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:49.311030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-71b24e17-3901-420a-9884-f0ec6cf55fd9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Getting quotas for user 3d55f68c111b4a388351c18551dd43ce and project f5ed5c4fc23d460e8d63226986b549bd. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:49.361855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-71b24e17-3901-420a-9884-f0ec6cf55fd9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.425027 Dec 25 21:13:49.366534 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1003/1940] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:13:47 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:49.377235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9b40954-a8e9-493f-96c1-1ac1a1ae8c08 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:49.381902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9b40954-a8e9-493f-96c1-1ac1a1ae8c08 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:49.397362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for project 00414bfe9d194c88b02d9664fdeaa217. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:49.414035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for user 30652e6248664267895369366201816e and project 00414bfe9d194c88b02d9664fdeaa217. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:49.466429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:13:49.467349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:13:49.468131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:13:49.468789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:13:49.469470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:13:49.511232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:49.513208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:49.516141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:49.519921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:49.579103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for project 00414bfe9d194c88b02d9664fdeaa217. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:13:49.599309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Getting quotas for user 30652e6248664267895369366201816e and project 00414bfe9d194c88b02d9664fdeaa217. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:13:49.635647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:13:49.638486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:13:49.747561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9b40954-a8e9-493f-96c1-1ac1a1ae8c08 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:49.766929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9b40954-a8e9-493f-96c1-1ac1a1ae8c08 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:49.780576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9b40954-a8e9-493f-96c1-1ac1a1ae8c08 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:49.792702 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9b40954-a8e9-493f-96c1-1ac1a1ae8c08 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1261 microversion: 2.26 time: 0.421461 Dec 25 21:13:49.819830 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1004/1941] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:49 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1261 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:49.828241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:49.839984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:49.855162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:49.857092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3af9e2d-4601-4a0c-841e-290b925120b5 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.986592 Dec 25 21:13:49.858188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:49.865613 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 938/1942] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:13:47 2021] POST /compute/v2.1/servers => generated 407 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:13:49.870211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:49.874097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:49.884255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:49.886366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:49.904232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:49.909545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:49.913172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:49.913172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:50.668705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:50.694386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ccc85fbf-bb0c-4652-b527-86dad81ae0d1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.873532 Dec 25 21:13:50.694386 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1005/1943] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:49 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:50.717242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e6eb539-b9b2-4e60-95ba-6b3850c74a20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:50.719028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e6eb539-b9b2-4e60-95ba-6b3850c74a20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:51.215846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4e6eb539-b9b2-4e60-95ba-6b3850c74a20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:51.226260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e6eb539-b9b2-4e60-95ba-6b3850c74a20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1269 microversion: 2.1 time: 0.519052 Dec 25 21:13:51.229039 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1006/1944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:50 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1269 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:51.250404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2358faef-d103-4837-aebc-bbebdf40f9b1 req-47b8fde6-05af-444a-b039-040bc308954f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "name": "network-vif-plugged", "status": "completed", "tag": "1536694c-1fd6-4641-92f9-9f25849ec588"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:51.256435 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:51.256435 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:51.313848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2358faef-d103-4837-aebc-bbebdf40f9b1 req-47b8fde6-05af-444a-b039-040bc308954f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:51.320020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2358faef-d103-4837-aebc-bbebdf40f9b1 req-47b8fde6-05af-444a-b039-040bc308954f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:51.341298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:51.353374 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9876cdb-8a0c-40e0-a671-e5effce663ce tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1270 microversion: 2.1 time: 1.482217 Dec 25 21:13:51.355688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 939/1945] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:49 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1270 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:51.359953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2358faef-d103-4837-aebc-bbebdf40f9b1 req-47b8fde6-05af-444a-b039-040bc308954f service nova] Creating event network-vif-plugged:1536694c-1fd6-4641-92f9-9f25849ec588 for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:13:51.370934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:51.373631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:51.375551 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2358faef-d103-4837-aebc-bbebdf40f9b1 req-47b8fde6-05af-444a-b039-040bc308954f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143811 Dec 25 21:13:51.410788 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1007/1946] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:51.428764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:51.432294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:51.432294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:51.432294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:51.711940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:51.714062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:51.724952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:51.730748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:51.732679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:51.733394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:52.365831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:52.386828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:52.396263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:52.400722 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61485202-adc7-4d58-8950-3d8e2eda0727 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1321 microversion: 2.26 time: 1.040986 Dec 25 21:13:52.400722 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 940/1947] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:51 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1321 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:52.413867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:52.414987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:52.436498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:52.440673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:52.443217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:52.446893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:52.670016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:52.703876 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b8d294a-3d74-4efd-993e-27878e374970 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1273 microversion: 2.1 time: 0.295670 Dec 25 21:13:52.715114 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 941/1948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:52 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1273 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:52.731822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:52.735559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:52.752634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:52.753438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:52.754569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:52.757773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:52.956250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:52.973559 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-76709992-ad6f-41b1-95b1-cd0c7d03c0fb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1270 microversion: 2.1 time: 0.255280 Dec 25 21:13:52.973559 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 942/1949] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:52 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1270 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:53.182822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:53.199430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-91be170f-3688-4f16-a0a8-10c0ae486327 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 1.492395 Dec 25 21:13:53.200693 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1008/1950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:51 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:53.422311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:53.423799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:53.434511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:53.441666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:53.442785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:53.443474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:53.471268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0bf4f44d-14d3-457a-987a-7653578dcdcb req-fadd4111-0278-4586-9e87-7cf5feaddd99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "name": "network-vif-plugged", "status": "completed", "tag": "702d4dce-1add-43eb-a25b-3025bf9405db"}, {"server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "name": "network-vif-plugged", "status": "completed", "tag": "366d8f19-dd34-4b42-bdcc-07b862818e7f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:53.475114 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:53.475114 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:53.514856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0bf4f44d-14d3-457a-987a-7653578dcdcb req-fadd4111-0278-4586-9e87-7cf5feaddd99 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:53.522558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0bf4f44d-14d3-457a-987a-7653578dcdcb req-fadd4111-0278-4586-9e87-7cf5feaddd99 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:53.575521 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0bf4f44d-14d3-457a-987a-7653578dcdcb req-fadd4111-0278-4586-9e87-7cf5feaddd99 service nova] Creating event network-vif-plugged:702d4dce-1add-43eb-a25b-3025bf9405db for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:13:53.580993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0bf4f44d-14d3-457a-987a-7653578dcdcb req-fadd4111-0278-4586-9e87-7cf5feaddd99 service nova] Creating event network-vif-plugged:366d8f19-dd34-4b42-bdcc-07b862818e7f for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:13:53.593183 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0bf4f44d-14d3-457a-987a-7653578dcdcb req-fadd4111-0278-4586-9e87-7cf5feaddd99 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.129266 Dec 25 21:13:53.611756 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1009/1951] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:53 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:53.723930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:53.725709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:53.736397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:53.759384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:53.764045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:53.764856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:54.005597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:54.020167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:54.026109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:54.031232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b4494d6-4e26-4938-a294-2227755596d3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1319 microversion: 2.26 time: 0.612786 Dec 25 21:13:54.053624 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 943/1952] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:53 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1319 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:54.081706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:54.082619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:54.108576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:54.110568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:54.115192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:54.116053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:54.205175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:54.216803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5d9216b-2e7d-456b-8c00-2bfec332732f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1321 microversion: 2.1 time: 0.493621 Dec 25 21:13:54.227833 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1010/1953] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:53 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1321 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:54.246040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:54.247204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:54.262968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:54.263436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:54.264908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:54.265351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:54.453999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:54.461585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16ad421d-e542-40cf-a33f-7088adcf6463 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1270 microversion: 2.1 time: 0.405334 Dec 25 21:13:54.465686 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 944/1954] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:54 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1270 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:54.892047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:54.906054 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8455c06-ec9c-47b2-9e54-680cbf92b3e5 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.677809 Dec 25 21:13:54.907361 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1011/1955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:54 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:55.083962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:55.084598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:55.093051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.093505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.107615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.109382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.243536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:55.245192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:55.258886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.263688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.264556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.270348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.414269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:55.424168 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba4cd183-e85f-45f1-a2c7-cbcd3487ec46 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1327 microversion: 2.1 time: 0.185666 Dec 25 21:13:55.426135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1012/1956] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:55 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1327 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:55.487072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:55.488976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:55.500952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.503106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.506940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.509956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.716121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:55.732261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:55.742361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:55.743595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9355e2c-5a8a-40b9-a93a-07f346947c7f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.665021 Dec 25 21:13:55.763058 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 945/1957] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:55 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:55.925689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:55.926319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:55.935018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.935459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:55.969663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:55.970421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:56.335791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:56.348342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e5e1cb53-0d3f-485e-a087-1282c4b15c4d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.866231 Dec 25 21:13:56.349357 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1013/1958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:55 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:56.443088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:56.443958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:56.452634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:56.457623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:56.458758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:56.459358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:56.649968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:56.659769 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67b18902-2bc2-4d02-87b1-ea7edff4a279 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1354 microversion: 2.1 time: 0.740149 Dec 25 21:13:56.666616 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 946/1959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:55 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1354 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:56.762625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:56.764536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:56.784680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:56.785357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:56.786331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:56.786926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:57.788713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:57.807263 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-682c5f66-76fd-4671-81e5-82759b4df812 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1395 microversion: 2.1 time: 1.367714 Dec 25 21:13:57.810099 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1014/1960] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:56 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1395 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:13:57.819655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:57.820271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:57.857090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:57.857090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:57.857592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:57.858331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:58.027131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:58.049619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:58.077138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:58.081947 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a4a2d425-371c-4941-b708-925fde1754af tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 1.320381 Dec 25 21:13:58.083927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 947/1961] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:56 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:58.118547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:58.128656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:58.158837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:58.161380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:58.163073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:58.167056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:58.468508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:58.476529 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-242e4c27-33c5-4692-afb3-8f19f0593a30 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.663722 Dec 25 21:13:58.481981 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1015/1962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:57 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:58.498147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6f735da8-851d-412b-a486-9b5a31a95b88 req-c2368038-c390-4f3f-ba55-8faa59eea422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06595622-92cb-4f87-bd0d-0320a9fc5d7e", "tag": "00640242-8453-4c98-b5aa-a9ed148543ff"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:13:58.499694 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:13:58.499694 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:13:58.521436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6f735da8-851d-412b-a486-9b5a31a95b88 req-c2368038-c390-4f3f-ba55-8faa59eea422 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:58.522072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6f735da8-851d-412b-a486-9b5a31a95b88 req-c2368038-c390-4f3f-ba55-8faa59eea422 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:58.555282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6f735da8-851d-412b-a486-9b5a31a95b88 req-c2368038-c390-4f3f-ba55-8faa59eea422 service nova] Creating event network-changed:00640242-8453-4c98-b5aa-a9ed148543ff for instance 06595622-92cb-4f87-bd0d-0320a9fc5d7e on nch2-master-1 Dec 25 21:13:58.579334 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6f735da8-851d-412b-a486-9b5a31a95b88 req-c2368038-c390-4f3f-ba55-8faa59eea422 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095801 Dec 25 21:13:58.579965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1016/1963] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:13:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:58.825447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:58.827541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:58.848821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:58.849610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:58.862045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:58.864790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:59.082123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:59.092142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87710f2e-864a-49b6-8e97-ba8d6f81eeaa tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1804 microversion: 2.1 time: 1.003611 Dec 25 21:13:59.100279 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 948/1964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:58 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1804 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:59.116741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:59.116741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:59.131764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:59.132231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:59.133117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:59.133752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:59.589138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:59.596601 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3229d31a-efe5-495b-b8a2-d83cde48a955 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1395 microversion: 2.1 time: 0.776331 Dec 25 21:13:59.598860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1017/1965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:58 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1395 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:13:59.611535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:59.612042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:59.628454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:59.628935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:59.629961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:59.630582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:59.676480 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82c6905d-2ec0-4104-9570-9006799b402d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8/ips" status: 200 len: 218 microversion: 2.1 time: 0.076562 Dec 25 21:13:59.677176 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1018/1966] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:13:59 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8/ips => generated 218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:13:59.765199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:59.777848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:59.787003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:13:59.788264 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db144026-b03e-4621-9bf5-766c0fa79e5f tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.686758 Dec 25 21:13:59.795123 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 949/1967] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:13:59 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:13:59.815715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:13:59.817727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:13:59.834507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:59.835798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:13:59.838333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:13:59.838796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:00.065150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f98a7b8d-766c-4a83-91b3-20e71fb0e18f tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] Calling method '.version_select at 0x7fa4f6ac6f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:00.066707 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:00.066707 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:00.092655 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f98a7b8d-766c-4a83-91b3-20e71fb0e18f tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.414126 Dec 25 21:14:00.095988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1019/1968] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:13:59 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:00.107290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:00.108083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:00.123686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:00.125439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:00.135563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:00.136246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:00.197067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:14:00.635901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51b17dc3-4a8e-4311-90c5-763794c4727c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 204 len: 0 microversion: 2.1 time: 0.538465 Dec 25 21:14:00.638049 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1020/1969] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:00 2021] DELETE /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:14:00.646702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e4df2f73-321c-4096-a281-83a448479837 req-c76f4733-8b63-4312-a6ad-6ba922d8a876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32723f8-9254-4e54-8d2d-7a4b08821e28", "tag": "fdcafc76-a01c-4114-a75e-4dbcfb7490ec"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:00.655095 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:00.655095 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:00.660328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:00.669387 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5173fa13-0262-4125-820b-b3d248a87ab4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.873013 Dec 25 21:14:00.674729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e4df2f73-321c-4096-a281-83a448479837 req-c76f4733-8b63-4312-a6ad-6ba922d8a876 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:00.675463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e4df2f73-321c-4096-a281-83a448479837 req-c76f4733-8b63-4312-a6ad-6ba922d8a876 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:00.678944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 950/1970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:13:59 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:00.684403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3589dfb8-8f94-4c47-80b1-ed2619751cc8 tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f6fe8820>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:00.688226 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:00.688226 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:00.698255 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e4df2f73-321c-4096-a281-83a448479837 req-c76f4733-8b63-4312-a6ad-6ba922d8a876 service nova] Creating event network-changed:fdcafc76-a01c-4114-a75e-4dbcfb7490ec for instance a32723f8-9254-4e54-8d2d-7a4b08821e28 on nch1-master-1 Dec 25 21:14:00.725646 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e4df2f73-321c-4096-a281-83a448479837 req-c76f4733-8b63-4312-a6ad-6ba922d8a876 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081040 Dec 25 21:14:00.726866 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1021/1971] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:00.742215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:00.743020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:00.757784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:00.761367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:00.761554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:00.764413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:01.159827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:01.167626 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f77cddc-006c-4837-886f-93103b2a385c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1395 microversion: 2.1 time: 0.438833 Dec 25 21:14:01.169152 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1022/1972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:00 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1395 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:01.197620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:01.198747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:01.221009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:01.224736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:01.225842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:01.226301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:01.585554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:01.593852 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b55de51f-b9ea-4a09-9eec-8887947ec0f4 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1810 microversion: 2.1 time: 0.423162 Dec 25 21:14:01.594427 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1023/1973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:01 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1810 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:01.599323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:01.599583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:01.605409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:01.606490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:01.607291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:01.607738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:01.913175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:01.924922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:01.926528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:01.927862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8b5aecc-5203-4365-aecf-9103fbd1595c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.332496 Dec 25 21:14:01.928426 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1024/1974] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:01 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:02.230178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1873981655", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:02.230178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:02.444968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:02.445393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:02.445867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:02.446575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:02.447164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:02.459832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:02.460703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:02.461746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:02.462192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:02.511296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Getting quotas for project 646e75ab8f934ab7b7d2fab01bb800d9. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:02.524238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Getting quotas for user c59c9265b73d4f778c27de407dce255f and project 646e75ab8f934ab7b7d2fab01bb800d9. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:02.551624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:02.554946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:02.670116 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3589dfb8-8f94-4c47-80b1-ed2619751cc8 tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.979674 Dec 25 21:14:02.676134 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 951/1975] 10.222.0.32 () {60 vars in 1205 bytes} [Sat Dec 25 21:14:00 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:02.678335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "9567beaf-dc87-435f-8c75-e490291b6617"}], "security_groups": [{"name": "tempest-securitygroup--839793960"}], "key_name": "tempest-keypair-1954652495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:02.766983 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7ad6cef-4c3d-4797-9280-a44aeb9455f5 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.837256 Dec 25 21:14:02.768262 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1025/1976] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:14:02.774769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:02.775579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:02.782801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:02.783508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:02.784580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:02.785248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:02.919862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] validate_networks() for [('9567beaf-dc87-435f-8c75-e490291b6617', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:03.477764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:03.489518 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3f21f5b6-e2a5-403e-8a16-882af2d64156 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.719493 Dec 25 21:14:03.502203 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1026/1977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:02 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:03.514386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:03.515416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:03.524483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:03.525302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:03.526905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:03.527604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:03.894988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:03.906452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c1f7b8ee-061f-4700-9eed-3a6439b0a479 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1395 microversion: 2.1 time: 0.402740 Dec 25 21:14:03.909419 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1027/1978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:03 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1395 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:03.924957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:03.932740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:03.956337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:03.957819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:03.971693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:03.972156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.099303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:04.099779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:04.100267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:04.100687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:04.101237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:04.138333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:04.138984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.142032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:04.145369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.174499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Getting quotas for project f5ed5c4fc23d460e8d63226986b549bd. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:04.180058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Getting quotas for user 3d55f68c111b4a388351c18551dd43ce and project f5ed5c4fc23d460e8d63226986b549bd. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:04.198351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:04.201507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:04.239660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:04.248176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dece5236-57cb-4bb1-b10e-8edb250bf71d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1768 microversion: 2.1 time: 0.335186 Dec 25 21:14:04.251473 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1028/1979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:03 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1768 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:04.261164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf1ae3b8-39b6-4b25-881c-1fcb3484c264 tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] Calling method '.version_select at 0x7fa4f6a76550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:04.266641 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:04.266641 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:04.285279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf1ae3b8-39b6-4b25-881c-1fcb3484c264 tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.032216 Dec 25 21:14:04.286675 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1029/1980] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:14:04 2021] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:04.291761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c49a41aa-87f6-4c6b-953a-8d8ebc4ee225 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:04.293547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c49a41aa-87f6-4c6b-953a-8d8ebc4ee225 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:04.372311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-73e15b9f-bbed-4100-801a-64f86a4e0c2d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.699971 Dec 25 21:14:04.373091 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 952/1981] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:02 2021] POST /compute/v2.1/servers => generated 408 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:14:04.382337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c49a41aa-87f6-4c6b-953a-8d8ebc4ee225 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:04.384156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3b669ad3-81b2-4b17-9897-e69721cb7032 req-3ef8cf06-7912-4e80-8af0-731de58d5c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b248cb56-18c2-4ff2-a8da-8e0993879a65", "tag": "5a73a242-a477-40db-9b6d-7ac1d38d6950"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:04.385954 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:04.385954 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:04.391734 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c49a41aa-87f6-4c6b-953a-8d8ebc4ee225 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1220 microversion: 2.1 time: 0.103823 Dec 25 21:14:04.392337 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1030/1982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:04 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:04.405261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:04.407725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:04.408583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3b669ad3-81b2-4b17-9897-e69721cb7032 req-3ef8cf06-7912-4e80-8af0-731de58d5c6f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:04.409280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3b669ad3-81b2-4b17-9897-e69721cb7032 req-3ef8cf06-7912-4e80-8af0-731de58d5c6f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.415810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:04.416351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.417198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:04.417703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.421609 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3b669ad3-81b2-4b17-9897-e69721cb7032 req-3ef8cf06-7912-4e80-8af0-731de58d5c6f service nova] Creating event network-changed:5a73a242-a477-40db-9b6d-7ac1d38d6950 for instance b248cb56-18c2-4ff2-a8da-8e0993879a65 on nch1-master-1 Dec 25 21:14:04.426894 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3b669ad3-81b2-4b17-9897-e69721cb7032 req-3ef8cf06-7912-4e80-8af0-731de58d5c6f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052392 Dec 25 21:14:04.428067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 953/1983] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:04.434831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-330156b4-7f77-4f88-82e2-3d0273649073 req-a83f9ffe-d8c4-4f6d-87a8-9a590d0b2e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "name": "network-vif-deleted", "tag": "366d8f19-dd34-4b42-bdcc-07b862818e7f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:04.436825 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:04.436825 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:04.444618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-330156b4-7f77-4f88-82e2-3d0273649073 req-a83f9ffe-d8c4-4f6d-87a8-9a590d0b2e4d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:04.447981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-330156b4-7f77-4f88-82e2-3d0273649073 req-a83f9ffe-d8c4-4f6d-87a8-9a590d0b2e4d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:04.458348 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-330156b4-7f77-4f88-82e2-3d0273649073 req-a83f9ffe-d8c4-4f6d-87a8-9a590d0b2e4d service nova] Creating event network-vif-deleted:366d8f19-dd34-4b42-bdcc-07b862818e7f for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:14:04.463717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-330156b4-7f77-4f88-82e2-3d0273649073 req-a83f9ffe-d8c4-4f6d-87a8-9a590d0b2e4d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034090 Dec 25 21:14:04.465525 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 954/1984] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:04.472453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c167445-ba86-407e-8d62-7523a491aea7 tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] Action: 'update', calling method: .version_select at 0x7fa4f6fe8310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:04.474576 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:04.474576 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:04.842382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:04.851932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:04.856623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:04.860726 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-76ea3850-3f80-4b48-9d5c-9f56ee418005 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.465016 Dec 25 21:14:04.863267 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1031/1985] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:04 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:04.869613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a142cfb0-2e8f-4e8c-91cc-de2c6841020d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:04.875295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a142cfb0-2e8f-4e8c-91cc-de2c6841020d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:04.995136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a142cfb0-2e8f-4e8c-91cc-de2c6841020d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:05.003114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a142cfb0-2e8f-4e8c-91cc-de2c6841020d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1226 microversion: 2.1 time: 0.138494 Dec 25 21:14:05.004310 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1032/1986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:04 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1226 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:05.008924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:05.009964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:05.016718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.017535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.018548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.019297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.386838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:05.392029 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3bc35f18-c4f6-4ec7-8570-55471cb9a88c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.386332 Dec 25 21:14:05.400580 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1033/1987] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:05 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:05.414757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1f092840-b02f-48ec-9a13-0b3757f21058 req-5d4be0cb-9ab4-41ac-a1bf-193f994c164b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06595622-92cb-4f87-bd0d-0320a9fc5d7e", "name": "network-vif-plugged", "status": "completed", "tag": "00640242-8453-4c98-b5aa-a9ed148543ff"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:05.416721 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:05.416721 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:05.430958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1f092840-b02f-48ec-9a13-0b3757f21058 req-5d4be0cb-9ab4-41ac-a1bf-193f994c164b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.431808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1f092840-b02f-48ec-9a13-0b3757f21058 req-5d4be0cb-9ab4-41ac-a1bf-193f994c164b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.451022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1f092840-b02f-48ec-9a13-0b3757f21058 req-5d4be0cb-9ab4-41ac-a1bf-193f994c164b service nova] Creating event network-vif-plugged:00640242-8453-4c98-b5aa-a9ed148543ff for instance 06595622-92cb-4f87-bd0d-0320a9fc5d7e on nch2-master-1 Dec 25 21:14:05.456513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1f092840-b02f-48ec-9a13-0b3757f21058 req-5d4be0cb-9ab4-41ac-a1bf-193f994c164b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051372 Dec 25 21:14:05.457863 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1034/1988] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:05.464352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:05.465949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:05.476952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.478874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.479942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.481364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.689648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:05.699193 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75c9d91c-aa6b-4e67-a7f0-0e4821531f1a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1395 microversion: 2.1 time: 0.239701 Dec 25 21:14:05.708849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1035/1989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:05 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1395 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:05.713583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:05.714236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:05.721236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.722612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.722612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.723885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.765785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.766282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.766746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lazy-loading 'fault' on Instance uuid e2caaec2-9663-4bdf-95c5-104c863c14e8 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:05.822948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:05.830843 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-103776c4-540e-480d-9453-7b6736bf57d6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 200 len: 1302 microversion: 2.1 time: 0.120879 Dec 25 21:14:05.831635 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1036/1990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:05 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 1302 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:05.835874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:05.836483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:05.843079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.843722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.844320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.845026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.903440 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c167445-ba86-407e-8d62-7523a491aea7 tempest-QuotaClassesAdminTestJSON-1661842082 tempest-QuotaClassesAdminTestJSON-1661842082-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.436417 Dec 25 21:14:05.906545 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 955/1991] 10.222.0.32 () {60 vars in 1205 bytes} [Sat Dec 25 21:14:04 2021] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:05.924399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:05.930163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:05.944500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:05.948447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.948958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.952037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:05.954076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:05.958390 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1681cf90-1567-46e0-8ee2-503c81506012 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1272 microversion: 2.1 time: 0.125933 Dec 25 21:14:05.959392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1037/1992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:05 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:06.020598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:06.021508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:06.034413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.038149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.044907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.044907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.173108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:06.184209 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18b8464b-4170-416b-bd0a-ff39cb39733f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1230 microversion: 2.1 time: 0.168166 Dec 25 21:14:06.196021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1038/1993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:06 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1230 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:06.197250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:06.205103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:06.206701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:06.207894 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5de2b0bd-79cd-4125-a38b-b850a4afba9c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.300183 Dec 25 21:14:06.208491 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 956/1994] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:05 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:06.418367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:06.419008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:06.431724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.432399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.434650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.437854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.494390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a1d18855-ce91-4e21-b005-8dfbb41dee0e req-b11aab19-4875-4be3-bd4d-c4c3e858a8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "name": "network-vif-deleted", "tag": "702d4dce-1add-43eb-a25b-3025bf9405db"}, {"server_uuid": "e2caaec2-9663-4bdf-95c5-104c863c14e8", "name": "network-vif-deleted", "tag": "1536694c-1fd6-4641-92f9-9f25849ec588"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:06.496402 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:06.496402 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:06.513753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a1d18855-ce91-4e21-b005-8dfbb41dee0e req-b11aab19-4875-4be3-bd4d-c4c3e858a8f1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.523263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a1d18855-ce91-4e21-b005-8dfbb41dee0e req-b11aab19-4875-4be3-bd4d-c4c3e858a8f1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.545205 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a1d18855-ce91-4e21-b005-8dfbb41dee0e req-b11aab19-4875-4be3-bd4d-c4c3e858a8f1 service nova] Creating event network-vif-deleted:702d4dce-1add-43eb-a25b-3025bf9405db for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:14:06.555326 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a1d18855-ce91-4e21-b005-8dfbb41dee0e req-b11aab19-4875-4be3-bd4d-c4c3e858a8f1 service nova] Creating event network-vif-deleted:1536694c-1fd6-4641-92f9-9f25849ec588 for instance e2caaec2-9663-4bdf-95c5-104c863c14e8 on nch2-master-1 Dec 25 21:14:06.563751 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a1d18855-ce91-4e21-b005-8dfbb41dee0e req-b11aab19-4875-4be3-bd4d-c4c3e858a8f1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076638 Dec 25 21:14:06.570071 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 957/1995] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:06 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:06.703041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:06.712782 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b60864d-fb8a-4a95-8481-30d05f66239d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.298683 Dec 25 21:14:06.713682 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1039/1996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:06 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:06.721507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:06.723354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:06.735672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.739881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.739881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.739881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.849566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:06.850197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:06.859059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.859625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.861086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:06.862577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:06.885632 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] HTTP exception thrown: Instance e2caaec2-9663-4bdf-95c5-104c863c14e8 could not be found. Dec 25 21:14:06.886266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Returning 404 to user: Instance e2caaec2-9663-4bdf-95c5-104c863c14e8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:06.890468 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40f35d65-ebe6-48b5-a679-73fc7822eafc tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 404 len: 111 microversion: 2.1 time: 0.046033 Dec 25 21:14:06.895781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1040/1997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:06 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:06.979302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:06.981277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:06.995787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.000614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.003813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.006613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.139012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:07.145257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:07.154126 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e1c257f-b15e-40bd-8d23-0cdfeb1f07f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1395 microversion: 2.1 time: 0.441179 Dec 25 21:14:07.154739 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 958/1998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:06 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1395 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:07.165847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f92587a3-1376-42ba-b849-c8e4f18124b8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1278 microversion: 2.1 time: 0.193465 Dec 25 21:14:07.168944 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1041/1999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:06 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1278 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:07.203635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:07.204682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:07.214328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.215701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.216749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.217531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.226319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:07.226935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:07.233490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.234549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.235595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.236184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.296625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:07.315274 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61a5e625-5a39-42a7-bab9-1ed38594ac28 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1222 microversion: 2.1 time: 0.117174 Dec 25 21:14:07.316247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 959/2000] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:07 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:07.400734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:07.409812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:07.411701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:07.412864 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe33d3c3-8610-4705-9b28-45e63b2395b5 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.190284 Dec 25 21:14:07.413456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1042/2001] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:07 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:14:07.472415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e2ad4f6f-0211-4278-8b61-a293e083a81c req-ae54b449-5f7c-409f-a1fc-75b9832f1702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32723f8-9254-4e54-8d2d-7a4b08821e28", "name": "network-vif-plugged", "status": "completed", "tag": "fdcafc76-a01c-4114-a75e-4dbcfb7490ec"}, {"server_uuid": "b248cb56-18c2-4ff2-a8da-8e0993879a65", "name": "network-vif-plugged", "status": "completed", "tag": "5a73a242-a477-40db-9b6d-7ac1d38d6950"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:07.474176 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:07.474176 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:07.482164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e2ad4f6f-0211-4278-8b61-a293e083a81c req-ae54b449-5f7c-409f-a1fc-75b9832f1702 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.482607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e2ad4f6f-0211-4278-8b61-a293e083a81c req-ae54b449-5f7c-409f-a1fc-75b9832f1702 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.495147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e2ad4f6f-0211-4278-8b61-a293e083a81c req-ae54b449-5f7c-409f-a1fc-75b9832f1702 service nova] Creating event network-vif-plugged:fdcafc76-a01c-4114-a75e-4dbcfb7490ec for instance a32723f8-9254-4e54-8d2d-7a4b08821e28 on nch1-master-1 Dec 25 21:14:07.495597 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e2ad4f6f-0211-4278-8b61-a293e083a81c req-ae54b449-5f7c-409f-a1fc-75b9832f1702 service nova] Creating event network-vif-plugged:5a73a242-a477-40db-9b6d-7ac1d38d6950 for instance b248cb56-18c2-4ff2-a8da-8e0993879a65 on nch1-master-1 Dec 25 21:14:07.502298 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e2ad4f6f-0211-4278-8b61-a293e083a81c req-ae54b449-5f7c-409f-a1fc-75b9832f1702 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033664 Dec 25 21:14:07.503110 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 960/2002] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:07 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:07.732733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:07.733378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:07.748212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.748671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:07.749495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:07.749986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.151663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:08.160577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c262ac17-379f-4ddc-9af6-0cab3cdf8619 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1312 microversion: 2.1 time: 0.431705 Dec 25 21:14:08.164725 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1043/2003] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:07 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:08.178743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:08.178743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:08.185986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:08.218111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:08.230852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.236751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.242310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.242310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.252683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.253288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.257404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.259915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.468452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:08.476251 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9378cbde-241e-4eec-b9fa-d16b60bc880e tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1278 microversion: 2.1 time: 0.295790 Dec 25 21:14:08.477203 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1044/2004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:08 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1278 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:08.490813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:08.491549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:08.511381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.512345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.513235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.513677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.630778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:08.644271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b313ea43-1b36-4f14-8df3-459233eea87d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1286 microversion: 2.1 time: 0.165980 Dec 25 21:14:08.647181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1045/2005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:08 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:08.679562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:08.681674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:08.719406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.719406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:08.719406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:08.719406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.016282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:09.049927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f21d2447-d83a-4d48-91b3-20592f6c25b9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1576 microversion: 2.1 time: 0.878325 Dec 25 21:14:09.062357 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 961/2006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:08 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1576 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:09.069823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:09.070750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:09.079591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.080330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.082602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.083377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.351386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:09.360228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:09.372786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:09.374058 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e83002e2-91f8-47e7-a7fb-4b7842c6f626 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1361 microversion: 2.26 time: 0.725322 Dec 25 21:14:09.384831 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1046/2007] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:08 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1361 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:09.400533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:09.401182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:09.408831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.409327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.410141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.410584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.517608 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-72d0c766-40d4-484c-8c15-55761f7e7f03 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.452825 Dec 25 21:14:09.518385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 962/2008] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:14:09 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/os-interface => generated 285 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:09.522976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:09.523808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:09.535750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.541297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.550922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.550922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.942931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:09.969028 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a3eca13-8bc3-4a99-806f-ef7d9de8ebb8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1462 microversion: 2.1 time: 0.582892 Dec 25 21:14:09.979472 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1047/2009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:09 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1462 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:09.982139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:09.982139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:09.994377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.994859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:09.998338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:09.998966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:10.198658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:10.211315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fec709f-f7a1-40ed-9cd3-425011145d06 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1284 microversion: 2.1 time: 0.239691 Dec 25 21:14:10.231305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1048/2010] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:09 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1284 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:10.237599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:10.254367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b12e598-c67d-47f9-a1e9-45b23ba42869 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.734748 Dec 25 21:14:10.276148 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 963/2011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:09 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:10.392795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:10.393806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:10.406085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:10.406789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:10.409748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:10.410653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:10.643695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:10.644980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:10.652632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:10.653471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:10.654501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:10.655133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.112048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:11.131449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:11.131449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:11.131449 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ddda602b-565c-417a-a08c-5762e722fa1b tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1544 microversion: 2.26 time: 0.742041 Dec 25 21:14:11.132369 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 964/2012] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:10 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1544 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:14:11.151182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f7335550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:11.177966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.187888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.188840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:11.207546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.208392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.210695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.211755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.300626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.301139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.353479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.353945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.512135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:11.588271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a6bf0ed-c5fc-4079-9493-d81d80a6615d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1657861522" status: 201 len: 0 microversion: 2.26 time: 0.440881 Dec 25 21:14:11.588979 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 965/2013] 10.222.0.32 () {62 vars in 1379 bytes} [Sat Dec 25 21:14:11 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1657861522 => generated 0 bytes in 442 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Dec 25 21:14:11.606079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:11.606968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:11.622938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.623664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.624671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.625338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.869642 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c7c8c4a-e33b-4fda-b53c-79c8254dae19 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1613 microversion: 2.1 time: 1.636913 Dec 25 21:14:11.877208 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1049/2014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:10 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1613 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:11.882015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:11.885910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:11.905229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.905995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:11.908415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:11.915815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.643143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:12.659003 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-643c44d1-6179-4627-b57e-135281d352c3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 1.063903 Dec 25 21:14:12.659003 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 966/2015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:11 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:12.663185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f225184c-8fa6-44de-9b4d-c9920abf4fbb tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa5007879d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:12.674680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f225184c-8fa6-44de-9b4d-c9920abf4fbb tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.675427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f225184c-8fa6-44de-9b4d-c9920abf4fbb tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.690408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f225184c-8fa6-44de-9b4d-c9920abf4fbb tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1657861522" status: 204 len: 0 microversion: 2.26 time: 0.033530 Dec 25 21:14:12.696051 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 967/2016] 10.222.0.32 () {60 vars in 1360 bytes} [Sat Dec 25 21:14:12 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1657861522 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:12.702570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7486cc2f-e560-4e08-9589-d0ee65924709 req-adbe6b9f-9005-4aeb-8358-c5ad910de744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45f0a001-36db-4334-9faa-a374e3a51158", "tag": "01be047a-fff9-4768-83e3-d8f015049719"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:12.704373 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:12.704373 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:12.712323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7486cc2f-e560-4e08-9589-d0ee65924709 req-adbe6b9f-9005-4aeb-8358-c5ad910de744 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.713016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7486cc2f-e560-4e08-9589-d0ee65924709 req-adbe6b9f-9005-4aeb-8358-c5ad910de744 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.734818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7486cc2f-e560-4e08-9589-d0ee65924709 req-adbe6b9f-9005-4aeb-8358-c5ad910de744 service nova] Creating event network-changed:01be047a-fff9-4768-83e3-d8f015049719 for instance 45f0a001-36db-4334-9faa-a374e3a51158 on nch2-master-1 Dec 25 21:14:12.751591 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7486cc2f-e560-4e08-9589-d0ee65924709 req-adbe6b9f-9005-4aeb-8358-c5ad910de744 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048697 Dec 25 21:14:12.753512 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 968/2017] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:12.765941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:12.768445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:12.785952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.786991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.789248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.790131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.849410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:12.858016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-258bd786-8d86-461f-b17b-e1c37d040a0f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.979481 Dec 25 21:14:12.858586 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1050/2018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:11 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:12.869352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6997700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:12.888244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.889429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.890129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:12.897997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.898654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.899644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.900232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.929651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:12.930367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:12.994732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '68e2585485584fc59e9b72868227f2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd62ea5e59c47fc8d5c271934c6a120', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:12.996860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] flavor_id is None. Assuming migration. {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 25 21:14:12.997944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:14:13.070153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:13.097643 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d1c2604-44d2-4941-9580-9ca58d21279c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 204 len: 0 microversion: 2.26 time: 0.234197 Dec 25 21:14:13.102604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1051/2019] 10.222.0.32 () {60 vars in 1294 bytes} [Sat Dec 25 21:14:12 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:13.108673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:13.110001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:13.118793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.119573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.121352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.122047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.177726 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87ae26bc-4f94-411a-9b0c-80878818744f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 14 microversion: 2.1 time: 0.071477 Dec 25 21:14:13.179081 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1052/2020] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:13 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:13.230355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32aee42a-1c05-4364-a3d7-b4eaf19ef0cc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6b70ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:13.272045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32aee42a-1c05-4364-a3d7-b4eaf19ef0cc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.277558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32aee42a-1c05-4364-a3d7-b4eaf19ef0cc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.329795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32aee42a-1c05-4364-a3d7-b4eaf19ef0cc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 200 len: 12 microversion: 2.26 time: 0.147968 Dec 25 21:14:13.332319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1053/2021] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 21:14:13 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 12 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:13.344972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6ae6280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:13.373859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.375553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.376366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:13.400147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.400147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.400990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.401876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.466600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.471737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.507815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.510512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.686949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:13.719513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45ddae8b-9a47-4a41-a465-afd6807328a3 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1468730063" status: 201 len: 0 microversion: 2.26 time: 0.381947 Dec 25 21:14:13.728006 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1054/2022] 10.222.0.32 () {62 vars in 1379 bytes} [Sat Dec 25 21:14:13 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1468730063 => generated 0 bytes in 392 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Dec 25 21:14:13.736700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:13.738261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:13.746385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.747451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:13.749560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:13.750289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.349395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:14.357931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa5fbabf-b2b9-4563-83f3-0446c618b5ec tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 0.628040 Dec 25 21:14:14.358804 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1055/2023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:13 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:14.364065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-73fe9586-4a5d-4728-928f-d816587d60dc req-28d96daf-f9f8-40d7-87c5-b5fc2e93d739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23221387-3a9d-4105-b3db-d1586e20d8a5", "tag": "0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:14.366242 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:14.366242 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:14.374791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-73fe9586-4a5d-4728-928f-d816587d60dc req-28d96daf-f9f8-40d7-87c5-b5fc2e93d739 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.380822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-73fe9586-4a5d-4728-928f-d816587d60dc req-28d96daf-f9f8-40d7-87c5-b5fc2e93d739 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.388383 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-73fe9586-4a5d-4728-928f-d816587d60dc req-28d96daf-f9f8-40d7-87c5-b5fc2e93d739 service nova] Creating event network-changed:0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2 for instance 23221387-3a9d-4105-b3db-d1586e20d8a5 on nch2-master-1 Dec 25 21:14:14.393570 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-73fe9586-4a5d-4728-928f-d816587d60dc req-28d96daf-f9f8-40d7-87c5-b5fc2e93d739 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Dec 25 21:14:14.394209 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1056/2024] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:14.399673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8351659f-cc0d-4f3e-ba77-e1e3dfba3982 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6ac6f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:14.408636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8351659f-cc0d-4f3e-ba77-e1e3dfba3982 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.409144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8351659f-cc0d-4f3e-ba77-e1e3dfba3982 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.419398 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8351659f-cc0d-4f3e-ba77-e1e3dfba3982 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 200 len: 36 microversion: 2.26 time: 0.023808 Dec 25 21:14:14.420006 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1057/2025] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 21:14:14 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 36 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:14.428077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:14.428813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:14.435823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.436526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.437425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.437860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.555899 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d6b3af5-34e3-46c8-8c09-3887f010d94b tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65/action" status: 202 len: 0 microversion: 2.1 time: 1.798992 Dec 25 21:14:14.557663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 969/2026] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:12 2021] POST /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65/action => generated 0 bytes in 1802 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:14:14.565483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:14.577855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:14.587072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.588086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.588997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.589553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.630641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6e8506c-cc57-4d0e-8a97-d69adabe79c1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 14 microversion: 2.1 time: 0.070722 Dec 25 21:14:14.631509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 970/2027] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:14 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:14.637561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f75cfb80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:14.647304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.647766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.648348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:14.659269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.659731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.660973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.661127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.689131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.690138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.799238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:14.820697 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18643c37-9bb6-4b3b-9cdb-94881a5ee350 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1468730063" status: 204 len: 0 microversion: 2.26 time: 0.186560 Dec 25 21:14:14.822059 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 971/2028] 10.222.0.32 () {60 vars in 1363 bytes} [Sat Dec 25 21:14:14 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1468730063 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:14.831334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:14.833088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:14.842318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.845312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.845312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.845312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.884029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:14.893687 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-066f4003-b56d-487d-bd1b-84808068c949 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.470572 Dec 25 21:14:14.903221 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1058/2029] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:14 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:14.905889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-20d626fe-414f-4a30-b351-97916c73f4ae req-255a69a0-153b-4172-aa94-b39bc9fb35ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06595622-92cb-4f87-bd0d-0320a9fc5d7e", "tag": "00640242-8453-4c98-b5aa-a9ed148543ff"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:14.909121 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:14.909121 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:14.929011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-20d626fe-414f-4a30-b351-97916c73f4ae req-255a69a0-153b-4172-aa94-b39bc9fb35ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:14.929760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-20d626fe-414f-4a30-b351-97916c73f4ae req-255a69a0-153b-4172-aa94-b39bc9fb35ec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:14.986182 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-20d626fe-414f-4a30-b351-97916c73f4ae req-255a69a0-153b-4172-aa94-b39bc9fb35ec service nova] Creating event network-changed:00640242-8453-4c98-b5aa-a9ed148543ff for instance 06595622-92cb-4f87-bd0d-0320a9fc5d7e on nch2-master-1 Dec 25 21:14:15.009127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-20d626fe-414f-4a30-b351-97916c73f4ae req-255a69a0-153b-4172-aa94-b39bc9fb35ec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105395 Dec 25 21:14:15.011693 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1059/2030] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:15.031010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02f6d166-0e8b-4543-8e33-ede7ee94e7de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6a16af0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:15.076909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02f6d166-0e8b-4543-8e33-ede7ee94e7de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.077387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02f6d166-0e8b-4543-8e33-ede7ee94e7de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.101023 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02f6d166-0e8b-4543-8e33-ede7ee94e7de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 200 len: 12 microversion: 2.26 time: 0.088043 Dec 25 21:14:15.102480 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1060/2031] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 21:14:15 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 12 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:15.115429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f69bce50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:15.142846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.150337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.152499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:15.171514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.171972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.179703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.180043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.218968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.219945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.236861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:15.258973 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-900f2822-d372-4fbd-a716-78f17e9db847 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 204 len: 0 microversion: 2.26 time: 0.151078 Dec 25 21:14:15.260278 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1061/2032] 10.222.0.32 () {60 vars in 1294 bytes} [Sat Dec 25 21:14:15 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:14:15.376818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:15.384784 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-340586fc-ae39-45e8-b58a-c995dbef8106 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1471 microversion: 2.1 time: 0.561497 Dec 25 21:14:15.387490 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 972/2033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:14 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1471 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:15.399730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f72ee1f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:15.417928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.418622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.419310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:15.421129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1952213497", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:15.426343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.427164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.428191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.428826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.459188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.459855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.473358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.474410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.504059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:15.607849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:15.671545 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b974cd4-6479-44d5-a50d-f7d177e8557c tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1755755473" status: 201 len: 0 microversion: 2.26 time: 0.282444 Dec 25 21:14:15.682712 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 973/2034] 10.222.0.32 () {62 vars in 1379 bytes} [Sat Dec 25 21:14:15 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1755755473 => generated 0 bytes in 284 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Dec 25 21:14:15.690401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:15.693769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:15.707442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.708184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.709526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.710132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.942864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:15.943288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:15.944017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:15.944648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:15.945086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:15.963053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.963705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.966164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:15.966775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:15.988055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Getting quotas for project c455cc0f858a452bb0b60cf0af0c453c. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:15.993987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:16.005272 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-989f8b43-4716-4b3a-9d42-7fc3853f756b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 0.329290 Dec 25 21:14:16.007957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 974/2035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:15 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:16.009943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Getting quotas for user e79788d5030a44b9b522c73791f77233 and project c455cc0f858a452bb0b60cf0af0c453c. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:16.019809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:16.023682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:16.035151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:16.039513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:16.039693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.040152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.044508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.045575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.125602 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-549d964d-ff69-46d1-94cd-381588c0a24c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 14 microversion: 2.1 time: 0.115536 Dec 25 21:14:16.126944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 975/2036] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:16 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:16.133944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f732f820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:16.148277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.149182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.149991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:16.158333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.159276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.160607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.161294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.200052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-daf89b23-90cd-4ea4-bace-eee35a78974c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937899 Dec 25 21:14:16.201061 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1062/2037] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:14:16.207455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:16.208085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:16.284566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.292003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.292500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.302137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.302597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.303720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.362903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.369586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.477839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:16.513739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b4bda6d-c881-4c25-b319-c331a5ee81ec tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-763867953" status: 201 len: 0 microversion: 2.26 time: 0.385190 Dec 25 21:14:16.514392 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 976/2038] 10.222.0.32 () {62 vars in 1376 bytes} [Sat Dec 25 21:14:16 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-763867953 => generated 0 bytes in 387 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Dec 25 21:14:16.524963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06471406-f010-4abb-b20b-b5e6d45664b8 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:16.525759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06471406-f010-4abb-b20b-b5e6d45664b8 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:16.545403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:16.554921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-59448ba0-3d91-435a-b6ae-842a5a51637a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.352554 Dec 25 21:14:16.556767 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1063/2039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:16 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:16.570247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:16.570859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:16.579924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.579924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.581087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.581525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.604019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06471406-f010-4abb-b20b-b5e6d45664b8 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:16.614709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06471406-f010-4abb-b20b-b5e6d45664b8 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1223 microversion: 2.1 time: 0.096380 Dec 25 21:14:16.621010 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 977/2040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:16 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:16.698318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1786552244", "imageRef": "b2fa53fc-9555-4f4a-9359-77898fa776a8", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "70cbe831-35cd-442f-8abb-fc8d5a9a0c36"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:16.755783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:16.764663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] validate_networks() for [('70cbe831-35cd-442f-8abb-fc8d5a9a0c36', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:16.766008 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6a9e05a2-c559-48cb-aff4-787d1131808f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1471 microversion: 2.1 time: 0.207982 Dec 25 21:14:16.766649 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1064/2041] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:16 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:16.771484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f69893a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:16.779452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.781352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.786587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:16.787869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.788331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.789154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.789593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.831412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:16.832109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:16.963422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:16.993016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e415933-3ea0-48e4-841c-a0152c8c95e7 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 204 len: 0 microversion: 2.26 time: 0.215365 Dec 25 21:14:16.993845 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1065/2042] 10.222.0.32 () {60 vars in 1294 bytes} [Sat Dec 25 21:14:16 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:17.003272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90212c3d-1f1a-4d75-9626-ed6127698d11 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6a16b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:17.014365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90212c3d-1f1a-4d75-9626-ed6127698d11 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.014942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90212c3d-1f1a-4d75-9626-ed6127698d11 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.025111 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90212c3d-1f1a-4d75-9626-ed6127698d11 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 200 len: 12 microversion: 2.26 time: 0.026071 Dec 25 21:14:17.025810 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1066/2043] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 21:14:16 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 12 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:17.031611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:17.032708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:17.039776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.040344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.041175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.041672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.402523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:17.412024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44904790-4e33-4e65-85c5-48b01c76d947 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 0.384514 Dec 25 21:14:17.412843 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1067/2044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:17 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:17.424027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6ae6160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:17.431581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.432258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.433129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:17.439314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.439767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.440578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.441087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.475125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.475699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.476689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:17.477121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:17.477791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:17.478380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:17.481330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:17.488696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:17.498302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.499072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.500298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.501005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.507458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3446cc9c-7dd9-40ce-90bb-da19415c38d2 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 204 len: 0 microversion: 2.26 time: 0.092701 Dec 25 21:14:17.509395 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1068/2045] 10.222.0.32 () {60 vars in 1294 bytes} [Sat Dec 25 21:14:17 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:17.514497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:17.516040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:17.523279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.523950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.524958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.526391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.549706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Getting quotas for project 53cc391e03de44dbb245531288da2872. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:17.562028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Getting quotas for user e3cb179749ef4bc786cc3059f72734f8 and project 53cc391e03de44dbb245531288da2872. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:17.572425 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3dc0ec06-5c55-498e-8b2b-a663a1f3a2d2 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 14 microversion: 2.1 time: 0.061574 Dec 25 21:14:17.576926 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1069/2046] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:17 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:17.581025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6aac8b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:17.582149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:17.585963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b2fa53fc-9555-4f4a-9359-77898fa776a8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:17.593305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.593896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.596259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:17.604117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.604730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.605673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.606205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.633573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.634110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.644371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.644793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.754892 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab3faed9-ac5e-4da7-96ba-8d6924e9cbaa tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137899 Dec 25 21:14:17.755583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 978/2047] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 1139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:14:17.760070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:17.760693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:17.767346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.767802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.768592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.769063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.799971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:17.831250 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9f5eb5d-03ed-40cd-8421-7fd69e0aaad6 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-668004449" status: 201 len: 0 microversion: 2.26 time: 0.246094 Dec 25 21:14:17.836359 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1070/2048] 10.222.0.32 () {62 vars in 1376 bytes} [Sat Dec 25 21:14:17 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-668004449 => generated 0 bytes in 262 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Dec 25 21:14:17.848901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:17.853016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:17.862779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.863588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.864494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:17.865494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:17.962801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:17.975108 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b27d929b-86db-443e-a391-5bb17f40cf8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1227 microversion: 2.1 time: 0.137283 Dec 25 21:14:17.990270 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1071/2049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:17 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1227 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.004195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e130583b-e0ca-4be3-889a-b926a11fca7d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:18.004419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:18.007129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e130583b-e0ca-4be3-889a-b926a11fca7d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.020204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c9b4899-6ed2-4620-b92d-cf70fc728156 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.258162 Dec 25 21:14:18.032310 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 979/2050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:17 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.038957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:18.039887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.048433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.049843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.050941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.056964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.109472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e130583b-e0ca-4be3-889a-b926a11fca7d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:18.126666 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e130583b-e0ca-4be3-889a-b926a11fca7d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1222 microversion: 2.1 time: 0.134881 Dec 25 21:14:18.127816 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1072/2051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:17 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.136766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f6aacf70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:18.160567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.164692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.166511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.180157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.181454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.182390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.183495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.226864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.227773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.246009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.246673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.371895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:18.407270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:18.409934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e23fea15-f8f9-4c94-b581-96cc84d3b046 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1169673852" status: 201 len: 0 microversion: 2.26 time: 0.280849 Dec 25 21:14:18.410612 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1073/2052] 10.222.0.32 () {62 vars in 1379 bytes} [Sat Dec 25 21:14:18 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags/tempest-tag-1169673852 => generated 0 bytes in 282 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Dec 25 21:14:18.422250 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-895654ac-4b4a-4575-ba15-3837811e6d02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1471 microversion: 2.1 time: 0.386492 Dec 25 21:14:18.423909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 980/2053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:18 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1471 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.427455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Action: 'update_all', calling method: .version_select at 0x7fa4f6ae6280>, body: {"tags": ["tempest-tag-2073342006", "tempest-tag-451057144"]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:18.428927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:18.430206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.443193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.443719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.444223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.444731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.454548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.454548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.454548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.456031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.456695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.458312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.458915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.502844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.503963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.607754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:18.635179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-66f7d309-675f-4921-899b-dcdb5fe0a7bd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 200 len: 61 microversion: 2.26 time: 0.214967 Dec 25 21:14:18.636807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1074/2054] 10.222.0.32 () {62 vars in 1311 bytes} [Sat Dec 25 21:14:18 2021] PUT /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 61 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.652216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:18.653347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.663405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.663858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.664936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.665560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.710826 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90a6fc6f-b8f3-4dcc-8336-9e5fe265deb7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 14 microversion: 2.1 time: 0.070987 Dec 25 21:14:18.714692 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1075/2055] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:18 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:18.719287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a6fb29e7-c063-4276-930a-4525d88f64ca tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f69bce50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:18.731767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6fb29e7-c063-4276-930a-4525d88f64ca tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.733087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6fb29e7-c063-4276-930a-4525d88f64ca tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.746120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:18.747732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a6fb29e7-c063-4276-930a-4525d88f64ca tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 200 len: 61 microversion: 2.26 time: 0.034242 Dec 25 21:14:18.748659 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1076/2056] 10.222.0.32 () {60 vars in 1291 bytes} [Sat Dec 25 21:14:18 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 61 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.756910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c781aacc-4baf-449e-ac8c-377f0c0f47de tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 0.331602 Dec 25 21:14:18.757438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1982161633", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "3e921bd6-c801-4e72-9632-6b6d2570d487"}, {"uuid": "bddc1eb9-357a-4f2d-89ab-8a23420fb037"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:18.758351 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 981/2057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:18 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:18.763765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '.version_select at 0x7fa4f730f0d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:18.773236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.773964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.774627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:18.783686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.784383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.785420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.786329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.825843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:18.826642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:18.857909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] validate_networks() for [('3e921bd6-c801-4e72-9632-6b6d2570d487', None, None, None, None, None), ('bddc1eb9-357a-4f2d-89ab-8a23420fb037', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:18.986576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lazy-loading 'flavor' on Instance uuid a32723f8-9254-4e54-8d2d-7a4b08821e28 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:19.017188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54dcfbcf-2b80-4165-bf61-aea27729ba8a tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags" status: 204 len: 0 microversion: 2.26 time: 0.257471 Dec 25 21:14:19.018185 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 982/2058] 10.222.0.32 () {60 vars in 1294 bytes} [Sat Dec 25 21:14:18 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28/tags => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:19.027527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:19.028223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:19.035863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:19.036581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:19.038145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:19.038784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:19.157449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:19.167738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b1609ca-3257-4e61-8a58-98d8e0e6237a tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1275 microversion: 2.1 time: 0.144454 Dec 25 21:14:19.179880 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 983/2059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:19 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:19.185270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:19.186503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:19.193416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:19.196263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:19.196263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:19.196263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:19.231007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:14:19.649629 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5096ae3-42a7-4dd3-9909-cd919dbfc5cd tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 204 len: 0 microversion: 2.26 time: 0.467865 Dec 25 21:14:19.650571 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 984/2060] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:14:19 2021] DELETE /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:14:19.661081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:19.661843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:19.668054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:19.668510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:19.669336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:19.669970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.185474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:20.194892 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14d65552-7c3f-4959-8536-efc8a0bd721d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.539274 Dec 25 21:14:20.195599 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 985/2061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:19 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:20.201110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-097fb695-90c9-4aa6-bf58-a2a655f15611 req-472f214a-fb2a-4eff-aca1-c326910b272f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f0a001-36db-4334-9faa-a374e3a51158", "name": "network-vif-plugged", "status": "completed", "tag": "01be047a-fff9-4768-83e3-d8f015049719"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:20.211475 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:20.211475 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:20.211475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-097fb695-90c9-4aa6-bf58-a2a655f15611 req-472f214a-fb2a-4eff-aca1-c326910b272f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.211804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-097fb695-90c9-4aa6-bf58-a2a655f15611 req-472f214a-fb2a-4eff-aca1-c326910b272f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.224732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-097fb695-90c9-4aa6-bf58-a2a655f15611 req-472f214a-fb2a-4eff-aca1-c326910b272f service nova] Creating event network-vif-plugged:01be047a-fff9-4768-83e3-d8f015049719 for instance 45f0a001-36db-4334-9faa-a374e3a51158 on nch2-master-1 Dec 25 21:14:20.230429 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-097fb695-90c9-4aa6-bf58-a2a655f15611 req-472f214a-fb2a-4eff-aca1-c326910b272f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032718 Dec 25 21:14:20.231410 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 986/2062] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:20.244547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:20.248910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:20.255383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.256113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.257162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.258038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.357765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:20.366176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-59621ea1-6c7d-4edc-9670-7b364c51909d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1218 microversion: 2.1 time: 0.132215 Dec 25 21:14:20.366763 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 987/2063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:20 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1218 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:20.371703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:20.372530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:20.378605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.390026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.390026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.390026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.577815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:20.584068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:20.584068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:20.584068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:20.584068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:20.589669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.590119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.590927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.591358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.614341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Getting quotas for project af3f5665f009477385c524a3e23aedc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:20.620528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Getting quotas for user 6015b6dc2cbd4171a690602866d50ace and project af3f5665f009477385c524a3e23aedc6. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:20.633770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:20.637184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:20.648172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:20.660220 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71360fc3-e83b-403d-b307-bb70b8e35170 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1471 microversion: 2.1 time: 0.292022 Dec 25 21:14:20.661437 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 988/2064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:20 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:20.666544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:20.667552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:20.680302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.682908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.684138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.684670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.892455 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c0e2e38-1ee0-4960-bfee-6e8b56fdab38 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.142417 Dec 25 21:14:20.898316 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1077/2065] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 2144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:14:20.900699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:20.903425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:20.910463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.911024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:20.912597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:20.913375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.008189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.017317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.018843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.020051 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6dea58d1-1851-46be-bc0e-0edb211c6cfc tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1550 microversion: 2.26 time: 0.357468 Dec 25 21:14:21.032678 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 989/2066] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:20 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1550 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:21.033128 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-21199c6d-fec3-40e3-b50a-9df46544181a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 16400 microversion: 2.1 time: 0.137537 Dec 25 21:14:21.034129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1078/2067] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:20 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 16400 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:21.035699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:21.036328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:21.040679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:21.043277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:21.047683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.048142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.049051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.051393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.065647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.066104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.067009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.067446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.177921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.188259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e987e8d-10b8-4884-928a-182aa76f9388 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1281 microversion: 2.1 time: 0.152826 Dec 25 21:14:21.192672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1079/2068] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:21 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:21.199071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e713d5f1-b592-424c-88b1-0b53f471553c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:21.199711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e713d5f1-b592-424c-88b1-0b53f471553c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:21.329354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e713d5f1-b592-424c-88b1-0b53f471553c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.349232 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e713d5f1-b592-424c-88b1-0b53f471553c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1213 microversion: 2.1 time: 0.159135 Dec 25 21:14:21.351915 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1080/2069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:21 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:21.365665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:21.366579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:21.374767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.379825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.379825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.379825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.669117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.677152 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46a8a91f-5320-4e42-b15f-8f07fe849244 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 0.645041 Dec 25 21:14:21.686459 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 990/2070] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:21 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:21.691790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:21.692645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:21.703953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.703953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.703953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.703953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.872928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:21.881112 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c9a253f-466c-4de4-b2a4-2f6b9da9fb13 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1292 microversion: 2.1 time: 0.193191 Dec 25 21:14:21.881784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 991/2071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:21 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1292 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:21.896811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:21.897583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:21.904328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.905096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:21.905976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:21.906553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.002281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:22.010816 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41764a54-3b53-40db-9173-993ff6db6df4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1320 microversion: 2.1 time: 0.648821 Dec 25 21:14:22.011580 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1081/2072] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:21 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1320 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:22.039503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:22.045073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:22.048744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.053514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.054589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.057705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.481914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:22.502002 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff08ab7e-323e-479c-b196-247e52b55e74 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.617752 Dec 25 21:14:22.502628 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 992/2073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:21 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:22.526985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:22.534600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:22.555423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.564309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.566120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.567539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.647683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:22.654353 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc7c68f0-1d53-46af-82e7-5c6d923c109a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 16400 microversion: 2.1 time: 0.149435 Dec 25 21:14:22.656084 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 993/2074] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:22 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 16400 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:22.664975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:22.666651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:22.667603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:22.669266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:22.680408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.690170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.690170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.690170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.690501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6a7d7a1d-e59e-4383-a14e-c093e104db19 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1550 microversion: 2.26 time: 0.642552 Dec 25 21:14:22.690501 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1082/2075] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:22 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1550 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:22.703745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a4048189-39e8-4a06-a68b-dfce98c26308 req-2d83173c-b759-4386-9fc9-99f5f582e916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23221387-3a9d-4105-b3db-d1586e20d8a5", "name": "network-vif-plugged", "status": "completed", "tag": "0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:22.706414 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:22.706414 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:22.731123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a4048189-39e8-4a06-a68b-dfce98c26308 req-2d83173c-b759-4386-9fc9-99f5f582e916 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.736374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a4048189-39e8-4a06-a68b-dfce98c26308 req-2d83173c-b759-4386-9fc9-99f5f582e916 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.755841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a4048189-39e8-4a06-a68b-dfce98c26308 req-2d83173c-b759-4386-9fc9-99f5f582e916 service nova] Creating event network-vif-plugged:0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2 for instance 23221387-3a9d-4105-b3db-d1586e20d8a5 on nch2-master-1 Dec 25 21:14:22.764900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a4048189-39e8-4a06-a68b-dfce98c26308 req-2d83173c-b759-4386-9fc9-99f5f582e916 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075307 Dec 25 21:14:22.784414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1083/2076] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:22.793436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:22.794926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:22.827247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.834679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:22.844238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:22.845315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.033094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:23.051011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0fea7b12-70b3-4049-96ef-1c16467f15f2 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1265 microversion: 2.1 time: 0.264388 Dec 25 21:14:23.052451 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1084/2077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:22 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1265 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:23.061514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:23.062434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:23.071055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.072494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.074300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.075574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.629777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:23.639421 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be064640-29ef-4074-831c-4a588be9668b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.980407 Dec 25 21:14:23.643420 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 994/2078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:22 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:23.648053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:23.648693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:23.660857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.661730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.662787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.663448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.749287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:23.759200 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c30bb75b-c799-4f17-b806-9f6ac483bfe7 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1280 microversion: 2.1 time: 0.114676 Dec 25 21:14:23.760044 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 995/2079] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:23 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1280 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:23.769544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:23.774282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:23.777773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.778456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.779760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.780521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.822940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:23.830524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90889018-f8f3-4cce-8b82-0a6c729a667c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1351 microversion: 2.1 time: 0.776754 Dec 25 21:14:23.833455 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1085/2080] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:23 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1351 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:23.838288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9cc451e5-f76f-46a5-a19f-0ac356e3c67c req-9d0f29a3-c5c7-40da-bc9e-21d782a5eba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32723f8-9254-4e54-8d2d-7a4b08821e28", "name": "network-vif-deleted", "tag": "fdcafc76-a01c-4114-a75e-4dbcfb7490ec"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:23.845497 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:23.845497 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:23.853258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9cc451e5-f76f-46a5-a19f-0ac356e3c67c req-9d0f29a3-c5c7-40da-bc9e-21d782a5eba5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.853984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9cc451e5-f76f-46a5-a19f-0ac356e3c67c req-9d0f29a3-c5c7-40da-bc9e-21d782a5eba5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.867303 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9cc451e5-f76f-46a5-a19f-0ac356e3c67c req-9d0f29a3-c5c7-40da-bc9e-21d782a5eba5 service nova] Creating event network-vif-deleted:fdcafc76-a01c-4114-a75e-4dbcfb7490ec for instance a32723f8-9254-4e54-8d2d-7a4b08821e28 on nch1-master-1 Dec 25 21:14:23.874698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9cc451e5-f76f-46a5-a19f-0ac356e3c67c req-9d0f29a3-c5c7-40da-bc9e-21d782a5eba5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039689 Dec 25 21:14:23.877719 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1086/2081] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:23.892984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:23.893765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:23.913423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.914438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:23.915474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:23.918915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.095148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.106490 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff537511-d018-457e-9761-5cbef48ac295 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1470 microversion: 2.1 time: 0.345164 Dec 25 21:14:24.120045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 996/2082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:23 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1470 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:24.124949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:24.146708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:24.158697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.159161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.169551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.169551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.230857 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-33efb1f1-9f5c-442b-ae54-d100a1bfd700 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 16400 microversion: 2.1 time: 0.109371 Dec 25 21:14:24.232293 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 997/2083] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:24 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 16400 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:24.242421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:24.243138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:24.256130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.261390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.261390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.261390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.304176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.321044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-870aaca2-3336-4c7b-8a77-05b315daf1db tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.443578 Dec 25 21:14:24.332861 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1087/2084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:23 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:24.340115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:24.340982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:24.349778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.350097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.351181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.352133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.378122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.390205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.392293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.403644 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a92f375a-1d15-4b01-aeb4-2292e0cd988d tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.169701 Dec 25 21:14:24.404570 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 998/2085] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:24 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:24.434793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.443773 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64afccad-0d97-4b9c-9639-fed3473eb366 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1283 microversion: 2.1 time: 0.109049 Dec 25 21:14:24.454552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1088/2086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:24 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1283 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:24.653573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:24.654701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:24.657324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:24.658516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:24.662473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.662945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.663801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.664989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.670406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.670877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.673754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.674926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.697351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:14:24.835565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:24.843072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f530b9f-69bb-4316-9058-6cf18050659f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.190499 Dec 25 21:14:24.843735 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1089/2087] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:24 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:24.848263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:24.849197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:24.854981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.860757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:24.860757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:24.860757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.017861 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebffab63-251c-45ee-8eb5-7c37f09e8c61 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] 10.222.0.32 "DELETE /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 204 len: 0 microversion: 2.1 time: 0.611849 Dec 25 21:14:25.021729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 999/2088] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:24 2021] DELETE /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:14:25.029771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.029771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.048346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.048908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.049748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.050198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.067471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.078456 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68d9c3d8-0837-4b59-b1eb-28dd82e55e57 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.233360 Dec 25 21:14:25.079735 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1090/2089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:24 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:25.086438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.087301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.094503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.095756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.097207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.098201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.358290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.369702 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c202234-d199-4353-898a-d611258f6ff3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1540 microversion: 2.1 time: 0.349341 Dec 25 21:14:25.383196 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1000/2090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1540 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:25.390558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:25.392410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.392940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.399382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.399958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.400467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4baab60-d283-4fab-90b5-f290106aa30d tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1476 microversion: 2.1 time: 0.319243 Dec 25 21:14:25.400987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.402064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.409951 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1091/2091] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1476 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:25.418978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.419210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.425557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.425968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.426734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.427174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.454862 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc52868c-dcc6-4534-9c4f-5e2eab44891b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 16400 microversion: 2.1 time: 0.069422 Dec 25 21:14:25.456326 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1001/2092] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:25 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 16400 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:25.466450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.467203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.484571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.487011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.487011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.487910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.604312 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dbf49eb5-f7bc-4125-877f-91c69b37e1d9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146258 Dec 25 21:14:25.605434 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1002/2093] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:25.615707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.615707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.616324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.623777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.624239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.625705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.626167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.631151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-692d0788-2548-4e75-8cd0-237589c8d2e2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.220101 Dec 25 21:14:25.632076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1092/2094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:25.638463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.644180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.647668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.648304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.649698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.650459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.747684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.760784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.767089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:25.768324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02ccae7c-b5a2-4a74-a7be-5bd186c58175 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.161796 Dec 25 21:14:25.773231 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1003/2095] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:25.861240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:25.862211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:25.868961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.869628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:25.870671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:25.871570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.006946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:26.019473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e03ecfb-c143-42a8-b04e-05d9a55382bb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1313 microversion: 2.1 time: 0.385711 Dec 25 21:14:26.020100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1093/2096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:26.096188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:26.096817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:26.106985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.107438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.108247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.108688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.277254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:26.285040 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0ee3838-1f44-4a08-809d-b001509db203 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.428636 Dec 25 21:14:26.285635 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1004/2097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:25 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:26.422725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:26.423527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:26.437268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.437869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.443906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.443906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.593665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:26.614548 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc8f38bf-3c7f-4c97-8736-85e1ac689320 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.520517 Dec 25 21:14:26.615695 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1094/2098] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:26 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:26.621360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:26.622354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:26.634146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.634693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.635618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.636339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.701477 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-922e4dee-ff44-48bb-b9ac-b9a0d618d415 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.084304 Dec 25 21:14:26.705723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1095/2099] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:26 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:26.708564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:26.709281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:26.716393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.716848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.717997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.718129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.873900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:26.881531 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-635363c3-7af0-45ab-81e5-07805fe321a7 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1476 microversion: 2.1 time: 0.465553 Dec 25 21:14:26.882120 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1005/2100] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:26 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:26.895618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:26.902565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:26.910293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.910750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:26.911562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:26.911997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.036936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:27.059789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:27.074319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:27.078891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2623368-776e-4fc5-ab4e-9ac1fb4a8f38 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.186877 Dec 25 21:14:27.081864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1006/2101] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:26 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:27.095440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:27.097045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:27.110686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.111143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.111951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.112394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.267179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:27.283485 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7de9aeda-bd16-4c47-a991-8483ce547843 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.578900 Dec 25 21:14:27.297617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1096/2102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:26 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:27.308156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:27.308156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:27.316096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.316624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.317667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.317965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.590940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:27.604759 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99f95020-2d6a-4780-89c0-73b9960cf0fb tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.521056 Dec 25 21:14:27.606066 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1007/2103] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:27 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:27.610945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-dd48183e-bc1d-43b1-8d4b-726a168a157a req-b79c6326-8985-46c6-a6ba-fb6de6e7a659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712038b0-21e9-49b2-adbc-494075814a04", "tag": "558fe07e-120c-40d4-bb28-cb8b2deda29a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:27.612837 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:27.612837 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:27.633494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dd48183e-bc1d-43b1-8d4b-726a168a157a req-b79c6326-8985-46c6-a6ba-fb6de6e7a659 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.633891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dd48183e-bc1d-43b1-8d4b-726a168a157a req-b79c6326-8985-46c6-a6ba-fb6de6e7a659 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.648180 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-dd48183e-bc1d-43b1-8d4b-726a168a157a req-b79c6326-8985-46c6-a6ba-fb6de6e7a659 service nova] Creating event network-changed:558fe07e-120c-40d4-bb28-cb8b2deda29a for instance 712038b0-21e9-49b2-adbc-494075814a04 on nch2-master-1 Dec 25 21:14:27.655739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-dd48183e-bc1d-43b1-8d4b-726a168a157a req-b79c6326-8985-46c6-a6ba-fb6de6e7a659 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047915 Dec 25 21:14:27.657186 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1008/2104] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:27.662969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:27.664017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:27.677550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.678695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.679978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.680600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.795643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:27.815342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c1439204-4279-4865-b4e3-530ffb1f6cc7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.515140 Dec 25 21:14:27.816594 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1097/2105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:27 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:27.825379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:27.826680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:27.835171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.835923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.841554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.841554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.910549 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64d75f5c-614d-4fc4-b845-ab2cf109aa19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.090480 Dec 25 21:14:27.915691 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1098/2106] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:27 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:27.926516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:27.930414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:27.937034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.937593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:27.938337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:27.938779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:28.105385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:28.115502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75a47480-8f10-4175-a343-3c56c9849671 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1434 microversion: 2.1 time: 0.198079 Dec 25 21:14:28.116447 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1099/2107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:27 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1434 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:28.121745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:28.122430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:28.129151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:28.129608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:28.130585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:28.131106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:28.702056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:28.714182 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce591ff0-921a-4168-b767-4559bf6fd00b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 1.055563 Dec 25 21:14:28.726005 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1009/2108] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:27 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:28.727337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:28.733515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:28.734500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:28.738257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:28.739941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:28.741310 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a9197e80-ec51-4f23-a9ef-e8d8b39e79ed tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.623814 Dec 25 21:14:28.742183 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1100/2109] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:28 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:28.742433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:28.742903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:28.743815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:28.744261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:28.758333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:28.759084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:28.767526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:28.767526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:28.768490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:28.769160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.187846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:29.206517 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9b693c4-59fd-482e-8eeb-185ebda9487e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.478658 Dec 25 21:14:29.207120 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1010/2110] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:28 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:29.218956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-93795b72-9c62-4638-b57e-322002102584 req-e252b0d2-84a1-4728-a6de-4f26a54f069c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45f0a001-36db-4334-9faa-a374e3a51158", "name": "network-vif-deleted", "tag": "01be047a-fff9-4768-83e3-d8f015049719"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:29.220626 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:29.220626 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:29.228221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:29.239898 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4fbed6e3-ee8c-4c25-a9af-8a8b4925622d tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.484831 Dec 25 21:14:29.247389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-93795b72-9c62-4638-b57e-322002102584 req-e252b0d2-84a1-4728-a6de-4f26a54f069c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.248148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-93795b72-9c62-4638-b57e-322002102584 req-e252b0d2-84a1-4728-a6de-4f26a54f069c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.256316 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1101/2111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:28 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:29.263083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:29.263812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:29.266674 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-93795b72-9c62-4638-b57e-322002102584 req-e252b0d2-84a1-4728-a6de-4f26a54f069c service nova] Creating event network-vif-deleted:01be047a-fff9-4768-83e3-d8f015049719 for instance 45f0a001-36db-4334-9faa-a374e3a51158 on nch2-master-1 Dec 25 21:14:29.273800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.274263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.275081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.275523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.277508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-93795b72-9c62-4638-b57e-322002102584 req-e252b0d2-84a1-4728-a6de-4f26a54f069c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067392 Dec 25 21:14:29.278582 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1011/2112] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:29.290900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:29.290900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:29.295751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.296578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.297872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.298471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.374561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2698fd18-49de-4302-b03c-1fcfb5868892 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.094153 Dec 25 21:14:29.375645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1012/2113] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:29 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:29.382015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:29.383270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:29.391668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.392299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.393334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.393948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.464499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6a7729d-60ee-40e3-a53e-5d1f7262eddc tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.086722 Dec 25 21:14:29.465444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1013/2114] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:29 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:29.477640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:29.478963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:29.490240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.490895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.491862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.492479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.539166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.539909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.540532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lazy-loading 'fault' on Instance uuid 45f0a001-36db-4334-9faa-a374e3a51158 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:29.610614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:29.619356 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8c60731-5f74-46bf-9922-abdeb4c8a4ef tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 200 len: 1310 microversion: 2.1 time: 0.152130 Dec 25 21:14:29.625731 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1014/2115] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:29 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 1310 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:29.647676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:29.658891 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ed2fb38-60dd-43df-9b1f-d0664abdba27 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.398758 Dec 25 21:14:29.658891 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1102/2116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:29 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:29.695236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-be846af2-483b-448b-8b84-9f630e417884 req-563daf69-a62d-46db-83d8-c6db3068fba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "712038b0-21e9-49b2-adbc-494075814a04", "tag": "16909884-4838-4f33-ab81-5984be2e8ea1"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:29.696849 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:29.696849 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:29.705589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-be846af2-483b-448b-8b84-9f630e417884 req-563daf69-a62d-46db-83d8-c6db3068fba2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.706710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-be846af2-483b-448b-8b84-9f630e417884 req-563daf69-a62d-46db-83d8-c6db3068fba2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.719494 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-be846af2-483b-448b-8b84-9f630e417884 req-563daf69-a62d-46db-83d8-c6db3068fba2 service nova] Creating event network-changed:16909884-4838-4f33-ab81-5984be2e8ea1 for instance 712038b0-21e9-49b2-adbc-494075814a04 on nch2-master-1 Dec 25 21:14:29.724918 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-be846af2-483b-448b-8b84-9f630e417884 req-563daf69-a62d-46db-83d8-c6db3068fba2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033513 Dec 25 21:14:29.725893 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1015/2117] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:29.731641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:29.732379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:29.738400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.739201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.740140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.740813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.762767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:29.765196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:29.788848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.790573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.790850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:29.793162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:29.994491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:30.005349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:30.007250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:30.008719 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-691d4b94-32d7-4955-9e06-411ce1c54a89 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.252828 Dec 25 21:14:30.009568 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1016/2118] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:29 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:14:30.223659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:30.224385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:30.232136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.232136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.234522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.234522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.257537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:30.266065 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52d5cb85-941a-4459-9985-e2cf3b409274 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.538707 Dec 25 21:14:30.267270 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1103/2119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:29 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:30.275749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:30.280624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:30.289500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.289945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.293702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.294487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.661796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:30.669997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1450926-5a2d-46b0-86ee-c846cc631b0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.450118 Dec 25 21:14:30.680119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:30.681095 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1017/2120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:30 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:30.686926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:30.688126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:30.692482 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e736532-754b-4337-967a-155d458e5c3e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.422145 Dec 25 21:14:30.694164 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1104/2121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:30 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:30.695160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.695614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.697121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.697599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.712973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:30.714737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:30.720973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.721428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.722440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.723077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.742895 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9287d8d-37b3-4b9a-854e-0076288962fd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.059522 Dec 25 21:14:30.743690 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1018/2122] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:30 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:30.750281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:30.752692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:30.765896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.769138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-490e498a-a899-499c-b11e-ac68904377a6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.072331 Dec 25 21:14:30.770081 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1105/2123] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:30 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:30.775145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.777208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.778574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:30.779240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.783558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:30.797286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.798043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.799030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:30.804868 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] HTTP exception thrown: Instance 45f0a001-36db-4334-9faa-a374e3a51158 could not be found. Dec 25 21:14:30.805700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:30.809930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Returning 404 to user: Instance 45f0a001-36db-4334-9faa-a374e3a51158 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:30.811079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81c3c79c-8dd4-4b8b-8a02-104e688e2b7b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 404 len: 111 microversion: 2.1 time: 0.064952 Dec 25 21:14:30.813495 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1019/2124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:30 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:30.954076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1142896044", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:31.022828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:31.032499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:31.040177 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ffa209a-70eb-4cc4-ab97-797e2bb3bfa9 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.268540 Dec 25 21:14:31.040918 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1106/2125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:30 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:31.046374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:31.046374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:31.051978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.052465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.053262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.053696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.155548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:31.165910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:31.168082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:31.169376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a728a72-5d82-4973-8706-e5529bad06de tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.127614 Dec 25 21:14:31.170018 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1107/2126] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:31 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:31.282908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:31.283549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:31.289629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.290081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.290857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.291289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.382549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:31.382807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:31.383465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:31.383887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:31.384480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:31.395662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.396205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.397429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.398178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.418784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Getting quotas for project 646e75ab8f934ab7b7d2fab01bb800d9. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:31.424307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Getting quotas for user c59c9265b73d4f778c27de407dce255f and project 646e75ab8f934ab7b7d2fab01bb800d9. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:31.439048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:31.442762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:31.544813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:31.554801 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-228b6661-f0b7-4a71-86a7-54ca3f590bfb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.275551 Dec 25 21:14:31.560407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1108/2127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:31 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:31.561832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-12d6a166-e566-4a3a-b5d4-2416c2770a5a req-d2026a5c-4179-4dd6-a400-7729f67b0813 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23221387-3a9d-4105-b3db-d1586e20d8a5", "tag": "0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:31.564147 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:31.564147 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:31.566900 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c57eaf3b-7f0c-43b4-b9c0-8b9061b2ce9b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615281 Dec 25 21:14:31.568271 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1020/2128] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:14:31.572811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-12d6a166-e566-4a3a-b5d4-2416c2770a5a req-d2026a5c-4179-4dd6-a400-7729f67b0813 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.573677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-12d6a166-e566-4a3a-b5d4-2416c2770a5a req-d2026a5c-4179-4dd6-a400-7729f67b0813 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.579322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5620b393-a323-4ebd-829f-d3eb1e3e13e8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:31.579980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5620b393-a323-4ebd-829f-d3eb1e3e13e8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:31.587092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-12d6a166-e566-4a3a-b5d4-2416c2770a5a req-d2026a5c-4179-4dd6-a400-7729f67b0813 service nova] Creating event network-changed:0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2 for instance 23221387-3a9d-4105-b3db-d1586e20d8a5 on nch2-master-1 Dec 25 21:14:31.592788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-12d6a166-e566-4a3a-b5d4-2416c2770a5a req-d2026a5c-4179-4dd6-a400-7729f67b0813 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035645 Dec 25 21:14:31.593987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1109/2129] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:31.689734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:31.691422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:31.701134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.701658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.702516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.702968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.722375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5620b393-a323-4ebd-829f-d3eb1e3e13e8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:31.734228 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5620b393-a323-4ebd-829f-d3eb1e3e13e8 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1220 microversion: 2.1 time: 0.159670 Dec 25 21:14:31.737378 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1021/2130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:31 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1220 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:31.743542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:31.748538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:31.756474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.757143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:31.758769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:31.759475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.113351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.126112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8004c0f8-506d-4d87-bb85-aff9310826a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.442070 Dec 25 21:14:32.136999 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1110/2131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:31 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:32.142777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:32.143750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:32.151536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.152306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.153175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.153615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.158715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.168173 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eef83305-98b0-4637-a978-6a5561d2a502 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.429449 Dec 25 21:14:32.182392 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1022/2132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:31 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:32.189767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:32.190824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:32.196782 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98199da0-2b33-479e-825d-b3351c498e92 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.058417 Dec 25 21:14:32.200240 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1111/2133] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:32 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:32.205179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.205702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.207369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.207590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.211196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:32.212068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:32.220796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.225278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.225278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.225278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.255150 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc56907d-9641-434d-9348-5f898c3604ee tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.070009 Dec 25 21:14:32.256215 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1023/2134] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:32 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:32.261856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:32.265388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:32.272943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.277111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.277111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.277111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.353099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.364800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.366360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.370195 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f5dcf60-93a0-422d-b863-990170a8189e tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.110041 Dec 25 21:14:32.373034 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1024/2135] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:32 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:32.436334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.447679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c46c62c8-adbd-4970-ad72-a70203d99229 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.245067 Dec 25 21:14:32.457416 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1112/2136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:32 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:32.573650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:32.574269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:32.580981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.581432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.582407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:32.582840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:32.713113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.720464 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc68740d-cc6f-4e0b-881e-b960586c12f8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.151345 Dec 25 21:14:32.721065 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1025/2137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:32 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:32.751949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48bd05eb-261d-4054-984c-8c3a5eaabedb tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:32.752897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48bd05eb-261d-4054-984c-8c3a5eaabedb tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:32.811766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48bd05eb-261d-4054-984c-8c3a5eaabedb tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:32.819933 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48bd05eb-261d-4054-984c-8c3a5eaabedb tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1220 microversion: 2.1 time: 0.072544 Dec 25 21:14:32.820502 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1113/2138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:32 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1220 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:33.143659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:33.144277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.151703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.152172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.152994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.153437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.185084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:33.186010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.192931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.193385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.194393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.195035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.352211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.360908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0af53d4f-f908-4fbc-9dfb-8804211e85e8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.220945 Dec 25 21:14:33.368934 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1026/2139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:33 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:33.368934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:33.368934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.375344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.377582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.386505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.387072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.411503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.417588 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e8d133a-458e-4beb-9ef1-bbc8982843b1 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.236224 Dec 25 21:14:33.418578 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1114/2140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:33 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:33.423337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:33.424345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.430385 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80e169bd-0e5a-4d8f-a2b1-6203336848a1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.067652 Dec 25 21:14:33.431005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.434231 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1027/2141] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:33 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:33.435136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.436550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.437704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.437855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:33.438463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.446245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.446702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.448275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.448787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.503634 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb81b27e-c1db-4d3b-84e0-5b95607d367e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.083626 Dec 25 21:14:33.504188 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1115/2142] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:33 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:33.509340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:33.510795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.518497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.519253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.520487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.521225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.522366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.536910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.539808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.542501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb65283e-db92-407a-b069-14a33f65f573 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.108798 Dec 25 21:14:33.544905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1028/2143] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:33 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:33.695782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.705153 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5702276-60c6-4a21-894f-016ef1bfd61d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.199461 Dec 25 21:14:33.706066 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1116/2144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:33 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:33.739430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:33.740328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.747445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.747890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.748693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.749929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.836954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:33.837580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:33.848269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.849116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.850217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:33.850842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:33.917918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.927767 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16236846-f931-4fa9-b553-9ea62abf70af tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.191771 Dec 25 21:14:33.942621 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1029/2145] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:33 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:33.958607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:33.966430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c93951d6-c9a4-465f-88c9-ac61d0b48f3f tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1272 microversion: 2.1 time: 0.133118 Dec 25 21:14:33.967007 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1117/2146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:33 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:34.377647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:34.378411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.386684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.387139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.387944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.388531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.436347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:34.437620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.454429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.454874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.458607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.458607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.638400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:34.646251 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-abb95829-6ac2-4a38-a5a7-f405070bc0d4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.272402 Dec 25 21:14:34.646939 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1030/2147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:34 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:34.651876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:34.652835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.659401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.659844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.660645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.661113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.694831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:34.703631 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-942c3e8d-26c7-4e4b-96b7-05e560c33276 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.271780 Dec 25 21:14:34.704327 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1118/2148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:34 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:34.710515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:34.721043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.721195 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f4e23bf-7678-46ce-a36c-f8b75b0bdf93 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.064588 Dec 25 21:14:34.721195 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1031/2149] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:34 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:34.721398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.721398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.721398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.721398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.728380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:34.729924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.737724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.738175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.739162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.739603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.768129 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-600a2ec4-570e-46b8-a0a1-1e9c92e918d4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.062268 Dec 25 21:14:34.769345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1119/2150] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:34 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:34.775452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:34.776773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.784074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.790029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.790029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.790029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.810979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:34.825858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:34.828227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd5e4a505ed3847588a7f577f2e607afd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86857b4629c4cdbbd6a4664d499fb87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:34.829714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e7f73bc-c661-47a5-807c-f090c55277b1 tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 200 len: 1508 microversion: 2.26 time: 0.110037 Dec 25 21:14:34.830744 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1032/2151] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:34 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 1508 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:14:34.967185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:34.967840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:34.974136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.974877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:34.975868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:34.976494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:35.150629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:35.160176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a13b1766-6cee-403f-9ff3-6e3271b43b22 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.206014 Dec 25 21:14:35.169237 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1033/2152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:34 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:35.169237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:35.169237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:35.175394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:35.176271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:35.176708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:35.177178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:35.217542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:35.228895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed7fdbfb-48c8-40b0-8c8f-1c09afdd1717 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.457781 Dec 25 21:14:35.229726 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1120/2153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:34 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:35.330754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:35.339013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f2caddb-a7b2-4c24-9727-dd65a7900887 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1320 microversion: 2.1 time: 0.177184 Dec 25 21:14:35.339950 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1034/2154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:35 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1320 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:35.663334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:35.665922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:35.677186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:35.677641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:35.678633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:35.679253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:35.720215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:35.720848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:35.733302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:35.733764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:35.734579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:35.735021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.501562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:36.509933 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2d2c548-d9a0-4eea-9875-39bd26baf3d8 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.793807 Dec 25 21:14:36.520593 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1035/2155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:35 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:36.520593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:36.520593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:36.532577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.533080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.533878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.535996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.536172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:36.549623 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4a5ab63-dfa3-44f1-b4c7-2cc0f46dc084 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.889877 Dec 25 21:14:36.550821 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1121/2156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:35 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:36.557199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:36.559070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:36.567752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.568416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.569696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.571043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.608974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2ae4beed-8412-4dd1-a769-d986206ff2d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.096635 Dec 25 21:14:36.613101 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1036/2157] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:36 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:36.619620 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9b56f83-c0b5-4714-a44a-7580b5894318 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.067281 Dec 25 21:14:36.620439 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1122/2158] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:36 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:36.621498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:36.624086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] [instance: a32723f8-9254-4e54-8d2d-7a4b08821e28] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:36.636160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.636925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.637468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:36.638090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.638690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.639370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:36.653914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.664924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.668485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.668983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.677557 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] HTTP exception thrown: Instance a32723f8-9254-4e54-8d2d-7a4b08821e28 could not be found. Dec 25 21:14:36.678461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] Returning 404 to user: Instance a32723f8-9254-4e54-8d2d-7a4b08821e28 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:36.680143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b834006e-505c-4de3-80d2-9e5be64297fe tempest-ServerTagsTestJSON-645171844 tempest-ServerTagsTestJSON-645171844-project] 10.222.0.32 "GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28" status: 404 len: 111 microversion: 2.26 time: 0.065591 Dec 25 21:14:36.685174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1037/2159] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:14:36 2021] GET /compute/v2.1/servers/a32723f8-9254-4e54-8d2d-7a4b08821e28 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:14:36.690271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:36.691245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:36.699254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.699941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:36.701133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:36.701739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.285745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:37.293489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4af5b64e-5296-4533-962c-85ad8d0b0795 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.668018 Dec 25 21:14:37.294059 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1123/2160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:36 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:37.298961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:37.299552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:37.306244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.306696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.310680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.310680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.311209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:37.318960 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7d1b30fe-0bf8-41c1-9ed5-cbcd8d33f29d tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.632185 Dec 25 21:14:37.320161 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1038/2161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:36 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:37.325815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-09aca656-16c7-478d-b0a2-dbbbd6eca01c req-24c11270-0e4d-43c8-8517-3c1a88fe5307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4701ffa8-7657-48b3-94c6-ad6336c8dfd6", "tag": "d62784a3-3811-4577-9f02-3d8938b22301"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:37.327634 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:37.327634 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:37.338615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-09aca656-16c7-478d-b0a2-dbbbd6eca01c req-24c11270-0e4d-43c8-8517-3c1a88fe5307 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.338615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-09aca656-16c7-478d-b0a2-dbbbd6eca01c req-24c11270-0e4d-43c8-8517-3c1a88fe5307 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.349784 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-09aca656-16c7-478d-b0a2-dbbbd6eca01c req-24c11270-0e4d-43c8-8517-3c1a88fe5307 service nova] Creating event network-changed:d62784a3-3811-4577-9f02-3d8938b22301 for instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 on nch2-master-1 Dec 25 21:14:37.355104 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-09aca656-16c7-478d-b0a2-dbbbd6eca01c req-24c11270-0e4d-43c8-8517-3c1a88fe5307 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033481 Dec 25 21:14:37.356009 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1039/2162] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:37.362202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ad4b43b3-7263-4648-a695-fae36d3f234b req-5b46b931-fa65-4950-a1d2-6bc4f7fa65f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712038b0-21e9-49b2-adbc-494075814a04", "name": "network-vif-plugged", "status": "completed", "tag": "558fe07e-120c-40d4-bb28-cb8b2deda29a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:37.363809 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:37.363809 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:37.371725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ad4b43b3-7263-4648-a695-fae36d3f234b req-5b46b931-fa65-4950-a1d2-6bc4f7fa65f7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.372171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ad4b43b3-7263-4648-a695-fae36d3f234b req-5b46b931-fa65-4950-a1d2-6bc4f7fa65f7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.383860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ad4b43b3-7263-4648-a695-fae36d3f234b req-5b46b931-fa65-4950-a1d2-6bc4f7fa65f7 service nova] Creating event network-vif-plugged:558fe07e-120c-40d4-bb28-cb8b2deda29a for instance 712038b0-21e9-49b2-adbc-494075814a04 on nch2-master-1 Dec 25 21:14:37.388944 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ad4b43b3-7263-4648-a695-fae36d3f234b req-5b46b931-fa65-4950-a1d2-6bc4f7fa65f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031307 Dec 25 21:14:37.392547 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1040/2163] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:37.528660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:37.530352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:37.536130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.536587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.537449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.537864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.858995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:37.882549 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e1c246e-8f2b-4e3f-b829-2e7492378bfa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1320 microversion: 2.1 time: 0.587187 Dec 25 21:14:37.883967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1124/2164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:37 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1320 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:37.889973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:37.894175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:37.910791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.911687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:37.912411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:37.917831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.128989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:38.138375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-018365d5-9e66-4c9a-bd97-334670708d2c tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.614910 Dec 25 21:14:38.139123 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1041/2165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:37 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:38.143831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:38.145129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:38.152809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.153557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.154429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.155090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.197689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0e6350fe-3ea8-4403-8a4a-a2784a1bfcea tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 24569 microversion: 2.1 time: 0.057139 Dec 25 21:14:38.198338 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1042/2166] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:38 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 24569 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:38.203479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:38.204498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:38.211774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.212232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.213064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.214036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.260797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-678255c4-4ed3-4d93-b106-5b47ef82f30a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 14 microversion: 2.1 time: 0.055567 Dec 25 21:14:38.260797 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1043/2167] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:38 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:14:38.269013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-304a9923-44cb-4708-801f-cda359c1e0c1 req-f8f77dbe-dd02-4e44-80cd-cbd92b5ae94c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1488edc8-a4a9-47c4-bc28-867a3c7538ba", "tag": "17909193-855a-40f6-a3dd-9f23db819ef3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:38.269013 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:38.269013 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:38.276705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-304a9923-44cb-4708-801f-cda359c1e0c1 req-f8f77dbe-dd02-4e44-80cd-cbd92b5ae94c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.277691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-304a9923-44cb-4708-801f-cda359c1e0c1 req-f8f77dbe-dd02-4e44-80cd-cbd92b5ae94c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.294179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-304a9923-44cb-4708-801f-cda359c1e0c1 req-f8f77dbe-dd02-4e44-80cd-cbd92b5ae94c service nova] Creating event network-changed:17909193-855a-40f6-a3dd-9f23db819ef3 for instance 1488edc8-a4a9-47c4-bc28-867a3c7538ba on nch1-master-1 Dec 25 21:14:38.300765 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-304a9923-44cb-4708-801f-cda359c1e0c1 req-f8f77dbe-dd02-4e44-80cd-cbd92b5ae94c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042662 Dec 25 21:14:38.306657 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1044/2168] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:38.312012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:38.313597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:38.320405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.321130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.322166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.322907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.534628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:38.542716 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fde82d9a-84e8-4fbc-ac87-1e6e7a8392f2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.656404 Dec 25 21:14:38.543287 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1125/2169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:37 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:38.548068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:38.548743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:38.555235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.555549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.556340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.557217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.748547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:38.756378 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b7d6861-df94-481e-b0b4-9df4781e213b tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.449730 Dec 25 21:14:38.756986 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1045/2170] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:38 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:38.901823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:38.902489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:38.909014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.909474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.910283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:38.910726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:38.937275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:38.950286 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f60f8016-80e4-40f5-a489-1f1514dcb8cf tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.405583 Dec 25 21:14:38.959935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1126/2171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:38 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:39.155602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:39.156513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:39.162935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.163402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.164245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.164683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.243274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:39.251263 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c0e2574-e4a9-46a4-a72f-b329d54f2bbe tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1320 microversion: 2.1 time: 0.353818 Dec 25 21:14:39.251826 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1046/2172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:38 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:39.256483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:39.257483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:39.264280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.264740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.265607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.266072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.326039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:39.369001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43f4ec24-dfe5-4b05-866f-7ca76d03de1e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.077434 Dec 25 21:14:39.369001 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1047/2173] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:39 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:39.370367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99582de7-fadd-43a1-9fa6-faf5f845c607 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.182669 Dec 25 21:14:39.370367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1127/2174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:39 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:39.370536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:39.370536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:39.370536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.370536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.370536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.370536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.405581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-efa6c016-9d3a-451e-971f-b33279c03503 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 8206 microversion: 2.1 time: 0.073018 Dec 25 21:14:39.405901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-153d1586-823e-4a07-83bf-6f71b2676dab req-f7563815-377c-4605-b3f7-b7fc3e19a435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712038b0-21e9-49b2-adbc-494075814a04", "name": "network-vif-plugged", "status": "completed", "tag": "16909884-4838-4f33-ab81-5984be2e8ea1"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:39.406704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1048/2175] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:39 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 8206 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:39.407587 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:39.407587 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:39.414986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-153d1586-823e-4a07-83bf-6f71b2676dab req-f7563815-377c-4605-b3f7-b7fc3e19a435 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.415448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-153d1586-823e-4a07-83bf-6f71b2676dab req-f7563815-377c-4605-b3f7-b7fc3e19a435 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.427953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-153d1586-823e-4a07-83bf-6f71b2676dab req-f7563815-377c-4605-b3f7-b7fc3e19a435 service nova] Creating event network-vif-plugged:16909884-4838-4f33-ab81-5984be2e8ea1 for instance 712038b0-21e9-49b2-adbc-494075814a04 on nch2-master-1 Dec 25 21:14:39.433756 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-153d1586-823e-4a07-83bf-6f71b2676dab req-f7563815-377c-4605-b3f7-b7fc3e19a435 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034342 Dec 25 21:14:39.434565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1128/2176] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:14:39.560942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:39.561669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:39.568748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.569236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.570037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.570487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.702882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:39.710799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8753e153-5383-4351-9932-330fccdb06d5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.154965 Dec 25 21:14:39.711369 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1049/2177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:39 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:39.774070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:39.774778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:39.782618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.783072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.783872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.784311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.969044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:39.969680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:39.977231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.977694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.978489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:39.979558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:39.995835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:40.003990 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c005c68-ff5e-48c1-984b-a1b79fadfe0c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.234013 Dec 25 21:14:40.004649 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1129/2178] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:39 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:40.204320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:40.214623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e574dd47-b1e4-4cd2-9e9c-a149f0a74d82 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.249993 Dec 25 21:14:40.215745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1050/2179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:39 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:40.270533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:40.271197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:40.277822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.278268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.279046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.292349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.374490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-80bfd700-709c-4a57-94ee-345fd7e574b5 req-96f5ebc9-a6fb-4e10-94fd-5f3aed91fc1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e7dfd9-c959-4465-a460-55aac15feeef", "tag": "b231c087-49e0-4d5a-a3ce-2791da36b76a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:40.376839 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:40.376839 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:40.384425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-80bfd700-709c-4a57-94ee-345fd7e574b5 req-96f5ebc9-a6fb-4e10-94fd-5f3aed91fc1c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.385583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-80bfd700-709c-4a57-94ee-345fd7e574b5 req-96f5ebc9-a6fb-4e10-94fd-5f3aed91fc1c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.405519 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-80bfd700-709c-4a57-94ee-345fd7e574b5 req-96f5ebc9-a6fb-4e10-94fd-5f3aed91fc1c service nova] Creating event network-changed:b231c087-49e0-4d5a-a3ce-2791da36b76a for instance f7e7dfd9-c959-4465-a460-55aac15feeef on nch1-master-1 Dec 25 21:14:40.405519 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-80bfd700-709c-4a57-94ee-345fd7e574b5 req-96f5ebc9-a6fb-4e10-94fd-5f3aed91fc1c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034658 Dec 25 21:14:40.406301 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1051/2180] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:40 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:14:40.411370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:40.412502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:40.419751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.420210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.421181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.421764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.470060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f8a59ba-70d8-43a1-89ff-568a0a1149ad tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.062336 Dec 25 21:14:40.470720 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1052/2181] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:40 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:40.476989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:40.481038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:40.487289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.487904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.488758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.489272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.898729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:40.906228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-015e2520-dab5-4cd4-a2aa-eae1c538cd01 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1320 microversion: 2.1 time: 0.639292 Dec 25 21:14:40.906807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1130/2182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:40 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1320 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:40.912220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:40.913416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:40.920199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.920653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.921507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.922594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.977237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0477af3-9d8b-4f33-8063-928bfdd2a83a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 16387 microversion: 2.1 time: 0.069156 Dec 25 21:14:40.978533 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1131/2183] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:40 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 16387 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:40.985534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:40.985534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:40.994148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.994636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:40.995440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:40.995882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.068433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:41.077825 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83574e58-c092-4ebc-a63b-4372a760134e tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1334 microversion: 2.1 time: 0.605768 Dec 25 21:14:41.079258 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1053/2184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:40 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1334 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:41.085009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:41.085856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:41.092685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.093634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.094459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.094891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.288864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:41.296397 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0aa09d65-3736-491b-931b-5f14537c86f5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.316052 Dec 25 21:14:41.296950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1132/2185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:40 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:41.310855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:41.311479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:41.317496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.317951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.318759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.319201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.381515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:41.389981 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b12860bf-619f-49ab-96e1-e4f6353c0429 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.309481 Dec 25 21:14:41.390563 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1054/2186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:41 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:41.481760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:41.483438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:41.493382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.494997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.496206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.497093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.540830 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9874beba-6539-460a-a018-8c8969e5195b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.063093 Dec 25 21:14:41.541948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1055/2187] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:41 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:14:41.556657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:41.565142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1c09d9a-0b1d-4a0d-908e-e70d329ff187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.258541 Dec 25 21:14:41.566314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1133/2188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:41 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:41.923748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:41.924561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:41.931648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.934300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.934300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.934300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.988792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:41.989834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:41.997051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.997652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:41.998277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:41.998710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.040387 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26d30568-90f6-41e5-b3e8-fa55325a3e68 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 16387 microversion: 2.1 time: 0.055317 Dec 25 21:14:42.041763 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1134/2189] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:41 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 16387 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:14:42.095902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:42.096520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.104795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.104795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.105819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.106457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.106686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:42.114663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea46dc3d-62fa-4ece-b0e2-79b71c8dc2ce tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1320 microversion: 2.1 time: 0.195007 Dec 25 21:14:42.115402 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1056/2190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:41 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:42.293105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-362aba78-c97a-48ad-acda-95fa528ccd0d req-3bf765cb-f869-4a53-99ea-7068a03ce335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4701ffa8-7657-48b3-94c6-ad6336c8dfd6", "name": "network-vif-plugged", "status": "completed", "tag": "d62784a3-3811-4577-9f02-3d8938b22301"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:42.294657 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:42.294657 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:42.302714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-362aba78-c97a-48ad-acda-95fa528ccd0d req-3bf765cb-f869-4a53-99ea-7068a03ce335 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.303168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-362aba78-c97a-48ad-acda-95fa528ccd0d req-3bf765cb-f869-4a53-99ea-7068a03ce335 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.314373 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-362aba78-c97a-48ad-acda-95fa528ccd0d req-3bf765cb-f869-4a53-99ea-7068a03ce335 service nova] Creating event network-vif-plugged:d62784a3-3811-4577-9f02-3d8938b22301 for instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 on nch2-master-1 Dec 25 21:14:42.319438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-362aba78-c97a-48ad-acda-95fa528ccd0d req-3bf765cb-f869-4a53-99ea-7068a03ce335 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030060 Dec 25 21:14:42.320037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1057/2191] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:14:42.325595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:42.326299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.338386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:42.341978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.342967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.343785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.344237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.358094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c4ff8d5-963f-4e21-9304-5949538f8d43 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1668 microversion: 2.1 time: 0.266142 Dec 25 21:14:42.369910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1135/2192] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:42 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1668 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:42.381803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:42.386804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.389783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.390548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.391671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.392367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.421046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d0f61de0-91ab-45ba-b86a-791b122143a6 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04/ips" status: 200 len: 178 microversion: 2.1 time: 0.043771 Dec 25 21:14:42.427254 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1136/2193] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:14:42 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04/ips => generated 178 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:14:42.433134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:42.434663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.447169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.447169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.447169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.447169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.602020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:42.602020 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2aab5031-38d1-48a0-ac68-efcbc936a832 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.279733 Dec 25 21:14:42.602020 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1058/2194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:42 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:42.608466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:42.609298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.615579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.616030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.616839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.617303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.643092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:14:42.662289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:42.670230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b975fcd5-7aea-4470-aa70-1fa32f81cf02 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.241617 Dec 25 21:14:42.670805 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1137/2195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:42 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:42.675179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:42.676141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.682795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.683254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.684073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.684537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.725219 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3f67a97-22b7-4e15-887e-0680664e5379 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.053167 Dec 25 21:14:42.725854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1138/2196] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:42 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:42.731545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:42.735195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:42.740503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.740972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.741800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:42.742241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:42.898899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:42.918567 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efeef748-9d46-49ea-b23a-f69101ae261f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.191463 Dec 25 21:14:42.919633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1139/2197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:42 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:42.995436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-541489ae-43c0-4825-bf82-f9717cb0a047 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "DELETE /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 204 len: 0 microversion: 2.1 time: 0.391423 Dec 25 21:14:42.996504 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1059/2198] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:42 2021] DELETE /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:14:43.008173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:43.009432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:43.016782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.017516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.018318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.019027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.052538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:43.054006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:43.062450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.063035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.064072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.064799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.127316 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b357546-7bdd-48a7-8157-ff0eb67ddf79 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 16387 microversion: 2.1 time: 0.078998 Dec 25 21:14:43.135535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1060/2199] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:43 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 16387 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:14:43.143578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:43.145944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:43.157275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.157791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.158837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.159149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.340736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:43.349870 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e700f13-57fd-4f41-a397-a70e3cdecf64 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1674 microversion: 2.1 time: 0.345547 Dec 25 21:14:43.353468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1140/2200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:43 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1674 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:43.481030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:43.490144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e00a1341-3790-4ea9-9b37-7be506161faa tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1320 microversion: 2.1 time: 0.353011 Dec 25 21:14:43.500515 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1061/2201] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:43 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:43.618455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:43.619414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:43.626204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.626959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.627942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.628533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.689464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:43.691136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:43.701877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.704508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:43.706718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:43.707721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.008888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:44.019267 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ec50614-be4e-4aee-893e-f9c503198770 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.404394 Dec 25 21:14:44.020336 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1141/2202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:43 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:44.025023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:44.030644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:44.041518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.042604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.044093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.044845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.092583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:44.092779 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8867b61-f20d-4530-84f9-9bcbd73b25d6 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.070804 Dec 25 21:14:44.093334 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1142/2203] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:44 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:44.100682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee76d38a-88d9-4c62-92a4-819e7d117148 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.416763 Dec 25 21:14:44.101776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1062/2204] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:43 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:44.102523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:44.103241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:44.110745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.117303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.117303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.117303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.146499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:44.147628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:44.154370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.154921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.155809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.156495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.220314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34b3779c-ca77-4fbf-92b9-c44ba8f128c4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 16387 microversion: 2.1 time: 0.076498 Dec 25 21:14:44.221359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1063/2205] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:44 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 16387 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:44.338355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:44.350290 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-65af3eec-9655-495a-8f3c-e36fad42e896 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.251673 Dec 25 21:14:44.351068 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1143/2206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:44 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:44.369002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:44.370252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:44.377722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.378180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.379149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.379595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.510577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:44.511547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:44.519611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.520593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.521642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.524014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.849753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:44.868944 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-37ad2721-a2d5-4fde-a8cd-7bdbf6b7b3a0 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1674 microversion: 2.1 time: 0.495476 Dec 25 21:14:44.868944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1064/2207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:44 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1674 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:44.881273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:44.893011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e4d89261-d226-472c-9670-399ed391a482 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1468 microversion: 2.1 time: 0.389417 Dec 25 21:14:44.894181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1144/2208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:44 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1468 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:44.910465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:44.911571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:44.919955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.923947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:44.923947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:44.923947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.036738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:45.037636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:45.052084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.052850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.056029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.056029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.285141 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9f1d4c4-4e89-434e-80f4-281073b100b4 tempest-DeleteServersAdminTestJSON-1794117862 tempest-DeleteServersAdminTestJSON-1794117862-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6/action" status: 202 len: 0 microversion: 2.1 time: 0.378509 Dec 25 21:14:45.287487 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1065/2209] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:44 2021] POST /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:14:45.294473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:45.296264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:45.303362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.304926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.306090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.307552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.369747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f63e19d7-342b-4a7d-a00d-39ecf54286dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.080600 Dec 25 21:14:45.383408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1066/2210] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:45 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:45.389023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:45.389751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:45.403316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.403877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.405085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.408959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:45.410475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.417701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c313f83-b64a-40f3-894b-a60b89b950d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.384795 Dec 25 21:14:45.418282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1145/2211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:45 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:45.423072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:45.424246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:45.430723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.431431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.432651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.433295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.498946 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5437f6e-ef80-42b5-80c8-e2667e0e1e3e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.079045 Dec 25 21:14:45.499882 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1146/2212] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:45 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:45.505365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:45.506287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:45.517140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.517140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.517140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.517140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.557032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.557762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.558525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lazy-loading 'fault' on Instance uuid 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:45.770044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:45.778084 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd9db193-547d-4a71-895d-67563ea4393d tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.396049 Dec 25 21:14:45.778682 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1067/2213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:45 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:45.793996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:45.794646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:45.807927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.809247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.811345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.811345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.910419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:45.918705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9093af3c-6d01-4b3e-b189-e0db40588e03 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1451 microversion: 2.1 time: 0.417223 Dec 25 21:14:45.919292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1147/2214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:45 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1451 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:45.940136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4cee15b0-0d34-4a39-8f15-61d9d121eac1 req-5db6539a-d9e4-49f8-9784-00c6ea19abae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712038b0-21e9-49b2-adbc-494075814a04", "name": "network-vif-deleted", "tag": "16909884-4838-4f33-ab81-5984be2e8ea1"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:45.940452 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:45.940452 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:45.963856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4cee15b0-0d34-4a39-8f15-61d9d121eac1 req-5db6539a-d9e4-49f8-9784-00c6ea19abae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:45.964313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4cee15b0-0d34-4a39-8f15-61d9d121eac1 req-5db6539a-d9e4-49f8-9784-00c6ea19abae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:45.988379 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4cee15b0-0d34-4a39-8f15-61d9d121eac1 req-5db6539a-d9e4-49f8-9784-00c6ea19abae service nova] Creating event network-vif-deleted:16909884-4838-4f33-ab81-5984be2e8ea1 for instance 712038b0-21e9-49b2-adbc-494075814a04 on nch2-master-1 Dec 25 21:14:45.993545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4cee15b0-0d34-4a39-8f15-61d9d121eac1 req-5db6539a-d9e4-49f8-9784-00c6ea19abae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070556 Dec 25 21:14:45.994969 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1148/2215] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:46.000506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:46.001303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:46.019973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.021317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.022655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.023270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.518338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:46.528757 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-004faae1-bb05-4ab2-8d3a-1db472b66122 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.746792 Dec 25 21:14:46.538450 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1068/2216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:45 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:46.544550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:46.545323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:46.552549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.553636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.554530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.554775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.612405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:14:46.678193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6015b6dc2cbd4171a690602866d50ace', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af3f5665f009477385c524a3e23aedc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:46.697429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfa21ccd-0a31-49b4-bb22-d0d31d21c337 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 200 len: 1653 microversion: 2.1 time: 0.698912 Dec 25 21:14:46.699576 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1149/2217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:45 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 1653 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:46.703756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:46.712693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:46.721394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.721819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.722625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.723283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.772698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d22f538-a3ea-4ff5-a975-33f5673605dc tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.072860 Dec 25 21:14:46.778520 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1150/2218] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:46 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:46.784105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:46.785064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:46.796968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.796968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:46.796968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:46.796968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.034378 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fbf1f2e2-e711-43de-82b7-5b1fdefab090 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 204 len: 0 microversion: 2.1 time: 0.503372 Dec 25 21:14:47.038818 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1069/2219] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:46 2021] DELETE /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:14:47.045215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:47.047059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:47.056721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.057572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.058625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.060597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.118215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98b70ad7-3f87-493e-8dc4-c5ee8bbaf27c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.077227 Dec 25 21:14:47.119809 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1070/2220] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:47 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:47.127502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:47.128579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:47.138796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.139695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.140739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.141418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.326169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:47.344281 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d0e2108-f9ed-4c13-828f-f78e4cb84a71 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1476 microversion: 2.1 time: 0.563927 Dec 25 21:14:47.345247 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1151/2221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:46 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1476 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:47.359247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:47.360668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:47.376151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.376974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.379743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.381135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.468314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.469397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.470799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lazy-loading 'fault' on Instance uuid 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:47.559322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:47.583136 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-117ac789-f8e9-4ac6-b452-42f820f300d4 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.450934 Dec 25 21:14:47.609095 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1071/2222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:47 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:47.624648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:47.625846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:47.634997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.635724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.637658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.638973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.763544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:47.776986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43121f86-818b-4719-8641-c4c71ed96a8b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1457 microversion: 2.1 time: 0.427278 Dec 25 21:14:47.781091 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1152/2223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:47 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1457 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:47.792709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:47.795674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:47.810311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.811778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.814420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.815873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.836445 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] HTTP exception thrown: Instance 712038b0-21e9-49b2-adbc-494075814a04 could not be found. Dec 25 21:14:47.837109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Returning 404 to user: Instance 712038b0-21e9-49b2-adbc-494075814a04 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:47.838558 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a703729-5fa7-478c-b650-e265096b7d85 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 404 len: 111 microversion: 2.1 time: 0.056452 Dec 25 21:14:47.841268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1153/2224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:47 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:47.845713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:47.847566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:47.856766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.857293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.858109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.858544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.905516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:47.917183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-561ada7f-90a9-4ab6-99ea-8cfd1592afa4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.306544 Dec 25 21:14:47.917931 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1072/2225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:47 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:47.925736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-415b3e83-22fd-4825-a58c-c477b6c4217d req-01840542-f19f-47f7-9039-ab92fb5f9501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1488edc8-a4a9-47c4-bc28-867a3c7538ba", "name": "network-vif-plugged", "status": "completed", "tag": "17909193-855a-40f6-a3dd-9f23db819ef3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:47.928107 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:47.928107 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:47.939639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-415b3e83-22fd-4825-a58c-c477b6c4217d req-01840542-f19f-47f7-9039-ab92fb5f9501 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:47.940790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-415b3e83-22fd-4825-a58c-c477b6c4217d req-01840542-f19f-47f7-9039-ab92fb5f9501 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:47.946016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-866151d6-d2f5-4fa6-b7b4-868dcf440496 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.101292 Dec 25 21:14:47.947807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1154/2226] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:47 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:47.955934 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-415b3e83-22fd-4825-a58c-c477b6c4217d req-01840542-f19f-47f7-9039-ab92fb5f9501 service nova] Creating event network-vif-plugged:17909193-855a-40f6-a3dd-9f23db819ef3 for instance 1488edc8-a4a9-47c4-bc28-867a3c7538ba on nch1-master-1 Dec 25 21:14:47.963986 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-415b3e83-22fd-4825-a58c-c477b6c4217d req-01840542-f19f-47f7-9039-ab92fb5f9501 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043167 Dec 25 21:14:47.966484 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1073/2227] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:48.138663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:48.146143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:48.155674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.156407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.157450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.157890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.209728 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87f87cc2-cc3b-4d0b-9011-242a3250a57a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.081398 Dec 25 21:14:48.214280 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1155/2228] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:48 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:48.242883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b377b919-eea4-4cad-9964-08c582871596 req-399040a2-78e8-4ede-9ca5-9dd928994043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "712038b0-21e9-49b2-adbc-494075814a04", "name": "network-vif-deleted", "tag": "558fe07e-120c-40d4-bb28-cb8b2deda29a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:48.244647 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:48.244647 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:48.257955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b377b919-eea4-4cad-9964-08c582871596 req-399040a2-78e8-4ede-9ca5-9dd928994043 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.262948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b377b919-eea4-4cad-9964-08c582871596 req-399040a2-78e8-4ede-9ca5-9dd928994043 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.290135 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b377b919-eea4-4cad-9964-08c582871596 req-399040a2-78e8-4ede-9ca5-9dd928994043 service nova] Creating event network-vif-deleted:558fe07e-120c-40d4-bb28-cb8b2deda29a for instance 712038b0-21e9-49b2-adbc-494075814a04 on nch2-master-1 Dec 25 21:14:48.306817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b377b919-eea4-4cad-9964-08c582871596 req-399040a2-78e8-4ede-9ca5-9dd928994043 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067612 Dec 25 21:14:48.307433 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1074/2229] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:48.364293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:48.365689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:48.382456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.382846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.388497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.389253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.595534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:48.596190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:48.617062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.624321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.628449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.629614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.866875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:48.882948 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20d43f83-e2d4-477d-8fba-225530667765 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1475 microversion: 2.1 time: 0.517607 Dec 25 21:14:48.883940 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1156/2230] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:48 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1475 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:48.897186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:48.898002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:48.924215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.924215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:48.925573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:48.926352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.015670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.016491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.017593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lazy-loading 'fault' on Instance uuid 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:49.050337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:49.061090 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b56970cc-bc8a-4c45-ae33-f9f946789941 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.471195 Dec 25 21:14:49.074627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1075/2231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:48 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:49.084809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:49.089383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:49.105371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.106136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.107184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.107859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.551215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:49.559498 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9daa891e-0d6c-475d-8a2f-e0c7fe3c9d2a tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1457 microversion: 2.1 time: 0.674147 Dec 25 21:14:49.569083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1157/2232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:48 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1457 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:49.577010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:49.578620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:49.592505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.593108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.593800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.594276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.614721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:49.630701 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8615385b-5d18-4c26-8d4a-83358e7aef3b tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1323 microversion: 2.1 time: 0.554630 Dec 25 21:14:49.639854 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1076/2233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:49 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1323 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:49.641893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:49.648282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:49.664327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.674897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.674897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.674897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.680299 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f983769-1296-4a85-b7ff-23c08ab016b3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.109742 Dec 25 21:14:49.681947 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1158/2234] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:49 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:49.715007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d4044880-6e2f-4c10-9e3d-bbb97642c559 req-cffb664d-d307-49a3-8cfa-faf9e2d10744 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b248cb56-18c2-4ff2-a8da-8e0993879a65", "name": "network-vif-unplugged", "status": "completed", "tag": "5a73a242-a477-40db-9b6d-7ac1d38d6950"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:49.717153 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:49.717153 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:49.726145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d4044880-6e2f-4c10-9e3d-bbb97642c559 req-cffb664d-d307-49a3-8cfa-faf9e2d10744 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.726577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d4044880-6e2f-4c10-9e3d-bbb97642c559 req-cffb664d-d307-49a3-8cfa-faf9e2d10744 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.744467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d4044880-6e2f-4c10-9e3d-bbb97642c559 req-cffb664d-d307-49a3-8cfa-faf9e2d10744 service nova] Creating event network-vif-unplugged:5a73a242-a477-40db-9b6d-7ac1d38d6950 for instance b248cb56-18c2-4ff2-a8da-8e0993879a65 on nch2-master-1 Dec 25 21:14:49.752968 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50f61ea0-bb65-420d-983d-3977d1b50b43 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.118781 Dec 25 21:14:49.754960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-d4044880-6e2f-4c10-9e3d-bbb97642c559 req-cffb664d-d307-49a3-8cfa-faf9e2d10744 service nova] Instance b248cb56-18c2-4ff2-a8da-8e0993879a65 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:14:49.765539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1077/2235] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:49 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:49.775049 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d4044880-6e2f-4c10-9e3d-bbb97642c559 req-cffb664d-d307-49a3-8cfa-faf9e2d10744 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089883 Dec 25 21:14:49.776614 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1159/2236] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:49.903447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:49.904164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:49.915466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.915466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.915466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:49.915466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:49.995902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-84c30374-15ec-42be-bcd9-0824fc3a61cb req-2dac7b03-b60b-4b87-b2c5-eeb741071b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e7dfd9-c959-4465-a460-55aac15feeef", "name": "network-vif-plugged", "status": "completed", "tag": "b231c087-49e0-4d5a-a3ce-2791da36b76a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:49.998735 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:49.998735 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:50.017214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-84c30374-15ec-42be-bcd9-0824fc3a61cb req-2dac7b03-b60b-4b87-b2c5-eeb741071b98 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.019585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-84c30374-15ec-42be-bcd9-0824fc3a61cb req-2dac7b03-b60b-4b87-b2c5-eeb741071b98 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.038259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-84c30374-15ec-42be-bcd9-0824fc3a61cb req-2dac7b03-b60b-4b87-b2c5-eeb741071b98 service nova] Creating event network-vif-plugged:b231c087-49e0-4d5a-a3ce-2791da36b76a for instance f7e7dfd9-c959-4465-a460-55aac15feeef on nch1-master-1 Dec 25 21:14:50.045395 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-84c30374-15ec-42be-bcd9-0824fc3a61cb req-2dac7b03-b60b-4b87-b2c5-eeb741071b98 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053953 Dec 25 21:14:50.047417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1160/2237] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:14:50.083892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:50.088506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:50.102611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.103356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.104355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.110256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.468689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:50.486772 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55cb61e0-8741-4d25-8226-7c21b4b2411f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1475 microversion: 2.1 time: 0.587756 Dec 25 21:14:50.487786 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1078/2238] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:49 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1475 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:50.589516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:50.593155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:50.593155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:50.598818 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6ae2719-67fc-4d7a-b061-d49d945cd5fe tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.521591 Dec 25 21:14:50.603577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1161/2239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:50 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:50.605983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.606630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.608237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.608844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.654375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:50.656513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:50.669383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.670293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.671374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.671939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.698880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.699428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.699792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lazy-loading 'fault' on Instance uuid 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:50.786659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c59c9265b73d4f778c27de407dce255f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '646e75ab8f934ab7b7d2fab01bb800d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:50.805522 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7695a1a0-01be-4efc-957f-97c875cdaa22 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 200 len: 1415 microversion: 2.1 time: 0.216694 Dec 25 21:14:50.805522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1079/2240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:50 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 1415 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:50.820417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:50.823732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:50.834129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.835087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:50.863484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:50.868938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.000052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-062b9dd0-9082-4438-ac48-be3c08f8e624 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.190544 Dec 25 21:14:51.000710 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1080/2241] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:50 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:51.013780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:51.020130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:51.033591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.035958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.035958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.035958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.095092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:51.104687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-736a7d26-5928-477c-9840-13ee6e9685a3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.095377 Dec 25 21:14:51.106172 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1081/2242] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:51 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:51.110275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c1245b17-07cb-46fb-9e5a-e9afbf23b1d7 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1473 microversion: 2.1 time: 0.465023 Dec 25 21:14:51.112990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9aba2686-025b-442d-9968-803f769cd27b req-5d553840-f42b-4850-9527-eff4600b30ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4701ffa8-7657-48b3-94c6-ad6336c8dfd6", "name": "network-vif-deleted", "tag": "d62784a3-3811-4577-9f02-3d8938b22301"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:51.118488 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:51.118488 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:51.122418 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1162/2243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:50 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1473 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:51.131355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9aba2686-025b-442d-9968-803f769cd27b req-5d553840-f42b-4850-9527-eff4600b30ee service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.132254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9aba2686-025b-442d-9968-803f769cd27b req-5d553840-f42b-4850-9527-eff4600b30ee service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.134203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:51.135331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:51.150233 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9aba2686-025b-442d-9968-803f769cd27b req-5d553840-f42b-4850-9527-eff4600b30ee service nova] Creating event network-vif-deleted:d62784a3-3811-4577-9f02-3d8938b22301 for instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 on nch2-master-1 Dec 25 21:14:51.156046 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9aba2686-025b-442d-9968-803f769cd27b req-5d553840-f42b-4850-9527-eff4600b30ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047531 Dec 25 21:14:51.157373 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1082/2244] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:51.166597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.167058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.167979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.168418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.222547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:51.223228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:51.224378 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07e0cfc3-c5ba-49fd-8273-928c65589d8f tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.100559 Dec 25 21:14:51.227807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1163/2245] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:14:51 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba/diagnostics => generated 117 bytes in 105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:51.244506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:51.248628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:51.262290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.264132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.265931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.266651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.308681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:14:51.508008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:51.509197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:51.523187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.523654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.524466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.525193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.788342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23af51a9-8b52-47d0-80bb-662ad473faf4 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 204 len: 0 microversion: 2.1 time: 0.544998 Dec 25 21:14:51.793144 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1083/2246] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:51 2021] DELETE /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:14:51.818217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:51.832221 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aecef189-294f-4104-a083-5c3f875eafc6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1475 microversion: 2.1 time: 0.328644 Dec 25 21:14:51.833627 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1164/2247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:51 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1475 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:51.839112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:51.840068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:51.848598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.849350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:51.850370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:51.851031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.059177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:52.075421 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e61f7469-1784-481e-8bb0-61ce8796aa40 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1322 microversion: 2.1 time: 0.240375 Dec 25 21:14:52.076011 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1165/2248] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:51 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:52.082311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.085327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.096812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.098427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.099463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.102157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.154647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83b80953-d4af-47d8-964c-46490c969133 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: .version_select at 0x7fa4f7061430>, body: {"keypair": {"name": "tempest-keypair-327730817"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:52.183443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-83b80953-d4af-47d8-964c-46490c969133 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:52.193096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-83b80953-d4af-47d8-964c-46490c969133 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for user d0383b7f61484347ba9875a2636e1057 and project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:52.378960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:52.388443 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-460c07d5-48b5-41f7-bafd-ed4e9e3aed9e tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1479 microversion: 2.1 time: 0.311020 Dec 25 21:14:52.389172 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1166/2249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:52 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1479 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:52.394475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-735b2a1b-e1e9-4f52-8754-1f21c6bfa26a req-a23c3043-fe85-4db9-bb72-37ccef022bf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b248cb56-18c2-4ff2-a8da-8e0993879a65", "tag": "5a73a242-a477-40db-9b6d-7ac1d38d6950"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:52.396587 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:52.396587 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:52.405258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-735b2a1b-e1e9-4f52-8754-1f21c6bfa26a req-a23c3043-fe85-4db9-bb72-37ccef022bf6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.407746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-735b2a1b-e1e9-4f52-8754-1f21c6bfa26a req-a23c3043-fe85-4db9-bb72-37ccef022bf6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.420502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-735b2a1b-e1e9-4f52-8754-1f21c6bfa26a req-a23c3043-fe85-4db9-bb72-37ccef022bf6 service nova] Creating event network-changed:5a73a242-a477-40db-9b6d-7ac1d38d6950 for instance b248cb56-18c2-4ff2-a8da-8e0993879a65 on nch2-master-1 Dec 25 21:14:52.428406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-735b2a1b-e1e9-4f52-8754-1f21c6bfa26a req-a23c3043-fe85-4db9-bb72-37ccef022bf6 service nova] Instance b248cb56-18c2-4ff2-a8da-8e0993879a65 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:14:52.441932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-735b2a1b-e1e9-4f52-8754-1f21c6bfa26a req-a23c3043-fe85-4db9-bb72-37ccef022bf6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050777 Dec 25 21:14:52.444558 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1167/2250] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:52.457650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.459033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.466834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.470616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.470616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.470616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.517221 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] HTTP exception thrown: Instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 could not be found. Dec 25 21:14:52.517871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Returning 404 to user: Instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:52.518751 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c942e31a-dbda-4772-8abc-3a9136e1cdd4 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 404 len: 111 microversion: 2.1 time: 0.066653 Dec 25 21:14:52.523576 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1168/2251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:52 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:52.534130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:52.536709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.550509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.551168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.552146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.554333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.619926 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2dd6692d-d6ae-4e62-be8c-8c18d2b80d02 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.093214 Dec 25 21:14:52.621602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1169/2252] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:52 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:52.632178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1b2c4233-9e2a-40a7-a2c7-0dd8f2533fad req-a7d063d4-69fc-4773-bfd1-90cf11750bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4701ffa8-7657-48b3-94c6-ad6336c8dfd6", "name": "network-vif-unplugged", "status": "completed", "tag": "d62784a3-3811-4577-9f02-3d8938b22301"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:52.635265 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:52.635265 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:52.649066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1b2c4233-9e2a-40a7-a2c7-0dd8f2533fad req-a7d063d4-69fc-4773-bfd1-90cf11750bc4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.650764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1b2c4233-9e2a-40a7-a2c7-0dd8f2533fad req-a7d063d4-69fc-4773-bfd1-90cf11750bc4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.675631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-83b80953-d4af-47d8-964c-46490c969133 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:52.685951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-83b80953-d4af-47d8-964c-46490c969133 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for user d0383b7f61484347ba9875a2636e1057 and project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:52.710328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83b80953-d4af-47d8-964c-46490c969133 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2296 microversion: 2.1 time: 0.907741 Dec 25 21:14:52.716730 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1084/2253] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:14:51 2021] POST /compute/v2.1/os-keypairs => generated 2296 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:52.721853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:52.722909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.731538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.732070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.738197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.738197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.761479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1b2c4233-9e2a-40a7-a2c7-0dd8f2533fad req-a7d063d4-69fc-4773-bfd1-90cf11750bc4 service nova] Creating event network-vif-unplugged:d62784a3-3811-4577-9f02-3d8938b22301 for instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 on nch2-master-1 Dec 25 21:14:52.771527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1b2c4233-9e2a-40a7-a2c7-0dd8f2533fad req-a7d063d4-69fc-4773-bfd1-90cf11750bc4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145002 Dec 25 21:14:52.774308 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1170/2254] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:52.782743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.783488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.790298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.790648 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-206a8871-ddf9-49a4-903e-df99f5fb37b0 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.072460 Dec 25 21:14:52.791232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.791754 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1085/2255] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:52 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:52.791900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.792406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.813802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] HTTP exception thrown: Instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 could not be found. Dec 25 21:14:52.814451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Returning 404 to user: Instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:52.815763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a8f8fa7-7431-4be1-88e8-e511dc242486 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 404 len: 111 microversion: 2.1 time: 0.040015 Dec 25 21:14:52.816346 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1171/2256] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:52 2021] DELETE /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:52.826475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.827988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 4701ffa8-7657-48b3-94c6-ad6336c8dfd6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.836576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.837292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.838743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.839401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.849871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.850490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.858783 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] HTTP exception thrown: Instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 could not be found. Dec 25 21:14:52.859389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Returning 404 to user: Instance 4701ffa8-7657-48b3-94c6-ad6336c8dfd6 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:52.860266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84e48f1c-5329-4f30-8955-13d2ad2e3b6b tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6" status: 404 len: 111 microversion: 2.1 time: 0.039777 Dec 25 21:14:52.860788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1086/2257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:52 2021] GET /compute/v2.1/servers/4701ffa8-7657-48b3-94c6-ad6336c8dfd6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:52.870289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.870942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.872476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.874284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.877503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.877988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.878801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.879310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.880183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.880811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.906723 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] HTTP exception thrown: Instance 45f0a001-36db-4334-9faa-a374e3a51158 could not be found. Dec 25 21:14:52.907984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Returning 404 to user: Instance 45f0a001-36db-4334-9faa-a374e3a51158 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:52.921780 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfd31908-e0d2-4180-9800-053cf3e382ff tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "DELETE /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 404 len: 111 microversion: 2.1 time: 0.056084 Dec 25 21:14:52.930439 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1087/2258] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:52 2021] DELETE /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:52.936301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:52.936947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] [instance: 45f0a001-36db-4334-9faa-a374e3a51158] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:52.961909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.962569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:52.963660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:52.964984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.012917 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] HTTP exception thrown: Instance 45f0a001-36db-4334-9faa-a374e3a51158 could not be found. Dec 25 21:14:53.016393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] Returning 404 to user: Instance 45f0a001-36db-4334-9faa-a374e3a51158 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:53.017315 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da0d122e-6df8-47be-86ce-3aa392cd1453 tempest-DeleteServersAdminTestJSON-130215457 tempest-DeleteServersAdminTestJSON-130215457-project] 10.222.0.32 "GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158" status: 404 len: 111 microversion: 2.1 time: 0.084929 Dec 25 21:14:53.023531 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1088/2259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:52 2021] GET /compute/v2.1/servers/45f0a001-36db-4334-9faa-a374e3a51158 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:53.030458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:53.031109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:53.043342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.044473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.045049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.045664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.072641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] HTTP exception thrown: Instance 712038b0-21e9-49b2-adbc-494075814a04 could not be found. Dec 25 21:14:53.073270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Returning 404 to user: Instance 712038b0-21e9-49b2-adbc-494075814a04 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:53.078908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43202ebf-ec88-4c3e-b59f-b4aad80c3896 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "DELETE /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 404 len: 111 microversion: 2.1 time: 0.055774 Dec 25 21:14:53.080651 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1089/2260] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:53 2021] DELETE /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:53.093316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:53.097201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: 712038b0-21e9-49b2-adbc-494075814a04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:53.114480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.115204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.116764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.117660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.136368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] HTTP exception thrown: Instance 712038b0-21e9-49b2-adbc-494075814a04 could not be found. Dec 25 21:14:53.137365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Returning 404 to user: Instance 712038b0-21e9-49b2-adbc-494075814a04 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:53.139993 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10717825-65ff-4c50-a045-c6e4c8d69aff tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04" status: 404 len: 111 microversion: 2.1 time: 0.054164 Dec 25 21:14:53.141077 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1090/2261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:53 2021] GET /compute/v2.1/servers/712038b0-21e9-49b2-adbc-494075814a04 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:53.147860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:53.148832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:53.174240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.177128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.179790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.180390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.269160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:53.284591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2db9a3fc-14e5-49c4-aca1-592ac63c8766 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1473 microversion: 2.1 time: 0.438427 Dec 25 21:14:53.289917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1172/2262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:52 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:53.303372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:53.306493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:53.313452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.313988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.314881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.315578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.334386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] HTTP exception thrown: Instance e2caaec2-9663-4bdf-95c5-104c863c14e8 could not be found. Dec 25 21:14:53.335092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Returning 404 to user: Instance e2caaec2-9663-4bdf-95c5-104c863c14e8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:53.336604 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a96731ad-2844-47d3-b836-b8cf183b1825 tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 404 len: 111 microversion: 2.1 time: 0.044375 Dec 25 21:14:53.341028 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1173/2263] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:14:53 2021] DELETE /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:53.354382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:53.356262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] [instance: e2caaec2-9663-4bdf-95c5-104c863c14e8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:53.369962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.370596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.371494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.371944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.389695 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] HTTP exception thrown: Instance e2caaec2-9663-4bdf-95c5-104c863c14e8 could not be found. Dec 25 21:14:53.390774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] Returning 404 to user: Instance e2caaec2-9663-4bdf-95c5-104c863c14e8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:53.392714 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-14acfe9e-63f3-4991-b0f9-450d47d33edf tempest-ServersTestMultiNic-496372452 tempest-ServersTestMultiNic-496372452-project] 10.222.0.32 "GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8" status: 404 len: 111 microversion: 2.1 time: 0.050438 Dec 25 21:14:53.394536 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1174/2264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:53 2021] GET /compute/v2.1/servers/e2caaec2-9663-4bdf-95c5-104c863c14e8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:53.422991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:53.428077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:53.447050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.447050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:53.447050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:53.447050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:54.637432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:54.644951 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcbbe2f6-55ab-4df6-9b3a-593131d00dbf tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1508 microversion: 2.1 time: 1.502453 Dec 25 21:14:54.646092 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1091/2265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:53 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1508 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:54.651516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:54.652790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:54.659503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:54.660268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:54.661399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:54.662066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:54.723225 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7fb24581-9ff4-4d7a-8dae-61528b7f7e0f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.075449 Dec 25 21:14:54.724743 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1092/2266] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:54 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:54.732211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:54.734001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:54.744043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:54.745124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:54.746138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:54.748048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:54.763838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:54.778083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7bdd554-cc50-47e2-8f5c-7c0e7d738187 tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1479 microversion: 2.1 time: 1.364985 Dec 25 21:14:54.800465 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1175/2267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:53 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1479 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:54.801163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:54.803203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0512a6db-7289-46db-9e81-d9e84a874fc7 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.074227 Dec 25 21:14:54.803910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1093/2268] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:54 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:54.809413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:54.829102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:54.830307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:54.831664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:54.832353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.123083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:55.131732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8e8abe82-b088-49a0-8b6a-3bb0202f99f8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1470 microversion: 2.1 time: 0.336761 Dec 25 21:14:55.133522 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1176/2269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:54 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1470 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:55.151235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:55.155342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:55.161891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.165321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.169225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.169866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.390316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4041d3be-826e-40d4-a8b8-a6adb7c4fa88 req-0e448d8b-9f20-495a-855c-790a7a653ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1488edc8-a4a9-47c4-bc28-867a3c7538ba", "name": "network-vif-deleted", "tag": "17909193-855a-40f6-a3dd-9f23db819ef3"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:55.391873 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:55.391873 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:55.406835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4041d3be-826e-40d4-a8b8-a6adb7c4fa88 req-0e448d8b-9f20-495a-855c-790a7a653ed3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.407293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4041d3be-826e-40d4-a8b8-a6adb7c4fa88 req-0e448d8b-9f20-495a-855c-790a7a653ed3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.430350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4041d3be-826e-40d4-a8b8-a6adb7c4fa88 req-0e448d8b-9f20-495a-855c-790a7a653ed3 service nova] Creating event network-vif-deleted:17909193-855a-40f6-a3dd-9f23db819ef3 for instance 1488edc8-a4a9-47c4-bc28-867a3c7538ba on nch1-master-1 Dec 25 21:14:55.470483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4041d3be-826e-40d4-a8b8-a6adb7c4fa88 req-0e448d8b-9f20-495a-855c-790a7a653ed3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083858 Dec 25 21:14:55.480770 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1177/2270] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:55.495214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2d8768e7-9241-48f3-aeab-4442cb40033e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65/action" status: 204 len: 0 microversion: 2.1 time: 0.336453 Dec 25 21:14:55.501426 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1094/2271] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:55 2021] POST /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65/action => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:14:55.506942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:55.507804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:55.515421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.516022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.516989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.517540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.736789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:55.738927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:55.757890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.758356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.760541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.761019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.838605 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54355e5f-59ad-4c9f-b719-94569f0a79e0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.106368 Dec 25 21:14:55.842209 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1095/2272] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:55 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:55.851535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:55.859736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:55.860588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.861089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.861915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.862364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.917184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:55.917865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:55.918504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lazy-loading 'fault' on Instance uuid 1488edc8-a4a9-47c4-bc28-867a3c7538ba {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:14:56.020028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e79788d5030a44b9b522c73791f77233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c455cc0f858a452bb0b60cf0af0c453c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:56.030957 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd57a8a2-a0ef-452c-8dd2-5013e64b75fd tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 200 len: 1313 microversion: 2.1 time: 0.187099 Dec 25 21:14:56.032417 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1096/2273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:55 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:56.039036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:56.040193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:56.050687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:56.051727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:56.053791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:56.059076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:56.059076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:56.067442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-afc45d21-f580-4e5a-9fbb-1cee30b5bca5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1470 microversion: 2.1 time: 0.564035 Dec 25 21:14:56.069387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1178/2274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:55 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1470 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:56.128042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cd0dde4-70d8-40cf-8343-698d4ea82c57 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.093349 Dec 25 21:14:56.131335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1097/2275] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:56 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:56.852785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:56.867460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:56.881279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:56.896403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:56.897692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:56.901367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:56.989563 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30954621-8625-4671-ac92-94f18159de50 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.141443 Dec 25 21:14:56.990850 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1179/2276] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:56 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:57.049525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:57.050242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] [instance: 1488edc8-a4a9-47c4-bc28-867a3c7538ba] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:57.070772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.073648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.074581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.075173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.086928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:57.088223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:57.096729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.097408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.098391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.098826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.107113 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] HTTP exception thrown: Instance 1488edc8-a4a9-47c4-bc28-867a3c7538ba could not be found. Dec 25 21:14:57.107838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] Returning 404 to user: Instance 1488edc8-a4a9-47c4-bc28-867a3c7538ba could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:14:57.109147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32166058-b40f-4543-b8a0-4e081e57345c tempest-ServerDiagnosticsNegativeTest-605739865 tempest-ServerDiagnosticsNegativeTest-605739865-project] 10.222.0.32 "GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba" status: 404 len: 111 microversion: 2.1 time: 0.065341 Dec 25 21:14:57.110454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1098/2277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:57 2021] GET /compute/v2.1/servers/1488edc8-a4a9-47c4-bc28-867a3c7538ba => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:14:57.141415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:57.142352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:57.149336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.150055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.151021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.151631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.205874 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ed20345-8be5-4e04-ae2c-e027a56db67b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.067815 Dec 25 21:14:57.209209 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1099/2278] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:57 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:14:57.276096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:57.282794 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60a53c18-324d-4d5a-84ef-24dd869cf6fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1470 microversion: 2.1 time: 0.201025 Dec 25 21:14:57.292546 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1180/2279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:57 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1470 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:57.654080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1743094512", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb028617-ca4b-4888-809e-8a74d7f084f8"}], "security_groups": [{"name": "tempest-securitygroup--740761746"}], "key_name": "tempest-keypair-327730817", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:57.844012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] validate_networks() for [('cb028617-ca4b-4888-809e-8a74d7f084f8', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:14:57.879344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8168ed2c-3f3a-433f-bf62-dd30cfb188b4"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:57.880634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:57.895106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.895893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:57.897264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:57.897925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:58.779932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:14:58.780715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:14:58.780835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:14:58.789369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:14:58.789369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:14:58.791372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:58.791834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:58.792671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:58.793150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:58.819008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:14:58.826710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for user d0383b7f61484347ba9875a2636e1057 and project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:14:58.844936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:14:58.847598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:14:58.855697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22905894-baaf-43e2-873c-e96e189e63c8 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "POST /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.980655 Dec 25 21:14:58.859461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1181/2280] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:14:57 2021] POST /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments => generated 194 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:58.868215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:58.870196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:58.882681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:58.907026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:58.908284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:58.910370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.001205 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7732dc83-4a4e-438f-b750-16c78f8bd0eb tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.138861 Dec 25 21:14:59.001858 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1182/2281] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:58 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:59.009145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:59.010368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:59.032074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.035803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.037607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.042538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.055707 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ad31811-bf30-43cc-b638-50de1a2dcae0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.390727 Dec 25 21:14:59.055707 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1100/2282] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:14:57 2021] POST /compute/v2.1/servers => generated 401 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:14:59.066498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:59.067243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:59.108846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.113916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.115837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.116512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.149335 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6fb3bfd5-11f2-40de-936d-4ae9dcac5b65 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 24558 microversion: 2.1 time: 0.142883 Dec 25 21:14:59.157834 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1183/2283] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:14:59 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 24558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:14:59.180197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fadf3379-1dd7-496e-9e32-75738080452d req-3513c5b5-4846-4dcb-9b13-00687eb55fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b248cb56-18c2-4ff2-a8da-8e0993879a65", "name": "network-vif-plugged", "status": "completed", "tag": "5a73a242-a477-40db-9b6d-7ac1d38d6950"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:14:59.185008 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:59.185008 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:14:59.217079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fadf3379-1dd7-496e-9e32-75738080452d req-3513c5b5-4846-4dcb-9b13-00687eb55fa8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.217596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fadf3379-1dd7-496e-9e32-75738080452d req-3513c5b5-4846-4dcb-9b13-00687eb55fa8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.234025 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fadf3379-1dd7-496e-9e32-75738080452d req-3513c5b5-4846-4dcb-9b13-00687eb55fa8 service nova] Creating event network-vif-plugged:5a73a242-a477-40db-9b6d-7ac1d38d6950 for instance b248cb56-18c2-4ff2-a8da-8e0993879a65 on nch2-master-1 Dec 25 21:14:59.242309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fadf3379-1dd7-496e-9e32-75738080452d req-3513c5b5-4846-4dcb-9b13-00687eb55fa8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082522 Dec 25 21:14:59.243605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1184/2284] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:14:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:14:59.252520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad43bac9-5894-4181-ac3e-094e7d66024d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:59.253515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad43bac9-5894-4181-ac3e-094e7d66024d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:59.392709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad43bac9-5894-4181-ac3e-094e7d66024d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:59.411805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad43bac9-5894-4181-ac3e-094e7d66024d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1237 microversion: 2.1 time: 0.165233 Dec 25 21:14:59.423343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1185/2285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:59 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1237 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:59.644534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:14:59.653585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9c9674f-4dbb-4db7-9c6e-0f6cb7f29067 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1462 microversion: 2.1 time: 0.601730 Dec 25 21:14:59.657741 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1101/2286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:59 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1462 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:14:59.673506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:59.674200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:14:59.683210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.683210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.683210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.683210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.892025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-810cea83-f984-40d7-86d4-d60a66d08a10 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1613 microversion: 2.1 time: 0.222156 Dec 25 21:14:59.893542 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1102/2287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:14:59 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1613 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:14:59.920009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef6d149b-4cbf-4164-871a-6f7b530c862c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '.version_select at 0x7fa4fd5f29d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:14:59.928402 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:14:59.928402 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:14:59.934300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef6d149b-4cbf-4164-871a-6f7b530c862c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:14:59.935151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef6d149b-4cbf-4164-871a-6f7b530c862c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:14:59.956047 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef6d149b-4cbf-4164-871a-6f7b530c862c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.039555 Dec 25 21:14:59.958477 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1103/2288] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:14:59 2021] GET /compute/v2.1/os-migrations => generated 409 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.018418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:00.018418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:00.027481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.028251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.029357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.030038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.033443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78d66a25-09a4-4118-8bf8-2c80debeec8d tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f6acd5e0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.034937 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.034937 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:00.037926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78d66a25-09a4-4118-8bf8-2c80debeec8d tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.038592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78d66a25-09a4-4118-8bf8-2c80debeec8d tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.039587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78d66a25-09a4-4118-8bf8-2c80debeec8d tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.041233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78d66a25-09a4-4118-8bf8-2c80debeec8d tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.097876 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a1727fa1-39f1-4bf2-8bd2-995ac6dc3a28 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.088538 Dec 25 21:15:00.104486 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1104/2289] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:00 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:00.113976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78d66a25-09a4-4118-8bf8-2c80debeec8d tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.689398 Dec 25 21:15:00.115279 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1186/2290] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:14:59 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.130473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56c093fe-c666-47ad-b53e-0113432b99c0 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f67d7310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.132080 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.132080 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:00.133928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c093fe-c666-47ad-b53e-0113432b99c0 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.135277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c093fe-c666-47ad-b53e-0113432b99c0 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.136388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c093fe-c666-47ad-b53e-0113432b99c0 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.138781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c093fe-c666-47ad-b53e-0113432b99c0 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.161324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:00.167451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:00.170374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.175328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.176601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.180245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.187070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56c093fe-c666-47ad-b53e-0113432b99c0 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.060602 Dec 25 21:15:00.200119 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1105/2291] 10.222.0.32 () {58 vars in 1138 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.205402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6750dd6c-1adb-4d0a-9812-0e8349e091ac tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f6f85940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.210955 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.210955 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:00.212850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6750dd6c-1adb-4d0a-9812-0e8349e091ac tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.213526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6750dd6c-1adb-4d0a-9812-0e8349e091ac tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.217214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6750dd6c-1adb-4d0a-9812-0e8349e091ac tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.217884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6750dd6c-1adb-4d0a-9812-0e8349e091ac tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.268404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6750dd6c-1adb-4d0a-9812-0e8349e091ac tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.054109 Dec 25 21:15:00.268404 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1106/2292] 10.222.0.32 () {58 vars in 1144 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:00.268404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1904513336", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:00.280438 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02a1f9f1-7aad-436f-b1de-d3d5bee3279b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.122628 Dec 25 21:15:00.281623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1187/2293] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:00 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:00.295420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e734be7-b5c9-4090-a6b8-44500497f064 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f698e310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.297405 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.297405 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:00.318229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e734be7-b5c9-4090-a6b8-44500497f064 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.324430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e734be7-b5c9-4090-a6b8-44500497f064 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.324430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e734be7-b5c9-4090-a6b8-44500497f064 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.324430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e734be7-b5c9-4090-a6b8-44500497f064 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.353938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:00.479575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e734be7-b5c9-4090-a6b8-44500497f064 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.196450 Dec 25 21:15:00.480473 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1188/2294] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.498227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-862f8746-9401-46a9-ba13-055e272ff02c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.499219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-862f8746-9401-46a9-ba13-055e272ff02c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:00.653291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-862f8746-9401-46a9-ba13-055e272ff02c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:00.663337 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-862f8746-9401-46a9-ba13-055e272ff02c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1237 microversion: 2.1 time: 0.172100 Dec 25 21:15:00.664473 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1189/2295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1237 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:00.692255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3f8e6e4a-6ac4-481e-a826-95766dc1743b tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f6ac68b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.693905 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.693905 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:00.695464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f8e6e4a-6ac4-481e-a826-95766dc1743b tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.695925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f8e6e4a-6ac4-481e-a826-95766dc1743b tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.696934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f8e6e4a-6ac4-481e-a826-95766dc1743b tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.697377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f8e6e4a-6ac4-481e-a826-95766dc1743b tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.725471 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3f8e6e4a-6ac4-481e-a826-95766dc1743b tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.043328 Dec 25 21:15:00.726040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1190/2296] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.742363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:00.742363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:00.742363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:00.742363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:00.742792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea4302fe-aafe-432f-abbd-4cc11e233332 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f6acd040>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.742907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:00.743009 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.743009 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:00.743009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea4302fe-aafe-432f-abbd-4cc11e233332 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.743009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea4302fe-aafe-432f-abbd-4cc11e233332 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.743009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea4302fe-aafe-432f-abbd-4cc11e233332 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.743009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea4302fe-aafe-432f-abbd-4cc11e233332 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.748126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.748755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.749616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.750058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.766870 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea4302fe-aafe-432f-abbd-4cc11e233332 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.032543 Dec 25 21:15:00.767960 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1191/2297] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts => generated 379 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.780724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ce6baca-9d61-47c8-b9b6-5d03a46e0729 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f6ac60d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.781677 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.781677 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:00.788374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:00.788562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ce6baca-9d61-47c8-b9b6-5d03a46e0729 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.788841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ce6baca-9d61-47c8-b9b6-5d03a46e0729 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.800818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for user f9e59d219fa640e48533e0efdf150b16 and project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:00.802562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ce6baca-9d61-47c8-b9b6-5d03a46e0729 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.803021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ce6baca-9d61-47c8-b9b6-5d03a46e0729 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.814730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:00.817431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:00.818042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ce6baca-9d61-47c8-b9b6-5d03a46e0729 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 467 microversion: 2.1 time: 0.040938 Dec 25 21:15:00.818620 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1192/2298] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 467 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.827629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4a96233-d130-4aa3-a68d-96bc47a9ac07 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Calling method '.version_select at 0x7fa4f6ac64c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.828642 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:00.828642 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:00.835651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4a96233-d130-4aa3-a68d-96bc47a9ac07 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.838078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4a96233-d130-4aa3-a68d-96bc47a9ac07 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.852511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4a96233-d130-4aa3-a68d-96bc47a9ac07 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:00.853684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4a96233-d130-4aa3-a68d-96bc47a9ac07 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:00.873957 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4a96233-d130-4aa3-a68d-96bc47a9ac07 tempest-HostsAdminTestJSON-548938087 tempest-HostsAdminTestJSON-548938087-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 729 microversion: 2.1 time: 0.049931 Dec 25 21:15:00.877834 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1193/2299] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 729 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:00.979794 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-516558f3-07ed-4581-ba1b-b74d1468bb43 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718391 Dec 25 21:15:00.982476 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1107/2300] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:00 2021] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:00.993196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18cf431f-b5c9-4b77-9ef6-a6b6137f8f26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:00.994186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18cf431f-b5c9-4b77-9ef6-a6b6137f8f26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:01.058709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18cf431f-b5c9-4b77-9ef6-a6b6137f8f26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:01.066780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18cf431f-b5c9-4b77-9ef6-a6b6137f8f26 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1213 microversion: 2.1 time: 0.077826 Dec 25 21:15:01.068018 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1194/2301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:00 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:01.110468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:01.111488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:01.119652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:01.120120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:01.120997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:01.121448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:01.174343 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e2c24c9-cc71-43ac-9ae2-7efc155fca90 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.067912 Dec 25 21:15:01.175421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1108/2302] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:01 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:01.291662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:01.292589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:01.302158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:01.302875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:01.303770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:01.304220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:01.351863 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aec05d60-b953-435b-9a58-c4e124b359ff tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.063662 Dec 25 21:15:01.352616 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1195/2303] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:01 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:01.686052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:01.686783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:01.694179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:01.694628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:01.695416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:01.695852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:01.767278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:01.782744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f267c21-b750-43cc-ac5e-9a69fbac9443 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1289 microversion: 2.1 time: 0.100979 Dec 25 21:15:01.784227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1109/2304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:01 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:02.085260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:02.085967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:02.097143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.097143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.097636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.097881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.174618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:02.185894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1dddec79-c7e1-4288-87c6-bf95c7a7a1d8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1217 microversion: 2.1 time: 0.104635 Dec 25 21:15:02.187059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:02.198651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:02.198919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1196/2305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:02 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:02.201376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.202116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.202925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.203531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.303669 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a840db5-043f-443c-9110-3fe97affae4b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.120675 Dec 25 21:15:02.308379 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1110/2306] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:02 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:02.364364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:02.365724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:02.373543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.374247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.375132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.375563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.437804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0fc44a95-9420-4c4f-a575-27e46e486f94 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.077565 Dec 25 21:15:02.438552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1197/2307] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:02 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:02.801350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:02.802072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:02.810725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.811183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.811989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:02.812437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:02.903084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:02.913174 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd775569-cee3-4c4c-95a9-74d6e274b6a5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1295 microversion: 2.1 time: 0.115751 Dec 25 21:15:02.913761 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1111/2308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:02 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1295 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:03.209437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:03.210788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:03.229754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.238104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.239870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.240321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.315873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:03.316829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:03.324277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.325073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.325764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.326406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.384820 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c090d8cf-807f-4d08-b4d9-ddda7ad4fa4f tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.071801 Dec 25 21:15:03.386234 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1112/2309] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:03 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:03.398618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:03.407472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9963b662-8559-40d4-86c9-661a70641008 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1265 microversion: 2.1 time: 0.202863 Dec 25 21:15:03.423465 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1198/2310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:03 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:03.455846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:03.455846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:03.464367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.464949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.465817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.466475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.518990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3fcb10ae-ef3f-4810-84f2-6c21893ed552 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.072095 Dec 25 21:15:03.522204 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1113/2311] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:03 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:03.544734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:03.549395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:03.553643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.566553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.569171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.570995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.610609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed48138c-2b60-42de-b2c0-00954e10a20a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069699 Dec 25 21:15:03.617294 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1199/2312] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:15:03 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:03.622700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:03.623278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:03.631713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.631969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.632776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.646614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.755999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lazy-loading 'services' on Instance uuid f7e7dfd9-c959-4465-a460-55aac15feeef {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:15:03.933031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:03.933689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:03.940437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.940923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:03.942082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:03.942529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.006162 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee3f7291-cd00-43f7-9be5-3f299607ec1c tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments/8168ed2c-3f3a-433f-bf62-dd30cfb188b4" status: 202 len: 0 microversion: 2.1 time: 0.387272 Dec 25 21:15:04.028385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1114/2313] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:15:03 2021] DELETE /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments/8168ed2c-3f3a-433f-bf62-dd30cfb188b4 => generated 0 bytes in 411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:15:04.200835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:04.209585 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18143d77-912c-4a94-be74-b3dba579c635 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.282422 Dec 25 21:15:04.210196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1200/2314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:03 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:04.398332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:04.399348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:04.405988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.406787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.408062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.408836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.425635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:04.426776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:04.434165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.435145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.436379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.437218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.490026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae6a0e30-3dc2-464e-8978-7a8cfa4b5e5b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.092162 Dec 25 21:15:04.490026 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1115/2315] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:04 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:04.520825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:04.529726 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4ab9674-7ea4-41fd-a692-a39af040de0f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1271 microversion: 2.1 time: 0.107561 Dec 25 21:15:04.530468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1201/2316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:04 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1271 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:04.543841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:04.545170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:04.557188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.558229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.559589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.560191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.624124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a1a82178-c6d6-48cc-92f9-14851fd0ea05 req-86192886-eb84-4d54-a066-9855b2e17336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c169c539-29b8-4eeb-bb76-6e6eabd11098", "tag": "305a9e22-e716-452b-815d-1b4b804fad15"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:04.626224 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:04.626224 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:04.639375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-961f07fd-3370-49af-b28f-5a4eb56eb3c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.104867 Dec 25 21:15:04.640041 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1116/2317] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:04 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:04.642622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a1a82178-c6d6-48cc-92f9-14851fd0ea05 req-86192886-eb84-4d54-a066-9855b2e17336 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:04.644560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a1a82178-c6d6-48cc-92f9-14851fd0ea05 req-86192886-eb84-4d54-a066-9855b2e17336 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:04.669940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a64acd0-245c-407f-8721-e15374b1d392 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f751f550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:04.672356 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a1a82178-c6d6-48cc-92f9-14851fd0ea05 req-86192886-eb84-4d54-a066-9855b2e17336 service nova] Creating event network-changed:305a9e22-e716-452b-815d-1b4b804fad15 for instance c169c539-29b8-4eeb-bb76-6e6eabd11098 on nch2-master-1 Dec 25 21:15:04.679750 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a1a82178-c6d6-48cc-92f9-14851fd0ea05 req-86192886-eb84-4d54-a066-9855b2e17336 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059870 Dec 25 21:15:04.682417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1202/2318] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:15:04.770228 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a64acd0-245c-407f-8721-e15374b1d392 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/ed367211-dfe7-48a8-8aaa-d5a0c9c4950a" status: 200 len: 661 microversion: 2.1 time: 0.118612 Dec 25 21:15:04.773099 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1117/2319] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:04 2021] GET /compute/v2.1/images/ed367211-dfe7-48a8-8aaa-d5a0c9c4950a => generated 661 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:04.798960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20d99aa7-137c-46ea-8e80-da37ebef0d1d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6997d30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:04.875507 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20d99aa7-137c-46ea-8e80-da37ebef0d1d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/ed367211-dfe7-48a8-8aaa-d5a0c9c4950a" status: 200 len: 661 microversion: 2.1 time: 0.091028 Dec 25 21:15:04.884612 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1203/2320] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:04 2021] GET /compute/v2.1/images/ed367211-dfe7-48a8-8aaa-d5a0c9c4950a => generated 661 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:05.233046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:05.233715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:05.233962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:05.235696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:05.241735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.242404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.242641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.242974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.244300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.244434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.244824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.245258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.290463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a9ffdb8-2283-4843-9082-6450a84d03ff tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062175 Dec 25 21:15:05.294235 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1204/2321] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:15:05 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:05.483460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:05.491238 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b89b1867-3d27-43ab-acd6-21db2e1881c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.263431 Dec 25 21:15:05.491750 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1118/2322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:05 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:05.505434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:05.506358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:05.513843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.514820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.515082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.515727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.554737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:05.555336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:05.561986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9dd0f07b-9aca-4278-9067-86bc1dfcf463 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.060000 Dec 25 21:15:05.563624 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1205/2323] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:05 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:05.570521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.570985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.572462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.573239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.651180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:05.653222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:05.660676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.661500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.662800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:05.663486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:05.733465 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c18f12b-fbf4-43a0-8ea9-6cbaa4d12e74 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.086325 Dec 25 21:15:05.739416 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1206/2324] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:05 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:06.265734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:06.276398 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22bbe3d5-92d1-4af0-aa49-9976eb309075 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.725976 Dec 25 21:15:06.276981 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1119/2325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:05 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:06.302352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:06.307844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:06.328171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.329193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.330139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.330597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.372196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6e55a27-037c-41ca-ba20-d2d6cb026971 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073996 Dec 25 21:15:06.373701 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1207/2326] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:15:06 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:06.464652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:06.466295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:06.475295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.475836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.482804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.482804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.535312 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-150bebea-7288-45a3-af6f-ef183f898af1 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075175 Dec 25 21:15:06.536995 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1208/2327] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:15:06 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:06.542528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:06.551816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:06.551816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.553452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.554773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.555472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.719528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1176493167", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "597fae95-d9e4-466a-853c-7cbb09218bf0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:06.776420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:06.787671 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-757e9444-1f64-4c32-96b7-3f435d72d1a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.249361 Dec 25 21:15:06.788272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1209/2328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:06 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:06.822596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:06.822596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:06.833057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] validate_networks() for [('597fae95-d9e4-466a-853c-7cbb09218bf0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:06.834585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.835247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.836250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.836897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.924268 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6295be63-ecb1-44b5-8d44-fab2a11de8be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.125440 Dec 25 21:15:06.925145 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1210/2329] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:06 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:06.935388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:06.938006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:06.949906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.950868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.951988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:06.952554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:06.994439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:15:07.299284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:07.299742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:07.300220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:07.300636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:07.301075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:07.311619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.312316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.312889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.313352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.329833 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc010354-674f-4c81-b148-ffa687cf87fb tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 204 len: 0 microversion: 2.1 time: 0.402636 Dec 25 21:15:07.331150 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1211/2330] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:15:06 2021] DELETE /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:15:07.333456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Getting quotas for project 27d474dfd37c46f0aa14aa84e8b3ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:07.338862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2c12ca34-34c6-4683-8042-216857c418c4 req-e05c6c57-d843-4f61-8806-b7116cf41105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3308bcb1-0f06-470f-913d-ae09dfc92a3a", "tag": "860d1670-d6af-4fc5-80bd-08f9b6582dac"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:07.338862 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:07.338862 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:07.339345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Getting quotas for user 819fcdf5d86a46399dfb7343639f3ea6 and project 27d474dfd37c46f0aa14aa84e8b3ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:07.346595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2c12ca34-34c6-4683-8042-216857c418c4 req-e05c6c57-d843-4f61-8806-b7116cf41105 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.347270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2c12ca34-34c6-4683-8042-216857c418c4 req-e05c6c57-d843-4f61-8806-b7116cf41105 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.353727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:07.356003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:07.359237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2c12ca34-34c6-4683-8042-216857c418c4 req-e05c6c57-d843-4f61-8806-b7116cf41105 service nova] Creating event network-changed:860d1670-d6af-4fc5-80bd-08f9b6582dac for instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a on nch2-master-1 Dec 25 21:15:07.364086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2c12ca34-34c6-4683-8042-216857c418c4 req-e05c6c57-d843-4f61-8806-b7116cf41105 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031381 Dec 25 21:15:07.364686 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1212/2331] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:07.370235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:07.371228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:07.377410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.377868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.378723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.379107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.420450 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e87f9ad-722e-495d-a0fd-0829b9ca6260 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.054331 Dec 25 21:15:07.423210 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1213/2332] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:07 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:07.486469 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-012d00db-3bd8-4a65-828a-b0f7e101b08e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028069 Dec 25 21:15:07.487615 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1120/2333] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:07.492505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.493463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:07.500302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.501130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.502202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.502918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.546821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6eba73bd-a523-4978-a992-1e8e49b95904 tempest-InstanceUsageAuditLogTestJSON-145631524 tempest-InstanceUsageAuditLogTestJSON-145631524-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.548532 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:07.548532 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:07.579818 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6eba73bd-a523-4978-a992-1e8e49b95904 tempest-InstanceUsageAuditLogTestJSON-145631524 tempest-InstanceUsageAuditLogTestJSON-145631524-project-admin] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log/2021-12-25 21:15:07" status: 200 len: 318 microversion: 2.1 time: 0.157147 Dec 25 21:15:07.580410 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1214/2334] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/os-instance_usage_audit_log/2021-12-25%2021%3A15%3A07 => generated 318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:07.586242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.586242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:07.594439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.594797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.595976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.597945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.708503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:07.716639 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6807dabc-03ff-4598-a1ec-360daf8fcd93 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.227813 Dec 25 21:15:07.717642 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1121/2335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:07.728688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56f5018a-3c5b-4fa4-b44f-8b72bffadf2a tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f736e8b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.773742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:07.783488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56f5018a-3c5b-4fa4-b44f-8b72bffadf2a tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/24aa7da8-9951-471e-b24b-4ad0c98d4021" status: 200 len: 662 microversion: 2.1 time: 0.057822 Dec 25 21:15:07.783488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1122/2336] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/images/24aa7da8-9951-471e-b24b-4ad0c98d4021 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:07.783488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a990ba40-9dfe-4547-8df3-0df8ace1fa66 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.783488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a990ba40-9dfe-4547-8df3-0df8ace1fa66 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:07.791172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4629715-3f41-4256-a935-c00db500ec55 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1514 microversion: 2.1 time: 0.208406 Dec 25 21:15:07.792084 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1215/2337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:07.796806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e408e16-d4cb-4157-9e8c-76bbbe33aaa4 tempest-InstanceUsageAuditLogTestJSON-145631524 tempest-InstanceUsageAuditLogTestJSON-145631524-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.799269 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:07.799269 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:07.811503 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e408e16-d4cb-4157-9e8c-76bbbe33aaa4 tempest-InstanceUsageAuditLogTestJSON-145631524 tempest-InstanceUsageAuditLogTestJSON-145631524-project-admin] 10.222.0.32 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.018156 Dec 25 21:15:07.812078 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1216/2338] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:07.818152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b287a7a4-fba0-4885-b5db-44e43853dee7 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6d8b670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.842036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a990ba40-9dfe-4547-8df3-0df8ace1fa66 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:07.849912 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a990ba40-9dfe-4547-8df3-0df8ace1fa66 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1218 microversion: 2.1 time: 0.071678 Dec 25 21:15:07.850497 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1123/2339] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:07.855523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:07.856321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:07.863788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.864784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.866781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.867443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.885927 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b287a7a4-fba0-4885-b5db-44e43853dee7 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/24aa7da8-9951-471e-b24b-4ad0c98d4021" status: 200 len: 662 microversion: 2.1 time: 0.072749 Dec 25 21:15:07.886542 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1217/2340] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/images/24aa7da8-9951-471e-b24b-4ad0c98d4021 => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:07.938504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:07.938504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:07.947407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.947974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.949177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:07.949755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:07.996534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b582a92-6f91-4437-96db-067018bbd89a tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.064395 Dec 25 21:15:08.007026 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1218/2341] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:07 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:08.058624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:08.067335 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ec9cd19-e8b4-4169-acc3-b3408968f57c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.215542 Dec 25 21:15:08.068024 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1124/2342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:07 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:08.437662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:08.438664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:08.445770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.446867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.459134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.459134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.492052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bcd2c0ec-3faa-4f03-b346-7c83e6819de6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.058572 Dec 25 21:15:08.492836 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1219/2343] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:08 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:08.733903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:08.734524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:08.746427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.749532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.749532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.749532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.809388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:08.810092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:08.818319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.821439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.821439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.821439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.970166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:08.976829 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc2d72ee-e457-4a62-8a0c-52b71889d1a1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.246722 Dec 25 21:15:08.978261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1125/2344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:08 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:08.982418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:08.983036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:08.989068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.989522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:08.995903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:08.995903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.100442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:09.115319 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b49929f2-2f38-452e-954e-54d9ca895b1b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1222 microversion: 2.1 time: 0.136042 Dec 25 21:15:09.121997 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1126/2345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:08 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1222 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:09.128928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:09.131193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:09.132294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:09.139716 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e5c3be4-de71-458a-a8b4-c2f5fd73b26a tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1514 microversion: 2.1 time: 0.334490 Dec 25 21:15:09.139969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.140635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.141919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.142568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.144331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1220/2346] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:08 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1514 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:09.156981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:09.162843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:09.166670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.167136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.167941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.168379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.195989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12af4dac-ff84-4f72-988f-acdd9f6d5b20 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.076670 Dec 25 21:15:09.202278 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1127/2347] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:09 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:09.440377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:09.448462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41288935-3c05-40ac-9014-3963e7e0ad79 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.302865 Dec 25 21:15:09.449059 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1221/2348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:09 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:09.505536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:09.506987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:09.516345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.516800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.517707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.518182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.562291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf8c018f-6414-4eca-a741-6810eee2b78e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.061456 Dec 25 21:15:09.563242 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1128/2349] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:09 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:09.712417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-397f6123-172f-480f-a116-460fccbba490 req-7c5c6927-6e5a-454d-9427-5e94812e707a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e7dfd9-c959-4465-a460-55aac15feeef", "name": "network-vif-deleted", "tag": "b231c087-49e0-4d5a-a3ce-2791da36b76a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:09.714178 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:09.714178 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:09.721766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-397f6123-172f-480f-a116-460fccbba490 req-7c5c6927-6e5a-454d-9427-5e94812e707a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:09.722277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-397f6123-172f-480f-a116-460fccbba490 req-7c5c6927-6e5a-454d-9427-5e94812e707a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:09.749886 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-397f6123-172f-480f-a116-460fccbba490 req-7c5c6927-6e5a-454d-9427-5e94812e707a service nova] Creating event network-vif-deleted:b231c087-49e0-4d5a-a3ce-2791da36b76a for instance f7e7dfd9-c959-4465-a460-55aac15feeef on nch1-master-1 Dec 25 21:15:09.764911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-397f6123-172f-480f-a116-460fccbba490 req-7c5c6927-6e5a-454d-9427-5e94812e707a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056592 Dec 25 21:15:09.766165 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1222/2350] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:09.831492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2660138b-baa1-4c5a-baba-70c370a28d61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500761040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:09.906134 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2660138b-baa1-4c5a-baba-70c370a28d61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0525820e-a39b-4f66-934c-af6debca1539" status: 200 len: 662 microversion: 2.1 time: 0.081808 Dec 25 21:15:09.907170 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1129/2351] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:09 2021] GET /compute/v2.1/images/0525820e-a39b-4f66-934c-af6debca1539 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:09.921043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-263fed5e-d681-4a91-8744-1f2ba8b197be tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6fdb040>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:09.971690 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-263fed5e-d681-4a91-8744-1f2ba8b197be tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0525820e-a39b-4f66-934c-af6debca1539" status: 200 len: 662 microversion: 2.1 time: 0.056717 Dec 25 21:15:09.972522 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1223/2352] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:09 2021] GET /compute/v2.1/images/0525820e-a39b-4f66-934c-af6debca1539 => generated 662 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:09.994276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:09.995377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:10.002174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.002741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.005604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.005604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.103280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1183518956", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:10.161220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:10.229770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:10.239033 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3fc36224-1cbd-48d8-b486-d00986fd9428 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.249533 Dec 25 21:15:10.240088 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1130/2353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:09 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:10.246246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:10.247056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:10.254906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.255913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.256910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.257597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.370958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:10.380056 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9c26d39-6b7b-4eab-9f27-6247c6657f0a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1276 microversion: 2.1 time: 0.138425 Dec 25 21:15:10.380700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1131/2354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:10 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1276 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:10.393825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:10.395763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:10.402536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.403210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.404324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.404768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.442415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.442872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.443332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lazy-loading 'fault' on Instance uuid f7e7dfd9-c959-4465-a460-55aac15feeef {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:15:10.509541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e3cb179749ef4bc786cc3059f72734f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cc391e03de44dbb245531288da2872', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:10.518281 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d25e90f5-c282-4ced-99b1-a2047008d432 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 200 len: 1308 microversion: 2.1 time: 0.136065 Dec 25 21:15:10.520929 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1132/2355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:10 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 1308 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:10.523437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:10.524994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:10.531919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.532377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.533212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.533648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.563756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:10.565252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:10.565745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:10.566150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:10.566747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:10.579614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.580060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.582038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.582639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.589381 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36daaa31-dc51-4ced-900e-150b209a9006 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.068737 Dec 25 21:15:10.590446 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1133/2356] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:10 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:10.602089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:10.603560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:10.616979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.617515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.618376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.620103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.653686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Getting quotas for project 919a00bb2d294ab291df4bbd212ae7fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:10.663893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Getting quotas for user 4039c9a053164b1685c6535b79a763a4 and project 919a00bb2d294ab291df4bbd212ae7fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:10.691391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:10.696193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:10.835397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:10.843284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e67bf5e3-3a02-4c23-bd82-07579240c86a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.250279 Dec 25 21:15:10.843846 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1134/2357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:10 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:10.848077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:10.848991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:10.854467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.854921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.855696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:10.856128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:10.895355 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d72db8ba-27dc-449f-b787-46f9fb4a257a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.050308 Dec 25 21:15:10.896263 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1135/2358] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:10 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:10.987496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-482cf2d9-9c4b-4927-8acb-ffe848c5f652 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890582 Dec 25 21:15:10.988148 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1224/2359] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:11.109634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-387131851", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:11.177493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:11.256829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:11.258135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:11.269650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.270098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.271080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.271544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.471649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:11.472525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:11.473164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:11.473685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:11.474221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:11.491536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.492150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.494184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.495066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.516535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:11.527957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Getting quotas for project 919a00bb2d294ab291df4bbd212ae7fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:11.528863 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f0c28c29-aca6-485d-a1ad-7b4825a4f578 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.275108 Dec 25 21:15:11.528863 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1225/2360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:11 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:11.538746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Getting quotas for user 4039c9a053164b1685c6535b79a763a4 and project 919a00bb2d294ab291df4bbd212ae7fe. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:11.541518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:11.545185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:11.560206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.560665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.561796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:11.566362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:11.568241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.568734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.850763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:11.858018 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-756f7f94-b794-4bb6-b3e3-9867a991763c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.752230 Dec 25 21:15:11.863473 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1136/2361] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:11.863607 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c51b6442-cc30-44d5-807c-415ec3ebeeef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1318 microversion: 2.1 time: 0.329731 Dec 25 21:15:11.864645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:11.865467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:11.870609 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1226/2362] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:11 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1318 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:11.875661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:11.875853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.876145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.876981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.877426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.877618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:11.885533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.886225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.887215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.887917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.905369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] HTTP exception thrown: Instance f7e7dfd9-c959-4465-a460-55aac15feeef could not be found. Dec 25 21:15:11.905973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Returning 404 to user: Instance f7e7dfd9-c959-4465-a460-55aac15feeef could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:11.907219 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9bb0b1e0-b5a9-4ea7-8ecf-13d48625c1a6 tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 404 len: 111 microversion: 2.1 time: 0.046860 Dec 25 21:15:11.907944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1137/2363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:11 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:11.914292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:11.920660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:11.934994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.935575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:11.936456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:11.937150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.008592 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-200fc611-e87d-4378-a7c0-fc8442dccebe tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.134553 Dec 25 21:15:12.011696 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1227/2364] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:11 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:12.022077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-945d502c-cd3e-4753-bf14-6350e26c3609 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:12.023930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-945d502c-cd3e-4753-bf14-6350e26c3609 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:12.119655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-945d502c-cd3e-4753-bf14-6350e26c3609 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:12.128833 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-945d502c-cd3e-4753-bf14-6350e26c3609 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1217 microversion: 2.1 time: 0.115797 Dec 25 21:15:12.129935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1228/2365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:12 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1217 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:12.157564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:12.157564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:12.161867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.162533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.163521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.164292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.189320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:12.198019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ba0c8ff-18f5-41e6-9ca4-80ef98c9460b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.288532 Dec 25 21:15:12.198907 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1138/2366] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:11 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:12.236164 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-93f44ade-cfe6-448c-b9d8-68a98f258df1 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.087463 Dec 25 21:15:12.238524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1229/2367] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:12 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:12.552308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:12.562162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:12.576818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6f30ce82-0d86-462c-888b-52e77e5ad944 req-d120dc54-d4fe-4cbe-a0cb-6010fdc5fe3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3308bcb1-0f06-470f-913d-ae09dfc92a3a", "name": "network-vif-plugged", "status": "completed", "tag": "860d1670-d6af-4fc5-80bd-08f9b6582dac"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:12.578596 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:12.578596 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:12.585452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.585914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.588038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.588038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.603588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6f30ce82-0d86-462c-888b-52e77e5ad944 req-d120dc54-d4fe-4cbe-a0cb-6010fdc5fe3e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.603775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6f30ce82-0d86-462c-888b-52e77e5ad944 req-d120dc54-d4fe-4cbe-a0cb-6010fdc5fe3e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.617124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6f30ce82-0d86-462c-888b-52e77e5ad944 req-d120dc54-d4fe-4cbe-a0cb-6010fdc5fe3e service nova] Creating event network-vif-plugged:860d1670-d6af-4fc5-80bd-08f9b6582dac for instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a on nch2-master-1 Dec 25 21:15:12.622490 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6f30ce82-0d86-462c-888b-52e77e5ad944 req-d120dc54-d4fe-4cbe-a0cb-6010fdc5fe3e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051827 Dec 25 21:15:12.623316 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1230/2368] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:15:12.784918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:12.794157 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f174ce94-fe4e-4c92-b1c6-4f3852694414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.251274 Dec 25 21:15:12.795344 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1139/2369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:12 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:12.879545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:12.880343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:12.887608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.888476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.889563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.890239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.910505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-84b43270-fee4-4bc0-91c7-86a50659f3d4 req-2a3e222b-2119-4537-ba6b-fa213cb4608c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfb31ab-a5a4-4386-b5bd-77f172344909", "tag": "4353b31a-16ab-4050-acd0-9548832705a6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:12.912708 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:12.912708 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:12.927491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-84b43270-fee4-4bc0-91c7-86a50659f3d4 req-2a3e222b-2119-4537-ba6b-fa213cb4608c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:12.929538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-84b43270-fee4-4bc0-91c7-86a50659f3d4 req-2a3e222b-2119-4537-ba6b-fa213cb4608c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:12.956844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-84b43270-fee4-4bc0-91c7-86a50659f3d4 req-2a3e222b-2119-4537-ba6b-fa213cb4608c service nova] Creating event network-changed:4353b31a-16ab-4050-acd0-9548832705a6 for instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 on nch1-master-1 Dec 25 21:15:12.972642 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-84b43270-fee4-4bc0-91c7-86a50659f3d4 req-2a3e222b-2119-4537-ba6b-fa213cb4608c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066071 Dec 25 21:15:12.978276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1140/2370] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:13.026266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:13.028476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:13.038100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.038986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.041061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.041671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.096089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f94b8991-55ad-41e1-8226-3b47af8bf746 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.074628 Dec 25 21:15:13.098406 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1141/2371] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:13 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:13.149937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:13.161382 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-624af825-6fce-42e6-908c-30efa1557ca4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1318 microversion: 2.1 time: 0.284618 Dec 25 21:15:13.167180 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1231/2372] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:12 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:13.172037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5dcc5f24-3050-4dca-8eac-a78330fb70dc tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:13.174403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5dcc5f24-3050-4dca-8eac-a78330fb70dc tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:13.252188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5dcc5f24-3050-4dca-8eac-a78330fb70dc tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:13.260028 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5dcc5f24-3050-4dca-8eac-a78330fb70dc tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1217 microversion: 2.1 time: 0.091499 Dec 25 21:15:13.260758 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1232/2373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:13 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:13.268055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:13.268915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:13.276298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.276761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.277589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.278204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.306123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8323b7d3-a48e-4596-9737-194807834dfd tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Action: 'create', calling method: .version_select at 0x7fa4f752b790>, body: {"keypair": {"name": "tempest-keypair-1650770837", "type": "ssh", "user_id": "6fa19d2beb384f71ab5a173bfde53711"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:13.323258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8323b7d3-a48e-4596-9737-194807834dfd tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:13.328214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8323b7d3-a48e-4596-9737-194807834dfd tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for user f52cdb9dd7624418be5ab8bdb7763709 and project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:13.503781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:13.511938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5882be9-e948-4f47-a511-b95fd92da43c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.249956 Dec 25 21:15:13.512600 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1233/2374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:13 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:13.517126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:13.518471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:13.525141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.525594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.526390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.526831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.587228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4dc74ae8-a15e-452d-9f0e-bee9db6686c9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.073325 Dec 25 21:15:13.588263 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1234/2375] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:13 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:13.812127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:13.813316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:13.820076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.820536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.822108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:13.822566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:13.936350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8323b7d3-a48e-4596-9737-194807834dfd tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:13.942154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8323b7d3-a48e-4596-9737-194807834dfd tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for user f52cdb9dd7624418be5ab8bdb7763709 and project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:13.958518 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8323b7d3-a48e-4596-9737-194807834dfd tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.832463 Dec 25 21:15:13.959133 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1142/2376] 10.222.0.32 () {62 vars in 1199 bytes} [Sat Dec 25 21:15:13 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 834 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:15:13.973174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41fe041b-2839-415d-9089-483513871b44 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Action: 'create', calling method: .version_select at 0x7fa4f6f850d0>, body: {"keypair": {"name": "tempest-keypair-737681902", "type": "ssh", "user_id": "6fa19d2beb384f71ab5a173bfde53711"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:13.979437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:13.987841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41fe041b-2839-415d-9089-483513871b44 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:13.988039 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9800bb6-6506-481e-9734-0169daf2a0c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1313 microversion: 2.1 time: 0.180177 Dec 25 21:15:14.000900 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1235/2377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:13 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:14.001244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41fe041b-2839-415d-9089-483513871b44 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for user f52cdb9dd7624418be5ab8bdb7763709 and project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:14.108663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:14.109699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:14.116132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.116674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.117490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.118528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.162751 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b44fbd1-1963-422f-962e-3607097b9851 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.058033 Dec 25 21:15:14.163405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1236/2378] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:14 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:14.186110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:14.187000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:14.196423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.197467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.198982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.199778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.220983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41fe041b-2839-415d-9089-483513871b44 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:14.226949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-41fe041b-2839-415d-9089-483513871b44 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for user f52cdb9dd7624418be5ab8bdb7763709 and project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:14.245671 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41fe041b-2839-415d-9089-483513871b44 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.10 time: 0.276192 Dec 25 21:15:14.247511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1143/2379] 10.222.0.32 () {62 vars in 1199 bytes} [Sat Dec 25 21:15:13 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 279 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:15:14.257769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc4eb016-b66e-4e8d-9493-8ec4dce62947 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Calling method '.version_select at 0x7fa4f72feca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:14.266851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc4eb016-b66e-4e8d-9493-8ec4dce62947 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-1650770837?user_id=6fa19d2beb384f71ab5a173bfde53711" status: 200 len: 707 microversion: 2.10 time: 0.013373 Dec 25 21:15:14.267787 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1144/2380] 10.222.0.32 () {60 vars in 1339 bytes} [Sat Dec 25 21:15:14 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-1650770837?user_id=6fa19d2beb384f71ab5a173bfde53711 => generated 707 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:14.278622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be9439eb-049f-4b4d-9aba-09acf80863cb tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Action: 'create', calling method: .version_select at 0x7fa4f72f9790>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1031937926", "type": "ssh"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:14.294992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-be9439eb-049f-4b4d-9aba-09acf80863cb tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:14.300537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-be9439eb-049f-4b4d-9aba-09acf80863cb tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for user f52cdb9dd7624418be5ab8bdb7763709 and project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:14.378656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:14.390433 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9222fad4-3c71-4592-b3e9-be8e07711d22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1318 microversion: 2.1 time: 0.210780 Dec 25 21:15:14.400974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1237/2381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:14 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:14.412201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:14.415744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:14.422947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.423655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.424649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.425123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.485241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:14.493587 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9c2ec625-7bb1-491a-8c70-47a92ae1640e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1213 microversion: 2.1 time: 0.091320 Dec 25 21:15:14.496985 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1238/2382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:14 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:14.528588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:14.529241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:14.535171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.535626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.536413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.536855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.678990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:14.686725 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b234d68-f1ba-43db-ae99-b3694602ca21 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.162371 Dec 25 21:15:14.687392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1239/2383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:14 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:14.691821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:14.692770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:14.699576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.700025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.703193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.703193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.743425 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e44c2605-c336-4e3e-91d6-af8128d53850 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.054747 Dec 25 21:15:14.744160 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1240/2384] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:14 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:14.749369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b16b7ad7-4933-4622-88d4-0c761d1bbbd0 req-15daafb4-ce73-4f13-ac4d-b282e0b7ce06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c169c539-29b8-4eeb-bb76-6e6eabd11098", "name": "network-vif-plugged", "status": "completed", "tag": "305a9e22-e716-452b-815d-1b4b804fad15"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:14.750868 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:14.750868 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:14.760795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b16b7ad7-4933-4622-88d4-0c761d1bbbd0 req-15daafb4-ce73-4f13-ac4d-b282e0b7ce06 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:14.764020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b16b7ad7-4933-4622-88d4-0c761d1bbbd0 req-15daafb4-ce73-4f13-ac4d-b282e0b7ce06 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:14.780091 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b16b7ad7-4933-4622-88d4-0c761d1bbbd0 req-15daafb4-ce73-4f13-ac4d-b282e0b7ce06 service nova] Creating event network-vif-plugged:305a9e22-e716-452b-815d-1b4b804fad15 for instance c169c539-29b8-4eeb-bb76-6e6eabd11098 on nch2-master-1 Dec 25 21:15:14.785110 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b16b7ad7-4933-4622-88d4-0c761d1bbbd0 req-15daafb4-ce73-4f13-ac4d-b282e0b7ce06 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039651 Dec 25 21:15:14.786267 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1241/2385] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:14.867080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-be9439eb-049f-4b4d-9aba-09acf80863cb tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:14.872535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-be9439eb-049f-4b4d-9aba-09acf80863cb tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Getting quotas for user f52cdb9dd7624418be5ab8bdb7763709 and project 4478cf0defd5427ea8ac8a0d994a2726. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:14.890956 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be9439eb-049f-4b4d-9aba-09acf80863cb tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2337 microversion: 2.10 time: 0.616783 Dec 25 21:15:14.891572 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1145/2386] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:15:14 2021] POST /compute/v2.1/os-keypairs => generated 2337 bytes in 618 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:15:14.902294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26b222e8-b89a-4e51-a907-f0674b2d7768 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Calling method '.version_select at 0x7fa4f6b29310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:14.905500 ncdv-master-1 devstack@n-api.service[136548]: WARNING oslo_db.sqlalchemy.utils [None req-26b222e8-b89a-4e51-a907-f0674b2d7768 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Dec 25 21:15:14.911340 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26b222e8-b89a-4e51-a907-f0674b2d7768 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "GET /compute/v2.1/os-keypairs?user_id=6fa19d2beb384f71ab5a173bfde53711" status: 200 len: 1113 microversion: 2.10 time: 0.013794 Dec 25 21:15:14.912007 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1242/2387] 10.222.0.32 () {60 vars in 1258 bytes} [Sat Dec 25 21:15:14 2021] GET /compute/v2.1/os-keypairs?user_id=6fa19d2beb384f71ab5a173bfde53711 => generated 1113 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:15:14.922596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52d83f83-948f-4d38-ac92-0c8427ae6536 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Calling method '.version_select at 0x7fa4f6e53d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.011621 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52d83f83-948f-4d38-ac92-0c8427ae6536 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1031937926" status: 204 len: 0 microversion: 2.10 time: 0.093460 Dec 25 21:15:15.012570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.017470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.021301 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1146/2388] 10.222.0.32 () {60 vars in 1324 bytes} [Sat Dec 25 21:15:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1031937926 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:15:15.030738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.031237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.032041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.032482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.033025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0464cc08-3b35-4487-817e-13aed4bd4fe4 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Calling method '.version_select at 0x7fa4f6870790>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.200565 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0464cc08-3b35-4487-817e-13aed4bd4fe4 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-737681902?user_id=6fa19d2beb384f71ab5a173bfde53711" status: 204 len: 0 microversion: 2.10 time: 0.176532 Dec 25 21:15:15.201421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1147/2389] 10.222.0.32 () {60 vars in 1339 bytes} [Sat Dec 25 21:15:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-737681902?user_id=6fa19d2beb384f71ab5a173bfde53711 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:15:15.207946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:15.209171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.214466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:15.218738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.219363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.220982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.222163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.229626 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90cb19a0-0fbf-4bc5-b83a-795d902fded4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1463 microversion: 2.1 time: 0.222317 Dec 25 21:15:15.231466 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1243/2390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:15 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:15.237313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8552570-36a0-4d57-bea1-2652a4e8e8b4 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] Calling method '.version_select at 0x7fa4f6fdb310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.294508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3deb23e4-45b1-4036-b2c4-2631d52323e8 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.091549 Dec 25 21:15:15.295170 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1148/2391] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:15 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:15.300452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:15.301528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.309349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.311198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.311198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.311533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.331863 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8552570-36a0-4d57-bea1-2652a4e8e8b4 tempest-KeyPairsV210TestJSON-137665429 tempest-KeyPairsV210TestJSON-137665429-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650770837?user_id=6fa19d2beb384f71ab5a173bfde53711" status: 204 len: 0 microversion: 2.10 time: 0.098956 Dec 25 21:15:15.337354 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1244/2392] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:15:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650770837?user_id=6fa19d2beb384f71ab5a173bfde53711 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:15:15.411508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.412547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.422824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.423650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.425052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.425713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.441637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:15.449175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Old instance type m1.heat2, new instance type m1.heat {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:15:15.468089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:15.468758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:15.469467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:15.470618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:15.471239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:15.617493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:15.625739 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d41d3f8c-7e66-442e-94ba-5f2a22158a53 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1318 microversion: 2.1 time: 0.222079 Dec 25 21:15:15.626390 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1245/2393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:15 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:15.632379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.632999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.639311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.639762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.640538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.641003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.737436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:15.761104 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d17aefdf-c445-4b9a-a7e8-7f2af30dbb77 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1269 microversion: 2.1 time: 0.131135 Dec 25 21:15:15.762843 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1246/2394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:15 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1269 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:15.767712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.768500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.770582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c214ddec-f5d0-4e27-8ea2-009fd38aa3f3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a/action" status: 202 len: 0 microversion: 2.1 time: 0.473927 Dec 25 21:15:15.771988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1149/2395] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:15 2021] POST /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:15:15.779421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:15.780719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.781175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.781307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.782021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.782726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.788356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.788543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.790400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.791017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.840259 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a2f5f71a-4960-406a-8d95-dfd46ce01ce9 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.066695 Dec 25 21:15:15.841482 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1150/2396] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:15 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:15.846945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:15.847651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:15.855735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.856590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:15.857108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:15.857641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.572538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:16.584719 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32bbf710-ac60-42f1-a0e3-3303a24da417 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1362 microversion: 2.1 time: 0.820499 Dec 25 21:15:16.585688 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1247/2397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:15 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1362 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:16.591995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:16.593138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:16.600012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.600579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.601502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.602811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.648750 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7607eb5-93d6-4e75-a9bc-79c714d67318 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.060809 Dec 25 21:15:16.649981 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1248/2398] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:16 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:16.654681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:16.660687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:16.661432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:16.663182 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ffc37a4-ec94-4977-b8ec-4aa18a917465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1472 microversion: 2.1 time: 0.820325 Dec 25 21:15:16.663969 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1151/2399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:15 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1472 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:16.669412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.670066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.670872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.671314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.779406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:16.780287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:16.792352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.793162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.794325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.795023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.886953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:16.894035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7edd6df7-f7c4-46f6-8463-4b47bdfa4e54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1275 microversion: 2.1 time: 0.118087 Dec 25 21:15:16.903857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1152/2400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:16 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:16.903857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:16.903857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:16.910844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.910844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.910844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:16.910844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:16.963206 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa72a8ac-33e7-421c-ab67-be22e12597ed tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.067179 Dec 25 21:15:16.965757 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1153/2401] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:16 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:17.023648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:17.032199 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-049c90db-f596-4c39-a364-0a0e9f73c4ca tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1318 microversion: 2.1 time: 0.380769 Dec 25 21:15:17.032914 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1249/2402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:16 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1318 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:17.464161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1f3748e4-ec4c-47b4-9524-5db885528df4 req-687c53e6-9ec0-4cf7-b145-6605b8222c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfb31ab-a5a4-4386-b5bd-77f172344909", "name": "network-vif-plugged", "status": "completed", "tag": "4353b31a-16ab-4050-acd0-9548832705a6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:17.468406 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:17.468406 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:17.478346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1f3748e4-ec4c-47b4-9524-5db885528df4 req-687c53e6-9ec0-4cf7-b145-6605b8222c29 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.478797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1f3748e4-ec4c-47b4-9524-5db885528df4 req-687c53e6-9ec0-4cf7-b145-6605b8222c29 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:17.503496 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1f3748e4-ec4c-47b4-9524-5db885528df4 req-687c53e6-9ec0-4cf7-b145-6605b8222c29 service nova] Creating event network-vif-plugged:4353b31a-16ab-4050-acd0-9548832705a6 for instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 on nch1-master-1 Dec 25 21:15:17.516939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1f3748e4-ec4c-47b4-9524-5db885528df4 req-687c53e6-9ec0-4cf7-b145-6605b8222c29 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062591 Dec 25 21:15:17.517706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1154/2403] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:17.604313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:17.605206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:17.616760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.617256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:17.619061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.620535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:17.666751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:17.670708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:17.683242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.685448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:17.686610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.687264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:17.739323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-facd4ecc-7fd1-4db7-9b10-25aff804ccf1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.081490 Dec 25 21:15:17.739983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1155/2404] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:17 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:17.745997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:17.747402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:17.755131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.755597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:17.760780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:17.760780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.147584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:18.161407 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e7d90f7-6fba-4c20-94eb-6d162890afec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1547 microversion: 2.1 time: 0.561857 Dec 25 21:15:18.181652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1250/2405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:17 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1547 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:18.198738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:18.213379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:18.221054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.221741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.222705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.223235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.256970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:18.270968 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4647796e-3682-49ae-9751-cb2acec2cea0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1472 microversion: 2.1 time: 0.528878 Dec 25 21:15:18.272055 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1156/2406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:17 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1472 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:18.280375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:18.282307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:18.299195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.299195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.299195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.299195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.344571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e2b589a-f66d-4787-9d3b-47d7e342ff4c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.070655 Dec 25 21:15:18.345346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1157/2407] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:18 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:18.353795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:18.353795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:18.360748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.361308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.362206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.362790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.671116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:18.685608 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd36d34a-948d-41e1-a7be-e3e048535507 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.502326 Dec 25 21:15:18.687413 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1251/2408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:18 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:18.692859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:18.693828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:18.728158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.729725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.735266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.737917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.875708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:18.885436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e12e596a-28e0-48c7-b7c8-1beaa86dddcf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1318 microversion: 2.1 time: 0.538488 Dec 25 21:15:18.886013 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1158/2409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:18 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1318 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:18.907327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:18.908869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:18.918005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.918452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.920002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:18.920806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:18.998349 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-60813cda-7d3d-4d87-ac55-fa4d0375e963 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.097967 Dec 25 21:15:19.000013 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1159/2410] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:18 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:19.009649 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49eaf318-c3b4-498c-8f6e-bd5c6d4011c3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319628 Dec 25 21:15:19.010157 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1252/2411] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:15:18 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:19.016958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:19.016958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:19.032036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.033199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.034217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.035162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.054115 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] HTTP exception thrown: Instance f7e7dfd9-c959-4465-a460-55aac15feeef could not be found. Dec 25 21:15:19.055679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Returning 404 to user: Instance f7e7dfd9-c959-4465-a460-55aac15feeef could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:19.056622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-90831ba1-3658-4649-b032-14e6d52875ba tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 404 len: 111 microversion: 2.1 time: 0.054208 Dec 25 21:15:19.057403 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1160/2412] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:15:19 2021] DELETE /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:19.066788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:19.067724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] [instance: f7e7dfd9-c959-4465-a460-55aac15feeef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:19.077202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.078087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.079183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.079929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.096525 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] HTTP exception thrown: Instance f7e7dfd9-c959-4465-a460-55aac15feeef could not be found. Dec 25 21:15:19.097185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] Returning 404 to user: Instance f7e7dfd9-c959-4465-a460-55aac15feeef could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:19.098152 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4bafb037-ba11-4101-8e9a-4a8f36f8e3fc tempest-AttachSCSIVolumeTestJSON-995789853 tempest-AttachSCSIVolumeTestJSON-995789853-project] 10.222.0.32 "GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef" status: 404 len: 111 microversion: 2.1 time: 0.036206 Dec 25 21:15:19.099033 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1253/2413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:19 2021] GET /compute/v2.1/servers/f7e7dfd9-c959-4465-a460-55aac15feeef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:15:19.290504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:19.293754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:19.300675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.301501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.302539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.303212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.357522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:19.359300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:19.367328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.368343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.369392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.370268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.442837 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b42260ce-5d09-4422-88f6-7676c485748d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.090136 Dec 25 21:15:19.444126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1254/2414] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:19 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:19.450785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5eea5b55-5fdf-44f4-8692-b39ee54a97a8 req-bf310298-4a37-4f19-9c07-76a650bb7af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:19.452749 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:19.452749 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:19.462000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5eea5b55-5fdf-44f4-8692-b39ee54a97a8 req-bf310298-4a37-4f19-9c07-76a650bb7af9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.462685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5eea5b55-5fdf-44f4-8692-b39ee54a97a8 req-bf310298-4a37-4f19-9c07-76a650bb7af9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.480041 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5eea5b55-5fdf-44f4-8692-b39ee54a97a8 req-bf310298-4a37-4f19-9c07-76a650bb7af9 service nova] Creating event network-changed:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:15:19.486881 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5eea5b55-5fdf-44f4-8692-b39ee54a97a8 req-bf310298-4a37-4f19-9c07-76a650bb7af9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041062 Dec 25 21:15:19.487708 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1255/2415] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:19.724855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:19.726858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:19.739440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.740252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.743548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.744612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.800686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:19.817194 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b18764b-df8a-4337-8580-d7456b429c1c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1472 microversion: 2.1 time: 0.531598 Dec 25 21:15:19.825921 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1161/2416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:19 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1472 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:19.902154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:19.906078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:19.923377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.923837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:19.924907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:19.926473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.638560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:20.649881 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b09ad6cb-2a8c-4dc0-bba7-8d1a107cc378 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.946222 Dec 25 21:15:20.652220 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1256/2417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:19 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:20.666213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:20.669090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:20.686625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.689292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.690405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.691140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.726016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:20.740747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8158910e-ea0a-4956-b98c-69fccdf53af5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1506 microversion: 2.1 time: 0.842336 Dec 25 21:15:20.741607 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1162/2418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:19 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1506 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:20.762150 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9473651f-462a-4047-97b5-2a2308cd7f45 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.095674 Dec 25 21:15:20.762901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1257/2419] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:20 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:20.767809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:20.768749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:20.782328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.783067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.784280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.790365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.835433 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8afb3b2d-340e-45d9-8ebf-62a5fa250ace tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.092035 Dec 25 21:15:20.836738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1163/2420] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:20 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:20.843596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:20.844971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:20.853663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.854384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.855519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.856127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.904125 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-346a2feb-c12d-4cb4-9c21-d1d51f0a1d97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.064786 Dec 25 21:15:20.906295 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1164/2421] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:20 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:20.930879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-826fb9a7-4e4f-43ff-9d38-e07bb89c2f82 req-f0ba4ecb-ea91-4cd8-ba6f-8c482fb7a9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c169c539-29b8-4eeb-bb76-6e6eabd11098", "tag": "305a9e22-e716-452b-815d-1b4b804fad15"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:20.939769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1361423186", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:20.947260 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:20.947260 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:20.973923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-826fb9a7-4e4f-43ff-9d38-e07bb89c2f82 req-f0ba4ecb-ea91-4cd8-ba6f-8c482fb7a9c1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:20.974394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-826fb9a7-4e4f-43ff-9d38-e07bb89c2f82 req-f0ba4ecb-ea91-4cd8-ba6f-8c482fb7a9c1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:20.994364 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-826fb9a7-4e4f-43ff-9d38-e07bb89c2f82 req-f0ba4ecb-ea91-4cd8-ba6f-8c482fb7a9c1 service nova] Creating event network-changed:305a9e22-e716-452b-815d-1b4b804fad15 for instance c169c539-29b8-4eeb-bb76-6e6eabd11098 on nch2-master-1 Dec 25 21:15:21.000731 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-826fb9a7-4e4f-43ff-9d38-e07bb89c2f82 req-f0ba4ecb-ea91-4cd8-ba6f-8c482fb7a9c1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092563 Dec 25 21:15:21.003319 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1165/2422] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:21.008747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:21.009497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:21.021378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:21.024528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.025260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.026596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.027222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.631517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:21.647106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-28e1bcca-4833-4be1-8d63-0899e78c1111 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1506 microversion: 2.1 time: 0.644521 Dec 25 21:15:21.648931 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1166/2423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:21 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1506 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:21.662806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:21.663902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:21.665213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:21.666052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:21.666728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:21.681884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:21.681884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:21.682203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.682203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.682203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.682203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.687901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.688591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.689818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.690482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.703032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Getting quotas for project 2fe1a82960c8413095a4b833950e8b3f. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:21.709372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Getting quotas for user 41b30a9fab164735bfb1d19a83b66ce6 and project 2fe1a82960c8413095a4b833950e8b3f. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:21.725015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:21.728306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:21.880323 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03bc6ac7-c223-46f4-a534-0c19b9fc41e0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116036 Dec 25 21:15:21.887230 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1258/2424] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:21.892761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6f77a100-7b81-4878-98c8-568848454697 req-e19f300a-7bdf-4964-891d-a9ecd5054648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d35b75-8e17-40b9-bfd2-615b2128e5df", "tag": "a8e1347c-d578-42de-9815-79469dc5aa48"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:21.894781 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:21.894781 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:21.907439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6f77a100-7b81-4878-98c8-568848454697 req-e19f300a-7bdf-4964-891d-a9ecd5054648 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.908156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6f77a100-7b81-4878-98c8-568848454697 req-e19f300a-7bdf-4964-891d-a9ecd5054648 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.925764 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6f77a100-7b81-4878-98c8-568848454697 req-e19f300a-7bdf-4964-891d-a9ecd5054648 service nova] Creating event network-changed:a8e1347c-d578-42de-9815-79469dc5aa48 for instance 59d35b75-8e17-40b9-bfd2-615b2128e5df on nch1-master-1 Dec 25 21:15:21.931372 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6f77a100-7b81-4878-98c8-568848454697 req-e19f300a-7bdf-4964-891d-a9ecd5054648 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042552 Dec 25 21:15:21.937616 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1259/2425] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:21.939094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:21.940633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:21.947066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.947706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:21.948670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:21.949385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.041979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:22.042545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:22.043142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:22.043657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:22.044178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:22.123197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:22.131130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-081c9e7a-87d4-434d-8ea2-4274f6f8aee4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.478738 Dec 25 21:15:22.131796 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1167/2426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:21 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:22.136976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:22.138034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.143898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.144626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.145755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.146283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.306103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.315003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.318623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.318623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.318623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.344741 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51c27859-5026-4da0-9883-4928a505830e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "POST /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909/action" status: 202 len: 1108 microversion: 2.1 time: 0.410061 Dec 25 21:15:22.361014 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1260/2427] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:21 2021] POST /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909/action => generated 1108 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 25 21:15:22.366295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:22.367660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.386770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.387334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.388232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.388772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.446773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:22.447019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c48b1b2d-4c98-49af-ab28-5b21ab86c1c0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.084153 Dec 25 21:15:22.447587 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1261/2428] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:22 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:22.453963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:22.454895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.457060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6fbacce-f187-464f-931a-175ec6b9ab1c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.323995 Dec 25 21:15:22.458052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1168/2429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:22 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:22.463866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.465414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.466030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c7daba32-80d8-4df8-b5d9-0fb4d03b19b2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:22.466895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.467980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.470097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c7daba32-80d8-4df8-b5d9-0fb4d03b19b2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.533272 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33c66947-e4ab-44de-9bd7-14ca22a76037 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.084099 Dec 25 21:15:22.537636 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1262/2430] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:22 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:22.545739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:22.547676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.560859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.561687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.565565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.565565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.595804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c7daba32-80d8-4df8-b5d9-0fb4d03b19b2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:22.603953 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c7daba32-80d8-4df8-b5d9-0fb4d03b19b2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1219 microversion: 2.1 time: 0.144846 Dec 25 21:15:22.604534 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1169/2431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:22 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:22.609677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:22.610516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:22.610988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aac270c9-ab2b-4f3a-b6e2-2b0431a2ef50 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.070235 Dec 25 21:15:22.615027 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1263/2432] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:22 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:22.617270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.618436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.619239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:22.630278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:22.932502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:22.941576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d5d4605-8286-4b1b-bc91-cb2f60102656 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.335948 Dec 25 21:15:22.945693 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1170/2433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:22 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:23.149736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:23.150449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.158219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.158677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.159471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.159933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.459168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:23.460276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.471031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.471485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.472662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.473321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.517187 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e16af09c-130d-4217-ae3c-42d11417c1f7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.061597 Dec 25 21:15:23.517861 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1171/2434] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:23 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:23.522978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:23.524214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.531500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.532013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.532820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.533290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.844361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:23.851995 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c92d9026-b79c-41dc-ad4d-2a06948b9ced tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.706695 Dec 25 21:15:23.852704 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1264/2435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:23 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:23.857290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:23.858382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.864436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.865002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.865851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.866352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.897730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:23.906092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-38d71b12-318e-40a7-b2d3-0ed125f51241 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.387046 Dec 25 21:15:23.906682 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1172/2436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:23 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:23.911115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:23.913738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.918766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.919220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20cba820-4696-42c1-a956-52bd7fa91050 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.065192 Dec 25 21:15:23.919372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.920099 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1265/2437] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:23 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:23.920226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.920675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.924804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:23.925540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.932689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.933173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.934248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.934692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.977530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a55ee8bf-a163-42bc-b559-e713ae397368 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.069561 Dec 25 21:15:23.980605 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1173/2438] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:23 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:23.984005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:23.984729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:23.992007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.993013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:23.993801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:23.994234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:24.012209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:24.019969 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b181c480-a98f-4696-be6f-6425bed5424e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1271 microversion: 2.1 time: 0.098900 Dec 25 21:15:24.020860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1266/2439] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:23 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:24.167072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:24.174835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e07dfdf0-ed47-4dee-8aff-28cbc34bccb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.194599 Dec 25 21:15:24.175561 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1174/2440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:23 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:24.529813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:24.530880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:24.545563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:24.546081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:24.547111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:24.547881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:24.598047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95d3a608-b113-4a63-8fc4-d0702dad8953 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.073171 Dec 25 21:15:24.598719 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1267/2441] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:24 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:24.869263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:24.869879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:24.876623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:24.877104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:24.877885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:24.878316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:24.923139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:24.923838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:24.931012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:24.931461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:24.932273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:24.932710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.076539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:25.084390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f1e812b-8f77-4fa1-a1bb-b059aaa3ef9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.219122 Dec 25 21:15:25.084983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1175/2442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:24 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:25.091465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:25.092491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:25.103093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.103540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.104723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.105542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.141819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:25.155191 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28230d8e-dd89-449e-b314-b08679173365 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.235991 Dec 25 21:15:25.156814 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1268/2443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:24 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:25.158972 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0559ae4-1a04-4af4-b041-6f53a9d6f942 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.072580 Dec 25 21:15:25.161606 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1176/2444] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:25 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:25.162608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:25.163785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:25.167831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:25.168568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:25.171452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.172135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.173178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.173859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.175751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.176213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.177229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.177862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.242607 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1df6540b-c491-41cb-a26e-812dccf569a2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.084230 Dec 25 21:15:25.244339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1269/2445] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:25 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:25.250052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:25.250736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:25.258398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.258864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.259677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.260119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.310772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:25.319408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-931c5657-ce31-45d5-9079-a4439b628a1a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1277 microversion: 2.1 time: 0.156481 Dec 25 21:15:25.328967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1177/2446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:25 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:25.430600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:25.448340 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82f1637e-b55a-4a3d-91e1-d39ef117c485 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.202487 Dec 25 21:15:25.449336 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1270/2447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:25 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:25.620089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:25.621794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:25.631337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.632124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.634372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.635213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.688433 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a50d9b5-f00f-466e-8038-c2826a0201a9 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.080031 Dec 25 21:15:25.690598 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1178/2448] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:25 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:25.764556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1d353052-085b-4056-a064-b15368707deb req-8f32c0e5-6a08-4466-8f2b-8c9389b9ac1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "name": "network-vif-plugged", "status": "completed", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:25.766280 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:25.766280 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:25.781736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1d353052-085b-4056-a064-b15368707deb req-8f32c0e5-6a08-4466-8f2b-8c9389b9ac1c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:25.783115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1d353052-085b-4056-a064-b15368707deb req-8f32c0e5-6a08-4466-8f2b-8c9389b9ac1c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:25.794462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1d353052-085b-4056-a064-b15368707deb req-8f32c0e5-6a08-4466-8f2b-8c9389b9ac1c service nova] Creating event network-vif-plugged:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:15:25.800420 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1d353052-085b-4056-a064-b15368707deb req-8f32c0e5-6a08-4466-8f2b-8c9389b9ac1c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044355 Dec 25 21:15:25.801200 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1271/2449] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:15:26.106610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:26.108060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.131166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.133077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.134242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.134909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.175744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:26.176466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.193769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.195002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.197297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.199062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.452530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:26.462380 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b997bf3d-105b-4f51-a4da-743381c2633a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.362784 Dec 25 21:15:26.464107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1179/2450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:26 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:26.469504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:26.470495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.470732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:26.477954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.478815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.480903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.482027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.482911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e72fb657-cab7-4411-bc5c-26c2a4608fbf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.311579 Dec 25 21:15:26.487634 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1272/2451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:26 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:26.497625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:26.498662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.505380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.506126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.506914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.507528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.535761 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-38d87239-da4d-4622-82ba-2c2ff1987287 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.069790 Dec 25 21:15:26.538741 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1180/2452] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:26 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:26.549443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:26.550678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.553072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04cc9335-4512-4e29-a5de-6654bfdd4526 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.063761 Dec 25 21:15:26.554293 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1273/2453] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:26 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:26.559113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.560397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.561229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.561365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:26.561866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.562323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.573557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.574085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.574992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.575548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.802760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:26.811647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95221b16-0543-4b8e-a2ed-ad96425e11b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.254875 Dec 25 21:15:26.812888 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1274/2454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:26 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:26.818162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:26.818320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:26.819182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:26.826275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c391ad2d-8b98-4485-8797-720bc5e2be9a tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1319 microversion: 2.1 time: 0.285150 Dec 25 21:15:26.837529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.839184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.841299 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1181/2455] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:26 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:26.843862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:26.844842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:26.900111 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-815678af-6bab-40c6-a01b-c17c474fc305 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.085657 Dec 25 21:15:26.901453 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1275/2456] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:26 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:27.479648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:27.480330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:27.488100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.488916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.489971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.490497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.501812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:27.502913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:27.512250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.513238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.514239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.514922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.850806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:27.858482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:27.860438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4741fd1-8298-4c0a-ac95-2d38467a5d3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.384540 Dec 25 21:15:27.861498 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1182/2457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:27 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:27.866476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a2040580-fb45-4682-a150-68c43ad0899b req-410b913f-d2d8-4a8a-aa1e-74456867a44c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e36ba04e-35fa-4f08-b691-833f273a7ec4", "tag": "1cafd266-4160-4e86-8dbb-b90af90eeb70"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:27.870406 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:27.870406 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:27.876184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2040580-fb45-4682-a150-68c43ad0899b req-410b913f-d2d8-4a8a-aa1e-74456867a44c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.876358 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48982754-1100-484e-8f5d-b12245559868 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.380057 Dec 25 21:15:27.876815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2040580-fb45-4682-a150-68c43ad0899b req-410b913f-d2d8-4a8a-aa1e-74456867a44c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.877375 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1276/2458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:27 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:27.886060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:27.887341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:27.890088 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a2040580-fb45-4682-a150-68c43ad0899b req-410b913f-d2d8-4a8a-aa1e-74456867a44c service nova] Creating event network-changed:1cafd266-4160-4e86-8dbb-b90af90eeb70 for instance e36ba04e-35fa-4f08-b691-833f273a7ec4 on nch2-master-1 Dec 25 21:15:27.894452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.895114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.898674 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a2040580-fb45-4682-a150-68c43ad0899b req-410b913f-d2d8-4a8a-aa1e-74456867a44c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032179 Dec 25 21:15:27.898674 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1183/2459] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:27.898946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.898946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.901832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:27.903192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:27.910939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.912307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.913390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.914103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.946234 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f50d935f-3ec5-4618-8e79-e79808d30f1f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.066005 Dec 25 21:15:27.947078 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1277/2460] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:27 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:27.955835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f88b0d01-349c-44ff-ad34-11df85f34504 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.058306 Dec 25 21:15:27.959090 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1184/2461] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:27 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:27.959245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c594f71d-bbd3-4082-ac91-dae147ee9638 req-374a50e2-94b0-41e6-ab2a-2395a70a3ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d35b75-8e17-40b9-bfd2-615b2128e5df", "name": "network-vif-plugged", "status": "completed", "tag": "a8e1347c-d578-42de-9815-79469dc5aa48"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:27.959849 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:27.959849 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:27.963478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:27.964291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:27.972189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.972646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.973470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.973907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.976781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c594f71d-bbd3-4082-ac91-dae147ee9638 req-374a50e2-94b0-41e6-ab2a-2395a70a3ae2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:27.976781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c594f71d-bbd3-4082-ac91-dae147ee9638 req-374a50e2-94b0-41e6-ab2a-2395a70a3ae2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:27.992069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c594f71d-bbd3-4082-ac91-dae147ee9638 req-374a50e2-94b0-41e6-ab2a-2395a70a3ae2 service nova] Creating event network-vif-plugged:a8e1347c-d578-42de-9815-79469dc5aa48 for instance 59d35b75-8e17-40b9-bfd2-615b2128e5df on nch1-master-1 Dec 25 21:15:27.998061 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c594f71d-bbd3-4082-ac91-dae147ee9638 req-374a50e2-94b0-41e6-ab2a-2395a70a3ae2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049448 Dec 25 21:15:27.998676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1278/2462] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:28.013453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:28.017536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:28.025857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.026712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.027102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.027538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.353217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:28.360554 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a179dafc-88bf-4579-986e-e5a0940b94cc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.402333 Dec 25 21:15:28.370297 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1185/2463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:27 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:28.370297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:28.370297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:28.374054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.374506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.375310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.375749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.404187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:28.412207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32bd3fd8-f93b-4730-9bdc-5718b2be75f2 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1319 microversion: 2.1 time: 0.412194 Dec 25 21:15:28.412819 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1279/2464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:27 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1319 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:28.427356 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9261256f-5cb3-4d33-9136-2610ad634611 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.064908 Dec 25 21:15:28.428191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1186/2465] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:28 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:28.877920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:28.878538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:28.894080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:28.897639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:28.906318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.907085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.908001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.910591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.915322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.916185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:28.919285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:28.920067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.285654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:29.293473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84772ed6-188b-480e-bea4-4dac0cc914d9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.419335 Dec 25 21:15:29.293670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:29.294062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1280/2466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:28 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:29.298662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:29.299842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:29.305876 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fcc17a98-a02b-4285-ac0f-d73c4931e2c2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1317 microversion: 2.1 time: 0.415774 Dec 25 21:15:29.312569 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1187/2467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:28 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1317 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:29.312737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.312737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.312737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.312737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.313185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:29.314466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:29.321177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.321638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.322439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.322884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.352356 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c02fa0e-8feb-43c0-82b4-9fa8979178bd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.056881 Dec 25 21:15:29.355542 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1281/2468] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:29 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:29.372706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b8248c21-4ccb-4fd7-85e9-3dcf5ccccdf5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 14 microversion: 2.1 time: 0.062986 Dec 25 21:15:29.372706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1188/2469] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:29 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:29.379419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:29.380118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:29.388061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.388541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.389352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.389787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.430963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:29.432074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:29.446009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.446580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.447459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:29.448222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:29.995954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:30.003533 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68eb05a7-b5bd-4889-a2c9-f0e35fa85061 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.628388 Dec 25 21:15:30.004104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1282/2470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:29 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:30.008574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:30.009535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.016046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.016435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.017251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.018899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.064161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:30.069901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be361ffa-cdc0-488e-88cb-bdf64027dfa7 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.064580 Dec 25 21:15:30.071373 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1283/2471] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:30 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:30.074600 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aef2cc12-d22f-4b48-8d75-57ab5b0806dd tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1319 microversion: 2.1 time: 0.648600 Dec 25 21:15:30.075386 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1189/2472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:29 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1319 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:30.311352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:30.312589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.323139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:30.328704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.334640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.337869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.338528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.339346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.339884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.342775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.343597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.348526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.552935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:30.563921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f4975d6-2362-4400-9307-41217efe7402 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.257252 Dec 25 21:15:30.573803 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1284/2473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:30 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:30.578999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:30.580000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.586729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.587093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:30.587711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.588731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.589408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.596012 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83d501a8-c856-4f8f-9715-88fab0403da4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1467 microversion: 2.1 time: 0.277111 Dec 25 21:15:30.596995 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1190/2474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:30 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1467 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:30.610798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:30.611808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.618094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.623680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.623680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.623680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.637462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70410d4a-8b41-4016-bc24-6f378265e54d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.061547 Dec 25 21:15:30.638594 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1285/2475] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:30 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:30.647226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:30.651022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.660637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.661171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.662153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.662596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.684104 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8926e8aa-97da-4701-a108-22f8b1733470 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 8194 microversion: 2.1 time: 0.085347 Dec 25 21:15:30.687428 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1191/2476] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:30 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 8194 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:30.816556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:30.824037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b6fb0a7-d9ac-4cea-8a90-193a057a269d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 1468 microversion: 2.1 time: 0.183636 Dec 25 21:15:30.824615 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1286/2477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:30 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 1468 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:30.840585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-734095492"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:30.842298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:30.849474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.850199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:30.850995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:30.851459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.019278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:31.019893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:31.027254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.027934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.029007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.029638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.236913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:31.245902 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db95fdc1-3c98-4e2e-bb7f-b4fd77a54ea7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.230299 Dec 25 21:15:31.255765 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1287/2478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:31 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:31.255765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:31.255765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:31.259687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.260469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.261655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.262578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.318099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-829ce302-bbf9-4fce-8ba5-cbc44fbd965e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.069612 Dec 25 21:15:31.319451 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1288/2479] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:31 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:31.324840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:31.325572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:31.333294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.333758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.334562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.335221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.338438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4eea8bd-a1b6-4ab0-b457-7eb32694cf61 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "POST /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42/action" status: 202 len: 0 microversion: 2.1 time: 0.502002 Dec 25 21:15:31.340485 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1192/2480] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:30 2021] POST /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:15:31.358488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e88a555e-1bf8-4d8a-9fb7-fd19f08907b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500570dc0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:31.447806 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e88a555e-1bf8-4d8a-9fb7-fd19f08907b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.097379 Dec 25 21:15:31.448945 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1193/2481] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:31 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:31.552839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:31.562705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6afb5866-07ae-4637-82b8-8c453fccfd1f tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1319 microversion: 2.1 time: 0.241445 Dec 25 21:15:31.563476 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1289/2482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:31 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:31.581958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:31.582693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:31.590630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.591088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.592259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.592756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.650635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:31.651935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:31.669999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.678406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.680140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.680976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.741094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-deac8918-a7da-4275-81b3-5a6c670775c8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.094177 Dec 25 21:15:31.741851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1290/2483] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:31 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:31.747847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:31.748918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:31.756555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.757222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.758845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:31.759470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:31.806054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:31.815878 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7cb690c7-89c1-4787-8b9a-197d28cdc0ad tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.238276 Dec 25 21:15:31.817293 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1194/2484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:31 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:31.834845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-133bd860-495d-40fc-9944-09e870b5dbd1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 16388 microversion: 2.1 time: 0.090666 Dec 25 21:15:31.835419 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1291/2485] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:31 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 16388 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:32.262410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:32.263016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:32.269845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.270304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.271105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.271538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.330635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:32.331986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:32.341273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.345756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.345756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.345756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.391346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb427ac3-e425-481e-8840-a728992d744c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.064616 Dec 25 21:15:32.392139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1292/2486] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:32 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:32.416047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:32.423572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70bf3a3c-172d-4fe8-920f-f7e928a28632 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.164755 Dec 25 21:15:32.424136 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1195/2487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:32 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:32.464538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53f71c57-830e-4da8-b46d-d807526248fd tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f7327ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:32.515480 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53f71c57-830e-4da8-b46d-d807526248fd tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.055485 Dec 25 21:15:32.516087 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1293/2488] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:32 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:32.574147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ad43a6ad-fb7f-4ce1-8a54-342ef05c1b38 req-62fdc0eb-677d-437d-bfc7-441d4523e821 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36ba04e-35fa-4f08-b691-833f273a7ec4", "name": "network-vif-plugged", "status": "completed", "tag": "1cafd266-4160-4e86-8dbb-b90af90eeb70"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:32.579719 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:32.579719 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:32.580161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:32.581014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:32.589207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.589770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.590804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.591455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.595048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ad43a6ad-fb7f-4ce1-8a54-342ef05c1b38 req-62fdc0eb-677d-437d-bfc7-441d4523e821 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.595518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ad43a6ad-fb7f-4ce1-8a54-342ef05c1b38 req-62fdc0eb-677d-437d-bfc7-441d4523e821 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.608728 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ad43a6ad-fb7f-4ce1-8a54-342ef05c1b38 req-62fdc0eb-677d-437d-bfc7-441d4523e821 service nova] Creating event network-vif-plugged:1cafd266-4160-4e86-8dbb-b90af90eeb70 for instance e36ba04e-35fa-4f08-b691-833f273a7ec4 on nch2-master-1 Dec 25 21:15:32.613581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ad43a6ad-fb7f-4ce1-8a54-342ef05c1b38 req-62fdc0eb-677d-437d-bfc7-441d4523e821 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043703 Dec 25 21:15:32.614208 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1196/2489] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:32.753953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:32.755475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:32.763686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.764952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.766056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.766751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.788835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:32.796303 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-feb70780-f466-4ffe-bb62-0e01c0353264 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1319 microversion: 2.1 time: 0.220816 Dec 25 21:15:32.796899 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1294/2490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:32 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:32.833305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:32.833946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:32.841785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.842283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.843012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:32.843448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:32.989423 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7044c0e2-b157-435e-b854-ccf89cc832fb tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.238799 Dec 25 21:15:32.994266 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1197/2491] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:32 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:32.997967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:32.998994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:33.001986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:33.006893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.007345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.008693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.009158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.010393 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c7971b5-3f5b-47fd-937d-8c29e6436eaf tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.180839 Dec 25 21:15:33.010979 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1295/2492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:32 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:33.050455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f16d308-0216-4f7f-aaaf-d09b3970ab4d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 16388 microversion: 2.1 time: 0.058037 Dec 25 21:15:33.051062 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1198/2493] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:32 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 16388 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:33.403861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:33.404847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:33.411818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.412283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.413207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.413650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.440225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:33.441050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:33.448358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.448811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.449619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.450058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.455432 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-855715df-96b8-4830-a9ce-fcdeed934b44 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.055728 Dec 25 21:15:33.456339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1296/2494] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:33 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:33.528794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5591b53e-7bd3-460a-a673-b3295f62d429 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6a52280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:33.578647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5591b53e-7bd3-460a-a673-b3295f62d429 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.053992 Dec 25 21:15:33.579822 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1297/2495] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:33 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:33.602755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:33.611967 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a782940-7603-47ad-aa8e-737887ffd9af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.175760 Dec 25 21:15:33.613104 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1199/2496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:33 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:33.817058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:33.817803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:33.826099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.826487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.827289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:33.827732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:33.983801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:33.992620 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9eccee38-575f-47d2-b46d-d43e9252ee6b tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1319 microversion: 2.1 time: 0.181797 Dec 25 21:15:33.993560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1298/2497] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:33 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:34.006188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:34.007136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:34.013616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.014171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.015046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.015564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.027682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:34.028375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:34.034427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.034883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.035679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.041947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.058056 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef46106f-12b9-4074-8207-7741204e8e7e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.059739 Dec 25 21:15:34.062827 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1200/2498] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:33 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:34.065343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:34.066351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:34.074353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.074653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.075438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.075951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.133800 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb6e6480-602c-404d-851c-ddf6d24d2615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 16388 microversion: 2.1 time: 0.073274 Dec 25 21:15:34.134792 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1201/2499] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:34 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 16388 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:34.184437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:34.191905 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfdbb035-3b07-415d-8ef2-edfd1b280057 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.168457 Dec 25 21:15:34.192475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1299/2500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:34 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:34.470721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:34.472213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:34.482949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.483639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.484850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.485556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.531629 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e65300f-c818-4b09-a2d2-b6f86038416d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.067459 Dec 25 21:15:34.532468 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1202/2501] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:34 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:34.591144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-add54cc6-9890-4e6b-89e5-ce3726fcf0e2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6b291f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:34.633359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:34.634067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:34.634682 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-add54cc6-9890-4e6b-89e5-ce3726fcf0e2 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.047077 Dec 25 21:15:34.635253 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1300/2502] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:34 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:34.641110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.641568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.642361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:34.642796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:34.803749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:34.813066 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-936ad1c6-4c7b-4158-a6ae-5ec7b73f7322 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.184192 Dec 25 21:15:34.813646 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1203/2503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:34 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:35.010360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:35.011945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.021293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.021746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.022535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.022970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.165512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:35.173205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-24a0d5ed-f281-401a-8dfd-34a3a1ee44c4 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:35.173844 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a11707b-2a39-4a5a-be82-c3a42a5b929c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1469 microversion: 2.1 time: 0.168104 Dec 25 21:15:35.174412 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1301/2504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:35 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:35.180669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:35.181916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-24a0d5ed-f281-401a-8dfd-34a3a1ee44c4 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.133326 Dec 25 21:15:35.182146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.182639 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1204/2505] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:15:35 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:35.189078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.189562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.190345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.190840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.196760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:35.199076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.205970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.206417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.207196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.207630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.238684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1045bec-af25-4383-a13e-aaeddc28b0db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.063041 Dec 25 21:15:35.239656 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1302/2506] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:35 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:35.252270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34e8c635-4c95-4f77-b4d8-f2fd80ada28e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 16388 microversion: 2.1 time: 0.068124 Dec 25 21:15:35.253522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1205/2507] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:35 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 16388 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:35.258584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:35.259286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.266481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.266932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.267727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.268163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.383874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1318612010", "block_migration": true, "disk_over_commit": false}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:35.385217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.403622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.404381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.406201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.406933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.441903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lazy-loading 'flavor' on Instance uuid e36ba04e-35fa-4f08-b691-833f273a7ec4 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:15:35.459428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Going to try to live migrate instance to tempest-host-1318612010 {{(pid=136548) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:15:35.467869 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] HTTP exception thrown: Compute host tempest-host-1318612010 could not be found. Dec 25 21:15:35.468744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Returning 400 to user: Compute host tempest-host-1318612010 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:35.470325 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc9028d9-22fa-4261-8679-6296bea43d88 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4/action" status: 400 len: 100 microversion: 2.1 time: 0.229383 Dec 25 21:15:35.471430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1303/2508] 10.222.0.32 () {60 vars in 1278 bytes} [Sat Dec 25 21:15:35 2021] POST /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4/action => generated 100 bytes in 231 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:15:35.499790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:35.501523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.517293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.517956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.519191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.519760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.524111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:35.534907 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a87338c4-c00c-41bc-bfd9-1ac9901b1fb6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.280712 Dec 25 21:15:35.536045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1206/2509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:35 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:35.542976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-edd905c3-2ae3-4d25-9b6a-7eb0c1a8346e req-2b8bd91c-215d-4cef-ba43-b32c94c1d96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "name": "network-vif-plugged", "status": "completed", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:35.544849 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:35.544849 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:35.553319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-edd905c3-2ae3-4d25-9b6a-7eb0c1a8346e req-2b8bd91c-215d-4cef-ba43-b32c94c1d96d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.554056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-edd905c3-2ae3-4d25-9b6a-7eb0c1a8346e req-2b8bd91c-215d-4cef-ba43-b32c94c1d96d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.573206 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-edd905c3-2ae3-4d25-9b6a-7eb0c1a8346e req-2b8bd91c-215d-4cef-ba43-b32c94c1d96d service nova] Creating event network-vif-plugged:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:15:35.592798 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-edd905c3-2ae3-4d25-9b6a-7eb0c1a8346e req-2b8bd91c-215d-4cef-ba43-b32c94c1d96d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054367 Dec 25 21:15:35.597123 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1207/2510] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:35.603696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:35.604683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.611601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.613714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.618214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.618214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.662729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ae9412a-d60d-4a82-b4ad-c76a82fa6692 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.063985 Dec 25 21:15:35.663550 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1208/2511] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:35 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:35.668629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62af0213-01e5-4cea-adfe-590d6e0fd102 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f739e940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:35.766166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:35.777039 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9a60032-4d18-413d-9078-cad08095d7a6 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1469 microversion: 2.1 time: 0.284183 Dec 25 21:15:35.778144 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1304/2512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:35 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1469 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:35.831693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:35.832576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:35.841779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.842634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:35.843842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:35.844357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.002013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62af0213-01e5-4cea-adfe-590d6e0fd102 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.337193 Dec 25 21:15:36.002590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1209/2513] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:35 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:36.014282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-374354899", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:36.032148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:36.047233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8c332c3-ac08-43b5-8523-518f2f6e68c5 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.220708 Dec 25 21:15:36.063292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1305/2514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:35 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:36.068077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cd75ec6-f3d0-4f05-a53e-2ade83498d84 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-290431204", "imageRef": "ccc2197a-cf98-4477-a2e1-16ae86408962", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:36.078665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:36.140673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-9cd75ec6-f3d0-4f05-a53e-2ade83498d84 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:36.462030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:36.462768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:36.463241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:36.463681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:36.464100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:36.487627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.488925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.489381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.489868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.491431 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9cd75ec6-f3d0-4f05-a53e-2ade83498d84 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] HTTP exception thrown: Flavor's memory is too small for requested image. Dec 25 21:15:36.492072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cd75ec6-f3d0-4f05-a53e-2ade83498d84 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:36.493067 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cd75ec6-f3d0-4f05-a53e-2ade83498d84 tempest-FlavorsV2NegativeTest-926731564 tempest-FlavorsV2NegativeTest-926731564-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.428619 Dec 25 21:15:36.493611 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1306/2515] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:36 2021] POST /compute/v2.1/servers => generated 93 bytes in 430 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:15:36.502365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:36.503535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:36.511110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.511569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.512391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.512814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.537464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Getting quotas for project 2fe1a82960c8413095a4b833950e8b3f. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:36.553411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Getting quotas for user 41b30a9fab164735bfb1d19a83b66ce6 and project 2fe1a82960c8413095a4b833950e8b3f. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:36.567006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68e72a1e-9cb9-4b3e-89d2-b1fc4a997727 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.071075 Dec 25 21:15:36.570877 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1307/2516] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:36 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:36.577977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:36.582358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:36.583250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:36.583607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:36.593338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.593792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.594608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.597941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.673401 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c78b5e1e-9069-4129-adbf-e2de0b6ef0b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.099323 Dec 25 21:15:36.679592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1308/2517] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:36 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:36.685641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:36.686426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:36.693600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.694065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.695549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.696004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.825067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30e39cac-aca4-4ab2-b44b-75a68bc192b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.815202 Dec 25 21:15:36.826031 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1210/2518] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:36.837498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:36.838840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:36.849626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.850412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.853817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:36.853817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:36.911374 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-caebf0e6-1d8a-4c65-95d7-e36047d26e2d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.083263 Dec 25 21:15:36.911537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:36.912675 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1211/2519] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:36 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:36.920524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-794a00cf-4602-40ea-a52b-0620e1cf4197 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:36.921440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-794a00cf-4602-40ea-a52b-0620e1cf4197 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:36.941906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72682e8e-b8bd-45d5-a0b5-8378c322e66a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.260499 Dec 25 21:15:36.945713 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1309/2520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:36 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:37.005697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-794a00cf-4602-40ea-a52b-0620e1cf4197 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:37.015357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1adfd372-66d6-4d91-a3e7-5b3aeaf725a4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6b29310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:37.015653 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-794a00cf-4602-40ea-a52b-0620e1cf4197 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1218 microversion: 2.1 time: 0.101257 Dec 25 21:15:37.016258 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1212/2521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:36 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1218 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:37.066145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:37.067722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:37.083615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.083615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.083615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.083615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.204510 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1adfd372-66d6-4d91-a3e7-5b3aeaf725a4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.192429 Dec 25 21:15:37.210833 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1310/2522] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:37 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:37.298034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:37.310824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0721fa1a-d34b-4e2a-bc39-dee35daf4c10 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.244898 Dec 25 21:15:37.310824 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1213/2523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:37 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:37.580408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:37.581476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:37.589686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.590392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.591371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.591812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.641102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32a7694f-ea5c-41ee-a6e7-bd0c226b7ed4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.064991 Dec 25 21:15:37.646619 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1311/2524] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:37 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:37.692352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:37.693327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:37.706256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.706996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.708105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.708951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.761708 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ff7f7cd-6d02-43c6-add8-a77a231064c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.073720 Dec 25 21:15:37.768053 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1214/2525] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:37 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:37.924111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:37.925174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:37.932891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.933861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.939120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.940224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.969918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:37.970981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:37.991783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.992246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:37.993089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:37.993531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.022048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1326160b-42fa-4b4a-8fb1-2a83d9eaf4be tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.101857 Dec 25 21:15:38.023534 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1312/2526] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:37 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:38.037663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:38.039278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:38.055371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.056320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.057279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.057788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.143682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:38.152628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fcb6b72-de81-4e43-a4a3-4935656b70c0 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1214 microversion: 2.1 time: 0.123252 Dec 25 21:15:38.167076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1313/2527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:38 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1214 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:38.219145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a9f38ba-de27-4a03-bcd8-5b61047884f0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f70deaf0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:38.279978 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a9f38ba-de27-4a03-bcd8-5b61047884f0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.065098 Dec 25 21:15:38.281303 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1314/2528] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:38 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:38.330296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:38.331197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:38.340191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.340654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.341498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.342487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.350763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:38.359703 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd0c5147-07b5-4fa9-b388-63e872506f25 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.402069 Dec 25 21:15:38.360853 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1215/2529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:37 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:38.506678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:38.520486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0d0a747-e39a-44f8-ad37-c6d608db066c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.200655 Dec 25 21:15:38.531474 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1315/2530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:38 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:38.653676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:38.654568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:38.663302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.664277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.665119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.665546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.706570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e7ad60f-2ba9-41d4-b3b1-11be6e8b12a4 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.056603 Dec 25 21:15:38.707261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1216/2531] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:38 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:38.779266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:38.780356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:38.787999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.789122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.789983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:38.790508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:38.840385 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-91bc776d-40cf-4109-9f45-f371f6201aa6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.064972 Dec 25 21:15:38.841574 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1316/2532] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:38 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:39.034915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:39.035910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:39.043645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.044105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.044912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.045378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.096770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c8a9e74-97a6-4c47-a33c-1e12b1dbcb58 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.065608 Dec 25 21:15:39.098055 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1217/2533] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:39 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:39.178275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:39.178973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:39.187159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.187860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.188851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.189330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.298392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6bdf509a-bbcf-4a78-91f9-3195e79e871b tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50054af70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:39.302753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:39.317323 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad6f50a0-b252-4d64-9511-374c689fa118 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1278 microversion: 2.1 time: 0.144317 Dec 25 21:15:39.318338 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1317/2534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:39 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1278 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:39.379511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:39.379666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:39.390583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.391037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.394184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.396850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.409484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6bdf509a-bbcf-4a78-91f9-3195e79e871b tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.115302 Dec 25 21:15:39.409484 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1218/2535] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:39 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:39.537139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:39.538479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:39.547699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.560815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.560815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.560815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.678838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:39.687442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e523008-d54b-46a3-85ea-8e109713372d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.313122 Dec 25 21:15:39.700965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1318/2536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:39 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:39.725847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:39.727181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:39.735028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.735797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.737066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.744320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.807679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b1b5b9b-b84b-4465-bbcc-a30848a39379 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.085117 Dec 25 21:15:39.809083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1319/2537] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:39 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:39.853774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:39.855010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:39.857181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:39.862368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.863043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.864166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:39.864792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:39.874672 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19629187-ed11-4899-9526-6067c7000c49 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.340590 Dec 25 21:15:39.877543 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1219/2538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:39 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:39.915626 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b489504-579b-486f-aee5-6163858ac9e4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.066376 Dec 25 21:15:39.916985 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1320/2539] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:39 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:40.108561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:40.109571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:40.121752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.122826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.124570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.125228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.186437 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cbba5563-2919-4d19-a8f8-1ec7d04f027e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.081398 Dec 25 21:15:40.190608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1220/2540] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:40 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:40.340426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:40.341718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:40.354429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.358340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.360743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.364781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.423165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f3bd051-8775-4ae2-8f66-85f1c54fc829 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f627f670>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:40.491275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f3bd051-8775-4ae2-8f66-85f1c54fc829 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.073707 Dec 25 21:15:40.495899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1221/2541] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:40 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:40.647985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:40.655820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95d35cff-5f3d-432e-92ee-df91440f96a4 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.323932 Dec 25 21:15:40.666470 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1321/2542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:40 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:40.709145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:40.710790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:40.722170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.723068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.724238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.725167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.828768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:40.830259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:40.839043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.839872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.840689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.843145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.911011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9c38bdf8-8a4d-4784-8bfd-59ff75ad210c tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.087078 Dec 25 21:15:40.918319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1322/2543] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:40 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:40.924169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:40.924958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:40.934794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.941243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:40.941243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:40.941243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.135629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:41.144709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7421122b-b47f-4342-b1a3-c3ee126f1077 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.443315 Dec 25 21:15:41.145304 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1222/2544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:40 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:41.165156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:41.170370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:41.173750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.174405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.175199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.175647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.235467 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d0ce020-f7e0-4cf1-b724-5e388e109337 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.074927 Dec 25 21:15:41.237079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1223/2545] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:41 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:41.243050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:41.244165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:41.250531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.250986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.251990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.252713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.314688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:41.318360 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d89b953e-c84d-48f6-99cd-dff127311cc0 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.079592 Dec 25 21:15:41.323124 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1224/2546] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:41 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:41.323306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90b47b4f-cba5-4ff2-bf2f-385c6b2975bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.402228 Dec 25 21:15:41.323306 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1323/2547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:40 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:41.505281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-506b6e78-2ea7-4911-be96-409281180a0e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50068d700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:41.574639 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-506b6e78-2ea7-4911-be96-409281180a0e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.073273 Dec 25 21:15:41.575817 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1225/2548] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:41 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:41.673516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:41.674121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:41.689170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.689636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.690448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.690895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.926327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:41.927336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:41.939127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.939856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.940797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:41.941304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:41.976113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:41.988907 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d2217c75-2eb4-480a-b6a6-e0024bd6bf21 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.318768 Dec 25 21:15:42.000851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1324/2549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:41 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:42.006121 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-991fd643-6713-4638-87da-2025802429b6 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.084564 Dec 25 21:15:42.007335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1226/2550] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:41 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:15:42.099285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-090fc418-cecf-42b1-95a2-286cf7bb6e15 req-d22253cc-9f55-4204-8fea-06954a3d3851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25868382-2f4d-4138-bd58-4d8505ab944a", "tag": "04b699b9-f328-49f3-bfd1-4302a65626c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:42.101214 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:42.101214 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:42.109909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-090fc418-cecf-42b1-95a2-286cf7bb6e15 req-d22253cc-9f55-4204-8fea-06954a3d3851 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.110494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-090fc418-cecf-42b1-95a2-286cf7bb6e15 req-d22253cc-9f55-4204-8fea-06954a3d3851 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.124473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-090fc418-cecf-42b1-95a2-286cf7bb6e15 req-d22253cc-9f55-4204-8fea-06954a3d3851 service nova] Creating event network-changed:04b699b9-f328-49f3-bfd1-4302a65626c8 for instance 25868382-2f4d-4138-bd58-4d8505ab944a on nch1-master-1 Dec 25 21:15:42.130749 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-090fc418-cecf-42b1-95a2-286cf7bb6e15 req-d22253cc-9f55-4204-8fea-06954a3d3851 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040857 Dec 25 21:15:42.136124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1325/2551] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:42.162907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:42.163648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:42.183802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.184263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.188481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.188952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.248655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:42.251554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:42.258940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.259675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.260490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.260934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.337949 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-574cc14a-bcdb-4399-a62f-a331a92e3a9e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.093075 Dec 25 21:15:42.340860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1326/2552] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:42 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:42.358626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:42.366295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:42.379316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.379983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.380958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.381413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.437220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfd36024-2270-4904-997c-bee31ced6414 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.094000 Dec 25 21:15:42.438309 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1327/2553] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:42 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:42.451345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:42.453329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:42.474080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.474554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.475446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:42.478742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:42.545040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:42.556652 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d0b57bf-d69c-485f-9c3c-a4c178e99c4a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.398338 Dec 25 21:15:42.557321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1227/2554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:42 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:42.587742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3416180c-eb53-4e17-9168-12d3fb880cba tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f627f9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:42.668966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3416180c-eb53-4e17-9168-12d3fb880cba tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.078201 Dec 25 21:15:42.668966 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1228/2555] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:42 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:42.823820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:42.842446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-93780fdf-9a80-4ad8-9019-e58e1f3b07e8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.402104 Dec 25 21:15:42.843560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1328/2556] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:42 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:43.007591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:43.009157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:43.015958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.016583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.017430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.017908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.020624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:43.021860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:43.034131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.035111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.036291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.037223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.083412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2cbc3e15-684d-4126-9514-a5bce552539b tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.066969 Dec 25 21:15:43.084236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1329/2557] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:43 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:43.244124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:43.252104 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54f737c9-cefa-4b85-995c-2670cf0c0e8e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.249558 Dec 25 21:15:43.252704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1229/2558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:43 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:43.352158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:43.353527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:43.361111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.361799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.362755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.363225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.405956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8fe7772e-7c9c-44f4-b97c-35ee01102464 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.058239 Dec 25 21:15:43.406595 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1330/2559] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:43 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:43.449192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:43.450171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:43.456189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.456636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.457507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.458143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.501622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d5521d4-aecf-493e-9266-ed7eb52bfa8b tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.056081 Dec 25 21:15:43.505656 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1230/2560] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:43 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:43.575878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:43.576598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:43.585194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.585662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.586767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.587312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.677748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1efb0a1d-7d64-44ea-8118-4356629d74ab tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f67d7550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:43.761060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1efb0a1d-7d64-44ea-8118-4356629d74ab tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.088680 Dec 25 21:15:43.765850 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1231/2561] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:43 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:43.865803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:43.869045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:43.898644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.902591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:43.904861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:43.911785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.451406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:44.463141 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0aacc7ea-3e9a-4554-a33a-4c64b3aa0b81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.891610 Dec 25 21:15:44.464281 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1331/2562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:43 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:44.468909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:44.470261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:44.474961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:44.483020 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-64a3b905-d5f3-4c4a-99bf-208b8142474f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.622536 Dec 25 21:15:44.488321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1232/2563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:43 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:44.494454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:44.501640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.503219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.504032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.504643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.505868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:44.526612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.527077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.536346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.536346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.595346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b6bd4b5d-b9e4-4b9f-b92f-8ff8f7883226 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.129719 Dec 25 21:15:44.596091 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1332/2564] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:44 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:44.605692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:44.611328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:44.623902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.624684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.625688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.626179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.675615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d863ef5d-fdb4-453f-b51f-daae0e21ac23 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.077430 Dec 25 21:15:44.683895 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1333/2565] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:44 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:44.690813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:44.692781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:44.700204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.700999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.702001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:44.703126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:44.755629 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7b47643-752b-4705-99cb-fb30c08d122d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.069233 Dec 25 21:15:44.760198 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1334/2566] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:44 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:44.778825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b499aa6-698b-4b3a-a823-744c1162e328 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6abcc10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:44.852771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b499aa6-698b-4b3a-a823-744c1162e328 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.077927 Dec 25 21:15:44.859341 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1335/2567] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:44 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:44.883929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:44.896366 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44bc5fa1-f499-43f9-96c6-1a228fc70889 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.405836 Dec 25 21:15:44.911657 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1233/2568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:44 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:45.479519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:45.480417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:45.492409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:45.493229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:45.494228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:45.494847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:45.506654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:45.507827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:45.522638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:45.522638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:45.523532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:45.523848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:45.932509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:45.938007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:45.946621 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efb619b9-c0ae-42a4-b7c6-d6bca2448a37 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.470580 Dec 25 21:15:45.947884 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1336/2569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:45 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:45.951590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1f3ea7b-5477-448c-8129-235ba99d0b73 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.448333 Dec 25 21:15:45.951899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1234/2570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:45 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:45.959643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:45.960910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:45.976770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:45.977849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:45.985662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:45.986127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:45.989741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:45.992207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:46.006715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.007782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.008586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.009058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.075598 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebf014ef-bff2-4bd0-8edd-41dfa9852a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.122262 Dec 25 21:15:46.076956 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1235/2571] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:45 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:46.087524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:46.088967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:46.092446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64da7439-5972-4fcb-af7a-e7973611a45a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.114403 Dec 25 21:15:46.093179 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1337/2572] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:45 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:46.100021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.101605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.102592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.103248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.105111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-238be783-e820-4ce3-8b24-b86b1f4bc2ec tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f751c940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:46.183568 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-238be783-e820-4ce3-8b24-b86b1f4bc2ec tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.089078 Dec 25 21:15:46.184370 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1338/2573] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:46 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:46.191139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:46.195079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:46.202630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.203331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.204416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.205069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.207528 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a57193f-2137-4f47-a647-fdc74dd0d0c3 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.126822 Dec 25 21:15:46.208447 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1236/2574] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:46 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:46.466573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:46.474245 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a6d447e9-b372-4c0c-b334-dffb402966af tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.286666 Dec 25 21:15:46.476238 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1339/2575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:46 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:46.972356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:46.973902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:46.978502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:46.979824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:46.988974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.995215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.997605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:46.998651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:46.999335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.001807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.002604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.004184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.597943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:47.627388 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afc53594-95b9-4efd-b700-07a293bdb1b0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1477 microversion: 2.1 time: 0.665607 Dec 25 21:15:47.632671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:47.651148 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4632ef7f-afd6-4450-b5c6-55606198a3c6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.687215 Dec 25 21:15:47.651749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1340/2576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:46 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:47.661617 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1237/2577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:46 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1477 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:47.661617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:47.661617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:47.672694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:47.673747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:47.683581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.684039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.684845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.686319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.699087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.699557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.700357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.700799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.771335 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d2e00ed-0afe-4347-be43-37cd8ec23b49 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.116860 Dec 25 21:15:47.772094 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1238/2578] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:47 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:47.781301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-901e9761-22c4-4599-ab4f-14f6adde991d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f628bc10>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:47.781718 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6eb3a1e-4557-4ba6-866e-2bca8d826765 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.128486 Dec 25 21:15:47.782470 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1341/2579] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:47 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:47.787624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:47.793535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:47.824651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.825268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.826262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.826786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.844802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-901e9761-22c4-4599-ab4f-14f6adde991d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.067904 Dec 25 21:15:47.851684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1239/2580] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:47 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:47.858178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:47.859195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:47.867592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.868385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.869442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:47.870094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:47.923235 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c161c1cb-ced7-4208-a88a-c3341efb7951 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.139309 Dec 25 21:15:47.924299 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1342/2581] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:47 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:48.301262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:48.314505 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71129338-464c-45c5-9205-512a87fbc3a9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.461335 Dec 25 21:15:48.315522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1240/2582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:47 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:48.669799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:48.670383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:48.677406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:48.677592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:48.677843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:48.678390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:48.679395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:48.679905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:48.680226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:48.680911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:48.686116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:48.686783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.507940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:49.516776 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77f33e16-17d0-4ad8-844e-4c679081c77e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1476 microversion: 2.1 time: 0.850696 Dec 25 21:15:49.525891 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1241/2583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:48 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1476 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:49.530656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:49.531619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:49.555671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.559823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.561416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.562609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.586647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:49.594630 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-77c39d21-fef3-414a-bb55-15d56e595c82 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.928954 Dec 25 21:15:49.602134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1343/2584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:48 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:49.607197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:49.618141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:49.625484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.626202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.627212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.627826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.643724 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d61243ea-4bd0-4af5-91ce-6a4580ff3353 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.116432 Dec 25 21:15:49.644793 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1242/2585] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:49 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:49.656547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-69183f36-2544-4db6-8d4a-a87171a6726f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f628b9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:49.678836 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e06b3d6d-1781-4d57-b9ea-ff154288efcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 24557 microversion: 2.1 time: 0.075003 Dec 25 21:15:49.683166 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1344/2586] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:49 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 24557 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:49.693686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:49.695043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:49.702321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.702517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.714273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.715273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.722334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-69183f36-2544-4db6-8d4a-a87171a6726f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1454 microversion: 2.1 time: 0.075833 Dec 25 21:15:49.722927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1243/2587] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:49 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1454 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:49.729827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:49.730561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:49.738005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.738727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.739733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.740398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.781893 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-631f3a4a-0d1a-4907-8e5c-5e4373a0ad5e tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 32642 microversion: 2.1 time: 0.100489 Dec 25 21:15:49.784067 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1345/2588] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:49 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 32642 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:49.869844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c9444824-b3a1-45cd-87e4-b110ff383ca0 req-f0d92ea4-5068-46bb-894e-9646ac3d36c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25868382-2f4d-4138-bd58-4d8505ab944a", "name": "network-vif-plugged", "status": "completed", "tag": "04b699b9-f328-49f3-bfd1-4302a65626c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:49.871427 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:49.871427 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:49.887384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c9444824-b3a1-45cd-87e4-b110ff383ca0 req-f0d92ea4-5068-46bb-894e-9646ac3d36c5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:49.887845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c9444824-b3a1-45cd-87e4-b110ff383ca0 req-f0d92ea4-5068-46bb-894e-9646ac3d36c5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:49.904857 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c9444824-b3a1-45cd-87e4-b110ff383ca0 req-f0d92ea4-5068-46bb-894e-9646ac3d36c5 service nova] Creating event network-vif-plugged:04b699b9-f328-49f3-bfd1-4302a65626c8 for instance 25868382-2f4d-4138-bd58-4d8505ab944a on nch1-master-1 Dec 25 21:15:49.910206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c9444824-b3a1-45cd-87e4-b110ff383ca0 req-f0d92ea4-5068-46bb-894e-9646ac3d36c5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045390 Dec 25 21:15:49.910969 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1346/2589] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:15:50.156459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:50.164144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2d5449d8-49de-4999-a295-55472524a0d3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.440161 Dec 25 21:15:50.164715 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1244/2590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:49 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:50.545193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:50.545903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:50.552776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.554367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.555432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.555965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.627306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:50.627306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:50.634817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.635587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.637943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.638780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.832819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:50.842106 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e9f9f74-3fb8-40cf-9205-07e8db228da0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1476 microversion: 2.1 time: 0.301410 Dec 25 21:15:50.844948 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1347/2591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:50 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1476 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:50.847973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:50.849322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:50.862562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.862961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.863844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.864324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.914050 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ccc47127-db76-4c34-9c8e-0fde5e81e3db tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.068351 Dec 25 21:15:50.917074 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1348/2592] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:50 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:50.922744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:50.923937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:50.932106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.933099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.934104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:50.934542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:50.972936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:50.984036 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e1b9bee5-e861-43a6-912b-7599184a899b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.368817 Dec 25 21:15:50.984768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1245/2593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:50 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:50.989405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-452b18f1-dc96-4f5b-a8ce-da1797486dc0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50068dca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.015505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff2c9162-03f5-4b09-a64e-68ef4271ffee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.096733 Dec 25 21:15:51.021536 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1349/2594] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:50 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:51.028926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:51.030191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:51.041737 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-452b18f1-dc96-4f5b-a8ce-da1797486dc0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1463 microversion: 2.1 time: 0.055656 Dec 25 21:15:51.046615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.047209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.048038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.048505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.055212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1246/2595] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:50 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1463 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:51.068242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8d3f3a8-cd1c-436f-8790-6b1a2a3f32ce tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa5005dbe50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.124014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72ec4825-6840-46be-b1a3-354c2d8674d1 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action" status: 200 len: 40798 microversion: 2.1 time: 0.100226 Dec 25 21:15:51.125686 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8d3f3a8-cd1c-436f-8790-6b1a2a3f32ce tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 200 len: 1463 microversion: 2.1 time: 0.063475 Dec 25 21:15:51.126871 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1247/2596] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:51 2021] GET /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 1463 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:51.129313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1350/2597] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:51 2021] POST /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e/action => generated 40798 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:51.138059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.138308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.138941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:51.139447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:51.146957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.148163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.148413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.148980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.149564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.149787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.150327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.151080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.355997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:51.360049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:51.364174 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cdc0779a-995f-4ddf-8f12-8601c19de53d tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1694 microversion: 2.1 time: 0.230007 Dec 25 21:15:51.364989 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1248/2598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:51 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1694 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:51.368588 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04ec98e4-3c09-45bd-ae0f-ab67a84ac2e0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 1468 microversion: 2.1 time: 0.234425 Dec 25 21:15:51.383139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1351/2599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:51 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:51.401309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.402073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:51.409126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.409578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.410613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.410992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.508997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad394745-3951-401f-bf68-d97b72e5f35d tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] Calling method '.version_select at 0x7fa4f6d49e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.566722 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad394745-3951-401f-bf68-d97b72e5f35d tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] 10.222.0.32 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.200654 Dec 25 21:15:51.567452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1249/2600] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:15:51 2021] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:51.579830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1399837245"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:51.581287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:51.590989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.591442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.592857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.593161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.605504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:51.613733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee098c7b-cfcb-46b8-96b8-c0a2fda24ed3 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1318 microversion: 2.1 time: 0.222716 Dec 25 21:15:51.614644 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1352/2601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:51 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:51.632256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d283d723-72e6-4cbb-bde9-a2b90c30fc47 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] Action: 'create', calling method: .version_select at 0x7fa4f70ba550>, body: {"pool": "non_exist_pool"} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:51.670625 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d283d723-72e6-4cbb-bde9-a2b90c30fc47 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] HTTP exception thrown: Floating IP pool not found. Dec 25 21:15:51.671951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d283d723-72e6-4cbb-bde9-a2b90c30fc47 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] Returning 404 to user: Floating IP pool not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:51.672956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d283d723-72e6-4cbb-bde9-a2b90c30fc47 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.057439 Dec 25 21:15:51.678364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1353/2602] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:15:51 2021] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:15:51.685718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82e5eecc-2c4a-4d8f-be7f-e41c93df6eb1 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] Calling method '.version_select at 0x7fa4f6e7da60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.732787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-82e5eecc-2c4a-4d8f-be7f-e41c93df6eb1 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3cc6a243-cdf2-4d6a-8b5c-446ded43ce51 could not be found", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:15:51.733524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-82e5eecc-2c4a-4d8f-be7f-e41c93df6eb1 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] HTTP exception thrown: Floating IP not found for ID 3cc6a243-cdf2-4d6a-8b5c-446ded43ce51 Dec 25 21:15:51.734246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82e5eecc-2c4a-4d8f-be7f-e41c93df6eb1 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] Returning 404 to user: Floating IP not found for ID 3cc6a243-cdf2-4d6a-8b5c-446ded43ce51 {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:51.735228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82e5eecc-2c4a-4d8f-be7f-e41c93df6eb1 tempest-FloatingIPsNegativeTestJSON-801188060 tempest-FloatingIPsNegativeTestJSON-801188060-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/3cc6a243-cdf2-4d6a-8b5c-446ded43ce51" status: 404 len: 111 microversion: 2.1 time: 0.054470 Dec 25 21:15:51.736139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1354/2603] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:15:51 2021] DELETE /compute/v2.1/os-floating-ips/3cc6a243-cdf2-4d6a-8b5c-446ded43ce51 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:15:51.861577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:51.862266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:51.878859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.879409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:51.880296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:51.880800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.145832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:52.161865 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f195ffa8-ad6d-4218-b838-6d893ec238e4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1474 microversion: 2.1 time: 0.305178 Dec 25 21:15:52.172722 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1355/2604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:51 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1474 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:52.178177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:52.180133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:52.187560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.188021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.188903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.189391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.233846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f472fc86-fc1f-4df8-b3f8-21561ef24b7f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "POST /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df/action" status: 202 len: 0 microversion: 2.1 time: 0.658889 Dec 25 21:15:52.234510 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1250/2605] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:51 2021] POST /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:15:52.236396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa9cb7fb-b71b-46ae-ab75-d36190101a62 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.061916 Dec 25 21:15:52.237077 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1356/2606] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:52 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:52.240438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:52.242006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:52.243100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:52.244134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:52.251863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.257211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.257211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.257211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.257786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.258343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.260709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.262165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.318256 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e6788f6-233c-4fa7-b8b9-118c64233bab tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.079496 Dec 25 21:15:52.318881 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1357/2607] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:52 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:52.324346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:52.328039 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:52.328039 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:52.329269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:52.330041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Searching by: {'deleted': False, 'project_id': '00414bfe9d194c88b02d9664fdeaa217'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:15:52.336363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.336996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.338158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.341929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.377499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:15:52.413509 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-869c21f5-3343-4a21-8528-0f9be75ea876 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.092777 Dec 25 21:15:52.414461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1358/2608] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:15:52 2021] GET /compute/v2.1/servers => generated 333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:52.431787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4ebd1f4-f7d3-4709-b647-a709162e0f89 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6e67b80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:52.485561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4ebd1f4-f7d3-4709-b647-a709162e0f89 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.063041 Dec 25 21:15:52.491361 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1359/2609] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:52 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:52.491982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:52.495463 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:52.495463 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:52.496566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:52.497449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Searching by: {'deleted': False, 'project_id': '00414bfe9d194c88b02d9664fdeaa217'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:15:52.503987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.504445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.505313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.505761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.541083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:15:52.616039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:52.626483 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2af5d7cf-e2dd-4dcc-8637-f44b4a491503 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.388624 Dec 25 21:15:52.627511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1251/2610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:52 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:52.632976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:52.633983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:52.636658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:52.645287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.645918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.656152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.657654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.663532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.663532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.950089 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13e96562-25e9-453f-ab75-bfe29873c119 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.461785 Dec 25 21:15:52.951367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1360/2611] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:15:52 2021] GET /compute/v2.1/servers/detail => generated 1697 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:52.955694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:52.967766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4681561d-123a-4630-bb2d-13dbdde6dc21 req-937240f7-fc2b-4228-a9b5-6f3c7501e48c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3308bcb1-0f06-470f-913d-ae09dfc92a3a", "name": "network-vif-unplugged", "status": "completed", "tag": "860d1670-d6af-4fc5-80bd-08f9b6582dac"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:52.972108 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:52.972108 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:52.981237 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fae6066d-c82f-4e85-998a-207ee2242ac9 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1468 microversion: 2.1 time: 0.352081 Dec 25 21:15:52.982077 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1252/2612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:52 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1468 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:52.992783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4681561d-123a-4630-bb2d-13dbdde6dc21 req-937240f7-fc2b-4228-a9b5-6f3c7501e48c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:52.992783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4681561d-123a-4630-bb2d-13dbdde6dc21 req-937240f7-fc2b-4228-a9b5-6f3c7501e48c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:52.999382 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4681561d-123a-4630-bb2d-13dbdde6dc21 req-937240f7-fc2b-4228-a9b5-6f3c7501e48c service nova] Creating event network-vif-unplugged:860d1670-d6af-4fc5-80bd-08f9b6582dac for instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a on nch2-master-1 Dec 25 21:15:53.004134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e2ad953-0f7e-4dc1-9b73-41f52f8c1053 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:53.008041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-4681561d-123a-4630-bb2d-13dbdde6dc21 req-937240f7-fc2b-4228-a9b5-6f3c7501e48c service nova] Instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a is migrating within the same cell, copying events to all relevant hosts: {'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:15:53.015581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e2ad953-0f7e-4dc1-9b73-41f52f8c1053 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018377 Dec 25 21:15:53.016596 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1253/2613] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:15:52 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:53.017223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4681561d-123a-4630-bb2d-13dbdde6dc21 req-937240f7-fc2b-4228-a9b5-6f3c7501e48c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053040 Dec 25 21:15:53.018215 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1361/2614] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:53.021006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:53.021731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.030173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.031661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.032666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.033853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.059038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lazy-loading 'flavor' on Instance uuid 25868382-2f4d-4138-bd58-4d8505ab944a {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:15:53.181371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:53.181371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.188085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.189270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.190164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.190618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.315728 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8dec94b8-051b-404f-969c-d976655fcd70 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a/action" status: 202 len: 0 microversion: 2.1 time: 0.297874 Dec 25 21:15:53.320350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1254/2615] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:53 2021] POST /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:15:53.328989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:53.329220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.343082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.354973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.355994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.357133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.425032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-192425eb-49e5-4965-8be2-ed8660f79c77 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.106435 Dec 25 21:15:53.425682 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1255/2616] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:53 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:53.434252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:53.434961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.445514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.446035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.446839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.448039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.448445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:53.458376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8e4b11a-5019-4b86-bd6a-c2e43f855cb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1471 microversion: 2.1 time: 0.282419 Dec 25 21:15:53.459008 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1362/2617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:53 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:53.481541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:53.482564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.488983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.489471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.490278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.490719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.549828 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9004e89d-83a4-45f1-9884-6e27566daca9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.078816 Dec 25 21:15:53.556624 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1363/2618] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:53 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:53.566312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:53.567000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.575841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.576375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.577329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.578066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.613065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:15:53.766619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:53.775406 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06f1a7ea-5587-4609-ade0-72cd24250a2c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1476 microversion: 2.1 time: 0.348449 Dec 25 21:15:53.776311 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1256/2619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:53 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:53.781081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:53.781601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:53.788536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.789224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.790283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:53.790718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:53.922853 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd8f375c-9aec-4eff-9fbc-4482df80cd19 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "DELETE /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 204 len: 0 microversion: 2.1 time: 0.357384 Dec 25 21:15:53.925781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1364/2620] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:15:53 2021] DELETE /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:15:53.935253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ff6a969-3b8a-4871-8ba5-6878f23d0736 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f70def70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:53.995316 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ff6a969-3b8a-4871-8ba5-6878f23d0736 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.068009 Dec 25 21:15:53.996012 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1365/2621] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:53 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:54.005483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:54.006157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:54.013055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.013448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.014253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.014699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.059466 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d172651d-ad86-440a-add2-242bead2ad04 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a/action" status: 204 len: 0 microversion: 2.1 time: 0.281805 Dec 25 21:15:54.060689 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1257/2622] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:53 2021] POST /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a/action => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:15:54.066448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:54.067394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:54.074987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.075840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.077013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.077678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.658300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:54.669626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:54.670530 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0274cb8d-a2b2-4f42-a27c-248e28a40dfb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1513 microversion: 2.1 time: 0.668698 Dec 25 21:15:54.680600 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1366/2623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:53 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1513 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:54.688308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:54.690319 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-098a715e-d7cc-4733-a3a1-c95bceafefbf tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1700 microversion: 2.1 time: 0.626262 Dec 25 21:15:54.692054 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1258/2624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:54 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1700 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:54.692217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:54.699503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:54.700773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:54.707501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.709323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.709323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.709541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.709685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.710697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.711517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.714666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.770373 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d411bf4b-b308-460d-977f-0453b5fa4ba2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.075116 Dec 25 21:15:54.771871 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1259/2625] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:54 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:54.777413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:54.784220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:54.788154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.789061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.790034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.790648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.855560 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-617c3591-97c5-4486-8587-1c2fcca0de5d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.081900 Dec 25 21:15:54.856417 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1260/2626] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:54 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:54.862427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:54.863351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:54.871326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.871781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.872568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:54.873037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:54.987603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:54.997700 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-47d64b0a-8126-47e1-a95c-f5a7ea721a3d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1471 microversion: 2.1 time: 0.315151 Dec 25 21:15:54.998669 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1367/2627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:54 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:55.012417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b129e07d-2d02-42c1-96af-63c8721adcae tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6e90160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:55.076857 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b129e07d-2d02-42c1-96af-63c8721adcae tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.072432 Dec 25 21:15:55.078719 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1368/2628] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:55 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:55.090277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8eefd275-aa77-4167-9040-9a67fcfd6614 req-7f2be8ca-c971-4a41-a2d2-3f9fc489ca6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "name": "network-vif-unplugged", "status": "completed", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:55.093178 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:55.093178 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:55.106101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8eefd275-aa77-4167-9040-9a67fcfd6614 req-7f2be8ca-c971-4a41-a2d2-3f9fc489ca6c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.107672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8eefd275-aa77-4167-9040-9a67fcfd6614 req-7f2be8ca-c971-4a41-a2d2-3f9fc489ca6c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:55.131041 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8eefd275-aa77-4167-9040-9a67fcfd6614 req-7f2be8ca-c971-4a41-a2d2-3f9fc489ca6c service nova] Creating event network-vif-unplugged:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:15:55.139264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8eefd275-aa77-4167-9040-9a67fcfd6614 req-7f2be8ca-c971-4a41-a2d2-3f9fc489ca6c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058285 Dec 25 21:15:55.140685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1369/2629] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:55.191468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:55.200961 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23cc5347-f40b-4d23-98bb-5ad62d0aea1c tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1459 microversion: 2.1 time: 0.343022 Dec 25 21:15:55.224375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1261/2630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:54 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1459 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:55.230593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:55.231542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:55.245074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.247876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:55.249346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.249984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:55.692746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:55.695198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:55.707177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.708073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:55.709307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.710540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:55.733899 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92230653-d612-4844-a929-5aff761c4340 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1610 microversion: 2.1 time: 0.507559 Dec 25 21:15:55.734533 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1370/2631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:55 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1610 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:55.745093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:55.745093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:55.746914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.747264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:55.748203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:55.748636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.040613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:56.043957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:56.050140 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-718027d1-d166-471c-b606-d7853a7e8884 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1519 microversion: 2.1 time: 0.364521 Dec 25 21:15:56.050729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1262/2632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:55 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1519 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:56.056840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e29c9134-177c-470b-8e1b-8bdf34f91611 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:56.058480 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:56.058480 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:56.060222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e29c9134-177c-470b-8e1b-8bdf34f91611 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.060685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e29c9134-177c-470b-8e1b-8bdf34f91611 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.061726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e29c9134-177c-470b-8e1b-8bdf34f91611 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.062165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e29c9134-177c-470b-8e1b-8bdf34f91611 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.062704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e972d54-393d-456f-a964-11a3f9a816f4 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1700 microversion: 2.1 time: 0.326961 Dec 25 21:15:56.063305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1371/2633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:55 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1700 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:56.068223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:56.070467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:56.077365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.077820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.078615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.079061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.088658 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e29c9134-177c-470b-8e1b-8bdf34f91611 tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036736 Dec 25 21:15:56.095208 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1263/2634] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:15:56 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:56.095208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:56.095498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:56.102303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.102699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.103504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.103945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.126857 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d3ce560-65f8-4a09-92ae-ea673e8cd62a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.061960 Dec 25 21:15:56.127527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1372/2635] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:56 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:56.134835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:56.136969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:56.143122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.143576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.144400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.144842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.149149 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3e7d760-6f73-48db-923c-ce2fe3298de0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.058518 Dec 25 21:15:56.154105 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1264/2636] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:56 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:56.160855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0bec848f-19c1-48ce-b73d-f3cda56c4601 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f628b550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:56.229993 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0bec848f-19c1-48ce-b73d-f3cda56c4601 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.073851 Dec 25 21:15:56.231127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1265/2637] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:56 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:56.236587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:56.238262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:56.245827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.250811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.250811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.250811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.304467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Lazy-loading 'flavor' on Instance uuid 25868382-2f4d-4138-bd58-4d8505ab944a {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:15:56.321451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 25868382-2f4d-4138-bd58-4d8505ab944a while it is in vm_state suspended Dec 25 21:15:56.322321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 25868382-2f4d-4138-bd58-4d8505ab944a while it is in vm_state suspended {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:15:56.323285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-612554ae-71fb-4c6c-ae73-31e7d4fd2ded tempest-LiveMigrationNegativeTest-763029880 tempest-LiveMigrationNegativeTest-763029880-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a/action" status: 409 len: 155 microversion: 2.1 time: 0.090968 Dec 25 21:15:56.324178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1266/2638] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:56 2021] POST /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a/action => generated 155 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:15:56.336625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:56.337802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:56.345553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.346275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.346466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:56.347531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.347993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.356269 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe7ed23a-be62-44b2-971c-d26afbb4a76b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1471 microversion: 2.1 time: 0.227041 Dec 25 21:15:56.360625 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1373/2639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:56 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1471 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:56.386399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:15:56.821294 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d12b01b3-4af7-4739-9309-189e10917674 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "DELETE /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 204 len: 0 microversion: 2.1 time: 0.488867 Dec 25 21:15:56.824290 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1267/2640] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:15:56 2021] DELETE /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:15:56.833612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:56.834400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:56.854344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.855308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:56.856673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:56.857646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.070391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:57.071474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:57.077696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:57.094288 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2218e83-3146-4d39-b702-9f208414dc03 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1465 microversion: 2.1 time: 0.264779 Dec 25 21:15:57.096623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.098256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.103075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.103824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.109048 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1374/2641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:56 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1465 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:15:57.119951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:57.120597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:57.138847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.140902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.142356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.145383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.327926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:57.343205 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca913573-99a8-4795-8ecc-de0dfd3feb42 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1632 microversion: 2.1 time: 0.232941 Dec 25 21:15:57.353669 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1375/2642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:57 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1632 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:57.360273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:57.361712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:57.374123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.379532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.379532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.379532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.435716 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eec58730-b607-4bd8-a588-322ac9fb69aa tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.079640 Dec 25 21:15:57.437586 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1376/2643] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:57 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:57.444983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:57.448146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:57.470542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.472495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.474587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.475041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.511346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:57.520091 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1dccee8-8cb5-40dc-ba38-14a49ffa8d7f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1519 microversion: 2.1 time: 0.456064 Dec 25 21:15:57.523260 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1268/2644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:57 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1519 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:57.532266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e07f53a3-170f-41f6-8ce2-66f108214029 req-5fec10a0-43c1-4f99-9e50-faac3b5e3284 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3308bcb1-0f06-470f-913d-ae09dfc92a3a", "name": "network-vif-plugged", "status": "completed", "tag": "860d1670-d6af-4fc5-80bd-08f9b6582dac"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:57.535415 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:57.535415 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:57.556587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e07f53a3-170f-41f6-8ce2-66f108214029 req-5fec10a0-43c1-4f99-9e50-faac3b5e3284 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.557570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e07f53a3-170f-41f6-8ce2-66f108214029 req-5fec10a0-43c1-4f99-9e50-faac3b5e3284 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.570918 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33315b3e-4308-4b2e-a185-5131289f4472 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.126805 Dec 25 21:15:57.571646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1377/2645] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:57 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:57.574663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e07f53a3-170f-41f6-8ce2-66f108214029 req-5fec10a0-43c1-4f99-9e50-faac3b5e3284 service nova] Creating event network-vif-plugged:860d1670-d6af-4fc5-80bd-08f9b6582dac for instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a on nch2-master-1 Dec 25 21:15:57.580475 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e07f53a3-170f-41f6-8ce2-66f108214029 req-5fec10a0-43c1-4f99-9e50-faac3b5e3284 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055213 Dec 25 21:15:57.581773 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1269/2646] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:57.587678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3f329b8f-52ff-468f-9032-d223b59e0982 req-0c111d9f-ef54-4912-a14f-aceab2d01959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06595622-92cb-4f87-bd0d-0320a9fc5d7e", "name": "network-vif-deleted", "tag": "00640242-8453-4c98-b5aa-a9ed148543ff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:57.589581 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:57.589581 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:57.591986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e443882e-a940-4051-bf78-e86b7a3409e5 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f7037430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:57.598603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3f329b8f-52ff-468f-9032-d223b59e0982 req-0c111d9f-ef54-4912-a14f-aceab2d01959 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.599366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3f329b8f-52ff-468f-9032-d223b59e0982 req-0c111d9f-ef54-4912-a14f-aceab2d01959 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.611292 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3f329b8f-52ff-468f-9032-d223b59e0982 req-0c111d9f-ef54-4912-a14f-aceab2d01959 service nova] Creating event network-vif-deleted:00640242-8453-4c98-b5aa-a9ed148543ff for instance 06595622-92cb-4f87-bd0d-0320a9fc5d7e on nch2-master-1 Dec 25 21:15:57.618686 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3f329b8f-52ff-468f-9032-d223b59e0982 req-0c111d9f-ef54-4912-a14f-aceab2d01959 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035396 Dec 25 21:15:57.619601 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1270/2647] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:57.626038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:57.627018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:57.634967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.635775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.637863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.637863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.701144 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e443882e-a940-4051-bf78-e86b7a3409e5 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.124807 Dec 25 21:15:57.702563 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1378/2648] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:57 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:57.800607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:57.813612 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-37867a95-40f8-4ebb-8c40-6d02a31ea414 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1463 microversion: 2.1 time: 0.189917 Dec 25 21:15:57.813612 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1271/2649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:57 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1463 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:57.829923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:57.831456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:57.840539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.841054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:57.841922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:57.842295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.026024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:58.034791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0aded593-beb7-4d2f-900f-9453ffc5dee5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1463 microversion: 2.1 time: 0.209570 Dec 25 21:15:58.045612 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1379/2650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:57 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:58.052290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9cf1b473-4063-43a4-a9e6-27881bce1703 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '.version_select at 0x7fa4f628e5e0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:58.056158 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-migrations:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:58.056158 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:15:58.058215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cf1b473-4063-43a4-a9e6-27881bce1703 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.059950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cf1b473-4063-43a4-a9e6-27881bce1703 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.074819 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9cf1b473-4063-43a4-a9e6-27881bce1703 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.025872 Dec 25 21:15:58.087283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1272/2651] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:15:58 2021] GET /compute/v2.1/os-migrations => generated 803 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:58.111497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-596bf78c-6cd0-41a6-9240-2268e52bacbe tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:58.118213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:58.123385 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-596bf78c-6cd0-41a6-9240-2268e52bacbe tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015438 Dec 25 21:15:58.124113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:58.125551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1380/2652] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:15:58 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:58.139148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c27540ec-3359-4211-b0b2-a7c2bba9e2d3 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1850190833", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:58.142114 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:58.142114 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:58.142371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.142716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.143726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.144337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.328542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c27540ec-3359-4211-b0b2-a7c2bba9e2d3 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.197005 Dec 25 21:15:58.329902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1381/2653] 10.222.0.32 () {60 vars in 1145 bytes} [Sat Dec 25 21:15:58 2021] POST /compute/v2.1/flavors => generated 499 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:15:58.340326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e322221a-41e1-4707-8346-0dc39349455f tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:58.363941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e322221a-41e1-4707-8346-0dc39349455f tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025103 Dec 25 21:15:58.367349 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1382/2654] 10.222.0.32 () {58 vars in 1181 bytes} [Sat Dec 25 21:15:58 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:15:58.392817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:58.393712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:58.411141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.412146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.414466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.416394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.430409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:58.454420 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ccb26fae-3209-40d2-8cdc-a837532d2bea tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1465 microversion: 2.1 time: 0.340365 Dec 25 21:15:58.467078 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1273/2655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:58 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1465 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:58.480374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:58.483527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:58.510147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.512278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.518140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.519154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.581866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.598101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.599676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lazy-loading 'fault' on Instance uuid 06595622-92cb-4f87-bd0d-0320a9fc5d7e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:15:58.653885 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b0550b0-b48b-48da-b772-8ba62135cc6f tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.185160 Dec 25 21:15:58.664178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1274/2656] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:58 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:58.675983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:58.677990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:58.702844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.703310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.704134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.704578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.742710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30652e6248664267895369366201816e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00414bfe9d194c88b02d9664fdeaa217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:58.754150 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a10a56f-0bc1-4444-9762-5e7253a65e3c tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 200 len: 1359 microversion: 2.1 time: 0.383735 Dec 25 21:15:58.765653 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1383/2657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:58 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 1359 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:58.779937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:58.781158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:58.799516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.799516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.799516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:58.799516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:58.883089 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dd294f5-0904-4eca-ac52-c6119636b16b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.108258 Dec 25 21:15:58.885836 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1384/2658] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:58 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:15:58.913588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-538888736", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "9c40a937-d17c-4d49-8252-ee02770105fd"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:58.998936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:15:59.207385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:15:59.221392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f0726bc6-9e1e-4ab3-a95c-da54117d8463 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1519 microversion: 2.1 time: 0.555453 Dec 25 21:15:59.225226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1275/2659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:58 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1519 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:59.236858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84cc4b6e-3e79-4c9d-a430-8114beda6e5e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500569280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:59.367395 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84cc4b6e-3e79-4c9d-a430-8114beda6e5e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.137877 Dec 25 21:15:59.369263 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1276/2660] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:15:59 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:15:59.485939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:15:59.490299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:59.510625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.512104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:59.514658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.515716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:59.516009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:15:59.523245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:15:59.524229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:15:59.527827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:15:59.527827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:15:59.554999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.559318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:59.577399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.578600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:59.606272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:15:59.613200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for user f9e59d219fa640e48533e0efdf150b16 and project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:15:59.631914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:15:59.635640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:15:59.790814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e87ce70a-6000-481a-a2f1-425e268250f9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900661 Dec 25 21:15:59.790814 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1385/2661] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:15:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:15:59.810591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0eeb72a2-43ce-4d3f-95c6-704385f8f2c4 req-68b76f86-2e8e-497e-923b-8fe41ca75b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d35b75-8e17-40b9-bfd2-615b2128e5df", "name": "network-vif-plugged", "status": "completed", "tag": "a8e1347c-d578-42de-9815-79469dc5aa48"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:59.812306 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:15:59.812306 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:15:59.856662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0eeb72a2-43ce-4d3f-95c6-704385f8f2c4 req-68b76f86-2e8e-497e-923b-8fe41ca75b91 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.862499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0eeb72a2-43ce-4d3f-95c6-704385f8f2c4 req-68b76f86-2e8e-497e-923b-8fe41ca75b91 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:59.884496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0eeb72a2-43ce-4d3f-95c6-704385f8f2c4 req-68b76f86-2e8e-497e-923b-8fe41ca75b91 service nova] Creating event network-vif-plugged:a8e1347c-d578-42de-9815-79469dc5aa48 for instance 59d35b75-8e17-40b9-bfd2-615b2128e5df on nch1-master-1 Dec 25 21:15:59.906191 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0eeb72a2-43ce-4d3f-95c6-704385f8f2c4 req-68b76f86-2e8e-497e-923b-8fe41ca75b91 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108754 Dec 25 21:15:59.920372 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1386/2662] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:15:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:15:59.920372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:15:59.920372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:15:59.974295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.974766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:15:59.976220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:15:59.976711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.031704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:00.052077 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03e698af-7105-4fec-8844-eefd7e43920d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1465 microversion: 2.1 time: 0.566605 Dec 25 21:16:00.053481 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1277/2663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:15:59 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1465 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:00.077849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:00.086293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] [instance: 06595622-92cb-4f87-bd0d-0320a9fc5d7e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:00.113361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.113821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.114763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.115067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.154392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c88f8de4-705c-43e3-9abf-3ffa6ee00168 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.238796 Dec 25 21:16:00.158901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1387/2664] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:15:59 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:00.174764 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] HTTP exception thrown: Instance 06595622-92cb-4f87-bd0d-0320a9fc5d7e could not be found. Dec 25 21:16:00.175626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Returning 404 to user: Instance 06595622-92cb-4f87-bd0d-0320a9fc5d7e could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:00.176655 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c305ce6a-8fa0-4ddd-9880-0bb7cf52f693 tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e" status: 404 len: 111 microversion: 2.1 time: 0.121902 Dec 25 21:16:00.176920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64cb248b-7991-4485-becf-85d4583231fd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:00.178776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1278/2665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:00 2021] GET /compute/v2.1/servers/06595622-92cb-4f87-bd0d-0320a9fc5d7e => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:00.185557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64cb248b-7991-4485-becf-85d4583231fd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:00.200986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:00.202459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:00.215927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.217459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.230332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.231485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.357718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64cb248b-7991-4485-becf-85d4583231fd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:00.368271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64cb248b-7991-4485-becf-85d4583231fd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1278 microversion: 2.1 time: 0.208065 Dec 25 21:16:00.369609 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1388/2666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:00 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:00.376951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-13cd767a-2aff-4edc-a042-74b3ed6ccad8 req-0a570ab1-5629-481e-a12c-b4f2c9bfa77b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25868382-2f4d-4138-bd58-4d8505ab944a", "name": "network-vif-deleted", "tag": "04b699b9-f328-49f3-bfd1-4302a65626c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:00.378967 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:00.378967 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:00.382661 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1bbf0736-1aae-45d0-9136-adb925e14b8c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.203678 Dec 25 21:16:00.392173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-13cd767a-2aff-4edc-a042-74b3ed6ccad8 req-0a570ab1-5629-481e-a12c-b4f2c9bfa77b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.392972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-13cd767a-2aff-4edc-a042-74b3ed6ccad8 req-0a570ab1-5629-481e-a12c-b4f2c9bfa77b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.396510 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1279/2667] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:00 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:00.408525 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-13cd767a-2aff-4edc-a042-74b3ed6ccad8 req-0a570ab1-5629-481e-a12c-b4f2c9bfa77b service nova] Creating event network-vif-deleted:04b699b9-f328-49f3-bfd1-4302a65626c8 for instance 25868382-2f4d-4138-bd58-4d8505ab944a on nch1-master-1 Dec 25 21:16:00.414253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-658ff717-ba17-4e5e-b472-78c6d7e80acd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] Calling method '.version_select at 0x7fa50073b700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:00.416034 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-13cd767a-2aff-4edc-a042-74b3ed6ccad8 req-0a570ab1-5629-481e-a12c-b4f2c9bfa77b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044930 Dec 25 21:16:00.417362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1389/2668] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:00.423377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:00.424160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:00.458932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.459977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.460760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:00.464968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:00.568337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-658ff717-ba17-4e5e-b472-78c6d7e80acd tempest-ServersTestJSON-45643402 tempest-ServersTestJSON-45643402-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137071604" status: 202 len: 0 microversion: 2.1 time: 0.173187 Dec 25 21:16:00.578291 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1280/2669] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:16:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137071604 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:16:00.596502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b726001-65ef-4238-8940-17b8e411b0c4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500761a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:00.716495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b726001-65ef-4238-8940-17b8e411b0c4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.132589 Dec 25 21:16:00.726385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1281/2670] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:00 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:00.770748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:00.779900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5b64ab6-6aad-4033-a353-fa8159963fb9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1519 microversion: 2.1 time: 0.360963 Dec 25 21:16:00.790295 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1390/2671] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:00 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:00.972092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50298396-de00-4032-8895-7fcdfbb8dd49 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] 10.222.0.32 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.244242 Dec 25 21:16:00.972646 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1282/2672] 10.222.0.32 () {58 vars in 1127 bytes} [Sat Dec 25 21:16:00 2021] DELETE /compute/v2.1/images/ => generated 112 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 25 21:16:00.991350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c981157-9296-4d8b-b36d-944b2c45af44 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Calling method '.version_select at 0x7fa4f6a1bc10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.019259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5c981157-9296-4d8b-b36d-944b2c45af44 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] HTTP exception thrown: Image not found. Dec 25 21:16:01.020085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c981157-9296-4d8b-b36d-944b2c45af44 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:01.021353 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c981157-9296-4d8b-b36d-944b2c45af44 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] 10.222.0.32 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.041934 Dec 25 21:16:01.022158 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1391/2673] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:16:00 2021] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:16:01.031270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-287d84eb-eff2-4958-8be2-f40f52fa453a tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Calling method '.version_select at 0x7fa4f62af9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.070334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.076046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:01.090794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.092331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.093716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.093950 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-287d84eb-eff2-4958-8be2-f40f52fa453a tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] HTTP exception thrown: Image not found. Dec 25 21:16:01.094562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-287d84eb-eff2-4958-8be2-f40f52fa453a tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:01.094866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.095393 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-287d84eb-eff2-4958-8be2-f40f52fa453a tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] 10.222.0.32 "DELETE /compute/v2.1/images/4bf5bdac-d71c-420f-8bb2-bce66615e82j" status: 404 len: 62 microversion: 2.1 time: 0.067868 Dec 25 21:16:01.101116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1283/2674] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:01 2021] DELETE /compute/v2.1/images/4bf5bdac-d71c-420f-8bb2-bce66615e82j => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:16:01.107845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b968474-9f6e-4821-9bff-0a049bd9d1b0 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Calling method '.version_select at 0x7fa4f62af670>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.127249 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-8b968474-9f6e-4821-9bff-0a049bd9d1b0 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] HTTP exception thrown: Image not found. Dec 25 21:16:01.128237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b968474-9f6e-4821-9bff-0a049bd9d1b0 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:01.129853 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b968474-9f6e-4821-9bff-0a049bd9d1b0 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] 10.222.0.32 "DELETE /compute/v2.1/images/a76ef4ce-a25b-494f-9e19-8b9dc040d2241" status: 404 len: 62 microversion: 2.1 time: 0.026832 Dec 25 21:16:01.138888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1284/2675] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:01 2021] DELETE /compute/v2.1/images/a76ef4ce-a25b-494f-9e19-8b9dc040d2241 => generated 62 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:16:01.150677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ba69430-b7c3-45a0-bf50-70c14d4780c5 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Calling method '.version_select at 0x7fa4f62af550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.158518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.159080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.159591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lazy-loading 'fault' on Instance uuid 25868382-2f4d-4138-bd58-4d8505ab944a {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:16:01.196044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9ba69430-b7c3-45a0-bf50-70c14d4780c5 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] HTTP exception thrown: Image not found. Dec 25 21:16:01.201945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ba69430-b7c3-45a0-bf50-70c14d4780c5 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:01.201945 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ba69430-b7c3-45a0-bf50-70c14d4780c5 tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] 10.222.0.32 "DELETE /compute/v2.1/images/tempest-invalid-712313720" status: 404 len: 62 microversion: 2.1 time: 0.055768 Dec 25 21:16:01.201945 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1285/2676] 10.222.0.32 () {58 vars in 1202 bytes} [Sat Dec 25 21:16:01 2021] DELETE /compute/v2.1/images/tempest-invalid-712313720 => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:16:01.206497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:01.207619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:01.215049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.215623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.216448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.217206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.273254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:01.284692 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f675cce-3132-4aac-850f-bac4996deaa8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.085037 Dec 25 21:16:01.286094 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1286/2677] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:01 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:01.286681 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0db8854d-510d-4f2b-baf9-fae42b8f142e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 200 len: 1308 microversion: 2.1 time: 0.220877 Dec 25 21:16:01.288392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1392/2678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:01 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:01.304735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e209b2c-1a38-4511-a9ef-c6d6162ad5dd tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Calling method '.version_select at 0x7fa50059a820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.330814 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3e209b2c-1a38-4511-a9ef-c6d6162ad5dd tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] HTTP exception thrown: Image not found. Dec 25 21:16:01.331430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e209b2c-1a38-4511-a9ef-c6d6162ad5dd tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:01.332297 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e209b2c-1a38-4511-a9ef-c6d6162ad5dd tempest-ImagesDeleteNegativeTestJSON-148546687 tempest-ImagesDeleteNegativeTestJSON-148546687-project] 10.222.0.32 "DELETE /compute/v2.1/images/000035b3-2cbd-481f-a484-bcb66b1c1efa" status: 404 len: 62 microversion: 2.1 time: 0.033204 Dec 25 21:16:01.332917 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1287/2679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:01 2021] DELETE /compute/v2.1/images/000035b3-2cbd-481f-a484-bcb66b1c1efa => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:16:01.385861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.386873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:01.396139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:01.398376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.400910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.401895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.405788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.408280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:01.431676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.432784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.433907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.436673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.508449 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fed178e6-0b51-4a65-8117-5c767cc56f31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.117630 Dec 25 21:16:01.512314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1288/2680] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:01 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:16:01.574580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:01.587060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53ce851b-e420-43f6-b35c-f651b78462dd tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1282 microversion: 2.1 time: 0.205327 Dec 25 21:16:01.588728 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1393/2681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:01 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:01.730527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-96d990e2-927e-4e58-862f-6a421e0a1b47 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f62a7a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.801003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:01.801737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:01.825366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.825507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-96d990e2-927e-4e58-862f-6a421e0a1b47 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.098024 Dec 25 21:16:01.830638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.830896 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1289/2682] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:01 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:01.831011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.831011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:01.967006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-82533f1f-6d16-456b-84e5-91a07d965cfd req-977c271b-ec1b-464e-a5ac-f2bc09172a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfb31ab-a5a4-4386-b5bd-77f172344909", "name": "network-vif-plugged", "status": "completed", "tag": "4353b31a-16ab-4050-acd0-9548832705a6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:01.969161 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:01.969161 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:01.988238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-82533f1f-6d16-456b-84e5-91a07d965cfd req-977c271b-ec1b-464e-a5ac-f2bc09172a69 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:01.988851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-82533f1f-6d16-456b-84e5-91a07d965cfd req-977c271b-ec1b-464e-a5ac-f2bc09172a69 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.013405 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-82533f1f-6d16-456b-84e5-91a07d965cfd req-977c271b-ec1b-464e-a5ac-f2bc09172a69 service nova] Creating event network-vif-plugged:4353b31a-16ab-4050-acd0-9548832705a6 for instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 on nch1-master-1 Dec 25 21:16:02.027351 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-82533f1f-6d16-456b-84e5-91a07d965cfd req-977c271b-ec1b-464e-a5ac-f2bc09172a69 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066940 Dec 25 21:16:02.035866 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1290/2683] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Dec 25 21:16:02.080319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:02.090096 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd9cfd7a-cc98-4d51-95c5-98329de9e8ec tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1519 microversion: 2.1 time: 0.296873 Dec 25 21:16:02.109933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1394/2684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:01 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1519 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:02.297917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:02.299846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:02.309526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:02.311571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.312389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: 25868382-2f4d-4138-bd58-4d8505ab944a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:02.314019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.316585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.317275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.325625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.331412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.336862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.337642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.368269 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] HTTP exception thrown: Instance 25868382-2f4d-4138-bd58-4d8505ab944a could not be found. Dec 25 21:16:02.369786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Returning 404 to user: Instance 25868382-2f4d-4138-bd58-4d8505ab944a could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:02.370941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f423f20-510b-494c-9557-2c1326986458 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a" status: 404 len: 111 microversion: 2.1 time: 0.070836 Dec 25 21:16:02.371797 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1395/2685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:02 2021] GET /compute/v2.1/servers/25868382-2f4d-4138-bd58-4d8505ab944a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:02.379474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:02.380246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:02.388501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6c528e6-433a-4136-9080-bad6b065b723 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.094429 Dec 25 21:16:02.390249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.391783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.392491 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1291/2686] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:02 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:02.393907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.394524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.422493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:16:02.521557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:02.523110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:02.549755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.550949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.553109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.553955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.629216 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61b58dbd-ce4f-48e8-a294-f996247e9187 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.111542 Dec 25 21:16:02.632373 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1292/2687] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:02 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:02.639341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:02.640342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:02.651473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.653454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.655578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.655578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.795241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:02.802200 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd37686a-29ea-4ce3-a952-88ce593ef58d tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 204 len: 0 microversion: 2.1 time: 0.426134 Dec 25 21:16:02.805663 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1396/2688] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:02 2021] DELETE /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:02.805832 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6bc1593-a875-4d45-a9d5-57d141660d96 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1338 microversion: 2.1 time: 0.169533 Dec 25 21:16:02.813731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:02.814456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:02.818467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1293/2689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:02 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1338 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:02.826323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.826798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.828061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:02.828506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:02.838431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a08589ce-311b-4790-bfeb-b1c5cfcfdebb tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50052a550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:02.901791 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a08589ce-311b-4790-bfeb-b1c5cfcfdebb tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.067572 Dec 25 21:16:02.902664 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1294/2690] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:02 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:03.074837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:03.086185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a270234c-90a6-43f0-94c4-f34e92db30b5 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1475 microversion: 2.1 time: 0.276898 Dec 25 21:16:03.088847 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1397/2691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:02 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1475 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:03.108279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:03.109034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:03.130879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.132187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.133053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.140638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.303833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:03.313885 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc38056c-fff8-4859-ace8-b5d6937d4835 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1519 microversion: 2.1 time: 0.210423 Dec 25 21:16:03.314464 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1295/2692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:03 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:03.417151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:03.418251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:03.424701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.428866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.431737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.433844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.504732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1b77518-baa3-4722-a7f6-4f1a7c75679a tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.097546 Dec 25 21:16:03.509436 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1398/2693] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:03 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:03.648387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:03.651000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:03.661093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.662894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.664087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.664841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.717086 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0b1b73f-5b2d-4bbc-bd07-609f833fdb68 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.078677 Dec 25 21:16:03.717808 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1296/2694] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:03 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:03.821646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:03.822351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:03.830367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.830752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.831530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:03.831968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:03.897689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:03.906094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-203040dc-4436-4c9b-9bbc-9e5328d1c153 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1336 microversion: 2.1 time: 0.088602 Dec 25 21:16:03.906804 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1399/2695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:03 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1336 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:03.916146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7760ef2-bd4e-4cfa-b74f-edbf9ad8cb95 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f62a7310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:03.960836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7760ef2-bd4e-4cfa-b74f-edbf9ad8cb95 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.049431 Dec 25 21:16:03.961425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1297/2696] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:03 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:04.104853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:04.105468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:04.112444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.112929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.113717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.114158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.289646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:04.300751 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98163f16-0dd9-4426-af77-a97cd1c10171 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1475 microversion: 2.1 time: 0.199316 Dec 25 21:16:04.310108 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1400/2697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:04 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1475 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:04.332265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:04.333441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:04.340041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.340492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.341490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.341929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.522324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:04.524082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:04.549208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.549663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.554846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.555311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.733983 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe29b29b-98d6-482e-8793-21f177b6af9e tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.221680 Dec 25 21:16:04.734660 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1401/2698] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:04 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:04.758081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:04.782864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:04.843044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.847524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.848386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:04.854691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:04.989867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-530e96ac-9b3f-4e49-890b-1333cf774433 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.236330 Dec 25 21:16:04.991516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1402/2699] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:04 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:05.001762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:05.009911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:05.028564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.029213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.030122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.030659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.063637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:05.081096 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71c17989-8899-4eeb-9042-ee199bf6adc9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1504 microversion: 2.1 time: 0.751215 Dec 25 21:16:05.086261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1298/2700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:04 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1504 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:05.093455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-679f3081-1ff9-4609-bcb8-1a1b2db4c599 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa5005d4e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:05.184414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-679f3081-1ff9-4609-bcb8-1a1b2db4c599 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.094417 Dec 25 21:16:05.196095 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1299/2701] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:05 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:05.204791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:05.219426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:05.235810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.236265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.237298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.237907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.594324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:05.604163 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfd67560-f0c9-44e6-8025-5ce0d33fe04d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 0.608278 Dec 25 21:16:05.608901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1403/2702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:04 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:05.611311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:05.620672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:05.622609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:05.627104 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3b6b2eb-f0fc-4980-838d-27a03efc6f23 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 200 len: 1504 microversion: 2.1 time: 0.425352 Dec 25 21:16:05.627752 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1300/2703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:05 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 1504 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:05.637556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.638874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.648608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:05.651939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:05.652153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.652321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.663650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.664472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.665701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:05.670107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:05.716448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:16:06.158398 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c25fefe-f07a-40be-bc21-2e5ba2794997 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 204 len: 0 microversion: 2.1 time: 0.514134 Dec 25 21:16:06.163542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41b30a9fab164735bfb1d19a83b66ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fe1a82960c8413095a4b833950e8b3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:06.206765 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1301/2704] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:05 2021] DELETE /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:06.206765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:06.208120 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e81e2ca-6214-4b45-8692-df2784ac953e tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 200 len: 1475 microversion: 2.1 time: 0.587825 Dec 25 21:16:06.208120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1404/2705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:05 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 1475 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:06.208714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:06.211854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:06.215104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:06.218317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.222207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:06.225400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.226243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:06.231386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.235532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:06.249101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.251355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:06.307193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e200dfd8-880a-4c67-a29a-0b07faf7a341 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 32625 microversion: 2.1 time: 0.118947 Dec 25 21:16:06.312381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1302/2706] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:06 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 32625 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:06.334277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0fd675f3-532d-4723-9ef5-0ae665f42069 req-b641ac3e-1cd2-411f-bdab-67247fe261d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36ba04e-35fa-4f08-b691-833f273a7ec4", "name": "network-vif-deleted", "tag": "1cafd266-4160-4e86-8dbb-b90af90eeb70"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:06.336179 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:06.336179 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:06.357865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0fd675f3-532d-4723-9ef5-0ae665f42069 req-b641ac3e-1cd2-411f-bdab-67247fe261d1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.361160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0fd675f3-532d-4723-9ef5-0ae665f42069 req-b641ac3e-1cd2-411f-bdab-67247fe261d1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:06.361757 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e37220f-d920-4ac0-ae1c-12d0fd652052 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.160371 Dec 25 21:16:06.363226 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1405/2707] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:06 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:06.376617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea2ae4db-1cc0-4e7e-bd1d-ea95f1533c97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f70860d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:06.413700 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0fd675f3-532d-4723-9ef5-0ae665f42069 req-b641ac3e-1cd2-411f-bdab-67247fe261d1 service nova] Creating event network-vif-deleted:1cafd266-4160-4e86-8dbb-b90af90eeb70 for instance e36ba04e-35fa-4f08-b691-833f273a7ec4 on nch2-master-1 Dec 25 21:16:06.424423 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0fd675f3-532d-4723-9ef5-0ae665f42069 req-b641ac3e-1cd2-411f-bdab-67247fe261d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110284 Dec 25 21:16:06.428727 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1303/2708] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:06.445919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-883995725", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "597fae95-d9e4-466a-853c-7cbb09218bf0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:06.458175 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea2ae4db-1cc0-4e7e-bd1d-ea95f1533c97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.093123 Dec 25 21:16:06.466131 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1406/2709] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:06 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:06.525804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] validate_networks() for [('597fae95-d9e4-466a-853c-7cbb09218bf0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:06.625703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:06.626688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:06.643445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.645954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:06.647026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:06.658476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:07.886902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:07.900335 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aed8bd59-6638-4099-bb64-73e587d7db9e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 1.279237 Dec 25 21:16:07.901262 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1407/2710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:06 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:07.913412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:07.914570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] [instance: e36ba04e-35fa-4f08-b691-833f273a7ec4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:07.959420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:07.960312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:07.961616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:07.962287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:07.990142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] HTTP exception thrown: Instance e36ba04e-35fa-4f08-b691-833f273a7ec4 could not be found. Dec 25 21:16:07.997076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] Returning 404 to user: Instance e36ba04e-35fa-4f08-b691-833f273a7ec4 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:07.998088 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d273540-a43a-4aca-95c9-fdf7f6116499 tempest-LiveMigrationNegativeTest-1846926095 tempest-LiveMigrationNegativeTest-1846926095-project] 10.222.0.32 "GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4" status: 404 len: 111 microversion: 2.1 time: 0.095146 Dec 25 21:16:07.998770 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1408/2711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:07 2021] GET /compute/v2.1/servers/e36ba04e-35fa-4f08-b691-833f273a7ec4 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:08.010086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1999c5db-0640-4917-83ec-5d5be4c148db req-eff7df02-1de2-46d5-87fe-6c151e56dcdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:08.016048 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:08.016048 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:08.043131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1999c5db-0640-4917-83ec-5d5be4c148db req-eff7df02-1de2-46d5-87fe-6c151e56dcdc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.043680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1999c5db-0640-4917-83ec-5d5be4c148db req-eff7df02-1de2-46d5-87fe-6c151e56dcdc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.072816 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1999c5db-0640-4917-83ec-5d5be4c148db req-eff7df02-1de2-46d5-87fe-6c151e56dcdc service nova] Creating event network-changed:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch2-master-1 Dec 25 21:16:08.086873 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1999c5db-0640-4917-83ec-5d5be4c148db req-eff7df02-1de2-46d5-87fe-6c151e56dcdc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076444 Dec 25 21:16:08.088018 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1409/2712] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:08.094169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:08.095340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:08.110814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.114220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.115192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.119381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.194165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60ac06ce-b41e-4841-98cf-bc02aa02a100 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action" status: 200 len: 40783 microversion: 2.1 time: 0.104447 Dec 25 21:16:08.195277 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1410/2713] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:08 2021] POST /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5/action => generated 40783 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:08.220960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:08.222439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:08.230803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.231622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.232710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.233411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.305061 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0be2df71-5cf1-496e-b937-3e3170b33437 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.093340 Dec 25 21:16:08.306646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1411/2714] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:08 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:08.313928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-beed0eaa-70ac-4bb3-8e62-2814f81b1e65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6989040>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:08.400038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-beed0eaa-70ac-4bb3-8e62-2814f81b1e65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.091041 Dec 25 21:16:08.401014 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1412/2715] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:08 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:08.633629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:08.634131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:08.634527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:08.634943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:08.635363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:08.655506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.661162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.662799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:08.663318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:08.709322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Getting quotas for project 27d474dfd37c46f0aa14aa84e8b3ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:08.717635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Getting quotas for user 819fcdf5d86a46399dfb7343639f3ea6 and project 27d474dfd37c46f0aa14aa84e8b3ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:08.745702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:08.757833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:08.898136 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb7b1e80-90f3-4419-b9ad-f94acbc99c61 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.466941 Dec 25 21:16:08.900282 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1304/2716] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:08.935016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ba220fa-4747-410a-ba60-f518f6a6dcf1 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:08.938786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2ba220fa-4747-410a-ba60-f518f6a6dcf1 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:08.950664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:08.951309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:09.005815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.005815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.005815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.005815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.180770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2ba220fa-4747-410a-ba60-f518f6a6dcf1 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:09.190668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ba220fa-4747-410a-ba60-f518f6a6dcf1 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1217 microversion: 2.1 time: 0.281966 Dec 25 21:16:09.192482 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1413/2717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:08 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1217 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:09.206268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:09.216298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:09.228441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.230674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.232136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.232667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.297552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:16:09.668109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:09.679980 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6dc2df1-0923-4789-890e-d5eef940f35e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 0.756434 Dec 25 21:16:09.692648 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1305/2718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:08 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:09.701552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:09.703322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:09.710824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.711548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.712984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.713597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.768381 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9790b45-5a00-40c9-b933-6cfaf6746778 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "DELETE /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 204 len: 0 microversion: 2.1 time: 0.574567 Dec 25 21:16:09.773717 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1414/2719] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:09 2021] DELETE /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:09.777653 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-661a93d8-99df-4faa-9804-ff816f730f88 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.081951 Dec 25 21:16:09.781893 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1306/2720] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:09 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:09.782069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82323b20-36ea-47a5-bc9b-3558f8c112eb tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6dc1e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:09.788269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-db58fd7e-1152-4a5e-ab6d-eeafef5a4aaf req-f565d271-6513-4f47-9f68-f1ee1dbdbd79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfb31ab-a5a4-4386-b5bd-77f172344909", "name": "network-vif-deleted", "tag": "4353b31a-16ab-4050-acd0-9548832705a6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:09.790196 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:09.790196 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:09.800097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-db58fd7e-1152-4a5e-ab6d-eeafef5a4aaf req-f565d271-6513-4f47-9f68-f1ee1dbdbd79 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.801059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-db58fd7e-1152-4a5e-ab6d-eeafef5a4aaf req-f565d271-6513-4f47-9f68-f1ee1dbdbd79 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.814495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-db58fd7e-1152-4a5e-ab6d-eeafef5a4aaf req-f565d271-6513-4f47-9f68-f1ee1dbdbd79 service nova] Creating event network-vif-deleted:4353b31a-16ab-4050-acd0-9548832705a6 for instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 on nch1-master-1 Dec 25 21:16:09.820595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-db58fd7e-1152-4a5e-ab6d-eeafef5a4aaf req-f565d271-6513-4f47-9f68-f1ee1dbdbd79 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036738 Dec 25 21:16:09.824445 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1307/2721] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:09.830798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:09.836150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:09.840603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.841319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.842290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:09.842904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:09.894034 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82323b20-36ea-47a5-bc9b-3558f8c112eb tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.122308 Dec 25 21:16:09.899207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1415/2722] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:09 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:10.100485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:10.117130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2128d28e-f3f4-448d-9272-904b05a695e2 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1665 microversion: 2.1 time: 0.287754 Dec 25 21:16:10.117130 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1308/2723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:09 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1665 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:10.207879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a301c23e-c831-4c23-9369-d540228f5a4a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:10.208651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a301c23e-c831-4c23-9369-d540228f5a4a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:10.326238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a301c23e-c831-4c23-9369-d540228f5a4a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:10.339901 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a301c23e-c831-4c23-9369-d540228f5a4a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1217 microversion: 2.1 time: 0.136057 Dec 25 21:16:10.341922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1309/2724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:10 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:10.506034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1028097", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "979f5e3f-5f36-45e3-b799-ae422a7efba5"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:10.576236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] validate_networks() for [('979f5e3f-5f36-45e3-b799-ae422a7efba5', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:10.700804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:10.701619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:10.715083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:10.715569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:10.721079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:10.739229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.060058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:11.082217 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0313c833-9629-47fa-932c-e7f72586c39f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 0.387046 Dec 25 21:16:11.083238 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1310/2725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:10 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:11.100347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:11.106902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:11.126502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.127071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.127876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.128317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.227143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f4528bbf-ca6f-470e-ad01-6bb2ca94d9d1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.130857 Dec 25 21:16:11.228399 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1311/2726] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:11 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:11.234736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c499ced-7087-475d-b3f1-57476c51955f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6242310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:11.299164 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c499ced-7087-475d-b3f1-57476c51955f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.069215 Dec 25 21:16:11.300419 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1312/2727] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:11 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:11.313772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:11.315178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:11.323342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.324031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.324998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.325520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.444320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:11.444754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:11.445638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:11.446285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:11.446875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:11.461659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.462415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.463835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.464985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.488568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:11.504068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for user e7c7a9d6618448c9a5ade71c13a1758d and project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:11.533167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:11.547516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:11.667689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:11.686740 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35d29428-b4d8-4a3c-97de-9fa04fc65bb3 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1665 microversion: 2.1 time: 0.381302 Dec 25 21:16:11.697691 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1313/2728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:11 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1665 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:11.711029 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8cc0a8ac-44de-4926-84dd-e659a51e9f39 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.795545 Dec 25 21:16:11.713234 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1416/2729] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:11.726049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:11.726868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:11.729416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7684642-78c8-4d00-8964-5445bbaf3b9c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:11.731855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7684642-78c8-4d00-8964-5445bbaf3b9c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:11.773535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.779337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.780281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:11.780736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:11.886192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7684642-78c8-4d00-8964-5445bbaf3b9c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:11.898975 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7684642-78c8-4d00-8964-5445bbaf3b9c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1222 microversion: 2.1 time: 0.180867 Dec 25 21:16:11.900700 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1417/2730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:11 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1222 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:11.912696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:11.925417 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8440cc92-8fb5-427d-9774-29f931b4b175 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1277 microversion: 2.1 time: 0.225586 Dec 25 21:16:11.933464 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1314/2731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:11 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:12.105275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:12.106233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:12.113642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:12.117487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:12.117487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:12.117487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:12.239783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:12.240905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:12.247045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:12.247598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:12.248463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:12.249004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:12.249548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:12.257190 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54ca645d-9da5-4180-838c-61b61930b49f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 0.157449 Dec 25 21:16:12.257758 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1418/2732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:12 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:12.291176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b5a2816-9d58-469f-96a7-f038e62aea9b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.055069 Dec 25 21:16:12.292027 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1315/2733] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:12 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:16:12.313835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d52e2c0d-39f8-4863-b514-339581102776 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6ea8f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:12.438339 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d52e2c0d-39f8-4863-b514-339581102776 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.126005 Dec 25 21:16:12.438339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1419/2734] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:12 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:12.705578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:12.706525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:12.741328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:12.741328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:12.741328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:12.741328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:12.920706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-610dc47f-f8ca-4063-bf86-a81a45b81dee tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:12.920706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-610dc47f-f8ca-4063-bf86-a81a45b81dee tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:12.973521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:12.987414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1ad99c98-9c6b-4144-8ba9-2fbe45d8e497 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1598 microversion: 2.1 time: 0.285953 Dec 25 21:16:12.989778 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1316/2735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:12 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1598 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:13.009219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:13.012518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:13.047136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.049795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.052949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.067115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.152902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-610dc47f-f8ca-4063-bf86-a81a45b81dee tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:13.168980 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-610dc47f-f8ca-4063-bf86-a81a45b81dee tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1222 microversion: 2.1 time: 0.257261 Dec 25 21:16:13.169585 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1420/2736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:12 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:13.210612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-cd2e0f6d-07f9-488e-bb76-c42363e69e19 req-6b33c36b-4a75-4ded-8bcd-4b0fce37859a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23221387-3a9d-4105-b3db-d1586e20d8a5", "name": "network-vif-deleted", "tag": "0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:13.212857 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:13.212857 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:13.227206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cd2e0f6d-07f9-488e-bb76-c42363e69e19 req-6b33c36b-4a75-4ded-8bcd-4b0fce37859a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.233015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cd2e0f6d-07f9-488e-bb76-c42363e69e19 req-6b33c36b-4a75-4ded-8bcd-4b0fce37859a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.296343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cd2e0f6d-07f9-488e-bb76-c42363e69e19 req-6b33c36b-4a75-4ded-8bcd-4b0fce37859a service nova] Creating event network-vif-deleted:0dd3bc1f-1fb5-4e1c-b9d7-78a069b36fb2 for instance 23221387-3a9d-4105-b3db-d1586e20d8a5 on nch2-master-1 Dec 25 21:16:13.320913 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-cd2e0f6d-07f9-488e-bb76-c42363e69e19 req-6b33c36b-4a75-4ded-8bcd-4b0fce37859a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130784 Dec 25 21:16:13.324067 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1421/2737] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:13.353257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:13.359743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:13.402206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.403534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.405149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.407511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.673616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:13.706029 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b60daf8b-d827-4bbb-b9c6-51110cf47331 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1317 microversion: 2.1 time: 0.714345 Dec 25 21:16:13.712520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1317/2738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:12 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1317 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:13.715531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:13.717220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:13.725780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.726530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.727539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:13.728159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:13.780998 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27bfae4f-ed79-433c-8003-d4202cea5581 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.072229 Dec 25 21:16:13.783508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1318/2739] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:13 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:13.788905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f20e181f-2368-4dbc-84c9-3bc3e2fbfa75 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f751f280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:13.868604 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f20e181f-2368-4dbc-84c9-3bc3e2fbfa75 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.081308 Dec 25 21:16:13.868604 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1319/2740] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:13 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:13.935647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:13.944030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d3fd377-5d83-4a22-a270-c7be7508eba4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 0.614461 Dec 25 21:16:13.957357 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1422/2741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:13 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:14.007194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:14.008927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:14.025923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.025923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.026349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.026911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.107131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.107588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.109800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lazy-loading 'fault' on Instance uuid 23221387-3a9d-4105-b3db-d1586e20d8a5 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:16:14.188488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:14.189460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:14.207219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.208356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.210519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.212156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.304761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d55f68c111b4a388351c18551dd43ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5ed5c4fc23d460e8d63226986b549bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:14.315989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44ed33fe-9e3f-4db1-b904-d48e6f5876fd tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 200 len: 1316 microversion: 2.1 time: 0.313220 Dec 25 21:16:14.327326 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1320/2742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:14 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:14.339201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:14.349418 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-29885243-6e31-4d48-901b-874c8d98c6de tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1218 microversion: 2.1 time: 0.166909 Dec 25 21:16:14.360122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1423/2743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:14 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:14.727487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:14.728383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:14.739345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.740055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.743285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.744470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.801087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:14.801087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:14.812977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.814562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.816023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:14.819244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:14.949071 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26c3a77f-2c1b-44f6-a1d9-f8735a6a6824 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.157887 Dec 25 21:16:14.953260 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1424/2744] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:14 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:14.970524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd2303b6-7382-4d51-929f-0fa8093efadd tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6a660d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:15.070271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd2303b6-7382-4d51-929f-0fa8093efadd tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.114240 Dec 25 21:16:15.076410 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1425/2745] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:14 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:15.081460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:15.082758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:15.091369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.092215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.093327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.094008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.160986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:15.175005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd402198-74ce-48e8-82b8-19c098e6b7bc tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1317 microversion: 2.1 time: 0.453353 Dec 25 21:16:15.176327 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1321/2746] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:14 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1317 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:15.193831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-757502a5-b030-418b-a43b-d356bad2653e req-6cf22304-a96a-41a2-a704-da5f6b75abc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "name": "network-vif-plugged", "status": "completed", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:15.222167 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:15.222167 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:15.233342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-757502a5-b030-418b-a43b-d356bad2653e req-6cf22304-a96a-41a2-a704-da5f6b75abc1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.234142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-757502a5-b030-418b-a43b-d356bad2653e req-6cf22304-a96a-41a2-a704-da5f6b75abc1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.250799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-757502a5-b030-418b-a43b-d356bad2653e req-6cf22304-a96a-41a2-a704-da5f6b75abc1 service nova] Creating event network-vif-plugged:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch2-master-1 Dec 25 21:16:15.260032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-757502a5-b030-418b-a43b-d356bad2653e req-6cf22304-a96a-41a2-a704-da5f6b75abc1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082190 Dec 25 21:16:15.260916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1322/2747] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:15.346181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:15.347229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] [instance: 23221387-3a9d-4105-b3db-d1586e20d8a5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:15.372243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.373599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.377550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.378004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.454156 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] HTTP exception thrown: Instance 23221387-3a9d-4105-b3db-d1586e20d8a5 could not be found. Dec 25 21:16:15.468402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Returning 404 to user: Instance 23221387-3a9d-4105-b3db-d1586e20d8a5 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:15.473809 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f14dbd8-4326-4af9-9cfe-c955e070b6b8 tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5" status: 404 len: 111 microversion: 2.1 time: 0.129878 Dec 25 21:16:15.478320 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1323/2748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:15 2021] GET /compute/v2.1/servers/23221387-3a9d-4105-b3db-d1586e20d8a5 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:15.498704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:15.505156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:15.542118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.543004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.545445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:15.545900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:15.854844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:15.868472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:15.874716 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b8f567d-f740-49c8-8ad2-e596d3196e21 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1292 microversion: 2.1 time: 0.392160 Dec 25 21:16:15.875880 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1324/2749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:15 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:15.879235 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecbbc4f6-2a66-4770-bbae-0789520b0e8d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1378 microversion: 2.1 time: 0.801234 Dec 25 21:16:15.879819 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1426/2750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:15 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1378 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:15.882193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd9d4232-1229-4189-9820-8ef05179405d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] Calling method '.version_select at 0x7fa4f6d554c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:16.042551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd9d4232-1229-4189-9820-8ef05179405d tempest-ServersTestFqdnHostnames-948157385 tempest-ServersTestFqdnHostnames-948157385-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954652495" status: 202 len: 0 microversion: 2.1 time: 0.164351 Dec 25 21:16:16.043597 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1325/2751] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:16:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1954652495 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:16:16.051517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:16.054440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:16.066751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.069414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:16.070666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.072265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:16.138786 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-386c4ea3-8215-4133-a6f5-0fd42804e335 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.093430 Dec 25 21:16:16.148562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1326/2752] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:16 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:16.160036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a56a44f4-9a4c-4cbd-90e1-9cf12ee7b23e req-66577ac9-6e2e-469e-922b-785aabc1992f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a665e8d7-d64e-4879-9389-ad2efb13749b", "tag": "7dbd4557-2b40-4db1-9a68-6caa3efd7bb8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:16.162189 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:16.162189 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:16.173604 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c75cec7-b35c-4ac8-9731-dd911beabb11 tempest-TenantUsagesNegativeTestJSON-124154967 tempest-TenantUsagesNegativeTestJSON-124154967-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/?start=2021-12-24T21%3A16%3A15.711696&end=2021-12-26T21%3A16%3A15.711696" status: 404 len: 112 microversion: - time: 0.292756 Dec 25 21:16:16.174986 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1427/2753] 10.222.0.32 () {58 vars in 1315 bytes} [Sat Dec 25 21:16:15 2021] GET /compute/v2.1/os-simple-tenant-usage/?start=2021-12-24T21%3A16%3A15.711696&end=2021-12-26T21%3A16%3A15.711696 => generated 112 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 25 21:16:16.179804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e5c2736-9187-4149-9866-a584b868c4dd tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f7533430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:16.190993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a56a44f4-9a4c-4cbd-90e1-9cf12ee7b23e req-66577ac9-6e2e-469e-922b-785aabc1992f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.191827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a56a44f4-9a4c-4cbd-90e1-9cf12ee7b23e req-66577ac9-6e2e-469e-922b-785aabc1992f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:16.211263 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a56a44f4-9a4c-4cbd-90e1-9cf12ee7b23e req-66577ac9-6e2e-469e-922b-785aabc1992f service nova] Creating event network-changed:7dbd4557-2b40-4db1-9a68-6caa3efd7bb8 for instance a665e8d7-d64e-4879-9389-ad2efb13749b on nch1-master-1 Dec 25 21:16:16.217306 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a56a44f4-9a4c-4cbd-90e1-9cf12ee7b23e req-66577ac9-6e2e-469e-922b-785aabc1992f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069137 Dec 25 21:16:16.218562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1327/2754] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:16.224333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-713c3b49-f215-4e48-b8b2-142df628d279 tempest-TenantUsagesNegativeTestJSON-124154967 tempest-TenantUsagesNegativeTestJSON-124154967-project-admin] Calling method '.version_select at 0x7fa50059a280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:16.228008 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-713c3b49-f215-4e48-b8b2-142df628d279 tempest-TenantUsagesNegativeTestJSON-124154967 tempest-TenantUsagesNegativeTestJSON-124154967-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Dec 25 21:16:16.228855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-713c3b49-f215-4e48-b8b2-142df628d279 tempest-TenantUsagesNegativeTestJSON-124154967 tempest-TenantUsagesNegativeTestJSON-124154967-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:16.229966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-713c3b49-f215-4e48-b8b2-142df628d279 tempest-TenantUsagesNegativeTestJSON-124154967 tempest-TenantUsagesNegativeTestJSON-124154967-project-admin] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage/f5cc01656ddf46e48857289e63f81a18?start=2021-12-26T21%3A16%3A15.711696&end=2021-12-24T21%3A16%3A15.711696" status: 400 len: 111 microversion: 2.1 time: 0.009949 Dec 25 21:16:16.230776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1328/2755] 10.222.0.32 () {58 vars in 1411 bytes} [Sat Dec 25 21:16:16 2021] GET /compute/v2.1/os-simple-tenant-usage/f5cc01656ddf46e48857289e63f81a18?start=2021-12-26T21%3A16%3A15.711696&end=2021-12-24T21%3A16%3A15.711696 => generated 111 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:16:16.242796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:16.251473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:16.267371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.268201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:16.269324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.269989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:16.275987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e5c2736-9187-4149-9866-a584b868c4dd tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.100239 Dec 25 21:16:16.278685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1428/2756] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:16 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:16.444978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f1ab413-2c85-4325-bcdd-4e61c64cfde4 tempest-TenantUsagesNegativeTestJSON-1553170495 tempest-TenantUsagesNegativeTestJSON-1553170495-project] Calling method '.version_select at 0x7fa4f6dc1940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:16.447553 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-simple-tenant-usage:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:16.447553 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:16.449145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9f1ab413-2c85-4325-bcdd-4e61c64cfde4 tempest-TenantUsagesNegativeTestJSON-1553170495 tempest-TenantUsagesNegativeTestJSON-1553170495-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'e2ce230775df45ea94c1b5f9b068d74c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5cc01656ddf46e48857289e63f81a18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:16.450022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f1ab413-2c85-4325-bcdd-4e61c64cfde4 tempest-TenantUsagesNegativeTestJSON-1553170495 tempest-TenantUsagesNegativeTestJSON-1553170495-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:16.454999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f1ab413-2c85-4325-bcdd-4e61c64cfde4 tempest-TenantUsagesNegativeTestJSON-1553170495 tempest-TenantUsagesNegativeTestJSON-1553170495-project] 10.222.0.32 "GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-24T21%3A16%3A15.711696&end=2021-12-26T21%3A16%3A15.711696&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.171958 Dec 25 21:16:16.456427 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1429/2757] 10.222.0.32 () {58 vars in 1334 bytes} [Sat Dec 25 21:16:16 2021] GET /compute/v2.1/os-simple-tenant-usage?start=2021-12-24T21%3A16%3A15.711696&end=2021-12-26T21%3A16%3A15.711696&detailed=1 => generated 123 bytes in 177 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:16.900666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:16.901327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:16.910466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.911210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:16.912747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:16.913265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:17.140083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:17.173460 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-667e1e06-4080-47c1-9753-b963d12ed076 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1280 microversion: 2.1 time: 0.285405 Dec 25 21:16:17.186073 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1430/2758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:16 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1280 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:17.193828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:17.195991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:17.203598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:17.204305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:17.206435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:17.207172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:17.405792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:17.421271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5da2578d-2000-4701-8d74-65d4bb81fbe3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1317 microversion: 2.1 time: 1.188663 Dec 25 21:16:17.434870 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1329/2759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:16 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1317 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:17.442526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:17.445293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:17.452671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:17.453165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:17.456667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:17.456667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:17.512800 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6b55c11e-303d-49d1-bbe9-184a844775f1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.075308 Dec 25 21:16:17.514165 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1330/2760] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:17 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:17.529435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad74ec31-de32-4f40-b320-76738dc5b8c7 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f62afe50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:17.649816 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad74ec31-de32-4f40-b320-76738dc5b8c7 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.134230 Dec 25 21:16:17.650389 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1331/2761] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:17 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:18.066616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:18.078511 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b97641a-f764-41bd-a154-3ae222b9eadb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1528 microversion: 2.1 time: 0.888364 Dec 25 21:16:18.080999 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1431/2762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:17 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1528 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:18.097758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:18.098705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:18.123240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:18.126237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:18.129970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:18.132020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:18.260544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1031984359", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:18.355706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:18.786025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:18.795820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37d2dcf7-a07b-4b06-a9d5-b12ca844cd56 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1528 microversion: 2.1 time: 0.702941 Dec 25 21:16:18.796428 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1432/2763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:18 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1528 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:18.812472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:18.813396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:18.820779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:18.821678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:18.822649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:18.823357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.222174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:19.232733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ddc8ac6b-ffd6-4fe0-ac6d-7307e36cd1f6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.435165 Dec 25 21:16:19.236340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1433/2764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:18 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:19.247837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:19.249768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:19.266334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:19.266797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.272372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:19.272887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.509245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:19.509818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:19.510541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:19.511170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:19.511597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:19.529212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:19.529676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.530512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:19.531028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.574435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:19.586513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:19.617024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:19.620731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:19.767464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:19.775908 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9c38bee-6fd6-41f8-b7e9-ebe1387fe299 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1317 microversion: 2.1 time: 0.536967 Dec 25 21:16:19.776697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1434/2765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:19 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:19.794284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:19.796110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:19.803676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:19.804627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.805701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:19.806369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:19.834725 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35c54f57-0fb8-4054-a772-6beeb732a7df tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.801058 Dec 25 21:16:19.835808 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1332/2766] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 1805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:19.850719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eeec544c-79ee-4d9c-8308-b2c0bfdcfe8f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50059a820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:19.891979 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84ed02fe-02db-4791-a216-787c3fc14a13 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.102086 Dec 25 21:16:19.893639 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1435/2767] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:19 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:19.899320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8051feb-7e32-4f3b-bc67-e130502ed66e tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:19.900561 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:19.900561 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:19.995868 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eeec544c-79ee-4d9c-8308-b2c0bfdcfe8f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1455 microversion: 2.1 time: 0.157212 Dec 25 21:16:19.998364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1333/2768] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:19 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1455 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:20.005862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25e1ae04-d559-4800-a97f-d66921de3bd7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:20.006491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25e1ae04-d559-4800-a97f-d66921de3bd7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:20.067675 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8051feb-7e32-4f3b-bc67-e130502ed66e tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/9c40a937-d17c-4d49-8252-ee02770105fd" status: 202 len: 0 microversion: 2.1 time: 0.166699 Dec 25 21:16:20.069070 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1436/2769] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:19 2021] DELETE /compute/v2.1/flavors/9c40a937-d17c-4d49-8252-ee02770105fd => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:16:20.079755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a10beab8-2fdb-48fe-b5a5-d4ed8697c3b8 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:20.110059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25e1ae04-d559-4800-a97f-d66921de3bd7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:20.144740 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a10beab8-2fdb-48fe-b5a5-d4ed8697c3b8 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.070434 Dec 25 21:16:20.154611 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1437/2770] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:16:20 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:20.158126 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25e1ae04-d559-4800-a97f-d66921de3bd7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1215 microversion: 2.1 time: 0.158066 Dec 25 21:16:20.160027 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1334/2771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:19 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:20.170371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:20.170371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:20.175359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.178025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.179837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.180284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.253466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:20.254230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:20.269252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.269891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.274136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.279981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.348690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:20.358286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Old instance type tempest-test_resize_flavor_-1850190833, new instance type m1.heat {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:16:20.375961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:20.376499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:20.377995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:20.378769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:20.379285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:20.644574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:20.657002 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14ec4c2d-fb81-4972-9c49-e3fb9881c155 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.408749 Dec 25 21:16:20.657843 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1335/2772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:20 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:20.791921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:20.792542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:20.808464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.810047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.811483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.813787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.823934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d154026f-ba8f-45fb-9c98-77b7e2b628c0 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c/action" status: 202 len: 0 microversion: 2.1 time: 0.666631 Dec 25 21:16:20.827650 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1438/2773] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:20 2021] POST /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:16:20.834773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:20.835628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:20.852327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.853075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:20.853992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:20.854437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.640150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:21.647912 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ae5cde0-a38a-4d57-8e77-3b4694bdac6d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1537 microversion: 2.1 time: 0.818620 Dec 25 21:16:21.648511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1439/2774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:20 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1537 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:21.656129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:21.658580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:21.659519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:21.668581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62f96382-ef6d-4669-9bf5-e947101e9ad9 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1317 microversion: 2.1 time: 0.877360 Dec 25 21:16:21.674225 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1336/2775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:20 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1317 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:21.679790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcceba4d-67be-4fc8-a32c-433c8db6b9f9 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6268b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:21.691341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.691808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.692629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.693209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.767145 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f795951-34b0-4bf6-a54f-11a7cac7dae9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.111991 Dec 25 21:16:21.768239 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1440/2776] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:21 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:21.787509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d2c52e92-3322-4c7f-bbc6-332a9e53c076 req-dbb85c0f-f8c8-4ebf-9d57-b6cbae294cec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d343d1d-ac0a-4447-862f-e13c2facfcef", "tag": "79306c37-bd08-49bf-b49d-90f7ba24ce10"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:21.789218 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:21.789218 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:21.805801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d2c52e92-3322-4c7f-bbc6-332a9e53c076 req-dbb85c0f-f8c8-4ebf-9d57-b6cbae294cec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.806256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d2c52e92-3322-4c7f-bbc6-332a9e53c076 req-dbb85c0f-f8c8-4ebf-9d57-b6cbae294cec service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.846483 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcceba4d-67be-4fc8-a32c-433c8db6b9f9 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1464 microversion: 2.1 time: 0.169111 Dec 25 21:16:21.855527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d2c52e92-3322-4c7f-bbc6-332a9e53c076 req-dbb85c0f-f8c8-4ebf-9d57-b6cbae294cec service nova] Creating event network-changed:79306c37-bd08-49bf-b49d-90f7ba24ce10 for instance 1d343d1d-ac0a-4447-862f-e13c2facfcef on nch1-master-1 Dec 25 21:16:21.856038 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1337/2777] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:21 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:21.862142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d2c52e92-3322-4c7f-bbc6-332a9e53c076 req-dbb85c0f-f8c8-4ebf-9d57-b6cbae294cec service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092447 Dec 25 21:16:21.863975 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1441/2778] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:21.870443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:21.872221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:21.873866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:21.877770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:21.879948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.880846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.882047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.882794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.894235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.895114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:21.896910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:21.900575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.026817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:22.034721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ba2b868-c4bc-43a6-be8a-56dfb1ddbbb5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1219 microversion: 2.1 time: 0.177145 Dec 25 21:16:22.048247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1338/2779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:21 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1219 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:22.059094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-501b0892-b060-4534-8ec6-3da4559d4ae3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50059a820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:22.172169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-501b0892-b060-4534-8ec6-3da4559d4ae3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 200 len: 1464 microversion: 2.1 time: 0.129370 Dec 25 21:16:22.180487 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1339/2780] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:22 2021] GET /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 1464 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:22.191406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5ea45001-a794-4fe4-831c-2a413844816b req-56669353-9aa6-410f-a63c-0af47b3cce5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a665e8d7-d64e-4879-9389-ad2efb13749b", "name": "network-vif-plugged", "status": "completed", "tag": "7dbd4557-2b40-4db1-9a68-6caa3efd7bb8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:22.195061 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:22.195061 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:22.234832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5ea45001-a794-4fe4-831c-2a413844816b req-56669353-9aa6-410f-a63c-0af47b3cce5f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.236562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5ea45001-a794-4fe4-831c-2a413844816b req-56669353-9aa6-410f-a63c-0af47b3cce5f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.277533 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5ea45001-a794-4fe4-831c-2a413844816b req-56669353-9aa6-410f-a63c-0af47b3cce5f service nova] Creating event network-vif-plugged:7dbd4557-2b40-4db1-9a68-6caa3efd7bb8 for instance a665e8d7-d64e-4879-9389-ad2efb13749b on nch1-master-1 Dec 25 21:16:22.282410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:22.294214 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d61a3996-7381-44f5-96a0-a33b78d7a90d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.428620 Dec 25 21:16:22.298298 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1442/2781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:21 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:22.299501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5ea45001-a794-4fe4-831c-2a413844816b req-56669353-9aa6-410f-a63c-0af47b3cce5f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113036 Dec 25 21:16:22.303167 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1340/2782] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:22.311560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:22.312190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:22.327955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.328454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.329732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.330217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.666317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:22.667031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:22.669893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:22.682291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.684207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f492827-c197-405a-ba89-2b563e7c94b3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1467 microversion: 2.1 time: 0.384403 Dec 25 21:16:22.684383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.685480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.686048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.690647 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1443/2783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:22 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1467 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:22.702208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:22.709935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:22.714444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.715606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:22.716801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:22.717464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.043077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:23.061466 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b91ab066-8ea0-42fe-877b-5b461db17ef2 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1537 microversion: 2.1 time: 0.397959 Dec 25 21:16:23.072637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1341/2784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:22 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1537 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:23.078419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1116076665"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:23.079593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:23.090871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.091636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.093653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.094409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.126053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:23.135395 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c6377e0-9f59-4672-b231-362b9a0d470d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1317 microversion: 2.1 time: 0.443464 Dec 25 21:16:23.135996 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1444/2785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:22 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1317 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:23.148926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:23.150870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:23.168491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.169572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.172047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.172684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.231031 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf1def08-8afe-4f3d-9c3a-31b58ccc71e0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.093786 Dec 25 21:16:23.232120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1445/2786] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:23 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:23.237814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:23.238852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:23.246732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.247393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.248365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.248994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.427682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:23.436227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92e22d22-2ac1-471f-90ae-68c6482ad01c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1275 microversion: 2.1 time: 0.202702 Dec 25 21:16:23.437011 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1446/2787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:23 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:23.446693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:23.448755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:23.455845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.456296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.457255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:23.457881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:23.780195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:23.791575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6ec78d1-90d4-4c59-bf3f-5358fdce85f0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.353294 Dec 25 21:16:23.792340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1447/2788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:23 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:23.870181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04156b07-48df-4bf0-9c99-e74eb4f6fa90 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "POST /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42/action" status: 202 len: 0 microversion: 2.1 time: 0.795544 Dec 25 21:16:23.873246 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1342/2789] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:23 2021] POST /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42/action => generated 0 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:16:23.889371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78b2cd4f-8195-4762-aea3-ea2be16023f0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50076c1f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:23.966365 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78b2cd4f-8195-4762-aea3-ea2be16023f0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.084442 Dec 25 21:16:23.972917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1448/2790] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:23 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:24.078414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:24.079587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:24.090123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.090813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.091855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.092471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.153835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:24.153835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:24.159532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.160281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.161421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.162168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.433753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:24.457631 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0f31024b-6ed1-4acc-8a18-eeeb5d4c2bc3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1537 microversion: 2.1 time: 0.383779 Dec 25 21:16:24.458142 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1343/2791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:24 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1537 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:24.465144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:24.466492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:24.487610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.488471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.491618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.492845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:24.493073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.502357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79539b22-9ee6-47ac-b1c5-eef234f5182d tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1505 microversion: 2.1 time: 0.354180 Dec 25 21:16:24.503216 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1449/2792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:24 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:24.510887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c883c082-3aeb-4ae6-aad2-0e5dcfde5fe6 req-d825b86e-3b8e-4974-968b-b8f2d8957791 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d35b75-8e17-40b9-bfd2-615b2128e5df", "name": "network-vif-unplugged", "status": "completed", "tag": "a8e1347c-d578-42de-9815-79469dc5aa48"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:24.512538 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:24.512538 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:24.522123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c883c082-3aeb-4ae6-aad2-0e5dcfde5fe6 req-d825b86e-3b8e-4974-968b-b8f2d8957791 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.522566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c883c082-3aeb-4ae6-aad2-0e5dcfde5fe6 req-d825b86e-3b8e-4974-968b-b8f2d8957791 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.535865 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c883c082-3aeb-4ae6-aad2-0e5dcfde5fe6 req-d825b86e-3b8e-4974-968b-b8f2d8957791 service nova] Creating event network-vif-unplugged:a8e1347c-d578-42de-9815-79469dc5aa48 for instance 59d35b75-8e17-40b9-bfd2-615b2128e5df on nch1-master-1 Dec 25 21:16:24.542631 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c883c082-3aeb-4ae6-aad2-0e5dcfde5fe6 req-d825b86e-3b8e-4974-968b-b8f2d8957791 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036242 Dec 25 21:16:24.543235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51494a6a-873a-43ba-8662-f293559b0d96 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.081888 Dec 25 21:16:24.547307 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1450/2794] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:24.547513 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1344/2794] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:24 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:24.551811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:24.553344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:24.554287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:24.554991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:24.561113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.561842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.563869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.564584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.579581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.580031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:24.580828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:24.581695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.069989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:25.085975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32f268a8-b41e-49b3-b34b-185530942fa2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1505 microversion: 2.1 time: 0.539524 Dec 25 21:16:25.087127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1345/2795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:24 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.093748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:25.095528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:25.105367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.108530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.108530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.108530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.121429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:25.129811 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-488bf3b0-d109-4d4d-a166-7c4d1f696cb0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.584132 Dec 25 21:16:25.130954 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1451/2796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:24 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.149972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-031a0322-ecd7-4291-8a09-2a02f0237765 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50076c0d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:25.198079 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-031a0322-ecd7-4291-8a09-2a02f0237765 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.052155 Dec 25 21:16:25.198690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1452/2797] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:25 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.203500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:25.204799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:25.213447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.214369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.215587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.216645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.370423 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b58d6578-6bd1-42a2-a25c-4816230d924c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "PUT /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1077 microversion: 2.1 time: 0.170575 Dec 25 21:16:25.371510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1453/2798] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:16:25 2021] PUT /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1077 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.387564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:25.388301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:25.398134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.399092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.400253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.400865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.425628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:25.435105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-953e044b-102e-45a4-a876-a84ca318425b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.346891 Dec 25 21:16:25.443220 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1346/2799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:25 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.474490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:25.477632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:25.485911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.487452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.494180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.494180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.759469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:25.766968 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9efd81fd-6829-4d82-829d-dc0a0284d49c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1503 microversion: 2.1 time: 0.383374 Dec 25 21:16:25.767556 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1454/2800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:25 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1503 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.783077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:25.784055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:25.790225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.790679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.791467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.791905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.840677 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d6c451b-f0e8-46bf-b23c-e5ed07a7b093 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.057478 Dec 25 21:16:25.840677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1455/2801] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:25 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:25.843792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:25.844058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:25.851806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.852255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.853093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.853537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.854265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:25.862501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70df4813-f035-4141-95ee-f1780fd95a68 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1537 microversion: 2.1 time: 0.391901 Dec 25 21:16:25.870629 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1347/2802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:25 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1537 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:25.875602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c809f650-5420-488e-b9bf-90b241fdc7c7 req-8fc3f132-0cc9-4e91-9ee3-67fe7cb35f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcc7022a-66f7-4481-80f6-03320c1f3a53", "tag": "2464a3e4-d827-4b03-b011-1cbc611f04ec"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:25.878155 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:25.878155 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:25.896131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c809f650-5420-488e-b9bf-90b241fdc7c7 req-8fc3f132-0cc9-4e91-9ee3-67fe7cb35f76 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:25.896890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c809f650-5420-488e-b9bf-90b241fdc7c7 req-8fc3f132-0cc9-4e91-9ee3-67fe7cb35f76 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:25.915427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c809f650-5420-488e-b9bf-90b241fdc7c7 req-8fc3f132-0cc9-4e91-9ee3-67fe7cb35f76 service nova] Creating event network-changed:2464a3e4-d827-4b03-b011-1cbc611f04ec for instance fcc7022a-66f7-4481-80f6-03320c1f3a53 on nch2-master-1 Dec 25 21:16:25.921087 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c809f650-5420-488e-b9bf-90b241fdc7c7 req-8fc3f132-0cc9-4e91-9ee3-67fe7cb35f76 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048871 Dec 25 21:16:25.922447 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1348/2803] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:26.087125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:26.095442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-974e5524-4d37-4b59-91fc-d3ca4a546de3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1503 microversion: 2.1 time: 0.256210 Dec 25 21:16:26.096271 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1456/2804] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:25 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1503 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:26.113154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:26.115479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.139106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.141336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.142527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.144433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.147651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:26.148280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.155590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.156291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.157381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.158034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.296733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:26.297215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:26.297858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:26.298282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:26.298701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:26.399940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:26.410216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8022871-73bc-426f-88f1-8ff48aed52ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.266667 Dec 25 21:16:26.420677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1457/2805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:26 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:26.420677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb30e28b-2588-42c2-8ff1-53e2450096de tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f5dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:26.475056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb30e28b-2588-42c2-8ff1-53e2450096de tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.061393 Dec 25 21:16:26.475690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1458/2806] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:26 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:26.481431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:26.482161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.489249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.490181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.491299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.491972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.535199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.560471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.560973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.561793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.565259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.629640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4360653c-b27b-4dc1-8f51-5a1fc76aecb4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "POST /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b/action" status: 202 len: 1109 microversion: 2.1 time: 0.519531 Dec 25 21:16:26.631883 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1349/2807] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:26 2021] POST /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b/action => generated 1109 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 25 21:16:26.680579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:26.681672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.702524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.708063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.710550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.713348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.760369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:26.770157 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9cf3155-674c-4454-8813-0c10a5581658 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.292381 Dec 25 21:16:26.780435 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1459/2808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:26 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:26.853782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:26.855154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.864190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.864862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.865846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.866640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.928657 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5fb4ee80-d44c-4a82-ae18-d3b63979f459 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.084089 Dec 25 21:16:26.933532 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1460/2809] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:26 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:26.935563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:26.936517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:26.947300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.947844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.948713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:26.952062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:26.984424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:26.993314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b684980-833e-439a-8bae-fca116a41724 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.340663 Dec 25 21:16:26.997638 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1350/2810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:26 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:27.113701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:27.121485 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cec93933-616c-4d61-9993-bdf14de3627c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.190871 Dec 25 21:16:27.122257 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1461/2811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:26 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:27.427332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:27.428549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:27.436437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:27.436437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:27.436845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:27.449973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:27.487283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33f47367-9856-403b-bf77-1f359159f0ed tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6a664c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:27.540036 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33f47367-9856-403b-bf77-1f359159f0ed tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.056252 Dec 25 21:16:27.541800 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1462/2812] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:27 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:27.647221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:27.656736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0938b22b-f5c5-4b62-bd1c-1d771a2c599d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.233049 Dec 25 21:16:27.657456 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1351/2813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:27 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:27.788047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:27.788993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:27.795398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:27.796153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:27.797179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:27.797778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:27.837135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b06bb50e-9b11-4453-8c65-73a396f929bd req-1580bb30-3106-4db4-824d-2cdefc99db3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "name": "network-vif-plugged", "status": "completed", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:27.840078 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:27.840078 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:27.851722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b06bb50e-9b11-4453-8c65-73a396f929bd req-1580bb30-3106-4db4-824d-2cdefc99db3e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:27.852169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b06bb50e-9b11-4453-8c65-73a396f929bd req-1580bb30-3106-4db4-824d-2cdefc99db3e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:27.864123 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b06bb50e-9b11-4453-8c65-73a396f929bd req-1580bb30-3106-4db4-824d-2cdefc99db3e service nova] Creating event network-vif-plugged:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:16:27.869590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b06bb50e-9b11-4453-8c65-73a396f929bd req-1580bb30-3106-4db4-824d-2cdefc99db3e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036294 Dec 25 21:16:27.870636 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1352/2814] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:16:27.990642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:28.000840 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1719610-c6ba-49a5-ba0d-13af26b4344e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.216955 Dec 25 21:16:28.011201 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1463/2815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:27 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:28.015999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:28.017003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:28.025259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.025722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.026578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.027209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.076151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-199528c0-6e0d-4e78-b0eb-7d0190bb38e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.063754 Dec 25 21:16:28.077975 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1464/2816] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:28 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:28.085233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:28.086244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:28.092797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.093278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.094055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.094491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.159631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1491747632", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "77b2a75d-f400-4539-8345-8e2b357f5c23"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:28.234350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] validate_networks() for [('77b2a75d-f400-4539-8345-8e2b357f5c23', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:28.263922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:28.271817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db3b3e4e-abae-4f7e-93df-be3aba53d97c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.193494 Dec 25 21:16:28.273237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1465/2817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:28 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:28.277993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:28.278834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:28.285572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.286861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.287866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.288294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.555943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:28.568400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d174b5d7-d4a9-4492-a41f-f9705d88add4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.293189 Dec 25 21:16:28.568963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1466/2818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:28 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:28.596776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8e24329-7a4c-44a0-8c33-df421b19110c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f5dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:28.668092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8e24329-7a4c-44a0-8c33-df421b19110c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.097969 Dec 25 21:16:28.669005 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1467/2819] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:28 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:28.682062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:28.682700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:28.691106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.691610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.692430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.693444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.783518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:28.784477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:28.785170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:28.785750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:28.786548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:28.796451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.797200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.798393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:28.798837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:28.826664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Getting quotas for project ef4a444bae614ca7b19f2e61052a4c6e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:28.829092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Getting quotas for user 82ec9d2698bd4b3f811022f3d8c458b2 and project ef4a444bae614ca7b19f2e61052a4c6e. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:28.842691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:28.845815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:28.884846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:28.894292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d094df28-8a7f-4903-8922-3d769db3322a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.223726 Dec 25 21:16:28.895274 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1468/2820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:28 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:28.968488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ae6d595-78ae-4646-9cd5-46fcdee5ecea tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.095965 Dec 25 21:16:28.969746 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1353/2821] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:27 2021] POST /compute/v2.1/servers => generated 380 bytes in 1098 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:28.980608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc9b17f0-667f-4085-b400-9767caf74a56 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:28.981444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc9b17f0-667f-4085-b400-9767caf74a56 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:29.018842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:29.019635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:29.027770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.028586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.029817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.031800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.092729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cc9b17f0-667f-4085-b400-9767caf74a56 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:29.102255 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc9b17f0-667f-4085-b400-9767caf74a56 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1218 microversion: 2.1 time: 0.125263 Dec 25 21:16:29.103089 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1469/2822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:28 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:29.127404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:29.128360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:29.140562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.141313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.144456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.145295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.220630 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e1b2101-010e-4891-921d-9e7581dc7419 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.097017 Dec 25 21:16:29.222018 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1470/2823] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:29 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:29.267707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:29.277052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31870c53-06f0-4208-862b-369a95b956d9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.262387 Dec 25 21:16:29.278189 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1354/2824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:29 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:29.293428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:29.294500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:29.306887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.307340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.308382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.309198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.490094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:29.498189 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1fb9ea2f-d0ba-4b9f-a75f-9d96cd90aa8e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.210436 Dec 25 21:16:29.521795 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1471/2825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:29 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:29.589450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:29.590652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:29.601081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.601928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.603016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.605072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.684483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d571890d-b7b0-4c4a-a177-3a6a208ee7a0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f18b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:29.782488 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d571890d-b7b0-4c4a-a177-3a6a208ee7a0 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.104646 Dec 25 21:16:29.784687 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1472/2826] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:29 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:29.875180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:29.887928 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-596aeb6c-e54d-4070-9950-4fa7fbb84834 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.306206 Dec 25 21:16:29.898528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1355/2827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:29 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:29.912386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:29.913630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:29.928259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.928862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:29.929695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:29.930142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.124602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8296b702-7ed4-4d66-8a08-7508dac537d5 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:30.125265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8296b702-7ed4-4d66-8a08-7508dac537d5 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:30.399472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8296b702-7ed4-4d66-8a08-7508dac537d5 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:30.410750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8296b702-7ed4-4d66-8a08-7508dac537d5 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1218 microversion: 2.1 time: 0.294250 Dec 25 21:16:30.418286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1356/2828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:30 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1218 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:30.434296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:30.437859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:30.451834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.453187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.454242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.454935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.526827 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c7ce8fda-f09e-4a66-9019-77de317b31d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.106421 Dec 25 21:16:30.527571 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1357/2829] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:30 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:30.535475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-698d2829-e2c3-4eac-afe6-95bd5782002f req-eb0273b0-fff2-4491-b9b6-f021c107b613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d343d1d-ac0a-4447-862f-e13c2facfcef", "name": "network-vif-plugged", "status": "completed", "tag": "79306c37-bd08-49bf-b49d-90f7ba24ce10"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:30.538247 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:30.538247 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:30.546947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-698d2829-e2c3-4eac-afe6-95bd5782002f req-eb0273b0-fff2-4491-b9b6-f021c107b613 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.560608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-698d2829-e2c3-4eac-afe6-95bd5782002f req-eb0273b0-fff2-4491-b9b6-f021c107b613 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.591808 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-698d2829-e2c3-4eac-afe6-95bd5782002f req-eb0273b0-fff2-4491-b9b6-f021c107b613 service nova] Creating event network-vif-plugged:79306c37-bd08-49bf-b49d-90f7ba24ce10 for instance 1d343d1d-ac0a-4447-862f-e13c2facfcef on nch1-master-1 Dec 25 21:16:30.598261 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-698d2829-e2c3-4eac-afe6-95bd5782002f req-eb0273b0-fff2-4491-b9b6-f021c107b613 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068563 Dec 25 21:16:30.600646 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1358/2830] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:30.606979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:30.608112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:30.616733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.617646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.621625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.621625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.642684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:30.665845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a969e6d6-db8f-4c06-a62c-fc69b94e85e6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.758049 Dec 25 21:16:30.678846 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1473/2831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:29 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:30.685332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:30.697809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:30.712435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.713269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:30.714637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:30.715335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.034538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:31.043634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-33fb4c4c-502e-4d23-bb5c-1f9b5aa00338 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.441468 Dec 25 21:16:31.048513 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1359/2832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:30 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:31.062022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef32fa30-f689-4a09-a34b-624ceebdd017 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f62743a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:31.122856 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef32fa30-f689-4a09-a34b-624ceebdd017 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.072946 Dec 25 21:16:31.124062 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1360/2833] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:31 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:31.128919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:31.130469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:31.140021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.143678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.143678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.143678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.234133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:31.242317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08221b65-8e5c-4ab4-a15e-8d47d4372d3e tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.560953 Dec 25 21:16:31.247758 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1474/2834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:30 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:31.427765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:31.428661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:31.446484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.447356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.448434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.449185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.534312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:31.542771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44d77ab0-b0e6-4d0b-be65-e5de1a3d2b39 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.417427 Dec 25 21:16:31.545199 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1361/2835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:31 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:31.559361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:31.560510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:31.576889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.577541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.596761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.596761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.698599 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aba6c4b5-55bd-47ba-8d4a-049b815fc411 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.143568 Dec 25 21:16:31.702184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1362/2836] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:31 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:31.715976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:31.716807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:31.731466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.736765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.741622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:31.744123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:31.953517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:31.981608 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eab67229-74cd-441b-8745-ccd71b19b1a3 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1270 microversion: 2.1 time: 0.549045 Dec 25 21:16:31.982305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1475/2837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:31 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1270 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:32.078718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:32.081054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:32.091620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:32.092818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:32.095627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:32.096460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:32.337706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:32.349888 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e67ae14-8f4a-4a26-b9eb-6ccde8e0e510 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.644806 Dec 25 21:16:32.354360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1363/2838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:31 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:32.368863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47f3a799-3a56-4424-9b58-e547103a6741 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6274280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:32.480978 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47f3a799-3a56-4424-9b58-e547103a6741 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.121840 Dec 25 21:16:32.480978 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1364/2839] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:32 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:32.492894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:32.493558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:32.510436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:32.510909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:32.511725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:32.512174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:32.712597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:32.720067 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c822268-6fa5-4984-9c8d-067c4add0798 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1322 microversion: 2.1 time: 0.659351 Dec 25 21:16:32.732557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1476/2840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:32 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:32.738450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:32.739131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:32.751689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:32.751689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:32.762122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:32.762122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.117301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:33.127463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-860aeab1-3d6d-4480-a2c4-e26508d9d9ff tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.646665 Dec 25 21:16:33.128073 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1365/2841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:32 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:33.137496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:33.137496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:33.142891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.143362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.144202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.144670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.184725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:33.196030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-10eff5f6-80b6-483f-9b2a-14e66dfd28d6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.461751 Dec 25 21:16:33.207817 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1477/2842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:32 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:33.208068 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5780d88d-06ee-42fe-8314-e44a18be00bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.077830 Dec 25 21:16:33.212931 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1366/2843] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:33 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:33.218121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:33.231532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:33.231532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.231532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.231532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.231532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.315067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:33.323405 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f856134-251e-469f-a293-d31547d565ae tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1276 microversion: 2.1 time: 0.113922 Dec 25 21:16:33.323993 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1478/2844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:33 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1276 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:33.372220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:33.373513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:33.389163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.391422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.392974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.393594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.492138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-512933d0-877b-48f6-98cc-8476ff1bb34d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50076c040>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:33.555378 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-512933d0-877b-48f6-98cc-8476ff1bb34d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.067110 Dec 25 21:16:33.556761 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1479/2845] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:33 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:33.567215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ed0681d2-5cb3-4073-a4f8-161a1b982cc4 req-a4a3827a-1471-4808-8a9b-aff6a1795e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc7022a-66f7-4481-80f6-03320c1f3a53", "name": "network-vif-plugged", "status": "completed", "tag": "2464a3e4-d827-4b03-b011-1cbc611f04ec"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:33.571351 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:33.571351 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:33.589302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ed0681d2-5cb3-4073-a4f8-161a1b982cc4 req-a4a3827a-1471-4808-8a9b-aff6a1795e04 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.592581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ed0681d2-5cb3-4073-a4f8-161a1b982cc4 req-a4a3827a-1471-4808-8a9b-aff6a1795e04 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.619165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ed0681d2-5cb3-4073-a4f8-161a1b982cc4 req-a4a3827a-1471-4808-8a9b-aff6a1795e04 service nova] Creating event network-vif-plugged:2464a3e4-d827-4b03-b011-1cbc611f04ec for instance fcc7022a-66f7-4481-80f6-03320c1f3a53 on nch2-master-1 Dec 25 21:16:33.637379 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ed0681d2-5cb3-4073-a4f8-161a1b982cc4 req-a4a3827a-1471-4808-8a9b-aff6a1795e04 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077196 Dec 25 21:16:33.642844 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1480/2846] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:33.737371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:33.738515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:33.748201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.749652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.751026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:33.751725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:33.846105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:33.854687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30bf8ed9-1382-4fb7-8a61-c8927b3d913f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1315 microversion: 2.1 time: 0.486766 Dec 25 21:16:33.857494 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1367/2847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:33 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:34.148627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:34.151840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:34.154932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:34.169627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.170306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92b4f348-caa4-47bf-9520-70d63bbfb5a6 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.434587 Dec 25 21:16:34.183489 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1481/2848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:33 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:34.188405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:34.189724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.190684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.191210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.195405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:34.204545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.205446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.208100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.209014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.847263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:34.859230 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e470f243-6514-4547-8c86-7667996098b3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.717637 Dec 25 21:16:34.859825 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1368/2849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:34 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:34.868352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:34.869550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:34.876704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.877806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.879042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.880183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.889282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:34.897116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce64b48f-2e8f-4329-b5d9-1ae65bae5970 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.712235 Dec 25 21:16:34.897704 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1482/2850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:34 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:34.909805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:34.911626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:34.920732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.921729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.922771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:34.923397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:34.995761 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b049a44-9e54-44f4-962c-0db32d16f90e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.089469 Dec 25 21:16:34.997292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1483/2851] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:34 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:35.003540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:35.004307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:35.011305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.015391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:35.015391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.015391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:35.448208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:35.459171 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4bcc0f0c-3e86-413a-8cf4-fce0e56a8d8f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.596274 Dec 25 21:16:35.460387 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1369/2852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:34 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:35.466098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-91cab44b-3d6a-4c1b-91b1-e709d617b20e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61c9d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:35.471965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:35.481639 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9f439e7-f9da-4707-b6b5-52378acd737e tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1318 microversion: 2.1 time: 0.482963 Dec 25 21:16:35.506749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1484/2853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:34 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1318 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:35.512037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:35.512733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:35.515421 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-91cab44b-3d6a-4c1b-91b1-e709d617b20e tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.053534 Dec 25 21:16:35.522572 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1370/2854] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:35 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:35.531406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.531800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:35.532601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.533065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:35.540372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e05127b7-3e93-436f-a187-733269b4b38c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1317335215", "metadata": {"": ""}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:35.542121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e05127b7-3e93-436f-a187-733269b4b38c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:35.543209 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e05127b7-3e93-436f-a187-733269b4b38c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action" status: 400 len: 170 microversion: 2.1 time: 0.020936 Dec 25 21:16:35.544435 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1371/2855] 10.222.0.32 () {60 vars in 1278 bytes} [Sat Dec 25 21:16:35 2021] POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action => generated 170 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:16:35.560500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:35.561966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:35.571553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.572344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:35.575502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.576262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:35.929587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:35.944191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:35.958858 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-148363bd-4f99-44fe-ad07-4136929d304d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1503 microversion: 2.1 time: 0.450411 Dec 25 21:16:35.960415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b9090fe-1671-4e7b-8c1b-0bcf50c488d2 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.406585 Dec 25 21:16:35.961588 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1372/2856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:35 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:35.963977 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1485/2857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:35 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1503 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:35.968014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:35.969654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:35.980028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:35.981012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:35.995327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:35.999980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.002148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.002881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.003536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.004208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.005815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.009340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.386594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:36.391859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:36.403265 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-59c0de72-af99-41e3-b090-14481d6b7efe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.427089 Dec 25 21:16:36.415209 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1486/2858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:35 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:36.415425 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d897d13a-b605-4ae5-9f02-aaa718937443 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.444265 Dec 25 21:16:36.415425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1373/2859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:35 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:36.424919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:36.426443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:36.434288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:36.435243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:36.448791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.450615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.451315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.454604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.455308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.455736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.462239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.462239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.518867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:16:36.520866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-580d4e5b-2d92-4f6c-bebb-053dc7cf242b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.109340 Dec 25 21:16:36.525014 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1374/2860] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:36 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:36.554195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-252353f8-e59b-4551-84f0-9ff4f8a09f04 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-447926763", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:36.559758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-252353f8-e59b-4551-84f0-9ff4f8a09f04 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:36.561487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-252353f8-e59b-4551-84f0-9ff4f8a09f04 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action" status: 400 len: 938 microversion: 2.1 time: 0.035224 Dec 25 21:16:36.564400 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1375/2861] 10.222.0.32 () {60 vars in 1278 bytes} [Sat Dec 25 21:16:36 2021] POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action => generated 938 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:16:36.575141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:36.576217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:36.591597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.598012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.601580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.601893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.887190 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-689d7f32-496a-4a0c-8681-bd7746cdda87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 204 len: 0 microversion: 2.1 time: 0.481992 Dec 25 21:16:36.887793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1487/2862] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:36 2021] DELETE /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:36.892787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-00ddf777-073f-4069-aa4b-ef943fb0c8bf req-7f622542-467c-4259-86fb-fdc0c44df620 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1b1d33-82d4-4c29-8f52-f3c59e495d4e", "tag": "fba43cf4-f214-42a5-b791-cde0e1556285"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:36.896950 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:36.896950 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:36.913286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-00ddf777-073f-4069-aa4b-ef943fb0c8bf req-7f622542-467c-4259-86fb-fdc0c44df620 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:36.913728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-00ddf777-073f-4069-aa4b-ef943fb0c8bf req-7f622542-467c-4259-86fb-fdc0c44df620 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:36.967073 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-00ddf777-073f-4069-aa4b-ef943fb0c8bf req-7f622542-467c-4259-86fb-fdc0c44df620 service nova] Creating event network-changed:fba43cf4-f214-42a5-b791-cde0e1556285 for instance 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e on nch1-master-1 Dec 25 21:16:36.977234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:36.984713 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-00ddf777-073f-4069-aa4b-ef943fb0c8bf req-7f622542-467c-4259-86fb-fdc0c44df620 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095523 Dec 25 21:16:36.990622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32a2aeaa-5502-4b91-b254-9f7aef82eaca tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.424845 Dec 25 21:16:36.996434 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1376/2863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:36 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:36.999883 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1488/2864] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:37.005087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:37.005803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:37.008514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-115eb69f-0834-46e7-a4e3-9d569897aebb tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50079a1f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:37.019822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.021834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.025262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.025870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.120063 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-115eb69f-0834-46e7-a4e3-9d569897aebb tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.118803 Dec 25 21:16:37.120670 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1489/2865] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:36 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:37.189115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:37.190383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:37.211180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.211943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.216693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.217408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.402149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:37.436324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f4098e8-17b3-4900-a81e-09b952f3c096 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1318 microversion: 2.1 time: 0.436064 Dec 25 21:16:37.439182 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1377/2866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:36 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1318 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:37.451473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:37.459279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:37.480362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.485017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.490157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.493132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.675794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:37.704238 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-47168ea3-318e-4fc8-81f6-eb603d1829b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.577511 Dec 25 21:16:37.705564 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1490/2867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:37 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:37.712024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:37.712943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:37.722935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.723793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.724966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.725630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.849340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:37.857679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa4bc135-944f-4b17-8759-66f6d60e9015 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1509 microversion: 2.1 time: 0.417302 Dec 25 21:16:37.858461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1378/2868] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:37 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1509 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:37.863277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:37.864822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:37.871045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.871475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.874689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.875164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.922193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62bed2d9-6440-498a-887e-b3edc060beee tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.062144 Dec 25 21:16:37.922858 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1379/2869] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:37 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:37.928564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:37.929273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:37.936789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.937272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:37.938079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:37.938537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.095696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:38.116069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20fb91ec-f5dd-413c-a9a1-2f8ad388bb86 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.406477 Dec 25 21:16:38.116069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1491/2870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:37 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:38.121466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:38.135225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:38.144271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:38.144857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.150839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:38.151363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.262787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:38.271232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e05ea22-dc77-4429-a523-ad9c9261ef13 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.347159 Dec 25 21:16:38.272172 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1380/2871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:37 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:38.276808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-73a6b9ab-ed42-4d89-a748-e54d6160d3c6 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6238430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:38.334659 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-73a6b9ab-ed42-4d89-a748-e54d6160d3c6 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.061384 Dec 25 21:16:38.335910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1381/2872] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:38 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:38.341898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d3dbdda-15a0-41f0-8699-7618c2558327 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:38.343761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d3dbdda-15a0-41f0-8699-7618c2558327 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:38.345158 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d3dbdda-15a0-41f0-8699-7618c2558327 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action" status: 400 len: 619 microversion: 2.1 time: 0.007981 Dec 25 21:16:38.346544 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1382/2873] 10.222.0.32 () {60 vars in 1278 bytes} [Sat Dec 25 21:16:38 2021] POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:16:38.356048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:38.357078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:38.364766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:38.365532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.367372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:38.368301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.432396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:38.445260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-841b39ec-9f9d-4464-b21b-ada2c76babec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.324303 Dec 25 21:16:38.446214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1492/2874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:38 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:38.473765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:38.474594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:38.497680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:38.500609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.501764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:38.505656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:38.960573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:38.971626 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c96415f-b292-470e-8175-d1a61fa7c32b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.620583 Dec 25 21:16:38.972238 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1383/2875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:38 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:38.984741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:38.987924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:39.014655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.016123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.016123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.016512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.029399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:39.057591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d13d1f0-1586-482c-a9c9-956bfec2b70b tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1318 microversion: 2.1 time: 0.598575 Dec 25 21:16:39.058937 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1493/2876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:38 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:39.064111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:39.065351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:39.084719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.085508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.086487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.087089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.168611 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b697fa99-3eaf-41bd-836b-c90cbe683f34 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.107982 Dec 25 21:16:39.169703 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1494/2877] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:39 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:39.174813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:39.184433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:39.192794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.199263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.200484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.202048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.314278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:39.327845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04bf2e58-017d-451a-aac1-b9313565caef tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1509 microversion: 2.1 time: 0.351768 Dec 25 21:16:39.329179 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1384/2878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:38 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:39.334322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:39.335297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:39.351123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.351850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.352960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.355590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.518482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:39.526193 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db9389cf-3e02-4fa6-8808-1cfa168601e1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.354999 Dec 25 21:16:39.531554 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1495/2879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:39 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:39.536625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b83bf77c-a469-4151-bf3c-d76147b25271 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f5940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:39.632930 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b83bf77c-a469-4151-bf3c-d76147b25271 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.100202 Dec 25 21:16:39.634336 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1496/2880] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:39 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:39.639563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:39.640934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:39.644464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:39.650823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.654576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.654712 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b5540459-a321-40c0-9ff3-445db6e94a2b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.321597 Dec 25 21:16:39.654824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.654824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.669302 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1385/2881] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:39 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:39.674188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1188077897"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:39.675284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:39.690774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.691233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.692279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:39.692719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:39.846405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:39.855644 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-060dc7d0-3750-4604-902f-45c71f9eb84c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.220026 Dec 25 21:16:39.856997 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1497/2882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:39 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:40.077503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:40.079141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:40.087006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.087752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.089088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.089759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.396248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:40.405501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32602200-f30a-4bd2-b1a1-80bd1372e2d4 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1318 microversion: 2.1 time: 0.333187 Dec 25 21:16:40.407746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1498/2883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:40 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1318 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:40.465802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a1a9c71c-3c16-40f3-9a7c-c0a7ea9ecd9d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action" status: 202 len: 0 microversion: 2.1 time: 0.794985 Dec 25 21:16:40.468718 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1386/2884] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:39 2021] POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action => generated 0 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:16:40.479759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:40.484863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:40.498650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.499420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.500478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.501133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.510821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-acc3e2c6-290f-4ed3-8dbd-2003ce0b3ac9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'create', calling method: .version_select at 0x7fa4f68f5ca0>, body: {"keypair": {"name": "tempest-keypair-1979290507"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:40.525723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-acc3e2c6-290f-4ed3-8dbd-2003ce0b3ac9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:40.531450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-acc3e2c6-290f-4ed3-8dbd-2003ce0b3ac9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:40.622068 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8d134a7-5aca-40d3-9095-1baef39ea322 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.151623 Dec 25 21:16:40.622854 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1387/2885] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:40 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:40.643112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2ffc9be5-d834-4d74-80b3-ac276a2f5302 req-e19af458-8fa3-455c-962c-a1f49b07fdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcc7022a-66f7-4481-80f6-03320c1f3a53", "name": "network-vif-deleted", "tag": "2464a3e4-d827-4b03-b011-1cbc611f04ec"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:40.647299 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:40.647299 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:40.675055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2ffc9be5-d834-4d74-80b3-ac276a2f5302 req-e19af458-8fa3-455c-962c-a1f49b07fdd6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.680169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2ffc9be5-d834-4d74-80b3-ac276a2f5302 req-e19af458-8fa3-455c-962c-a1f49b07fdd6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.705130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2ffc9be5-d834-4d74-80b3-ac276a2f5302 req-e19af458-8fa3-455c-962c-a1f49b07fdd6 service nova] Creating event network-vif-deleted:2464a3e4-d827-4b03-b011-1cbc611f04ec for instance fcc7022a-66f7-4481-80f6-03320c1f3a53 on nch2-master-1 Dec 25 21:16:40.711971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2ffc9be5-d834-4d74-80b3-ac276a2f5302 req-e19af458-8fa3-455c-962c-a1f49b07fdd6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086817 Dec 25 21:16:40.713706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1388/2886] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:40.721288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:40.722471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:40.730095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.731481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.732657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.733357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.766409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-acc3e2c6-290f-4ed3-8dbd-2003ce0b3ac9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:40.778206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-acc3e2c6-290f-4ed3-8dbd-2003ce0b3ac9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:40.795695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.796404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.797062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lazy-loading 'fault' on Instance uuid fcc7022a-66f7-4481-80f6-03320c1f3a53 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:16:40.799586 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-acc3e2c6-290f-4ed3-8dbd-2003ce0b3ac9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.389968 Dec 25 21:16:40.800327 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1499/2887] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:16:40 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:40.806485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-217026761"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:40.809090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:40.825896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.826402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.827208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.827650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.863275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:40.877552 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7faf0bd5-2360-49e6-9b21-181f57eb07f2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 200 len: 1305 microversion: 2.1 time: 0.162402 Dec 25 21:16:40.893526 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1389/2888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:40 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 1305 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:40.893526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-79f80040-06c3-474c-8eb9-8c82f99f0afc tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61c91f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:40.896448 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Cannot 'createImage' instance 1d343d1d-ac0a-4447-862f-e13c2facfcef while it is in task_state image_snapshot Dec 25 21:16:40.898342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 409 to user: Cannot 'createImage' instance 1d343d1d-ac0a-4447-862f-e13c2facfcef while it is in task_state image_snapshot {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:40.907388 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bb87665-528f-47b5-af6e-52f7083eab22 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action" status: 409 len: 159 microversion: 2.1 time: 0.096972 Dec 25 21:16:40.908366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1500/2889] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:40 2021] POST /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef/action => generated 159 bytes in 107 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:16:40.927134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:40.927720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:40.946205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.946205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:40.948947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:40.949364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.007083 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-79f80040-06c3-474c-8eb9-8c82f99f0afc tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.126807 Dec 25 21:16:41.020911 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1390/2890] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:40 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:41.025311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:41.026120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:41.043607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.044086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.044945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.045390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.233432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:41.247852 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c64ab3d-c556-4308-99ad-685cc621a661 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.338341 Dec 25 21:16:41.248440 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1501/2891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:40 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:41.265981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ef2c108-5b92-4302-ba12-ac83d63d25b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '.version_select at 0x7fa4f69791f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:41.360818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:41.376646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40e4a4b8-f0b3-459f-9a78-b19ca5f6c02a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.355851 Dec 25 21:16:41.378271 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1391/2892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:41 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:41.427405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:41.429557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:41.439595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.440043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.440848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.449472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.641766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:41.655753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-773a1ae8-340d-4e74-9110-8ff0811bde6a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1318 microversion: 2.1 time: 0.229795 Dec 25 21:16:41.655753 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1392/2893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:41 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:41.657794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:41.658768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:41.665725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.666113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.667169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.667791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.686304 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ef2c108-5b92-4302-ba12-ac83d63d25b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/images/54520c35-8ed4-4398-906b-112cd8202410" status: 204 len: 0 microversion: 2.1 time: 0.423594 Dec 25 21:16:41.686826 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1502/2894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:41 2021] DELETE /compute/v2.1/images/54520c35-8ed4-4398-906b-112cd8202410 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:41.696009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:41.696676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:41.710104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.710565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.713435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.713889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.718943 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e947a5e-5ff6-401c-a060-27a8b0d92944 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.065431 Dec 25 21:16:41.724981 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1393/2895] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:41 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:41.890903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:41.905501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:41.906235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:41.911465 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da843b50-ddee-4af9-91e8-ee463084765b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1532 microversion: 2.1 time: 0.215655 Dec 25 21:16:41.924956 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1503/2896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:41 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1532 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:41.926288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.927612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:41.952540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:41.958866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:42.021803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance fcc7022a-66f7-4481-80f6-03320c1f3a53 could not be found. Dec 25 21:16:42.022419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance fcc7022a-66f7-4481-80f6-03320c1f3a53 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:42.023312 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-59eacb82-c085-41c3-bf98-c8d1acaa65fe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 404 len: 111 microversion: 2.1 time: 0.126544 Dec 25 21:16:42.032140 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1394/2897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:41 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:42.041077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5aedad41-3b3f-4811-8ad9-7b37707f2957 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f70a4f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:42.125986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5aedad41-3b3f-4811-8ad9-7b37707f2957 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.109574 Dec 25 21:16:42.127029 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1504/2898] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:42 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:42.226729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3d0864aa-0a66-4894-b6d1-134ad1a63f5d req-cda62fb8-7825-4baf-94d1-92b43d4ed747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1b1d33-82d4-4c29-8f52-f3c59e495d4e", "name": "network-vif-plugged", "status": "completed", "tag": "fba43cf4-f214-42a5-b791-cde0e1556285"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:42.228268 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:42.228268 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:42.239384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1802944974", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:42.249652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3d0864aa-0a66-4894-b6d1-134ad1a63f5d req-cda62fb8-7825-4baf-94d1-92b43d4ed747 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:42.250952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3d0864aa-0a66-4894-b6d1-134ad1a63f5d req-cda62fb8-7825-4baf-94d1-92b43d4ed747 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:42.267268 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3d0864aa-0a66-4894-b6d1-134ad1a63f5d req-cda62fb8-7825-4baf-94d1-92b43d4ed747 service nova] Creating event network-vif-plugged:fba43cf4-f214-42a5-b791-cde0e1556285 for instance 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e on nch1-master-1 Dec 25 21:16:42.279957 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3d0864aa-0a66-4894-b6d1-134ad1a63f5d req-cda62fb8-7825-4baf-94d1-92b43d4ed747 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051078 Dec 25 21:16:42.279957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1395/2899] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:42.298300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:42.299441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:42.320524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:42.324550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:42.325646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:42.326089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:42.328172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:43.354868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:43.367415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea886a8f-531b-45c6-ad53-bb71940fd0cf tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 1.090439 Dec 25 21:16:43.368581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1396/2900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:42 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:43.374156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:43.375014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:43.386372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:43.386926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:43.387808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:43.388322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:43.563846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:43.564396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:43.564732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:43.565177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:43.565614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:43.577664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:43.578409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:43.579561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:43.580195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:43.603510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:43.610460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:43.630959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:43.633697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:43.802689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-91295b33-d158-49c7-bdcb-e3a0249b10e0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.566775 Dec 25 21:16:43.811252 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1505/2901] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:43.824498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:43.827438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:43.847785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:43.849662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:43.854449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:43.855225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:43.985205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:44.009783 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4985b931-1a0f-4148-a5f3-78dbac61b0fa tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.638528 Dec 25 21:16:44.009783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1397/2902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:43 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:44.019009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:44.021045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:44.046289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:44.046289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:44.046289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:44.046289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:44.166183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-196cf31b-8775-4397-8d0d-a6f965e5ad31 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.151264 Dec 25 21:16:44.167325 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1398/2903] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:44 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:44.172765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:44.177772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:44.200605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:44.200605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:44.200980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:44.201365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:44.264913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:44.279032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-655083ae-a1b9-45b8-bd55-e90ea2fb0e3a tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1318 microversion: 2.1 time: 0.464834 Dec 25 21:16:44.279847 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1506/2904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:43 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:44.343238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5281d17f-c7a4-411c-b90e-346fd6f681fa tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f696ab80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:44.365221 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5281d17f-c7a4-411c-b90e-346fd6f681fa tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.079477 Dec 25 21:16:44.373716 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1507/2905] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:44 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:44.381553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-229bf8b6-fe80-4cdd-87b0-f3e01dfab362 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:44.382623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-229bf8b6-fe80-4cdd-87b0-f3e01dfab362 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:44.494392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-229bf8b6-fe80-4cdd-87b0-f3e01dfab362 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:44.501804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-229bf8b6-fe80-4cdd-87b0-f3e01dfab362 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1215 microversion: 2.1 time: 0.126127 Dec 25 21:16:44.511921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1508/2906] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:44 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:44.517051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:44.517945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:44.529129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:44.529596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:44.530411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:44.530861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:44.570209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:44.583337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a68430ba-9612-4fd0-9672-fe3674be2587 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1538 microversion: 2.1 time: 0.414446 Dec 25 21:16:44.593671 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1399/2907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:44 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1538 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:44.700538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:44.708104 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5892914-8ee6-4f1a-a3ed-d38d8087ac77 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.194670 Dec 25 21:16:44.708676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1509/2908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:44 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:45.038018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:45.045188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:45.053336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.057313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.057313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.057313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.207052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:45.209522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:45.227872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.228339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.229194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.229639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.311715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f71253d-2b41-44ab-b1f9-c949b2b8087b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.112856 Dec 25 21:16:45.322126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1510/2909] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:45 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:45.328082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:45.329200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:45.343216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.344032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.345129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.351325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.389718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:45.407436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc53d41f-0370-44f6-81f9-096e4e91604f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.373849 Dec 25 21:16:45.409118 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1400/2910] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:45 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:45.416675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e329403-b386-4abb-b19f-0aba365382b5 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61e0ee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:45.488073 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e329403-b386-4abb-b19f-0aba365382b5 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1455 microversion: 2.1 time: 0.078864 Dec 25 21:16:45.488980 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1401/2911] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:45 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:45.519299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:45.524004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:45.527535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.528073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.528959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.529585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.626409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:45.669452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:45.676399 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83abbf6c-ced3-4530-b8c5-973e93d86c07 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1219 microversion: 2.1 time: 0.160859 Dec 25 21:16:45.685135 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1402/2912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:45 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1219 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:45.693458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:45.700350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:45.708229 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f01a54e3-b834-4a8c-bc97-d991c7535d25 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1508 microversion: 2.1 time: 0.383543 Dec 25 21:16:45.711333 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1511/2913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:45 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1508 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:45.730664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:45.731478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:45.733835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.735579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.740567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.741449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.742470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.743239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:45.744574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:45.745296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.035633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:46.040459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:46.051916 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4578fe3-0e32-47f2-bf6a-a63db4e4ce07 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.325304 Dec 25 21:16:46.053321 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1512/2914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:45 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:46.059650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-199256061", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "050fe506-29b6-4536-b03a-6d4fd9d4993c"}], "security_groups": [{"name": "tempest-securitygroup--986829741"}], "key_name": "tempest-keypair-1979290507", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:46.064699 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16b319a2-ceca-4168-9f74-52f559761456 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1520 microversion: 2.1 time: 0.378062 Dec 25 21:16:46.073480 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1403/2915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:45 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1520 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:46.078036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c506b376-ff41-4fc8-9ee6-f70320046931 req-27629faa-ae60-483a-9cc1-c07e7c947570 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d343d1d-ac0a-4447-862f-e13c2facfcef", "name": "network-vif-plugged", "status": "completed", "tag": "79306c37-bd08-49bf-b49d-90f7ba24ce10"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:46.079645 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:46.079645 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:46.095147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c506b376-ff41-4fc8-9ee6-f70320046931 req-27629faa-ae60-483a-9cc1-c07e7c947570 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.095613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c506b376-ff41-4fc8-9ee6-f70320046931 req-27629faa-ae60-483a-9cc1-c07e7c947570 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.123024 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c506b376-ff41-4fc8-9ee6-f70320046931 req-27629faa-ae60-483a-9cc1-c07e7c947570 service nova] Creating event network-vif-plugged:79306c37-bd08-49bf-b49d-90f7ba24ce10 for instance 1d343d1d-ac0a-4447-862f-e13c2facfcef on nch1-master-1 Dec 25 21:16:46.158917 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c506b376-ff41-4fc8-9ee6-f70320046931 req-27629faa-ae60-483a-9cc1-c07e7c947570 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084343 Dec 25 21:16:46.160075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1404/2916] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:46.178519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:46.179123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:46.192584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.193078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.193894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.194358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.219588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] validate_networks() for [('050fe506-29b6-4536-b03a-6d4fd9d4993c', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:46.237769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:16:46.631144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:46.631576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:46.632086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:46.632563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:46.633042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:46.647908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.649012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.649933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.650720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.675472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:46.682708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:46.702490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:46.705189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:46.760685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7a5ba7e-e25b-407e-8378-7bdb88db690b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 204 len: 0 microversion: 2.1 time: 0.598593 Dec 25 21:16:46.761342 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1405/2917] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:46 2021] DELETE /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:46.771990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:46.773075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:46.779000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.779451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.780265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.780796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.864732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81fbac36-be88-4356-85ff-c898514186f4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.810100 Dec 25 21:16:46.870631 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1513/2918] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:46 2021] POST /compute/v2.1/servers => generated 408 bytes in 812 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:46.871125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:46.871824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:46.879003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.880278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:46.884295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:46.884295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.109442 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03eb7bca-b6cc-4c1b-9893-12199e89a038 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.343357 Dec 25 21:16:47.110142 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1406/2919] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:46 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:47.115601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0622a789-a4c6-40d7-a3d0-84ab1b9a8ca9 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61c1b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.135677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:47.148059 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51437b01-42fe-4e41-aba3-003abad27f8b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.280962 Dec 25 21:16:47.159160 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1514/2920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:46 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.172377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.173160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:47.180274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.181201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.182101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.182564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.200530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0622a789-a4c6-40d7-a3d0-84ab1b9a8ca9 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1464 microversion: 2.1 time: 0.088599 Dec 25 21:16:47.208784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1407/2921] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1464 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.209380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.210441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:47.217088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.217638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.218518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.219030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.270531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:47.279393 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60da9ef1-59c1-4660-9310-4c08b3d8dc92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1275 microversion: 2.1 time: 0.118256 Dec 25 21:16:47.288988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1515/2922] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1275 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.294539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-020b5c5e-d389-44f9-be2e-55ae2247213c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.295638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-020b5c5e-d389-44f9-be2e-55ae2247213c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:47.358656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-020b5c5e-d389-44f9-be2e-55ae2247213c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:47.366343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-020b5c5e-d389-44f9-be2e-55ae2247213c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1238 microversion: 2.1 time: 0.076170 Dec 25 21:16:47.366846 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1516/2923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.371535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.372387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:47.383501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.384173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.385142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.385658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.405558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:47.413635 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf0fa377-dac1-4958-9c83-114b91b7299e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1526 microversion: 2.1 time: 0.210493 Dec 25 21:16:47.414569 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1408/2924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1526 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.419104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a7ce922-f2d4-4b1a-8dab-29c28276e20d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61c1310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.475089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a7ce922-f2d4-4b1a-8dab-29c28276e20d tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 200 len: 1464 microversion: 2.1 time: 0.059075 Dec 25 21:16:47.476026 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1409/2925] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 1464 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.487740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.489294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:47.496460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.496951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.497946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:47.498559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:47.620656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:47.634703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-049075fe-72d4-4fe3-a9f6-5c4332660602 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.266737 Dec 25 21:16:47.642411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1517/2926] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.685284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:47.691551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-984a20a7-6e3d-44a6-a4c5-712688143a97 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 1468 microversion: 2.1 time: 0.207601 Dec 25 21:16:47.692217 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1410/2927] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:47.708592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0037f456-99f8-4ae2-a531-1bb6e805e0ac tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500732550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.822633 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0037f456-99f8-4ae2-a531-1bb6e805e0ac tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?changes-since=2021-12-25T21%3A15%3A08Z" status: 200 len: 1903 microversion: 2.1 time: 0.117684 Dec 25 21:16:47.823227 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1518/2928] 10.222.0.32 () {58 vars in 1198 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/images?changes-since=2021-12-25T21%3A15%3A08Z => generated 1903 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:47.834816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8497e331-df0d-4314-a47a-464ba2f1595c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61c1e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:47.915875 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8497e331-df0d-4314-a47a-464ba2f1595c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-247048621" status: 200 len: 484 microversion: 2.1 time: 0.084414 Dec 25 21:16:47.923200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1411/2929] 10.222.0.32 () {58 vars in 1228 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-247048621 => generated 484 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:47.929722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04d0b530-a840-437e-86d4-9bd9b742c9a3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6e330d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.031269 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04d0b530-a840-437e-86d4-9bd9b742c9a3 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?server=66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 957 microversion: 2.1 time: 0.106187 Dec 25 21:16:48.031841 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1519/2930] 10.222.0.32 () {58 vars in 1208 bytes} [Sat Dec 25 21:16:47 2021] GET /compute/v2.1/images?server=66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 957 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:48.043884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5131a2d4-365a-4e5d-bca7-14fd33abed2f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61854c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.092826 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5131a2d4-365a-4e5d-bca7-14fd33abed2f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 485 microversion: 2.1 time: 0.052524 Dec 25 21:16:48.093425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1412/2931] 10.222.0.32 () {58 vars in 1316 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 485 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:48.104146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abf9b085-76ab-416f-b700-cbcfcad75848 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f1310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.120300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:48.121305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.127844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.128358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.129185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.129634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.153367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abf9b085-76ab-416f-b700-cbcfcad75848 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 485 microversion: 2.1 time: 0.052809 Dec 25 21:16:48.153942 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1520/2932] 10.222.0.32 () {58 vars in 1302 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 485 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:48.165237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.169287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.172283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.172575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.172738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2dd8b386-f519-4bb5-a751-5fee116d6502 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.055948 Dec 25 21:16:48.176783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.176976 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1413/2933] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:48 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:48.177103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.178892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2031416-2ff0-49d2-853d-4cf8d0e1e18c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6185700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.300142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2031416-2ff0-49d2-853d-4cf8d0e1e18c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.125485 Dec 25 21:16:48.301321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1414/2934] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.306412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ba7a1635-83cb-4104-b376-db779809404d req-a47851fd-910c-4a56-be6f-874a0513e612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d343d1d-ac0a-4447-862f-e13c2facfcef", "name": "network-vif-unplugged", "status": "completed", "tag": "79306c37-bd08-49bf-b49d-90f7ba24ce10"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:48.310039 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:48.310039 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:48.324711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ba7a1635-83cb-4104-b376-db779809404d req-a47851fd-910c-4a56-be6f-874a0513e612 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.325309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ba7a1635-83cb-4104-b376-db779809404d req-a47851fd-910c-4a56-be6f-874a0513e612 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.338436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ba7a1635-83cb-4104-b376-db779809404d req-a47851fd-910c-4a56-be6f-874a0513e612 service nova] Creating event network-vif-unplugged:79306c37-bd08-49bf-b49d-90f7ba24ce10 for instance 1d343d1d-ac0a-4447-862f-e13c2facfcef on nch1-master-1 Dec 25 21:16:48.343846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ba7a1635-83cb-4104-b376-db779809404d req-a47851fd-910c-4a56-be6f-874a0513e612 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041142 Dec 25 21:16:48.346918 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1415/2935] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:48.349399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.350100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.356462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.356967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.357797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.358285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.387575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:48.410582 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-181a4fd9-bbab-4e97-9f24-fd72d8b79626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1542 microversion: 2.1 time: 0.248761 Dec 25 21:16:48.411179 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1521/2936] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.430266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e7c416e-f152-42a2-b97f-ecd5d4906f54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500732e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.502262 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e7c416e-f152-42a2-b97f-ecd5d4906f54 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.078706 Dec 25 21:16:48.503127 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1522/2937] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.511595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.512482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.512715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:48.520824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.527801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.527801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.528036 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c60877d6-4c56-41b5-9bc2-fcb92db9f77c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1315 microversion: 2.1 time: 0.176989 Dec 25 21:16:48.528133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.528224 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1416/2938] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.529261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.530140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.538805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.539266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.540071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.540507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.620089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:48.627542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-16c5a832-6938-45d3-857c-830e91e2f5e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1242 microversion: 2.1 time: 0.123208 Dec 25 21:16:48.628120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1523/2939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1242 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.633151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-19687c48-45ab-4c5c-bb6a-1503800d2579 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6e330d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.714724 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-19687c48-45ab-4c5c-bb6a-1503800d2579 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.085533 Dec 25 21:16:48.715440 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1524/2940] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:48.724235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.726896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.735837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:48.740703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.741465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.742500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.743150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.750611 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e17400b9-7808-4068-8809-a712b509825a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1526 microversion: 2.1 time: 0.224846 Dec 25 21:16:48.751251 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1417/2941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1526 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.769825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1b71850-1d17-44fb-bd8f-c43b0253f1aa tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f67c0280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:48.869653 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1b71850-1d17-44fb-bd8f-c43b0253f1aa tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?changes-since=2021-12-25T21%3A15%3A03Z" status: 200 len: 6334 microversion: 2.1 time: 0.107934 Dec 25 21:16:48.870990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1418/2942] 10.222.0.32 () {58 vars in 1219 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/images/detail?changes-since=2021-12-25T21%3A15%3A03Z => generated 6334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:48.877877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "372213cb-a444-4b5e-a26a-0dcf9d722c47"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:48.889123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:48.897899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.901762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:48.901762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:48.901762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.025858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:49.040113 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3184fce0-87ef-4e75-a4ef-7893b2e80c05 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.323299 Dec 25 21:16:49.041096 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1525/2943] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:48 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:49.057951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c744b67d-d0b4-48ee-9270-9fe2fbe26fab tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f5670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.108918 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c744b67d-d0b4-48ee-9270-9fe2fbe26fab tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-247048621" status: 200 len: 664 microversion: 2.1 time: 0.062224 Dec 25 21:16:49.116504 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1526/2944] 10.222.0.32 () {58 vars in 1249 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-247048621 => generated 664 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:49.128295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eae00f8f-3953-4e84-bf75-9bc2ca61f7d4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500732ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.190961 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eae00f8f-3953-4e84-bf75-9bc2ca61f7d4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1467 microversion: 2.1 time: 0.070207 Dec 25 21:16:49.191602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1527/2945] 10.222.0.32 () {58 vars in 1337 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fv2.1%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1467 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:49.197103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b728ee59-6452-4bc1-ab8c-fdfbc31d218b req-5e2e05cb-664b-4230-9222-d131cf75e995 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cf3a17-49d6-43d2-9b08-505f1e637900", "tag": "68b20766-9d12-4028-ab7b-1eb5150d2808"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:49.199221 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:49.199221 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:49.215504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b728ee59-6452-4bc1-ab8c-fdfbc31d218b req-5e2e05cb-664b-4230-9222-d131cf75e995 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.215948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b728ee59-6452-4bc1-ab8c-fdfbc31d218b req-5e2e05cb-664b-4230-9222-d131cf75e995 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.232433 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b728ee59-6452-4bc1-ab8c-fdfbc31d218b req-5e2e05cb-664b-4230-9222-d131cf75e995 service nova] Creating event network-changed:68b20766-9d12-4028-ab7b-1eb5150d2808 for instance 05cf3a17-49d6-43d2-9b08-505f1e637900 on nch2-master-1 Dec 25 21:16:49.238070 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b728ee59-6452-4bc1-ab8c-fdfbc31d218b req-5e2e05cb-664b-4230-9222-d131cf75e995 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045174 Dec 25 21:16:49.240748 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1528/2946] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:49.246764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:49.250202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:49.256969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.257720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.258556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.259021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.323768 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-874136ff-a7e6-4252-9d49-6a2fe3b4699b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.081346 Dec 25 21:16:49.324434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1529/2947] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:49 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:49.330560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6da09c94-3a1c-4b9d-ad21-74cf955e2595 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f1940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.390399 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6da09c94-3a1c-4b9d-ad21-74cf955e2595 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1467 microversion: 2.1 time: 0.064519 Dec 25 21:16:49.391838 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1530/2948] 10.222.0.32 () {58 vars in 1323 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.32%2Fcompute%2Fservers%2F59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1467 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:49.404810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c0dbfa9-100b-4b4e-8e96-37e541ca2dd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa500722280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.503685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c0dbfa9-100b-4b4e-8e96-37e541ca2dd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7109 microversion: 2.1 time: 0.103031 Dec 25 21:16:49.515756 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1531/2949] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7109 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:49.523053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.523800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:49.530651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.531341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.532136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.532578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.786939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4374586d-ba5d-43af-b145-c7b0be188302 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "POST /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912413 Dec 25 21:16:49.788683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1419/2950] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:16:48 2021] POST /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments => generated 194 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:49.818016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53f65e1c-d4e2-4511-9ab3-41b8877ab4ce tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f758cca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.913399 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53f65e1c-d4e2-4511-9ab3-41b8877ab4ce tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4376 microversion: 2.1 time: 0.122992 Dec 25 21:16:49.913981 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1420/2951] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/images/detail?type=snapshot => generated 4376 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:49.919849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:49.920858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:49.978535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.979000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:49.984256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:49.984864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.083936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:50.092502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b82c0ef8-5345-46cf-a2bd-9ab530030ded tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1541 microversion: 2.1 time: 0.574124 Dec 25 21:16:50.102931 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1532/2952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1541 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:50.108132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:50.108988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:50.135275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.138089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.142339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.143075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.343795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:50.353341 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae52c006-587d-4bbc-bb88-80931b4c08ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1308 microversion: 2.1 time: 0.249020 Dec 25 21:16:50.364961 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1533/2953] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:50 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1308 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:50.372259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:50.373269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:50.385475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.385475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.385475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.385475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.847258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:50.857638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e90565a-23ec-4608-ac9e-8a92394c2b00 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 200 len: 1307 microversion: 2.1 time: 0.490814 Dec 25 21:16:50.858477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1534/2954] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:50 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 1307 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:50.864095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b254d72b-5c57-4da7-8534-44d84aad62cf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f75334c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:50.870271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:50.889487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-671aa70b-d6fb-47e5-8d75-b4a596f0c6db tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1315 microversion: 2.1 time: 0.972803 Dec 25 21:16:50.890352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1421/2955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:49 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1315 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:50.915367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e4169e16-08b5-4235-9f7a-f69325dea0ec req-ba01c31b-aa18-412f-acd7-3eea0ff405ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "name": "network-vif-unplugged", "status": "completed", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:50.917803 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:50.917803 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:50.919059 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b254d72b-5c57-4da7-8534-44d84aad62cf tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/aca914d0-5f7b-465f-a024-75efa27d7291" status: 200 len: 784 microversion: 2.1 time: 0.058902 Dec 25 21:16:50.919875 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1535/2956] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:16:50 2021] GET /compute/v2.1/images/aca914d0-5f7b-465f-a024-75efa27d7291 => generated 784 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:50.929198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:50.933865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:50.935082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e4169e16-08b5-4235-9f7a-f69325dea0ec req-ba01c31b-aa18-412f-acd7-3eea0ff405ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.935601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e4169e16-08b5-4235-9f7a-f69325dea0ec req-ba01c31b-aa18-412f-acd7-3eea0ff405ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.937722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.938174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.939187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:50.939745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:50.964095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e4169e16-08b5-4235-9f7a-f69325dea0ec req-ba01c31b-aa18-412f-acd7-3eea0ff405ad service nova] Creating event network-vif-unplugged:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch1-master-1 Dec 25 21:16:50.971595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-e4169e16-08b5-4235-9f7a-f69325dea0ec req-ba01c31b-aa18-412f-acd7-3eea0ff405ad service nova] Instance 36168d53-184a-47fb-a60b-6f72689c760c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:16:50.994463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e4169e16-08b5-4235-9f7a-f69325dea0ec req-ba01c31b-aa18-412f-acd7-3eea0ff405ad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093846 Dec 25 21:16:50.995078 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1422/2957] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:51.004113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:51.005197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:51.011526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.014194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:51.014194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.014194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:51.079889 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baa9690c-e436-41c4-8346-86bab18b5772 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.083116 Dec 25 21:16:51.080791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1423/2958] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:50 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:51.103117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7ab8a965-ecf4-456e-9be8-5c851b8e63d5 req-5183c9f2-bbb8-42b5-a8e9-baa71dfbbcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "name": "network-vif-unplugged", "status": "completed", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:51.105834 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:51.105834 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:51.115256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7ab8a965-ecf4-456e-9be8-5c851b8e63d5 req-5183c9f2-bbb8-42b5-a8e9-baa71dfbbcf1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.115992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7ab8a965-ecf4-456e-9be8-5c851b8e63d5 req-5183c9f2-bbb8-42b5-a8e9-baa71dfbbcf1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:51.133362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7ab8a965-ecf4-456e-9be8-5c851b8e63d5 req-5183c9f2-bbb8-42b5-a8e9-baa71dfbbcf1 service nova] Creating event network-vif-unplugged:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:16:51.145884 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7ab8a965-ecf4-456e-9be8-5c851b8e63d5 req-5183c9f2-bbb8-42b5-a8e9-baa71dfbbcf1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061141 Dec 25 21:16:51.146530 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1424/2959] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:51 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:51.156201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01e0982f-98ec-4be8-976c-ddd5b26b35d6 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f62423a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:51.228689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01e0982f-98ec-4be8-976c-ddd5b26b35d6 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.078582 Dec 25 21:16:51.229244 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1425/2960] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:16:51 2021] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:51.241878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:51.245878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:51.261057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.261057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:51.261057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.261409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:51.301611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:51.324863 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-951cce19-04c1-43c3-8995-7547309da7a3 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.403417 Dec 25 21:16:51.328774 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1536/2961] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:50 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:51.362695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ada335b-779d-4292-b3bc-6027c919d3ee tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa50079aaf0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:51.655069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:51.663719 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b22399a2-8069-4f94-9564-49f89dfc4a18 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1541 microversion: 2.1 time: 0.433221 Dec 25 21:16:51.673382 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1426/2962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:51 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1541 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:51.673382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:51.673382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:51.676594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.676975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:51.677763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:51.681206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.053810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:52.071644 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c46e3bd-174e-4189-9c9c-fd361d2c09db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.406171 Dec 25 21:16:52.072253 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1427/2963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:51 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:52.077992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:52.078631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:52.085434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.086249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.087438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.087898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.105542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance 1d343d1d-ac0a-4447-862f-e13c2facfcef could not be found. Dec 25 21:16:52.106210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance 1d343d1d-ac0a-4447-862f-e13c2facfcef could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:52.107074 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc53f6c6-b49b-4221-8c07-a91e98270d5c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 404 len: 111 microversion: 2.1 time: 0.033880 Dec 25 21:16:52.108623 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1428/2964] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:52 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:52.114769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:52.116511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:52.125345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.126084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.127406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.128063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.430577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:52.440065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89dd8394-3b82-4f16-9912-f37ea1b3343d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1315 microversion: 2.1 time: 0.329948 Dec 25 21:16:52.445251 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1429/2965] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:52 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:52.452972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:52.453969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:52.463343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.463805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.464627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.465111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.523641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc35ce47-2d99-45bc-9c07-af01dd3d5bba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.076676 Dec 25 21:16:52.525203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1430/2966] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:52 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:52.532016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99c1c313-6c13-4e8f-9340-4b437770752d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'create', calling method: .version_select at 0x7fa4f6185c10>, body: {"keypair": {"name": "tempest-keypair-229917077"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:52.549212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-99c1c313-6c13-4e8f-9340-4b437770752d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:52.558160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-99c1c313-6c13-4e8f-9340-4b437770752d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for user e7c7a9d6618448c9a5ade71c13a1758d and project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:52.766438 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ada335b-779d-4292-b3bc-6027c919d3ee tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe" status: 204 len: 0 microversion: 2.1 time: 1.433789 Dec 25 21:16:52.767021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1537/2967] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:51 2021] DELETE /compute/v2.1/images/c40145e2-1805-4e5a-8d96-d8510945c0fe => generated 0 bytes in 1437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:52.773662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c3162ebc-f08e-4bf2-8284-332a9d39213e req-15c59201-e2be-40d3-a779-a2b5f2337152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:52.775267 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:52.775267 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:52.782235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c3162ebc-f08e-4bf2-8284-332a9d39213e req-15c59201-e2be-40d3-a779-a2b5f2337152 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.784817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c3162ebc-f08e-4bf2-8284-332a9d39213e req-15c59201-e2be-40d3-a779-a2b5f2337152 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.794948 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c3162ebc-f08e-4bf2-8284-332a9d39213e req-15c59201-e2be-40d3-a779-a2b5f2337152 service nova] Creating event network-changed:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:16:52.800721 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c3162ebc-f08e-4bf2-8284-332a9d39213e req-15c59201-e2be-40d3-a779-a2b5f2337152 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031534 Dec 25 21:16:52.801874 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1538/2968] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:52.807700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:52.808722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:52.815528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.816913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.817818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.818445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.928055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-99c1c313-6c13-4e8f-9340-4b437770752d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:52.934442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-99c1c313-6c13-4e8f-9340-4b437770752d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for user e7c7a9d6618448c9a5ade71c13a1758d and project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:52.952940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99c1c313-6c13-4e8f-9340-4b437770752d tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.425039 Dec 25 21:16:52.953962 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1431/2969] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:16:52 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:52.970568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:52.971378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:52.979187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:52.982051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.982510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.990879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:52.991647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:52.991865 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-869aa93a-bd11-4b33-90db-7b061bf45f78 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.188449 Dec 25 21:16:52.992620 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1539/2970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:52 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:53.007181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3bf93158-faec-4399-8311-c3c578930324 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f68f5310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:53.190869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:53.202158 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f926d89-db11-4b0b-b1cb-90e658c27690 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1473 microversion: 2.1 time: 0.247010 Dec 25 21:16:53.212355 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1432/2971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:52 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:53.212355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d343d1d-ac0a-4447-862f-e13c2facfcef", "name": "network-vif-deleted", "tag": "79306c37-bd08-49bf-b49d-90f7ba24ce10"}, {"name": "network-changed", "server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:53.212672 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:53.212672 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:16:53.221923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.222444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.241642 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] Creating event network-vif-deleted:79306c37-bd08-49bf-b49d-90f7ba24ce10 for instance 1d343d1d-ac0a-4447-862f-e13c2facfcef on nch1-master-1 Dec 25 21:16:53.242155 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] Creating event network-changed:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch1-master-1 Dec 25 21:16:53.250143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] Instance 36168d53-184a-47fb-a60b-6f72689c760c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:16:53.264214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5971681f-92ce-4bfc-ae8b-86fd73f0e2a5 req-ba1e3372-5cb0-43b6-8421-4049d2664074 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059454 Dec 25 21:16:53.264815 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1433/2972] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:53 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:53.274957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:53.276920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:53.284813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.285180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.286022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.286536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.561884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:53.580586 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3f609be-9b22-4d7e-ad70-32bf35009e2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.311037 Dec 25 21:16:53.581300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1434/2973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:53 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:53.586705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:53.587617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:53.598278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.599717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.601016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.601707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.819975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:53.833527 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1d406c5-bf17-481f-93ca-3edc9039ac64 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1315 microversion: 2.1 time: 0.250653 Dec 25 21:16:53.843156 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1435/2974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:53 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:53.848718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:53.850253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:53.857247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.857810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.858690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:53.859368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:53.914197 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2929206-3d3b-4e74-a34f-5a4483a50fbe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.069567 Dec 25 21:16:53.914888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1436/2975] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:53 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:54.009363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:54.010073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:54.019136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.020347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.021383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.022576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.182470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:54.192687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2f42194-5f90-4f9d-9eb2-7f1b4c417171 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.187307 Dec 25 21:16:54.193313 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1437/2976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:54 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:54.219530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:54.220550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:54.228027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.228488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.229782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.229782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.363478 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3bf93158-faec-4399-8311-c3c578930324 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a" status: 204 len: 0 microversion: 2.1 time: 1.360526 Dec 25 21:16:54.364126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1540/2977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:53 2021] DELETE /compute/v2.1/images/bc766d4f-ee9f-4a3b-848b-a49d61ab0f2a => generated 0 bytes in 1362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:54.383340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:54.391278 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86278a6d-7998-4aa2-8469-2fa9f616c379 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1473 microversion: 2.1 time: 0.175594 Dec 25 21:16:54.401002 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1438/2978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:54 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1473 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:54.405261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2ff98a0f-e5b4-43be-902a-c88800e4d0f5 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f62428b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:54.491165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "2b245818-4656-478d-a9e9-1a4534c95def"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:54.492246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:54.507829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.508678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.509497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.509928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.531832 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:54.531832 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:54.611591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] HTTP exception thrown: Volume 2b245818-4656-478d-a9e9-1a4534c95def could not be found. Dec 25 21:16:54.612204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Returning 400 to user: Volume 2b245818-4656-478d-a9e9-1a4534c95def could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:54.613220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3fe24d3-13fd-4456-adb6-d3abb5bd62dd tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] 10.222.0.32 "PUT /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments/372213cb-a444-4b5e-a26a-0dcf9d722c47" status: 400 len: 107 microversion: 2.1 time: 0.247743 Dec 25 21:16:54.613805 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1541/2979] 10.222.0.32 () {60 vars in 1432 bytes} [Sat Dec 25 21:16:54 2021] PUT /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments/372213cb-a444-4b5e-a26a-0dcf9d722c47 => generated 107 bytes in 249 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:16:54.618274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:54.618922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:54.626146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.626734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.627766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.628405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.776125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:54.783474 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dcbcc0d-c538-4db6-b871-582ea9c86fd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.168648 Dec 25 21:16:54.784053 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1542/2980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:54 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:54.788460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:54.789172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:54.795157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.795609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.796422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:54.798600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:54.886422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lazy-loading 'services' on Instance uuid 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:16:55.119589 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05560dcd-1090-4029-8813-9a1ea89686ee tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments/372213cb-a444-4b5e-a26a-0dcf9d722c47" status: 202 len: 0 microversion: 2.1 time: 0.333800 Dec 25 21:16:55.120193 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1543/2981] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:16:54 2021] DELETE /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments/372213cb-a444-4b5e-a26a-0dcf9d722c47 => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:16:55.126773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:55.127477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.137911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.138410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.139345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.139854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.384115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:55.392935 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64ea36ba-a41b-4054-9cf1-bf087598c281 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1315 microversion: 2.1 time: 0.271522 Dec 25 21:16:55.398497 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1544/2982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:55 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:55.398497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:55.399533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.405772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.406444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.407242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.407686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.450108 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a23407a-012d-4ff4-a80f-571bb9002d17 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.055350 Dec 25 21:16:55.454283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1545/2983] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:55 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:55.455698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3cc9fcc8-d3cb-4ff0-b54c-cab78338c1b4 req-a30ad6a4-b759-477a-8138-16df09ce9dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf3a17-49d6-43d2-9b08-505f1e637900", "name": "network-vif-plugged", "status": "completed", "tag": "68b20766-9d12-4028-ab7b-1eb5150d2808"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:55.457829 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:55.457829 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:55.465641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3cc9fcc8-d3cb-4ff0-b54c-cab78338c1b4 req-a30ad6a4-b759-477a-8138-16df09ce9dc7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.466084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3cc9fcc8-d3cb-4ff0-b54c-cab78338c1b4 req-a30ad6a4-b759-477a-8138-16df09ce9dc7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.478144 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3cc9fcc8-d3cb-4ff0-b54c-cab78338c1b4 req-a30ad6a4-b759-477a-8138-16df09ce9dc7 service nova] Creating event network-vif-plugged:68b20766-9d12-4028-ab7b-1eb5150d2808 for instance 05cf3a17-49d6-43d2-9b08-505f1e637900 on nch2-master-1 Dec 25 21:16:55.482804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3cc9fcc8-d3cb-4ff0-b54c-cab78338c1b4 req-a30ad6a4-b759-477a-8138-16df09ce9dc7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030770 Dec 25 21:16:55.483393 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1546/2984] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:55.490683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:55.492019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.499160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.499672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.500460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.500931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.532441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1e0ce00-91ab-44cf-a5dd-dbb082d44a17 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046285 Dec 25 21:16:55.533040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1547/2985] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:16:55 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:55.537891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:55.538624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.545255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.545798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.547118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.547567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.576387 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2ff98a0f-e5b4-43be-902a-c88800e4d0f5 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70" status: 204 len: 0 microversion: 2.1 time: 1.180178 Dec 25 21:16:55.578431 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1439/2986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:54 2021] DELETE /compute/v2.1/images/0a4f65cb-6861-4077-bd4e-8872f4bc2b70 => generated 0 bytes in 1184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:55.586458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:55.587817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.596966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.597430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.599244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.599683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.830360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:55.839037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8266a2f-8e09-4cde-9a7d-6a51b694d159 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.305014 Dec 25 21:16:55.839617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1548/2987] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:55 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:55.851588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:55.859313 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13033d62-ef17-4b46-afc9-f1f910683626 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1470 microversion: 2.1 time: 0.279027 Dec 25 21:16:55.859512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:55.859886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.873078 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1440/2988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:55 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1470 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:55.875102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:55.875906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:55.876154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.876928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.877744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.878325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.883304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.883871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.884791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:55.885373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:55.914665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:16:56.115412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:56.123400 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55018e34-1612-4ea0-bfba-be7b0988cf68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.252101 Dec 25 21:16:56.124211 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1441/2989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:55 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:56.129751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:56.146925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:56.146925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.146925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.146925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.146925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.170797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.171247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.172060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.172503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.194808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:56.199870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for user f9e59d219fa640e48533e0efdf150b16 and project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:56.279319 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-140277f9-3b80-45b9-8ec9-de857f2f1f65 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 204 len: 0 microversion: 2.1 time: 0.426611 Dec 25 21:16:56.280104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1549/2990] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:16:55 2021] DELETE /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:16:56.288300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:56.288998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:56.294857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.295306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.296083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.296511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.441893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:56.449604 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca20c249-7866-4738-aae2-8b8518175224 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1473 microversion: 2.1 time: 0.165380 Dec 25 21:16:56.450266 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1550/2991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:56 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1473 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:56.463398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:56.464088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:56.469954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.470488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.471372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.473450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.555735 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2724eff7-0953-4645-8210-6493f5e257a8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c/action" status: 202 len: 0 microversion: 2.1 time: 0.429056 Dec 25 21:16:56.556471 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1442/2992] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:56 2021] POST /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:16:56.564570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:56.565782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:56.574532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.574994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.575803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.576280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.615054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:56.619585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7abcd2b7-c05b-4cb3-8f31-5a85115519bf tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.061316 Dec 25 21:16:56.621009 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1443/2993] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:56 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:56.624206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-417517d0-69c0-4a11-8905-8e08393a5876 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1315 microversion: 2.1 time: 0.164236 Dec 25 21:16:56.624781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1551/2994] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:56 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:56.626677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-478251550", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "979f5e3f-5f36-45e3-b799-ae422a7efba5"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:56.629621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:56.630786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:56.638047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.638764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.639558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.639998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.675561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-367add6a-6832-4081-995f-b3f41325bdcc tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049347 Dec 25 21:16:56.681425 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1552/2995] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:16:56 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:16:56.685970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:56.689815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:56.694261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.694952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.695946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:56.696583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:56.698009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] validate_networks() for [('979f5e3f-5f36-45e3-b799-ae422a7efba5', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:16:57.023208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:57.030872 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a521e4cb-3d90-4a15-a691-4b724e7ae8c3 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1469 microversion: 2.1 time: 0.348427 Dec 25 21:16:57.031453 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1553/2996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:56 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1469 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:57.039049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:57.039816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:57.046406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.048259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.048259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.048259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.360695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:57.369083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94b566ac-3a0a-46df-ab78-49a02dcb2141 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.336550 Dec 25 21:16:57.379107 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1554/2997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:57 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:57.379107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:57.379107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:57.383328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.383855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.384736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.385389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.787068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:16:57.788168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:16:57.789055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:16:57.790435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:16:57.792338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:16:57.810340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.810801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.811877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.812316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.832243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:16:57.838627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for user e7c7a9d6618448c9a5ade71c13a1758d and project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:16:57.852378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:16:57.855561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:16:57.883670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:57.891753 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c785d17-199a-4be0-9c5d-98c15acab9af tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.520994 Dec 25 21:16:57.892581 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1555/2998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:57 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:57.897108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:57.898073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:57.904348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.904801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:57.907730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:57.907730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.082374 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0345cefc-0787-465d-af4e-9cb7ee0f63cb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.459988 Dec 25 21:16:58.089653 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1444/2999] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:16:56 2021] POST /compute/v2.1/servers => generated 383 bytes in 1468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:16:58.095087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:58.097220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:58.105079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.105798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.107040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.107692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.182594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:58.188075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44b5c08a-a6a0-44ad-9a58-b692190ba615 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.096819 Dec 25 21:16:58.188732 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1445/3000] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:58 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:58.193974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:58.195033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:58.196163 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cdfb9451-31fe-4d57-a9ef-93a3429623d1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1473 microversion: 2.1 time: 0.302333 Dec 25 21:16:58.209720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.209720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.209720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.209720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.211448 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1556/3001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:57 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1473 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:58.217712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:58.222038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:58.248493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.254263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.254263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.254263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.462217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:58.464476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:58.473097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e896cd19-709d-468a-9c54-044854d22e36 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1502 microversion: 2.1 time: 0.281066 Dec 25 21:16:58.473283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9bdddead-b2b1-43e0-b910-c4c21b692eb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1469 microversion: 2.1 time: 0.259737 Dec 25 21:16:58.473912 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1557/3002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:58 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1469 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:58.489474 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1446/3003] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:58 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1502 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:58.493536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed344fcb-ec0b-488c-9722-0eb89221a942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:58.494354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:58.497934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed344fcb-ec0b-488c-9722-0eb89221a942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:58.498075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:58.502621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.503080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.503919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.504360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.563284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed344fcb-ec0b-488c-9722-0eb89221a942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:58.575239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed344fcb-ec0b-488c-9722-0eb89221a942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1224 microversion: 2.1 time: 0.100046 Dec 25 21:16:58.575950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1558/3004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:58 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:58.678131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:58.686570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dda43331-8756-4a60-9fad-1bf1f84107bb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1514 microversion: 2.1 time: 0.195959 Dec 25 21:16:58.687177 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1447/3005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:58 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1514 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:58.704261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0bab33a6-7409-447f-98db-e538f042237a req-ad906d76-5aee-4093-95d6-a4252064db08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d35b75-8e17-40b9-bfd2-615b2128e5df", "name": "network-vif-deleted", "tag": "a8e1347c-d578-42de-9815-79469dc5aa48"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:58.706220 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:58.706220 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:58.715213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0bab33a6-7409-447f-98db-e538f042237a req-ad906d76-5aee-4093-95d6-a4252064db08 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.715654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0bab33a6-7409-447f-98db-e538f042237a req-ad906d76-5aee-4093-95d6-a4252064db08 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.727810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0bab33a6-7409-447f-98db-e538f042237a req-ad906d76-5aee-4093-95d6-a4252064db08 service nova] Creating event network-vif-deleted:a8e1347c-d578-42de-9815-79469dc5aa48 for instance 59d35b75-8e17-40b9-bfd2-615b2128e5df on nch1-master-1 Dec 25 21:16:58.733797 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0bab33a6-7409-447f-98db-e538f042237a req-ad906d76-5aee-4093-95d6-a4252064db08 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033498 Dec 25 21:16:58.734409 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1559/3006] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:16:58.908446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:58.909047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:58.915869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.916406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:58.917181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:58.917620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.099508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:59.108375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e7159dea-1cb5-4817-965e-c31acaef7cc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.203733 Dec 25 21:16:59.109306 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1448/3007] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:58 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:59.200862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:59.211951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:59.217368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:59.218056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:59.218413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.218866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.219658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.220088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.224778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.225414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.226500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.227439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.271014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e9b73a93-d7f2-4a7f-b830-2bde4ef0ea93 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 32627 microversion: 2.1 time: 0.074598 Dec 25 21:16:59.272057 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1560/3008] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:16:59 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 32627 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:16:59.272366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.272992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.273661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lazy-loading 'fault' on Instance uuid 59d35b75-8e17-40b9-bfd2-615b2128e5df {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:16:59.324859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:59.332442 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5120c398-65af-4189-90c1-07dde3c99cff tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 200 len: 1307 microversion: 2.1 time: 0.118901 Dec 25 21:16:59.333027 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1449/3009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:59 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:59.446543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f296f6a8-189b-4e64-90ca-f36c76a1e788"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:59.448515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:59.456237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.456692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.457531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.457964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.480949 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-volumes-attachments:swap": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:59.480949 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:59.495793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:59.496424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:59.503090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.503597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.504936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.505521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.508565 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] HTTP exception thrown: Volume a6b6bfcd-0973-4182-86f1-2cf4bfc30ccd could not be found. Dec 25 21:16:59.509202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] Returning 404 to user: Volume a6b6bfcd-0973-4182-86f1-2cf4bfc30ccd could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:16:59.510034 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c32e408b-d90b-4405-840f-11c9e64137c7 tempest-VolumesAdminNegativeTest-896882390 tempest-VolumesAdminNegativeTest-896882390-project-admin] 10.222.0.32 "PUT /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments/a6b6bfcd-0973-4182-86f1-2cf4bfc30ccd" status: 404 len: 109 microversion: 2.1 time: 0.067774 Dec 25 21:16:59.511862 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1561/3010] 10.222.0.32 () {60 vars in 1432 bytes} [Sat Dec 25 21:16:59 2021] PUT /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e/os-volume_attachments/a6b6bfcd-0973-4182-86f1-2cf4bfc30ccd => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:16:59.605878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:59.607676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:59.617282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.617884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.618813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.619358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.657894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:59.666159 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ea3f1dc-7203-4a88-a8da-c1310319441f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1469 microversion: 2.1 time: 0.174366 Dec 25 21:16:59.666737 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1450/3011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:59 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:59.701876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:59.703299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:16:59.703919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:16:59.710753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.711221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.711876 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfb1ecf5-0bd7-4dad-ad98-3273ba032bd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1276 microversion: 2.1 time: 0.121714 Dec 25 21:16:59.712008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.712450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:16:59.712818 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1562/3012] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:59 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1276 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:16:59.856919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:16:59.869606 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-91b21eef-2bce-4af7-899b-08d5b6f49332 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1520 microversion: 2.1 time: 0.169939 Dec 25 21:16:59.875573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1451/3013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:16:59 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:16:59.979065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-371731c2-68d0-4114-9370-765eab844ee1 req-7a9eb5aa-36df-4c85-a842-79bc837e1b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "name": "network-vif-plugged", "status": "completed", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:16:59.980903 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:16:59.980903 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:16:59.988771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-371731c2-68d0-4114-9370-765eab844ee1 req-7a9eb5aa-36df-4c85-a842-79bc837e1b8b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:16:59.989359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-371731c2-68d0-4114-9370-765eab844ee1 req-7a9eb5aa-36df-4c85-a842-79bc837e1b8b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.001534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-371731c2-68d0-4114-9370-765eab844ee1 req-7a9eb5aa-36df-4c85-a842-79bc837e1b8b service nova] Creating event network-vif-plugged:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch1-master-1 Dec 25 21:17:00.006925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-371731c2-68d0-4114-9370-765eab844ee1 req-7a9eb5aa-36df-4c85-a842-79bc837e1b8b service nova] Instance 36168d53-184a-47fb-a60b-6f72689c760c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:17:00.017343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-371731c2-68d0-4114-9370-765eab844ee1 req-7a9eb5aa-36df-4c85-a842-79bc837e1b8b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042279 Dec 25 21:17:00.017989 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1563/3014] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:16:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:00.127232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.127857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.135953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.136912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.137707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.138145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.279104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:00.288484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc588bac-1bde-4db6-868f-1e3130c0bc3e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.167041 Dec 25 21:17:00.289731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:00.290732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.298639 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1452/3015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:00.305269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.305736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.306740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.307190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.354517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.355341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 59d35b75-8e17-40b9-bfd2-615b2128e5df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.361526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.361981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.362792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.363571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.375305 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ac9a020-7e02-47f1-875c-e042a15de7a9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 200 len: 40779 microversion: 2.1 time: 0.090791 Dec 25 21:17:00.379779 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1564/3016] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:00 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 40779 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:17:00.379917 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] HTTP exception thrown: Instance 59d35b75-8e17-40b9-bfd2-615b2128e5df could not be found. Dec 25 21:17:00.379917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Returning 404 to user: Instance 59d35b75-8e17-40b9-bfd2-615b2128e5df could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:00.380557 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-232bb96a-0867-47fe-961e-3793e86c23e4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df" status: 404 len: 111 microversion: 2.1 time: 0.029817 Dec 25 21:17:00.381345 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1453/3017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/59d35b75-8e17-40b9-bfd2-615b2128e5df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:17:00.389609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.390604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.392849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.393415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.400229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.400740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.403331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.403331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.403579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.403579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.403777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.403777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.431789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:00.437909 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d71bfbab-1ebe-4121-91a5-cd0b020a7b1d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/ips" status: 200 len: 144 microversion: 2.1 time: 0.052905 Dec 25 21:17:00.450472 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1565/3018] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/ips => generated 144 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:00.685755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.686775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.694481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.695190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.696186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.696621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.865571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:00.873489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-31d8c41f-46e3-480e-9533-aa5c4d101174 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1469 microversion: 2.1 time: 0.194012 Dec 25 21:17:00.874214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1566/3019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1469 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:00.881710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.882636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.886186 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9b93eaf-9a31-4ca7-9c56-fe547f199489 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 204 len: 0 microversion: 2.1 time: 0.496821 Dec 25 21:17:00.890046 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1454/3020] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:00 2021] DELETE /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:00.890197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.890516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.891454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.893109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:00.893974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:00.900274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.900815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.901158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.902163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:00.902869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:00.980070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:00.988911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b3b83ec8-1ca6-4c0b-a4e1-067ab191f188 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1294 microversion: 2.1 time: 0.112609 Dec 25 21:17:00.989761 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1567/3021] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:01.003302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:01.004417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:01.010862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.011317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.012148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.012590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.112358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:01.122586 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3139b859-8ab5-4002-8bb2-8168771557af tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1520 microversion: 2.1 time: 0.234493 Dec 25 21:17:01.123250 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1455/3022] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:01.185092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:01.193092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab84f6db-31cb-4141-8774-cb611d43fbd1 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 1474 microversion: 2.1 time: 0.193480 Dec 25 21:17:01.193675 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1568/3023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:00 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 1474 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:01.306450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:01.307068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:01.314023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.314853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.315595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.316019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.404421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "451b93e3-1579-44a1-b05d-3475df3c0e22"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:01.404421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:01.405955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.406688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.407761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.408287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.580343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:01.588579 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85aca9c0-24eb-4e6b-b1fe-ee79548121ef tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.286048 Dec 25 21:17:01.589180 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1456/3024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:01 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:01.891938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:01.892386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:01.899843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.900298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:01.902358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:01.902358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.055621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:02.064864 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9015f4dc-ad92-4748-b526-7650e7ea3ff8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1535 microversion: 2.1 time: 0.177772 Dec 25 21:17:02.075830 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1457/3025] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:01 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1535 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:02.082122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8599472c-4c9d-48bf-a386-8f439314ee9a req-7e4411a7-7bf0-4a12-bcd2-05bc4f2c1742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "name": "network-vif-unplugged", "status": "completed", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:02.084159 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:02.084159 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:02.106849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8599472c-4c9d-48bf-a386-8f439314ee9a req-7e4411a7-7bf0-4a12-bcd2-05bc4f2c1742 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.107322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8599472c-4c9d-48bf-a386-8f439314ee9a req-7e4411a7-7bf0-4a12-bcd2-05bc4f2c1742 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.122776 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8599472c-4c9d-48bf-a386-8f439314ee9a req-7e4411a7-7bf0-4a12-bcd2-05bc4f2c1742 service nova] Creating event network-vif-unplugged:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch2-master-1 Dec 25 21:17:02.129089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-8599472c-4c9d-48bf-a386-8f439314ee9a req-7e4411a7-7bf0-4a12-bcd2-05bc4f2c1742 service nova] Instance 36168d53-184a-47fb-a60b-6f72689c760c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:17:02.152280 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8599472c-4c9d-48bf-a386-8f439314ee9a req-7e4411a7-7bf0-4a12-bcd2-05bc4f2c1742 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074612 Dec 25 21:17:02.153656 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1458/3026] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:02.160796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:02.161917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:02.193516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.193516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.193516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.193516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.271217 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0906711e-e169-4710-90e7-75f368b1146a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879139 Dec 25 21:17:02.276530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1569/3027] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:17:01 2021] POST /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900/os-volume_attachments => generated 194 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:02.295800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-cacbc61d-e2bf-4b3e-8338-429d7a471b7f req-4e07e1c4-e7da-462c-b93a-3ba4fd6d5d67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-plugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}, {"server_uuid": "a665e8d7-d64e-4879-9389-ad2efb13749b", "name": "network-vif-unplugged", "status": "completed", "tag": "7dbd4557-2b40-4db1-9a68-6caa3efd7bb8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:02.297621 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:02.297621 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:02.324149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cacbc61d-e2bf-4b3e-8338-429d7a471b7f req-4e07e1c4-e7da-462c-b93a-3ba4fd6d5d67 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.324149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cacbc61d-e2bf-4b3e-8338-429d7a471b7f req-4e07e1c4-e7da-462c-b93a-3ba4fd6d5d67 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.347258 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cacbc61d-e2bf-4b3e-8338-429d7a471b7f req-4e07e1c4-e7da-462c-b93a-3ba4fd6d5d67 service nova] Creating event network-vif-plugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:17:02.347784 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cacbc61d-e2bf-4b3e-8338-429d7a471b7f req-4e07e1c4-e7da-462c-b93a-3ba4fd6d5d67 service nova] Creating event network-vif-unplugged:7dbd4557-2b40-4db1-9a68-6caa3efd7bb8 for instance a665e8d7-d64e-4879-9389-ad2efb13749b on nch1-master-1 Dec 25 21:17:02.362292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-cacbc61d-e2bf-4b3e-8338-429d7a471b7f req-4e07e1c4-e7da-462c-b93a-3ba4fd6d5d67 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.088893 Dec 25 21:17:02.363457 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1570/3028] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:02.383937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:02.387412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:02.416476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.416476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.416476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.416476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.525735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:02.533535 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83de1219-ca29-474c-b861-255b52c77f4f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.378435 Dec 25 21:17:02.543443 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1459/3029] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:02 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:02.543443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:02.543443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:02.547751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.548209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.549046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.549489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.829167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:02.852317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b96ad1d0-c5e5-4791-9bdb-c5d8098591d4 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1520 microversion: 2.1 time: 0.470773 Dec 25 21:17:02.853398 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1571/3030] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:02 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1520 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:02.868200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:02.869181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:02.884176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.884737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.887032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:02.888218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:02.978053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:02.987520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2051e30e-04ef-4ef6-95e8-0b76299de32c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 1474 microversion: 2.1 time: 0.451987 Dec 25 21:17:02.990225 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1460/3031] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:02 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 1474 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:02.993423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3bfe5215-ee0b-4d5f-9fd1-1e88c1cae7a3 req-5bf0ea2d-ef31-4cba-b22a-a409f520c2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cf2c55e-9f30-4390-b13e-f7a8917aba8b", "tag": "ca27c441-c54d-4e05-8a52-86b1df07f0e3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:02.995114 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:02.995114 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:03.005269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3bfe5215-ee0b-4d5f-9fd1-1e88c1cae7a3 req-5bf0ea2d-ef31-4cba-b22a-a409f520c2fd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.005990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3bfe5215-ee0b-4d5f-9fd1-1e88c1cae7a3 req-5bf0ea2d-ef31-4cba-b22a-a409f520c2fd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:03.018198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3bfe5215-ee0b-4d5f-9fd1-1e88c1cae7a3 req-5bf0ea2d-ef31-4cba-b22a-a409f520c2fd service nova] Creating event network-changed:ca27c441-c54d-4e05-8a52-86b1df07f0e3 for instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b on nch2-master-1 Dec 25 21:17:03.024732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3bfe5215-ee0b-4d5f-9fd1-1e88c1cae7a3 req-5bf0ea2d-ef31-4cba-b22a-a409f520c2fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034831 Dec 25 21:17:03.025381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1461/3032] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:03.084143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:03.084862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:03.091934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.092629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:03.093963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.094619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:03.280155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:03.291508 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e284f648-48b3-420c-8173-3fc744897f06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1363 microversion: 2.1 time: 0.436645 Dec 25 21:17:03.295866 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1572/3033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:02 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1363 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:03.397546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:03.412541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8cb681a-b6f7-4422-8a9b-cabd245f5ac8 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1535 microversion: 2.1 time: 0.333252 Dec 25 21:17:03.415708 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1462/3034] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:03 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1535 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:03.554117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:03.556245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:03.568530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.570963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:03.572518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.573985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:03.742099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:03.749882 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eadac984-7c42-4759-97a8-5324dc42400c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.202321 Dec 25 21:17:03.750495 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1573/3035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:03 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:03.876730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:03.881514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:03.885678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.886134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:03.886931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:03.889017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.005474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:04.006105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:04.012120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.012569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.013640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.014089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.049523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:04.058770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-434c36df-fc6b-434a-ad26-e5d8065da295 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1520 microversion: 2.1 time: 0.188398 Dec 25 21:17:04.070366 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1463/3036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:03 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:04.085970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4039c9a053164b1685c6535b79a763a4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '919a00bb2d294ab291df4bbd212ae7fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:04.093898 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45e43021-4e4a-4181-ab59-a686d365bc31 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 200 len: 1432 microversion: 2.1 time: 0.093292 Dec 25 21:17:04.094681 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1574/3037] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:03 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 1432 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:04.187167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f20c2314-e634-47bd-8057-27fd172e0171 req-e59d46e0-9ad2-45ec-9e57-ee2dcb8d9cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:04.189053 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:04.189053 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:04.198269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f20c2314-e634-47bd-8057-27fd172e0171 req-e59d46e0-9ad2-45ec-9e57-ee2dcb8d9cda service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.199177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f20c2314-e634-47bd-8057-27fd172e0171 req-e59d46e0-9ad2-45ec-9e57-ee2dcb8d9cda service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.227167 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f20c2314-e634-47bd-8057-27fd172e0171 req-e59d46e0-9ad2-45ec-9e57-ee2dcb8d9cda service nova] Creating event network-changed:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch2-master-1 Dec 25 21:17:04.227167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-f20c2314-e634-47bd-8057-27fd172e0171 req-e59d46e0-9ad2-45ec-9e57-ee2dcb8d9cda service nova] Instance 36168d53-184a-47fb-a60b-6f72689c760c is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:17:04.233282 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f20c2314-e634-47bd-8057-27fd172e0171 req-e59d46e0-9ad2-45ec-9e57-ee2dcb8d9cda service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049877 Dec 25 21:17:04.234443 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1464/3038] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:04.311901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:04.312443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:04.320580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.325382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.327299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.329479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.434593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:04.435401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:04.454309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.461154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.462056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.462733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.697095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:04.711644 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c554aba2-0e7f-44b4-be05-b20ff5a486b9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1550 microversion: 2.1 time: 0.403541 Dec 25 21:17:04.723446 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1575/3039] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:04 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1550 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:04.736151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ddbed29-7029-4b8d-ab16-b904195f2582"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:04.738519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:04.748097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.748798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.750311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.751047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.876088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:04.886984 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad423eb5-7844-4d18-99a6-248bc868f400 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1535 microversion: 2.1 time: 0.458306 Dec 25 21:17:04.897055 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1465/3040] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:04 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1535 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:04.902320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:04.903078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:04.909386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.910096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:04.910887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:04.911491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.035509 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-42eaee21-f8ba-4f9c-867b-aa6b9b4e7797 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136938 Dec 25 21:17:05.037078 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1466/3041] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:17:04 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:05.044815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:05.045486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:05.052194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.052662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.053591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.054036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.235345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:05.244017 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1cdc5317-1bf6-40bf-8fb1-f575991841a5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.205704 Dec 25 21:17:05.246208 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1467/3042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:05 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:05.249145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-49438473-c462-4d8f-a349-c88e13e85951 req-ed7a34c2-a6e7-4ff2-aa3a-16dfd00b11ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66cd474f-564e-4f62-ba35-0016e7dcec42", "name": "network-vif-deleted", "tag": "36aab66a-d72a-4228-bef8-35285fc6597a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:05.250683 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:05.250683 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:05.258406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-49438473-c462-4d8f-a349-c88e13e85951 req-ed7a34c2-a6e7-4ff2-aa3a-16dfd00b11ee service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.258767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-49438473-c462-4d8f-a349-c88e13e85951 req-ed7a34c2-a6e7-4ff2-aa3a-16dfd00b11ee service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.270063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-49438473-c462-4d8f-a349-c88e13e85951 req-ed7a34c2-a6e7-4ff2-aa3a-16dfd00b11ee service nova] Creating event network-vif-deleted:36aab66a-d72a-4228-bef8-35285fc6597a for instance 66cd474f-564e-4f62-ba35-0016e7dcec42 on nch1-master-1 Dec 25 21:17:05.274963 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-49438473-c462-4d8f-a349-c88e13e85951 req-ed7a34c2-a6e7-4ff2-aa3a-16dfd00b11ee service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029173 Dec 25 21:17:05.275503 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1468/3043] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:05.280786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:05.281527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:05.287690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.288157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.288987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.289505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.426990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:05.435177 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-64f23f13-28f3-4f4d-b424-08c63223f898 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1520 microversion: 2.1 time: 0.158334 Dec 25 21:17:05.436408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1469/3044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:05 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:05.441909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:05.442533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] [instance: 66cd474f-564e-4f62-ba35-0016e7dcec42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:05.454164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.454901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.456047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.457080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.471989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] HTTP exception thrown: Instance 66cd474f-564e-4f62-ba35-0016e7dcec42 could not be found. Dec 25 21:17:05.472564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Returning 404 to user: Instance 66cd474f-564e-4f62-ba35-0016e7dcec42 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:05.473431 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d502a4f-8c4e-4cb2-9389-35fe86ce072c tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42" status: 404 len: 111 microversion: 2.1 time: 0.035777 Dec 25 21:17:05.474477 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1470/3045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:05 2021] GET /compute/v2.1/servers/66cd474f-564e-4f62-ba35-0016e7dcec42 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:05.496428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed762c93-589f-4cde-a8b2-cb359601bbd4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6205040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:05.658452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abafe202-1b8f-4939-b694-46c0a2b5b37d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930918 Dec 25 21:17:05.661825 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1576/3046] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:17:04 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:05.904819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-68482e00-7d0f-42a9-ae5f-92648ed4d6e3 req-c6312f4e-139e-47a3-bb04-a5110d9b0dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a665e8d7-d64e-4879-9389-ad2efb13749b", "name": "network-vif-plugged", "status": "completed", "tag": "7dbd4557-2b40-4db1-9a68-6caa3efd7bb8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:05.910188 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:05.910188 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:05.919613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-68482e00-7d0f-42a9-ae5f-92648ed4d6e3 req-c6312f4e-139e-47a3-bb04-a5110d9b0dcd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.920966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-68482e00-7d0f-42a9-ae5f-92648ed4d6e3 req-c6312f4e-139e-47a3-bb04-a5110d9b0dcd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.936372 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-68482e00-7d0f-42a9-ae5f-92648ed4d6e3 req-c6312f4e-139e-47a3-bb04-a5110d9b0dcd service nova] Creating event network-vif-plugged:7dbd4557-2b40-4db1-9a68-6caa3efd7bb8 for instance a665e8d7-d64e-4879-9389-ad2efb13749b on nch1-master-1 Dec 25 21:17:05.941430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-68482e00-7d0f-42a9-ae5f-92648ed4d6e3 req-c6312f4e-139e-47a3-bb04-a5110d9b0dcd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045272 Dec 25 21:17:05.942191 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1577/3047] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:05.948911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:05.949853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:05.962030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.962030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:05.962030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:05.962030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.198783 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed762c93-589f-4cde-a8b2-cb359601bbd4 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/images/0525820e-a39b-4f66-934c-af6debca1539" status: 204 len: 0 microversion: 2.1 time: 0.712973 Dec 25 21:17:06.202132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1471/3048] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:05 2021] DELETE /compute/v2.1/images/0525820e-a39b-4f66-934c-af6debca1539 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:06.207501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-113954e2-b37e-48d5-9768-c4eea048f34f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f6205a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:06.219716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:06.234309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6237feff-6cb2-4608-8915-8bc3e51e331b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1535 microversion: 2.1 time: 0.290691 Dec 25 21:17:06.235219 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1578/3049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:05 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1535 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:06.262931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:06.263070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:06.279279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.279747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.280557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.281031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.488447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:06.497515 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d43d4ad9-c809-4b39-a03c-95a143bd0448 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.239210 Dec 25 21:17:06.510824 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1579/3050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:06 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:06.516205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:06.517556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:06.525430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.526183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.527060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.527506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.574098 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e488764-c112-4fd5-bf9a-eb94ee83794f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.061719 Dec 25 21:17:06.574752 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1580/3051] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:06 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:06.584903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:06.585938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:06.593488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.594271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.595330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.595980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.762515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:06.770249 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a9f721ad-c2c4-4435-9895-5d9dfc2797b8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1520 microversion: 2.1 time: 0.189993 Dec 25 21:17:06.777703 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1581/3052] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:06 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:06.785174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:06.785783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:06.795061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.796490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.797735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:06.798647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:06.799642 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-113954e2-b37e-48d5-9768-c4eea048f34f tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/images/24aa7da8-9951-471e-b24b-4ad0c98d4021" status: 204 len: 0 microversion: 2.1 time: 0.596178 Dec 25 21:17:06.800765 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1472/3053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:06 2021] DELETE /compute/v2.1/images/24aa7da8-9951-471e-b24b-4ad0c98d4021 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:17:06.818492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8394d220-2430-422d-a64d-303d8dc56d55 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] Calling method '.version_select at 0x7fa4f61c1a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:06.840601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:07.164459 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c30fe486-e64a-4e56-963a-7cc245466b98 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 204 len: 0 microversion: 2.1 time: 0.385259 Dec 25 21:17:07.165191 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1582/3054] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:06 2021] DELETE /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:07.173476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:07.174317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:07.182612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.183304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.184400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.185139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.330576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:07.339391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac9e3d1b-a15c-44f5-95f0-d985c123c5a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1554 microversion: 2.1 time: 0.169855 Dec 25 21:17:07.340042 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1583/3055] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:07 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:07.353371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:07.354182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:07.360088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.360540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.361361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.361866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.395590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8394d220-2430-422d-a64d-303d8dc56d55 tempest-ListImageFiltersTestJSON-1815595502 tempest-ListImageFiltersTestJSON-1815595502-project] 10.222.0.32 "DELETE /compute/v2.1/images/ed367211-dfe7-48a8-8aaa-d5a0c9c4950a" status: 204 len: 0 microversion: 2.1 time: 0.583039 Dec 25 21:17:07.396418 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1473/3056] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:06 2021] DELETE /compute/v2.1/images/ed367211-dfe7-48a8-8aaa-d5a0c9c4950a => generated 0 bytes in 585 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:17:07.401447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9ee7fdb8-b4d4-4c8c-b117-1feae8bda81a req-341b4dd3-4b9a-44f1-bc25-1c8261ee0438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:07.403243 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:07.403243 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:07.415456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9ee7fdb8-b4d4-4c8c-b117-1feae8bda81a req-341b4dd3-4b9a-44f1-bc25-1c8261ee0438 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.416293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9ee7fdb8-b4d4-4c8c-b117-1feae8bda81a req-341b4dd3-4b9a-44f1-bc25-1c8261ee0438 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.432234 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9ee7fdb8-b4d4-4c8c-b117-1feae8bda81a req-341b4dd3-4b9a-44f1-bc25-1c8261ee0438 service nova] Creating event network-changed:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:17:07.438705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9ee7fdb8-b4d4-4c8c-b117-1feae8bda81a req-341b4dd3-4b9a-44f1-bc25-1c8261ee0438 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040550 Dec 25 21:17:07.439383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1474/3057] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:07.520675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:07.521701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:07.535494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:07.536023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.539982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.539982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.539982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.551398 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-466b2128-4065-4dc2-ae48-2ed09af95384 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1528 microversion: 2.1 time: 0.209539 Dec 25 21:17:07.556930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1584/3058] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:07 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1528 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:07.569690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:07.570311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:07.580109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.580579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.581972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.582584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.829390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:07.852616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b0c6cc54-5728-4d21-83b0-700d02213942 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.340300 Dec 25 21:17:07.856835 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1475/3059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:07 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:07.890862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:07.896233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:07.916672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.918828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.925898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:07.926370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:07.981518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:07.990493 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-514605a2-ecde-40a0-9845-82a54ec8ed83 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1528 microversion: 2.1 time: 0.424621 Dec 25 21:17:07.991516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1585/3060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:07 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1528 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:07.996914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:07.997993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:08.015876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.020198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.021769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.022234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.023313 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3d7ca5a-da0a-428b-bedf-0bf99214d431 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.164457 Dec 25 21:17:08.023972 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1476/3061] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:07 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:08.029451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1b71523-2949-4c76-8a2b-e164743d44b4 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:08.034151 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:08.034151 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:08.055307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f1b71523-2949-4c76-8a2b-e164743d44b4 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] HTTP exception thrown: Flavor 9c40a937-d17c-4d49-8252-ee02770105fd could not be found. Dec 25 21:17:08.056219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1b71523-2949-4c76-8a2b-e164743d44b4 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Returning 404 to user: Flavor 9c40a937-d17c-4d49-8252-ee02770105fd could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:08.061644 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1b71523-2949-4c76-8a2b-e164743d44b4 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/9c40a937-d17c-4d49-8252-ee02770105fd" status: 404 len: 109 microversion: 2.1 time: 0.036347 Dec 25 21:17:08.067672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1477/3062] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:08 2021] DELETE /compute/v2.1/flavors/9c40a937-d17c-4d49-8252-ee02770105fd => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:08.192090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-354526982", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:08.271710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:08.337959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:08.347509 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-004c6ff3-0955-4335-8e88-3d98e46d95e2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1505 microversion: 2.1 time: 0.354692 Dec 25 21:17:08.348102 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1586/3063] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:07 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1505 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:08.357134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:08.363764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:08.382785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.383264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.384058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.384491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.604803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:08.614299 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44a473c1-119a-461f-a607-1c39ab303972 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1554 microversion: 2.1 time: 0.261084 Dec 25 21:17:08.614892 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1587/3064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:08 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:08.619792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:08.620658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:08.627279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.627728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.628081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:08.629214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.629828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.630546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:08.631150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:08.631677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:08.632196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:08.644952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.645556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.646750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.647448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.667029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:08.672480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Getting quotas for user f9e59d219fa640e48533e0efdf150b16 and project ed880d80bcfb4641b02f26da5fad21b8. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:08.686110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:08.688942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:08.785998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:08.793577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-59bfacc0-0694-4f96-856c-a4b2f1d4829f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 200 len: 1505 microversion: 2.1 time: 0.177608 Dec 25 21:17:08.794171 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1588/3065] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:08 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:08.809208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:08.809705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:08.815479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.816463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.817284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.817912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.848443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:08.850819 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9bdcf988-8655-44db-be53-bd8c3ee5efec tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663258 Dec 25 21:17:08.851552 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1478/3066] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:17:08.861437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b46eda14-f4ba-4b9a-a5c8-617b487b983a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:08.862066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b46eda14-f4ba-4b9a-a5c8-617b487b983a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:08.930800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b46eda14-f4ba-4b9a-a5c8-617b487b983a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:08.941555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b46eda14-f4ba-4b9a-a5c8-617b487b983a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1212 microversion: 2.1 time: 0.082640 Dec 25 21:17:08.946520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1479/3067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:08 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1212 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:08.957008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:08.958968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:08.971513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.973109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:08.974934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:08.976372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:09.122433 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-444d791a-21d0-40e7-aca0-19233dca3d94 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 204 len: 0 microversion: 2.1 time: 0.315448 Dec 25 21:17:09.129244 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1589/3068] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:08 2021] DELETE /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:17:09.135630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:09.137472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:09.139276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:09.151622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d249fa3-ff9f-43de-973a-1ea79839976b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.206684 Dec 25 21:17:09.152465 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1480/3069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:08 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:09.155050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:09.155722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:09.156707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:09.157385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:09.228496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f73e04e6-2247-4318-8a95-6caaf3979f51 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.099633 Dec 25 21:17:09.230488 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1590/3070] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:09 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:09.292767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-697491894", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "597fae95-d9e4-466a-853c-7cbb09218bf0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:09.375560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] validate_networks() for [('597fae95-d9e4-466a-853c-7cbb09218bf0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:09.631703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:09.632429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:09.639774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:09.640216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:09.641036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:09.641477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.196370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:10.196932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:10.197425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:10.197859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:10.198840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:10.208495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.209411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.210237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.210689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.235969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Getting quotas for project 27d474dfd37c46f0aa14aa84e8b3ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:10.242591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Getting quotas for user 819fcdf5d86a46399dfb7343639f3ea6 and project 27d474dfd37c46f0aa14aa84e8b3ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:10.257938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:10.266490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:10.275093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:10.284868 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87b903ed-0c75-4611-96ab-36aee95ca734 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1554 microversion: 2.1 time: 0.657037 Dec 25 21:17:10.290128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1591/3071] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:09 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1554 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:10.292993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1bbe58ac-31b2-4e42-a72f-293d8f7592cb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:10.294008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1bbe58ac-31b2-4e42-a72f-293d8f7592cb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:10.361176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1bbe58ac-31b2-4e42-a72f-293d8f7592cb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:10.368116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1bbe58ac-31b2-4e42-a72f-293d8f7592cb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1212 microversion: 2.1 time: 0.081285 Dec 25 21:17:10.377543 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1592/3072] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:10 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1212 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:10.377543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:10.377543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:10.384809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.385296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.386271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.386717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.442058 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-63693f28-a721-4c0d-83e6-0c33a41ec871 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.153148 Dec 25 21:17:10.442981 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1481/3073] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:10.448559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:10.449630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:10.456043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.457223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.457990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.458444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.519197 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-420ef37e-b88f-4898-ab5a-8929880141e6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.074634 Dec 25 21:17:10.520168 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1482/3074] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:10 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:10.529501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-219e761a-7ec4-4adb-9419-204b9cbc8117 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:10.530810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-219e761a-7ec4-4adb-9419-204b9cbc8117 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:10.627807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-219e761a-7ec4-4adb-9419-204b9cbc8117 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:10.645811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-219e761a-7ec4-4adb-9419-204b9cbc8117 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1217 microversion: 2.1 time: 0.124234 Dec 25 21:17:10.647029 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1483/3075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:10 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:10.718067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:10.726925 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-300ebd9d-f122-42ca-8aa3-63997530dfbe tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.357021 Dec 25 21:17:10.727898 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1593/3076] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:10 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:10.939153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d55df43c-10cb-4bda-aa0e-a6a19f719b92 req-acda4b54-a0bf-42e6-b1b8-e581ff254efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cf3a17-49d6-43d2-9b08-505f1e637900", "name": "network-vif-deleted", "tag": "68b20766-9d12-4028-ab7b-1eb5150d2808"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:10.940730 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:10.940730 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:10.954968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d55df43c-10cb-4bda-aa0e-a6a19f719b92 req-acda4b54-a0bf-42e6-b1b8-e581ff254efd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:10.955420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d55df43c-10cb-4bda-aa0e-a6a19f719b92 req-acda4b54-a0bf-42e6-b1b8-e581ff254efd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:10.993098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d55df43c-10cb-4bda-aa0e-a6a19f719b92 req-acda4b54-a0bf-42e6-b1b8-e581ff254efd service nova] Creating event network-vif-deleted:68b20766-9d12-4028-ab7b-1eb5150d2808 for instance 05cf3a17-49d6-43d2-9b08-505f1e637900 on nch2-master-1 Dec 25 21:17:11.005266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d55df43c-10cb-4bda-aa0e-a6a19f719b92 req-acda4b54-a0bf-42e6-b1b8-e581ff254efd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069739 Dec 25 21:17:11.008117 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1484/3077] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:11.234242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a315eda-cc3e-4d05-b2a9-f559256e89f4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:11.249900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a315eda-cc3e-4d05-b2a9-f559256e89f4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.249900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a315eda-cc3e-4d05-b2a9-f559256e89f4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.290375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a315eda-cc3e-4d05-b2a9-f559256e89f4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:17:11.316429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:11.318280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.328557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.329057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.329993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.331669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.426256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:11.434508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d4a4093-52c9-41cf-97e9-30894fe10d51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1346 microversion: 2.1 time: 0.136122 Dec 25 21:17:11.435096 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1485/3078] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:11 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1346 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:11.446519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c01498a2-f6c7-47fd-8ff0-f99b531ea834 req-8ed1d67f-d35f-429a-835a-8a5eae4342c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "name": "network-vif-plugged", "status": "completed", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:11.448060 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:11.448060 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:11.458101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c01498a2-f6c7-47fd-8ff0-f99b531ea834 req-8ed1d67f-d35f-429a-835a-8a5eae4342c2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.459482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c01498a2-f6c7-47fd-8ff0-f99b531ea834 req-8ed1d67f-d35f-429a-835a-8a5eae4342c2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.490915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a315eda-cc3e-4d05-b2a9-f559256e89f4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 202 len: 0 microversion: 2.1 time: 0.261865 Dec 25 21:17:11.491866 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1594/3079] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:11 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:17:11.494521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c01498a2-f6c7-47fd-8ff0-f99b531ea834 req-8ed1d67f-d35f-429a-835a-8a5eae4342c2 service nova] Creating event network-vif-plugged:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch2-master-1 Dec 25 21:17:11.501726 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c01498a2-f6c7-47fd-8ff0-f99b531ea834 req-8ed1d67f-d35f-429a-835a-8a5eae4342c2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065386 Dec 25 21:17:11.504366 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1486/3080] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:11.511244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-86edf7ef-cc21-4a34-aaaa-3b3d5ff690d7 req-f224c93a-9966-43f7-b9cb-451beaea4f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a665e8d7-d64e-4879-9389-ad2efb13749b", "name": "network-vif-deleted", "tag": "7dbd4557-2b40-4db1-9a68-6caa3efd7bb8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:11.513645 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:11.513645 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:11.517345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:11.518389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.525060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-86edf7ef-cc21-4a34-aaaa-3b3d5ff690d7 req-f224c93a-9966-43f7-b9cb-451beaea4f90 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.525291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-86edf7ef-cc21-4a34-aaaa-3b3d5ff690d7 req-f224c93a-9966-43f7-b9cb-451beaea4f90 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.530361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.530951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.542874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.543542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.556291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-86edf7ef-cc21-4a34-aaaa-3b3d5ff690d7 req-f224c93a-9966-43f7-b9cb-451beaea4f90 service nova] Creating event network-vif-deleted:7dbd4557-2b40-4db1-9a68-6caa3efd7bb8 for instance a665e8d7-d64e-4879-9389-ad2efb13749b on nch1-master-1 Dec 25 21:17:11.563577 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-86edf7ef-cc21-4a34-aaaa-3b3d5ff690d7 req-f224c93a-9966-43f7-b9cb-451beaea4f90 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056813 Dec 25 21:17:11.565920 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1487/3081] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:11.597671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:11.601085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.609773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.613840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.613840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.613840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.661573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:11.670025 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f0de940f-c5f2-434b-8a8c-8cbf1b782629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1264 microversion: 2.1 time: 0.176247 Dec 25 21:17:11.670880 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1595/3082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:11 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:11.675937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:11.677205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.683871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.684326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.687265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.687265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.725988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0b096e38-5ed9-44d3-8b5c-be6907ea707e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.053664 Dec 25 21:17:11.726666 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1596/3083] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:11 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:11.731514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:11.732238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.739573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.740008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.740802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.741281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.827619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:11.837622 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60949996-5b12-45b4-bc8f-5fee03ecdbe0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1221 microversion: 2.1 time: 0.109742 Dec 25 21:17:11.839104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1597/3084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:11 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:11.845524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:11.846479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.853255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.854217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:11.855173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.856560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.857324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.864088 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d7b90e3-81b0-44e4-8de5-abe5411dea04 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.295996 Dec 25 21:17:11.865009 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1488/3085] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:11 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:11.907147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:11.907789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:11.930054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.930797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:11.931924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:11.932671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.013102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:12.029120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:12.039116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64e9f134-30c3-470e-b567-66526582ccd9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.198050 Dec 25 21:17:12.049659 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1598/3086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:11 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:12.431876 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e5e2f31-c83a-4b69-bbaf-fb05e2b65fb0 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 204 len: 0 microversion: 2.1 time: 0.533612 Dec 25 21:17:12.435171 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1489/3087] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:11 2021] DELETE /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:17:12.440472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:12.441143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:12.448016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.448471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.449282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.449715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.451487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:12.452331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:12.458669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.463901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.463901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.463901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.498586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.499294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.500566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lazy-loading 'fault' on Instance uuid 05cf3a17-49d6-43d2-9b08-505f1e637900 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:17:12.594602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:12.606461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1c9109e-1257-4c40-b4bf-6ddf027733b8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 200 len: 1305 microversion: 2.1 time: 0.159065 Dec 25 21:17:12.608608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1490/3088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:12 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 1305 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:12.682658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:12.688555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:12.689361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:12.692182 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36dac4a3-4260-40d6-959c-b1b10f277795 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1514 microversion: 2.1 time: 0.255331 Dec 25 21:17:12.692806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1599/3089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:12 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1514 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:12.701713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.701713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.701713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.701713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.762750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:12.771717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff5fbf45-736d-48a6-a155-a07a9f3a1a2a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1270 microversion: 2.1 time: 0.087790 Dec 25 21:17:12.772517 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1491/3090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:12 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:12.777486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:12.778497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:12.785005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.785464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.786824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.787474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.839883 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff7634fa-68d9-4421-9940-619691529e59 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.065911 Dec 25 21:17:12.840571 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1492/3091] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:12 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:12.857195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:12.857949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:12.865191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.865740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.866615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.867210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.877549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe2797c4-50d1-4bb2-9af5-235c2f68359d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa4f6e33e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1118929642", "description": "tempest-description-518741877"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:12.946804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:12.957470 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f54d06b-e45a-492b-b601-cf3c14d2ca56 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1269 microversion: 2.1 time: 0.106445 Dec 25 21:17:12.958194 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1493/3092] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:12 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1269 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:12.966778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:12.966778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:12.983611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.984022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:12.984922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:12.985445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.186505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:13.193292 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55aa3e94-978f-45c4-a6ed-4f5d0406bffd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.233467 Dec 25 21:17:13.193884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1494/3093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:12 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:13.198736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:13.199639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:13.212745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.213771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.215291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.216153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.434939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe2797c4-50d1-4bb2-9af5-235c2f68359d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.706329 Dec 25 21:17:13.435615 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1600/3094] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:12 2021] POST /compute/v2.1/os-security-groups => generated 243 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:13.458269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1239cf4-dfba-4daa-b636-014541f377cc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa500722790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1499255848", "description": "tempest-description-1866969044"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:13.604298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:13.611958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62dc8f10-e04b-4d80-97eb-98cf86359099 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1324 microversion: 2.1 time: 0.416617 Dec 25 21:17:13.622004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1495/3095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:13 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:13.627279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4051e1de-9fa3-4027-b727-bcea2de1d818 req-5a001989-ae26-4973-aa4f-348d58a57f93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf2c55e-9f30-4390-b13e-f7a8917aba8b", "name": "network-vif-plugged", "status": "completed", "tag": "ca27c441-c54d-4e05-8a52-86b1df07f0e3"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:13.629736 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:13.629736 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:13.638058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4051e1de-9fa3-4027-b727-bcea2de1d818 req-5a001989-ae26-4973-aa4f-348d58a57f93 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.638516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4051e1de-9fa3-4027-b727-bcea2de1d818 req-5a001989-ae26-4973-aa4f-348d58a57f93 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.651760 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4051e1de-9fa3-4027-b727-bcea2de1d818 req-5a001989-ae26-4973-aa4f-348d58a57f93 service nova] Creating event network-vif-plugged:ca27c441-c54d-4e05-8a52-86b1df07f0e3 for instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b on nch2-master-1 Dec 25 21:17:13.657055 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4051e1de-9fa3-4027-b727-bcea2de1d818 req-5a001989-ae26-4973-aa4f-348d58a57f93 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033324 Dec 25 21:17:13.658031 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1496/3096] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:13.666651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:13.666651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:13.672562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.673665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.675193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.675817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.691965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. Dec 25 21:17:13.692573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:13.693452 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-480b4a21-b367-4b57-be46-3f70c5c839ec tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 404 len: 111 microversion: 2.1 time: 0.034158 Dec 25 21:17:13.697337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1497/3097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:13 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:13.713134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:13.716084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:13.723530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.724324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:13.726235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:13.726913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.034701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1239cf4-dfba-4daa-b636-014541f377cc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.589508 Dec 25 21:17:14.055021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1601/3098] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:13 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:14.062263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:14.064150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:14.076902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.077442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.078308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.078765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.118068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:14.125942 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f830093-e118-4bce-aee0-f442a951a595 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1514 microversion: 2.1 time: 0.421252 Dec 25 21:17:14.132590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1498/3099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:13 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1514 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:14.133726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:14.134891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:14.142534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.143086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.144143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.144738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.159703 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. Dec 25 21:17:14.160464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:14.161379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e7070e30-9dcb-4527-a19a-9134c0b2ec76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032113 Dec 25 21:17:14.161940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1499/3100] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:17:14 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:14.166774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:14.167692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:14.174102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.174628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.185674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.186137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.252295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6e02129-0fd1-4b28-99b7-061b36e090a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.073731 Dec 25 21:17:14.252295 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1500/3101] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:14 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:14.252295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:14.253353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:14.266503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.267205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.268925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.269548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.433551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:14.441916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99257be7-4889-4985-b994-a8766f229e92 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1275 microversion: 2.1 time: 0.202419 Dec 25 21:17:14.451711 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1501/3102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:14 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1275 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:14.458910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-816625530", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "ce9b43e7-57f0-42d1-9422-f764ccb2bd06"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:14.485770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:14.496861 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5a5b2b1-ebed-408e-a8db-3c720933cd88 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1312 microversion: 2.1 time: 0.440387 Dec 25 21:17:14.506344 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1602/3103] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:14 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1312 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:14.516612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:14.517595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:14.522373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] validate_networks() for [('ce9b43e7-57f0-42d1-9422-f764ccb2bd06', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:14.524587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.525088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.525880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:14.526524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:14.978652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:14.987248 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5971320e-fd41-492b-93f8-53b599dc4496 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.487794 Dec 25 21:17:14.996716 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1603/3104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:14 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:15.001558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-69a2d89c-d5b6-4a1c-bad2-7677720d94b5 req-5d50617a-9958-42e4-80bf-d50907a95e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:15.003134 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:15.003134 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:15.010054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-69a2d89c-d5b6-4a1c-bad2-7677720d94b5 req-5d50617a-9958-42e4-80bf-d50907a95e1e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:15.010500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-69a2d89c-d5b6-4a1c-bad2-7677720d94b5 req-5d50617a-9958-42e4-80bf-d50907a95e1e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:15.021903 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-69a2d89c-d5b6-4a1c-bad2-7677720d94b5 req-5d50617a-9958-42e4-80bf-d50907a95e1e service nova] Creating event network-changed:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch1-master-1 Dec 25 21:17:15.026660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-69a2d89c-d5b6-4a1c-bad2-7677720d94b5 req-5d50617a-9958-42e4-80bf-d50907a95e1e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028687 Dec 25 21:17:15.027418 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1604/3105] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:15.032084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-804585454", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:15.092671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:15.519547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:15.520353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:15.521125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:15.521691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:15.522239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:15.531924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:15.532923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:15.533488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:15.534026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:15.555606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Getting quotas for project 16a084940f024be8aee5807248918cb5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:15.562583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Getting quotas for user d9a0d56f4a364ba38235b7eccbd8db8a and project 16a084940f024be8aee5807248918cb5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:15.576220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:15.578797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:15.733143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ad248f9-ec54-40fd-bb13-d3e581da428f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.279042 Dec 25 21:17:15.738850 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1502/3106] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:14 2021] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:15.739581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:15.740493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:15.747735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:15.751156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:15.751156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:15.751156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:15.991428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:15.991859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:15.992343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:15.992752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:15.993191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:16.002538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.003597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.004642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.005121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.023127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:16.028255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:16.041230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:16.043975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:16.054950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:16.062724 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94835913-4145-4111-9155-bd591102e74c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1521 microversion: 2.1 time: 0.327399 Dec 25 21:17:16.063292 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1503/3107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:15 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1521 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:16.077567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.077567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.080750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.081411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.082359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.082802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.114337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.114783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.115234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lazy-loading 'fault' on Instance uuid 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:17:16.154471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ec9d2698bd4b3f811022f3d8c458b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4a444bae614ca7b19f2e61052a4c6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:16.162325 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dce7aea7-70e7-4172-bfbc-f0a192f2c122 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 200 len: 1308 microversion: 2.1 time: 0.098095 Dec 25 21:17:16.162880 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1504/3108] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:16.167244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:16.168199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.173894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.174345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.175811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.176249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.212662 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e8006b1-c2ad-4e13-9666-f4a03621f9e5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 14 microversion: 2.1 time: 0.048477 Dec 25 21:17:16.213841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1505/3109] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:16 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 14 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:16.220316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.221262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.222635 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b599d881-3dcf-4d46-9c04-5b64213c1276 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194180 Dec 25 21:17:16.224146 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1605/3110] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 1196 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:16.229380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.230303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.234232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.234700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.235512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.235961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.239785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.240431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.241493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.241926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.568861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:16.570771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:16.577274 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-868c6919-b61b-47a8-a172-797fe4bad2f2 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.362094 Dec 25 21:17:16.578761 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1506/3111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:16.584333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3f743aa8-65f9-402d-a4d4-830bbcb2629c req-ddd9ca7a-31ea-4ee8-a337-86f511c057c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1b1d33-82d4-4c29-8f52-f3c59e495d4e", "name": "network-vif-deleted", "tag": "fba43cf4-f214-42a5-b791-cde0e1556285"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:16.586162 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:16.586162 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:16.594569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3f743aa8-65f9-402d-a4d4-830bbcb2629c req-ddd9ca7a-31ea-4ee8-a337-86f511c057c5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.595129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3f743aa8-65f9-402d-a4d4-830bbcb2629c req-ddd9ca7a-31ea-4ee8-a337-86f511c057c5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.596225 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1ccb3d11-126e-4a90-b296-ae72fb27256d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1312 microversion: 2.1 time: 0.369889 Dec 25 21:17:16.597489 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1606/3112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:16.607851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3f743aa8-65f9-402d-a4d4-830bbcb2629c req-ddd9ca7a-31ea-4ee8-a337-86f511c057c5 service nova] Creating event network-vif-deleted:fba43cf4-f214-42a5-b791-cde0e1556285 for instance 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e on nch1-master-1 Dec 25 21:17:16.613081 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3f743aa8-65f9-402d-a4d4-830bbcb2629c req-ddd9ca7a-31ea-4ee8-a337-86f511c057c5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Dec 25 21:17:16.614300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1507/3113] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:16.616182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfa0cd4d-67e8-4567-9c52-f23d7e7dc7e0 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.617187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfa0cd4d-67e8-4567-9c52-f23d7e7dc7e0 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.631672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.632348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.638874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.639425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.640278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.640631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.730236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfa0cd4d-67e8-4567-9c52-f23d7e7dc7e0 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:16.738092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfa0cd4d-67e8-4567-9c52-f23d7e7dc7e0 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1215 microversion: 2.1 time: 0.128137 Dec 25 21:17:16.738686 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1607/3114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1215 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:16.743174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.744077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:16.750382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.750837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.751629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:16.752070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:16.895539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:16.910880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-987fbfda-fc32-4284-b105-b7c1671b1846 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.295244 Dec 25 21:17:16.917347 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1508/3115] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:16.923963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c2e4e6a1-0d42-4560-9535-95263cb961d2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:16.924766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c2e4e6a1-0d42-4560-9535-95263cb961d2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.004776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c2e4e6a1-0d42-4560-9535-95263cb961d2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:17.009743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:17.011502 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c2e4e6a1-0d42-4560-9535-95263cb961d2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48" status: 200 len: 1214 microversion: 2.1 time: 0.098050 Dec 25 21:17:17.017957 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-282c81d8-781d-4245-b2dd-457355260fd0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1521 microversion: 2.1 time: 0.278234 Dec 25 21:17:17.019122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1608/3116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1521 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:17.023044 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1509/3117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:16 2021] GET /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:17.027670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84d4deae-7642-4be0-ad81-ce6524fdc731 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:17.028247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84d4deae-7642-4be0-ad81-ce6524fdc731 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.037221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-52081180"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:17.039469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.045879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.046346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.046832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84d4deae-7642-4be0-ad81-ce6524fdc731 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:17.047165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.047607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.635893 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-45a3e1bb-475c-4ee6-9db0-6ea5e4e547ff tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b/action" status: 202 len: 0 microversion: 2.1 time: 0.604194 Dec 25 21:17:17.641123 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1510/3118] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:17 2021] POST /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b/action => generated 0 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Dec 25 21:17:17.642166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:17.642944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] [instance: 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.649335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.649797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.652309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.652309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.665668 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] HTTP exception thrown: Instance 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e could not be found. Dec 25 21:17:17.666299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] Returning 404 to user: Instance 4a1b1d33-82d4-4c29-8f52-f3c59e495d4e could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:17.667139 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-347c39fe-639a-4f9b-83c4-a84ad029cf26 tempest-VolumesAdminNegativeTest-1446759092 tempest-VolumesAdminNegativeTest-1446759092-project] 10.222.0.32 "GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e" status: 404 len: 111 microversion: 2.1 time: 0.029096 Dec 25 21:17:17.667884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1511/3119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:17 2021] GET /compute/v2.1/servers/4a1b1d33-82d4-4c29-8f52-f3c59e495d4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:17.672428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:17.673438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.680121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.681158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.681407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.681857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.738417 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40b1c3f4-6096-47d7-ad1c-252f4bf03e57 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 8154 microversion: 2.1 time: 0.069194 Dec 25 21:17:17.739269 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1512/3120] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:17 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 8154 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:17.744315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:17.745345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.757218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.757218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.757942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.758391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.763376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.scheduler.client.report [None req-84d4deae-7642-4be0-ad81-ce6524fdc731 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Deleted allocations for instance e338781e-8257-4f80-8001-d9d3b7422f48 Dec 25 21:17:17.885464 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84d4deae-7642-4be0-ad81-ce6524fdc731 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48" status: 204 len: 0 microversion: 2.1 time: 0.861416 Dec 25 21:17:17.886156 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1609/3121] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:17 2021] DELETE /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:17.892396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:17.895263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:17.901156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.901618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.902430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:17.903613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:17.941178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:17.950954 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10e0491f-4585-42bd-ae01-97d30cbc751b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.210249 Dec 25 21:17:17.961000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1513/3122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:17 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:17.962709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0de39c33-d14e-4b29-b3f9-92c986dbbf70 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '.version_select at 0x7fa4f6205ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:18.096028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:18.103584 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55c05889-865d-4b77-a9a5-417f0621a86a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1312 microversion: 2.1 time: 0.215309 Dec 25 21:17:18.104164 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1610/3123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:17 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:18.119228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:18.119850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:18.125829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.126288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.127079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.127526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.198560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:18.206026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64f1cd0b-cbed-4d8b-a828-f1339a1e06c1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1267 microversion: 2.1 time: 0.091416 Dec 25 21:17:18.206606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1611/3124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:18 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:18.210951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:18.211562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:18.223422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.224112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.224679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.225229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.239959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance e338781e-8257-4f80-8001-d9d3b7422f48 could not be found. Dec 25 21:17:18.240574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance e338781e-8257-4f80-8001-d9d3b7422f48 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:18.241667 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60a8e496-61da-486a-bd36-14f2b9960055 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48" status: 404 len: 111 microversion: 2.1 time: 0.034144 Dec 25 21:17:18.242241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1612/3125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:18 2021] GET /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:18.246865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:18.254058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:18.254338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.254807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.255622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.256061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.354840 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0de39c33-d14e-4b29-b3f9-92c986dbbf70 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/images/fad40fd6-7996-43da-8e33-dcdcc1c4c111" status: 204 len: 0 microversion: 2.1 time: 0.396748 Dec 25 21:17:18.355419 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1514/3126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:17 2021] DELETE /compute/v2.1/images/fad40fd6-7996-43da-8e33-dcdcc1c4c111 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:18.360162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1775786557", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:18.431450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:18.469443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:18.479363 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd5fc759-2b60-444b-b222-c039a188d3f9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.236078 Dec 25 21:17:18.479960 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1613/3127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:18 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:18.484689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb41e2c0-05db-450b-bf70-5e9393fce8cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '.version_select at 0x7fa5006f3160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:18.509703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-eb41e2c0-05db-450b-bf70-5e9393fce8cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Image not found. Dec 25 21:17:18.510279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb41e2c0-05db-450b-bf70-5e9393fce8cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:18.511277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb41e2c0-05db-450b-bf70-5e9393fce8cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/images/fad40fd6-7996-43da-8e33-dcdcc1c4c111" status: 404 len: 62 microversion: 2.1 time: 0.030231 Dec 25 21:17:18.512006 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1614/3128] 10.222.0.32 () {58 vars in 1232 bytes} [Sat Dec 25 21:17:18 2021] GET /compute/v2.1/images/fad40fd6-7996-43da-8e33-dcdcc1c4c111 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:18.519658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:18.520262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:18.528262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.528774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:18.529593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:18.530037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.023288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:19.031255 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89ffb90a-ab5a-4629-8a0f-e3b92d4deb0a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1533 microversion: 2.1 time: 0.515085 Dec 25 21:17:19.032024 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1615/3129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:18 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1533 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:19.037598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7d42cdc2-85db-486e-a3e1-6ce4fab2ebfd req-6c6c5e04-4398-4297-bbac-e3a7e8d36a20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145d49b0-3bfb-45f5-9f32-8f86e111755f", "tag": "bcca9b59-72e2-4e80-8ac7-e478ceb19706"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:19.039452 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:19.039452 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:19.046731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7d42cdc2-85db-486e-a3e1-6ce4fab2ebfd req-6c6c5e04-4398-4297-bbac-e3a7e8d36a20 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.047178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7d42cdc2-85db-486e-a3e1-6ce4fab2ebfd req-6c6c5e04-4398-4297-bbac-e3a7e8d36a20 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.059883 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7d42cdc2-85db-486e-a3e1-6ce4fab2ebfd req-6c6c5e04-4398-4297-bbac-e3a7e8d36a20 service nova] Creating event network-changed:bcca9b59-72e2-4e80-8ac7-e478ceb19706 for instance 145d49b0-3bfb-45f5-9f32-8f86e111755f on nch1-master-1 Dec 25 21:17:19.064989 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7d42cdc2-85db-486e-a3e1-6ce4fab2ebfd req-6c6c5e04-4398-4297-bbac-e3a7e8d36a20 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031502 Dec 25 21:17:19.066128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1616/3130] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:19.071033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:19.072641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:19.078920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.079380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.080176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.080616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.136753 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c00a4df-eae9-4c43-a3e8-04bc65ffbdd8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 16343 microversion: 2.1 time: 0.069221 Dec 25 21:17:19.140261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1617/3131] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:19 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 16343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:19.142583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:19.143829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:19.151734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.152186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.153001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.153448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.474640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:19.475169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:19.476100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:19.476632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:19.477098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:19.487520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.488222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.489247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.498395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.516321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:19.522878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:19.535879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:19.538426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:19.629203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:19.636714 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9097510-8cba-4ff9-b146-638f1ec91aac tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.498101 Dec 25 21:17:19.637320 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1618/3132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:19 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:19.646961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:19.646961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:19.651590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.652281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.653190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.653693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.715499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35cfa267-b067-476a-87f8-40b2f4d501d9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.358964 Dec 25 21:17:19.716330 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1515/3133] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:18 2021] POST /compute/v2.1/servers => generated 380 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:19.722283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:19.727258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:19.732029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.732499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.733391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.733840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.868143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:19.879057 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3662b869-26bc-44bb-ada3-221ebd2888ac tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1273 microversion: 2.1 time: 0.160676 Dec 25 21:17:19.879923 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1516/3134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:19 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:19.884509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:19.885561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:19.893466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.893922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:19.895146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:19.895966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.120767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:20.128376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-65f13551-a567-4a6e-ab78-8cecce63902e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1312 microversion: 2.1 time: 0.490028 Dec 25 21:17:20.141542 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1619/3135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:19 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:20.141542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9dc22b72-3010-472b-9893-76bb526944f1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:20.141542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9dc22b72-3010-472b-9893-76bb526944f1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:20.239913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9dc22b72-3010-472b-9893-76bb526944f1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:20.246757 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9dc22b72-3010-472b-9893-76bb526944f1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1215 microversion: 2.1 time: 0.114583 Dec 25 21:17:20.247580 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1620/3136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:20 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1215 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:20.252067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:20.253025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:20.253923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:20.261183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.261645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.262447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.262799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35b2d751-cdea-47ac-b271-c55c58abbf57 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.381562 Dec 25 21:17:20.262933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.263528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1517/3137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:19 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:20.271179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6c12a4f5-9e21-401e-a510-0547d550affc req-d90ae7b8-5e5d-4cad-b941-c36ad979e426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "name": "network-vif-plugged", "status": "completed", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:20.272859 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:20.272859 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:20.282374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6c12a4f5-9e21-401e-a510-0547d550affc req-d90ae7b8-5e5d-4cad-b941-c36ad979e426 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.283115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6c12a4f5-9e21-401e-a510-0547d550affc req-d90ae7b8-5e5d-4cad-b941-c36ad979e426 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.296581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6c12a4f5-9e21-401e-a510-0547d550affc req-d90ae7b8-5e5d-4cad-b941-c36ad979e426 service nova] Creating event network-vif-plugged:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch1-master-1 Dec 25 21:17:20.301834 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6c12a4f5-9e21-401e-a510-0547d550affc req-d90ae7b8-5e5d-4cad-b941-c36ad979e426 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036948 Dec 25 21:17:20.302442 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1518/3138] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:20.308065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:20.309098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:20.315394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.316113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.317269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.317878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.365771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb60b470-c48e-49e5-9350-cda0411c1f14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 16343 microversion: 2.1 time: 0.061749 Dec 25 21:17:20.369108 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1519/3139] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:20 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 16343 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:20.551462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:20.559368 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f610010-04cb-4575-ab85-fee41b7249a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1539 microversion: 2.1 time: 0.310806 Dec 25 21:17:20.559952 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1621/3140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:20 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1539 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:20.654867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:20.655653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:20.663207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.663662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.664461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.664922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.897090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:20.897845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:20.905433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.905892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.906896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:20.907438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:20.920079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:20.932154 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f9017db-4216-452b-ac60-8d3c980debef tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.281391 Dec 25 21:17:20.932736 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1520/3141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:20 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:21.152251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:21.153308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:21.166716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:21.182845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-46aa7a3a-d086-42d7-a837-c46ca93e1e76 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1315 microversion: 2.1 time: 0.290135 Dec 25 21:17:21.186398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.188517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.193104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.193928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.195117 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1622/3142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:20 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1315 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:21.263455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:21.264380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:21.272666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.273524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.277150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.277702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.394789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:21.403508 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d610029-d040-45a0-8e40-dc7777c2a0f7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1211 microversion: 2.1 time: 0.143757 Dec 25 21:17:21.404744 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1623/3143] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:21 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1211 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:21.410642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:21.411548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:21.420598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.421103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.421904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.422343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.604280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:21.612093 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5613b296-cd79-441d-8d8f-7f30f398d5f4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1312 microversion: 2.1 time: 0.465214 Dec 25 21:17:21.612666 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1521/3144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:21 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:21.621549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:21.625285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:21.632365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.632819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.633705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.634316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.685142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48885bf8-a761-4989-a2ce-12483ad97926 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 16343 microversion: 2.1 time: 0.066966 Dec 25 21:17:21.688738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1522/3145] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:21 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 16343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:21.692576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:21.693321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:21.700768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.712573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:21.712573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:21.712573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.074743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:22.096650 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a11da80-01be-479d-aa8a-02d4e79a0dca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.690403 Dec 25 21:17:22.097288 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1624/3146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:21 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:22.112414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.112414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.120677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.121775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.122752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.123582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.211700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:22.219874 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c3b0de4-c4ba-439e-b227-152608a1a7b4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1521 microversion: 2.1 time: 0.532574 Dec 25 21:17:22.220724 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1523/3147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:21 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:22.227200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.235096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.236533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.237103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.237913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.238360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.299852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:22.310885 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efb59fd8-9feb-49dd-bf39-aa0f392e2c3b tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.207434 Dec 25 21:17:22.312182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1625/3148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:22 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:22.319463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.320231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.340136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.343779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.345898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.346771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.387731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:22.464019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:22.472193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcf631fd-7f0a-4395-9091-3cb6301fa803 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1315 microversion: 2.1 time: 0.250116 Dec 25 21:17:22.473606 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1524/3149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:22 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:22.478590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d3316839-f552-4a80-9d87-2d2d69a37e05 req-5b1ae28b-d275-40bc-8a8f-1233dd8101b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5de591e-2d50-4b6e-8d61-887076ed592d", "tag": "dfc1a5c0-22fe-4e86-8082-3ae401c78b61"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:22.480180 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:22.480180 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:22.488038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d3316839-f552-4a80-9d87-2d2d69a37e05 req-5b1ae28b-d275-40bc-8a8f-1233dd8101b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.489112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d3316839-f552-4a80-9d87-2d2d69a37e05 req-5b1ae28b-d275-40bc-8a8f-1233dd8101b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.500896 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d3316839-f552-4a80-9d87-2d2d69a37e05 req-5b1ae28b-d275-40bc-8a8f-1233dd8101b3 service nova] Creating event network-changed:dfc1a5c0-22fe-4e86-8082-3ae401c78b61 for instance e5de591e-2d50-4b6e-8d61-887076ed592d on nch2-master-1 Dec 25 21:17:22.506707 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d3316839-f552-4a80-9d87-2d2d69a37e05 req-5b1ae28b-d275-40bc-8a8f-1233dd8101b3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031905 Dec 25 21:17:22.507500 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1525/3150] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:22.512593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.513610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.520808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.521708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.523250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.523879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.608389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:22.617734 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0876eaf6-7fd5-4843-a9e4-934bd8e14edb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1275 microversion: 2.1 time: 0.108820 Dec 25 21:17:22.618360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1526/3151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:22 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1275 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:22.629764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.630437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.636655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.637240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.638050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.638492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.821403 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-009706bb-79b9-4f20-b945-b2a6394bbca4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 204 len: 0 microversion: 2.1 time: 0.507459 Dec 25 21:17:22.822295 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1626/3152] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:22 2021] DELETE /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:22.835153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:22.838428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.853209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.853662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.854453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.855199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.871485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:22.886425 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac43528a-6161-482c-9a23-e5a825b1df3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1462 microversion: 2.1 time: 0.261164 Dec 25 21:17:22.897452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1527/3153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:22 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1462 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:22.904540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.905494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.913668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.914339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.915425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.916107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.951326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f276d40-a023-4e4c-b6ec-225b0024ecdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.124742 Dec 25 21:17:22.952488 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1627/3154] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:22 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:22.958578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:22.959351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:22.967413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.972576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:22.972576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:22.972576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.211763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:23.229818 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f084451a-6061-405d-9c3d-4affb938b55c tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1613 microversion: 2.1 time: 0.275795 Dec 25 21:17:23.240777 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1628/3155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:22 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1613 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:23.253610 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2416c7a3-756c-4906-bf32-3f071f89cfa9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1527 microversion: 2.1 time: 0.353937 Dec 25 21:17:23.254494 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1528/3156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:22 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1527 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:23.259452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:23.260085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:23.267760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.268573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.269488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.270216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.393330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ca20f53-ec55-4e89-80f2-59e69a405c90 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Calling method '.version_select at 0x7fa4f696ab80>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:23.424831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4ca20f53-ec55-4e89-80f2-59e69a405c90 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] HTTP exception thrown: Image not found. Dec 25 21:17:23.424831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ca20f53-ec55-4e89-80f2-59e69a405c90 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:23.424831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ca20f53-ec55-4e89-80f2-59e69a405c90 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] 10.222.0.32 "DELETE /compute/v2.1/images/477c166e-b424-447a-b636-7e7e750e134c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.186008 Dec 25 21:17:23.424831 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1629/3157] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:17:23 2021] DELETE /compute/v2.1/images/477c166e-b424-447a-b636-7e7e750e134c/metadata/os_distro => generated 62 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:23.425333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:23.425830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:23.432700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.433448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.434356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.434797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.506895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:23.509758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '68e2585485584fc59e9b72868227f2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd62ea5e59c47fc8d5c271934c6a120', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:23.510340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] flavor_id is None. Assuming migration. {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 25 21:17:23.510769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:17:23.524385 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a9c5ff53-f116-4ef1-9727-c1565b117bc4 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.268551 Dec 25 21:17:23.525129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1529/3158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:23 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:23.530333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:23.531264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:23.546079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.546612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.547551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.548247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.808746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:23.819396 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-390a3468-5a2c-4552-8a0a-cb9ef58ae17a tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.292987 Dec 25 21:17:23.820119 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1530/3159] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:23 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:23.828392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7d7230ea-ac8c-457e-8203-62257fa081e3 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Calling method '.version_select at 0x7fa4f6f85f70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:23.856679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-7d7230ea-ac8c-457e-8203-62257fa081e3 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] HTTP exception thrown: Image not found. Dec 25 21:17:23.857622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7d7230ea-ac8c-457e-8203-62257fa081e3 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:23.858574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7d7230ea-ac8c-457e-8203-62257fa081e3 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] 10.222.0.32 "GET /compute/v2.1/images/5253c052-87d5-4a26-b555-f37b38ad604a/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.037450 Dec 25 21:17:23.859359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1531/3160] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:17:23 2021] GET /compute/v2.1/images/5253c052-87d5-4a26-b555-f37b38ad604a/metadata/os_version => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:23.870181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:23.870824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:23.878395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.879550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:23.880537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:23.881220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.060896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:24.067706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f6ecc11-8428-4f11-a843-788711e51af9 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec/action" status: 202 len: 0 microversion: 2.1 time: 0.647759 Dec 25 21:17:24.071551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1630/3161] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:23 2021] POST /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec/action => generated 0 bytes in 652 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:24.077921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:24.078731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:24.087208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.088465 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cbb4bb21-f76f-4c90-a294-0cac4f84b562 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1315 microversion: 2.1 time: 0.225675 Dec 25 21:17:24.088804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.089861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.090511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.093022 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1532/3162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:23 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:24.105626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1798ed2-b642-4fb1-b87c-b1945e626a6f tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Calling method '.version_select at 0x7fa4f738aa60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:24.128476 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b1798ed2-b642-4fb1-b87c-b1945e626a6f tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] HTTP exception thrown: Image not found. Dec 25 21:17:24.129138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1798ed2-b642-4fb1-b87c-b1945e626a6f tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:24.135478 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1798ed2-b642-4fb1-b87c-b1945e626a6f tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] 10.222.0.32 "GET /compute/v2.1/images/201d2bdc-303f-450f-abfb-ff522aac0904/metadata" status: 404 len: 62 microversion: 2.1 time: 0.032070 Dec 25 21:17:24.135478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1533/3163] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:17:24 2021] GET /compute/v2.1/images/201d2bdc-303f-450f-abfb-ff522aac0904/metadata => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:24.135704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:24.136973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:24.146798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.147252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.148050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.148488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.191942 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-42fede46-84f6-4af2-99d3-a2dcb2c13d6c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.060123 Dec 25 21:17:24.196599 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1534/3164] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:24 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:24.201307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:24.202012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:24.210151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.210701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.211586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.211866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.277692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:24.285990 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fab66e6e-0990-4894-973d-a9b9f771ced8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1315 microversion: 2.1 time: 0.212965 Dec 25 21:17:24.286562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1631/3165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:24 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:24.290978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2d82e262-1a59-4658-bfa9-d90bf417b55a req-a51fde6d-e421-478b-abd1-e2894ca9e590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d49b0-3bfb-45f5-9f32-8f86e111755f", "name": "network-vif-plugged", "status": "completed", "tag": "bcca9b59-72e2-4e80-8ac7-e478ceb19706"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:24.292806 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:24.292806 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:24.301167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2d82e262-1a59-4658-bfa9-d90bf417b55a req-a51fde6d-e421-478b-abd1-e2894ca9e590 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.301620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2d82e262-1a59-4658-bfa9-d90bf417b55a req-a51fde6d-e421-478b-abd1-e2894ca9e590 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.324004 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2d82e262-1a59-4658-bfa9-d90bf417b55a req-a51fde6d-e421-478b-abd1-e2894ca9e590 service nova] Creating event network-vif-plugged:bcca9b59-72e2-4e80-8ac7-e478ceb19706 for instance 145d49b0-3bfb-45f5-9f32-8f86e111755f on nch1-master-1 Dec 25 21:17:24.334026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2d82e262-1a59-4658-bfa9-d90bf417b55a req-a51fde6d-e421-478b-abd1-e2894ca9e590 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045981 Dec 25 21:17:24.341781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1632/3166] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:24.368057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75aef5c2-f812-44fa-83b3-8852bf6099d0 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Action: 'update_all', calling method: .version_select at 0x7fa5006934c0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:24.385197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:24.399838 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2fa1588e-7239-44dd-ab7e-2703e883119f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1471 microversion: 2.1 time: 0.205661 Dec 25 21:17:24.400644 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1535/3167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:24 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1471 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:24.405052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-75aef5c2-f812-44fa-83b3-8852bf6099d0 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] HTTP exception thrown: Image not found. Dec 25 21:17:24.405052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75aef5c2-f812-44fa-83b3-8852bf6099d0 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:24.409768 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75aef5c2-f812-44fa-83b3-8852bf6099d0 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] 10.222.0.32 "PUT /compute/v2.1/images/314806c1-eb1c-4e30-a3d0-6907c5a517f3/metadata" status: 404 len: 62 microversion: 2.1 time: 0.052792 Dec 25 21:17:24.411427 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1633/3168] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:17:24 2021] PUT /compute/v2.1/images/314806c1-eb1c-4e30-a3d0-6907c5a517f3/metadata => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:24.419989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-458127c6-8918-453f-8658-a772ceefcfd4 req-87f2d465-4899-45a5-a590-93b81ad20e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2254a4b-e6ed-4560-a239-47903f19b47d", "tag": "285370c8-a68b-4ddd-9ceb-19642f45731c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:24.422366 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:24.422366 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:24.423596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:24.425555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:24.430433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-458127c6-8918-453f-8658-a772ceefcfd4 req-87f2d465-4899-45a5-a590-93b81ad20e7e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.431074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-458127c6-8918-453f-8658-a772ceefcfd4 req-87f2d465-4899-45a5-a590-93b81ad20e7e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.436167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.436865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.438020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.438727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.445660 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-458127c6-8918-453f-8658-a772ceefcfd4 req-87f2d465-4899-45a5-a590-93b81ad20e7e service nova] Creating event network-changed:285370c8-a68b-4ddd-9ceb-19642f45731c for instance d2254a4b-e6ed-4560-a239-47903f19b47d on nch2-master-1 Dec 25 21:17:24.451339 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-458127c6-8918-453f-8658-a772ceefcfd4 req-87f2d465-4899-45a5-a590-93b81ad20e7e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039861 Dec 25 21:17:24.452444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1536/3169] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:24.458657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6452952a-5d02-43f3-ade1-374486357643 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Action: 'update', calling method: .version_select at 0x7fa4f6242af0>, body: {"meta": {"os_distro": "alt"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:24.491550 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6452952a-5d02-43f3-ade1-374486357643 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] HTTP exception thrown: Image not found. Dec 25 21:17:24.492192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6452952a-5d02-43f3-ade1-374486357643 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:24.493166 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6452952a-5d02-43f3-ade1-374486357643 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] 10.222.0.32 "PUT /compute/v2.1/images/82bc41fb-a6c8-4ccb-9e69-cfbc7a1463b7/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.039490 Dec 25 21:17:24.493660 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1537/3170] 10.222.0.32 () {60 vars in 1309 bytes} [Sat Dec 25 21:17:24 2021] PUT /compute/v2.1/images/82bc41fb-a6c8-4ccb-9e69-cfbc7a1463b7/metadata/os_distro => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:24.503476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d27e3337-9448-41ff-8ba3-f7b0d51e4b34 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Action: 'create', calling method: .version_select at 0x7fa4f6f850d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:24.545831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d27e3337-9448-41ff-8ba3-f7b0d51e4b34 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] HTTP exception thrown: Image not found. Dec 25 21:17:24.546442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d27e3337-9448-41ff-8ba3-f7b0d51e4b34 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:24.547282 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d27e3337-9448-41ff-8ba3-f7b0d51e4b34 tempest-ImagesMetadataNegativeTestJSON-157529765 tempest-ImagesMetadataNegativeTestJSON-157529765-project] 10.222.0.32 "POST /compute/v2.1/images/3aa3dddd-3ba3-4778-9b70-877081761112/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048374 Dec 25 21:17:24.547851 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1538/3171] 10.222.0.32 () {60 vars in 1280 bytes} [Sat Dec 25 21:17:24 2021] POST /compute/v2.1/images/3aa3dddd-3ba3-4778-9b70-877081761112/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 25 21:17:24.557161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:24.558489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:24.567248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.567941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.568974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.569584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.867542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:24.876534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ce33075-d93e-4cbb-941d-deb24497c1cf tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1527 microversion: 2.1 time: 0.460517 Dec 25 21:17:24.877232 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1634/3172] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:24 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1527 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:24.884253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:24.885421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:24.892561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.893550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.894661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:24.895439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:24.997205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:25.006556 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-132de001-0943-4752-bf9e-6cba2b3472fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.453239 Dec 25 21:17:25.009229 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1539/3173] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:24 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:25.113435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:25.114273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:25.121487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.124357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.127770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.128354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.176530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:25.184276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af839d6f-3d14-4c6a-bbbd-c74c3f5e764c tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.304481 Dec 25 21:17:25.196551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1635/3174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:24 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:25.203047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:25.204006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:25.210665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.211475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.212506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.213313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.259462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e02fac8-43fe-4634-8256-40ebf34893a2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.059865 Dec 25 21:17:25.260642 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1636/3175] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:25 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:17:25.305867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:25.309683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:25.314305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.314913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.315894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.316559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.562638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:25.573717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2d781d76-6355-493c-9ab3-eaa9ce865fcd tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1315 microversion: 2.1 time: 0.471639 Dec 25 21:17:25.576110 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1540/3176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:25 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:25.582548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:25.583365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:25.583985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:25.590046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.590730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.591870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.592392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f34edd85-576e-4853-b48c-e68f73815b42 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1315 microversion: 2.1 time: 0.291403 Dec 25 21:17:25.592722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.600971 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1637/3177] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:25 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:25.735956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6e1fb304-b3fa-439e-ac86-5b2e4b7e2bf2 req-d62e16f5-bf85-4193-90f2-1d3703ddfaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cf2c55e-9f30-4390-b13e-f7a8917aba8b", "name": "network-vif-deleted", "tag": "ca27c441-c54d-4e05-8a52-86b1df07f0e3"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:25.738785 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:25.738785 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:25.749553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6e1fb304-b3fa-439e-ac86-5b2e4b7e2bf2 req-d62e16f5-bf85-4193-90f2-1d3703ddfaae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.750075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6e1fb304-b3fa-439e-ac86-5b2e4b7e2bf2 req-d62e16f5-bf85-4193-90f2-1d3703ddfaae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.781203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6e1fb304-b3fa-439e-ac86-5b2e4b7e2bf2 req-d62e16f5-bf85-4193-90f2-1d3703ddfaae service nova] Creating event network-vif-deleted:ca27c441-c54d-4e05-8a52-86b1df07f0e3 for instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b on nch2-master-1 Dec 25 21:17:25.812328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6e1fb304-b3fa-439e-ac86-5b2e4b7e2bf2 req-d62e16f5-bf85-4193-90f2-1d3703ddfaae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063043 Dec 25 21:17:25.817506 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1638/3178] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:25.840486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:25.859998 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11cd1c6b-cfac-4284-b68c-7420f9af0824 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1471 microversion: 2.1 time: 0.282478 Dec 25 21:17:25.863287 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1541/3179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:25 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:25.896975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:25.898297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:25.910748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.911498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:25.912537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:25.913277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.020265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:26.023755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:26.028913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:26.029048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00bea858-c52f-4378-ab1e-90ced0e1ac95 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 200 len: 1309 microversion: 2.1 time: 0.135873 Dec 25 21:17:26.033151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1639/3180] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:25 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:26.034941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.035394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.037190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.037754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.200029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:26.200559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:26.211720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.212202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.213030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.213471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.236371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:26.244480 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c815570-dc14-4867-9cbe-13d596e5353a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1721 microversion: 2.1 time: 0.224705 Dec 25 21:17:26.245076 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1542/3181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:26 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:26.272990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:26.273990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:26.280905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.281467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.282297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.282791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.325342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a682dd78-ecda-45b2-bbdc-8b6c9cca4684 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.055340 Dec 25 21:17:26.326868 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1543/3182] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:26 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:26.371414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:26.378800 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92f8d7eb-c2a0-46a6-9f3d-359950682e22 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1317 microversion: 2.1 time: 0.182496 Dec 25 21:17:26.379362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1640/3183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:26 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:26.591495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:26.593232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:26.600197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.600694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.606116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.606116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.609458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:26.610218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:26.617272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.617804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.618602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.619070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.809069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:26.816602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:26.819418 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6edfc398-18cf-4670-a9d1-55639433271f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1315 microversion: 2.1 time: 0.231892 Dec 25 21:17:26.820040 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1544/3184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:26 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:26.833670 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff733544-ccac-42c2-8219-5c6f00d3fb00 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1315 microversion: 2.1 time: 0.228206 Dec 25 21:17:26.834389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1641/3185] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:26 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:26.879708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:26.880338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:26.887337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.887789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:26.888571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:26.889034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.277584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:27.281694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:27.281694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:27.281694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.281694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.281694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.282309 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7fd68e62-393b-4a1e-9e0e-a3f2bffff4b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1471 microversion: 2.1 time: 0.179425 Dec 25 21:17:27.282704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.282704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b could not be found. Dec 25 21:17:27.282704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:27.283283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1545/3186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:26 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1471 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:27.283654 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ed4993d-4a40-47cc-b0ce-124f742fb9f5 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 404 len: 111 microversion: 2.1 time: 0.028536 Dec 25 21:17:27.283654 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1642/3187] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:27 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:17:27.287093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-2068418010", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "979f5e3f-5f36-45e3-b799-ae422a7efba5"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:27.287093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] validate_networks() for [('979f5e3f-5f36-45e3-b799-ae422a7efba5', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:27.291317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:27.291317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:27.291317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.291317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.291317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.291317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.566232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:27.576830 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24581fba-1b7a-4e38-a4e1-b370fabb7933 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1698 microversion: 2.1 time: 0.318526 Dec 25 21:17:27.578005 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1643/3188] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:27 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1698 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:27.583510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:27.584664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:27.591723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.592173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.593364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.593933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.641827 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b982d0da-e139-4f3a-b23d-109e450a3820 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.062358 Dec 25 21:17:27.646519 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1644/3189] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:27 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:27.652788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:27.653888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:27.663306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.663758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.664739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.665351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.923057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:27.924622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:27.926046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:27.926848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:27.927493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:27.937642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.938105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.938940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.939461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:27.957482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:27.966764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Getting quotas for user e7c7a9d6618448c9a5ade71c13a1758d and project 9dbe1e97c3f64bee9355ec5d1b424c8a. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:27.974850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:27.975535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:27.978570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:27.982573 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-69c24e22-6936-43ff-87e7-935f0dc04ca6 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1505 microversion: 2.1 time: 0.334365 Dec 25 21:17:27.983222 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1645/3190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:27 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:27.988326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80064567-6435-4d45-8483-79a160934f7e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:27.994328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80064567-6435-4d45-8483-79a160934f7e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:27.994843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80064567-6435-4d45-8483-79a160934f7e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.017579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80064567-6435-4d45-8483-79a160934f7e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Going to try to start instance {{(pid=136548) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 21:17:28.106655 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3518f0a0-517f-4092-a7ba-9562cc0ff7a4 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.941218 Dec 25 21:17:28.112938 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1546/3191] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:27 2021] POST /compute/v2.1/servers => generated 383 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:28.114664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1c2edcfc-9d19-47a4-b60b-a7e7c5f19a08 req-58362680-e546-445a-bea9-50c5ea63f1c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5de591e-2d50-4b6e-8d61-887076ed592d", "name": "network-vif-plugged", "status": "completed", "tag": "dfc1a5c0-22fe-4e86-8082-3ae401c78b61"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:28.116664 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:28.116664 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:28.144507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1c2edcfc-9d19-47a4-b60b-a7e7c5f19a08 req-58362680-e546-445a-bea9-50c5ea63f1c8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.145074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1c2edcfc-9d19-47a4-b60b-a7e7c5f19a08 req-58362680-e546-445a-bea9-50c5ea63f1c8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.160238 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1c2edcfc-9d19-47a4-b60b-a7e7c5f19a08 req-58362680-e546-445a-bea9-50c5ea63f1c8 service nova] Creating event network-vif-plugged:dfc1a5c0-22fe-4e86-8082-3ae401c78b61 for instance e5de591e-2d50-4b6e-8d61-887076ed592d on nch2-master-1 Dec 25 21:17:28.166570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1c2edcfc-9d19-47a4-b60b-a7e7c5f19a08 req-58362680-e546-445a-bea9-50c5ea63f1c8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057312 Dec 25 21:17:28.167941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1547/3192] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:28.175625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:28.176669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:28.185773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.186231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.187031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.187665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.230037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80064567-6435-4d45-8483-79a160934f7e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 202 len: 0 microversion: 2.1 time: 0.245404 Dec 25 21:17:28.231486 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1646/3193] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:27 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:28.249216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:28.250419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:28.259954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.260421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.261251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.261693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.868434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:28.876226 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e378eee9-e641-4e95-b7f2-de479959484f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1315 microversion: 2.1 time: 0.706274 Dec 25 21:17:28.876805 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1548/3194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:28 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:28.882242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:28.882862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:28.884944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:28.889079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.889561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.890988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.891442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.893776 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9c97c248-5100-4eb8-8a4a-bffe6388117f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1315 microversion: 2.1 time: 0.660277 Dec 25 21:17:28.895241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1647/3195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:28 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1315 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:28.918438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:28.919063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:28.925997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.927321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:28.928328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:28.929196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.238120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:29.246934 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1fb768a5-ce49-44dd-9097-69f5a4b0d0a0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1505 microversion: 2.1 time: 0.368181 Dec 25 21:17:29.247539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1549/3196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:28 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:29.254266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:29.255226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:29.262030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.262494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.263306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.263899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.274583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:29.285819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3904fbfb-23e4-47b8-a694-8b4326eb7c8a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1471 microversion: 2.1 time: 0.387673 Dec 25 21:17:29.287566 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1648/3197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:28 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1471 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:29.295036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:29.296012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:29.303623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.305020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.308974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.308974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.352081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:29.359941 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95ee36ca-836b-489b-a68a-251d05e65c5b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1229 microversion: 2.1 time: 0.111068 Dec 25 21:17:29.360522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1550/3198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:29 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1229 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:29.366900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:29.368082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:29.374302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.374814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.375869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.376314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.423324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6221d309-56f1-49f5-94d5-25e94266d391 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.061443 Dec 25 21:17:29.428017 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1551/3199] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:29 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:29.552756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:29.582393 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15da9c4d-34f6-479e-86f9-2a91b96f5563 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1707 microversion: 2.1 time: 0.293493 Dec 25 21:17:29.587776 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1649/3200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:29 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1707 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:29.600637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:29.601849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:29.609789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.610246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.611039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.612092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.632020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d52aee87-857f-4cc4-9463-f6b3ecac4a03 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Calling method '.version_select at 0x7fa4f6f85e50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:29.666120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-d52aee87-857f-4cc4-9463-f6b3ecac4a03 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 60a573f5-2fbe-4083-a61b-b6589f9ef9be does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:29.666799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-d52aee87-857f-4cc4-9463-f6b3ecac4a03 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Neutron security group 60a573f5-2fbe-4083-a61b-b6589f9ef9be not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:29.668869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d52aee87-857f-4cc4-9463-f6b3ecac4a03 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] HTTP exception thrown: Security group 60a573f5-2fbe-4083-a61b-b6589f9ef9be does not exist Dec 25 21:17:29.668869 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-8e201076-3e80-4bed-ac8b-a4c6a7b87333'] Dec 25 21:17:29.669244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d52aee87-857f-4cc4-9463-f6b3ecac4a03 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Returning 404 to user: Security group 60a573f5-2fbe-4083-a61b-b6589f9ef9be does not exist Dec 25 21:17:29.669244 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-8e201076-3e80-4bed-ac8b-a4c6a7b87333'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:29.670753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d52aee87-857f-4cc4-9463-f6b3ecac4a03 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/60a573f5-2fbe-4083-a61b-b6589f9ef9be" status: 404 len: 194 microversion: 2.1 time: 0.240840 Dec 25 21:17:29.671648 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1552/3201] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:17:29 2021] DELETE /compute/v2.1/os-security-groups/60a573f5-2fbe-4083-a61b-b6589f9ef9be => generated 194 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:29.682210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0f04cde2-920a-446a-8c23-5fae0f463344 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004680 Dec 25 21:17:29.684409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1553/3202] 10.222.0.32 () {58 vars in 1163 bytes} [Sat Dec 25 21:17:29 2021] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 25 21:17:29.696584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7d003571-f89b-4d33-8702-112aaff0c4ed tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Calling method '.version_select at 0x7fa4f736e280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:29.848245 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7d003571-f89b-4d33-8702-112aaff0c4ed tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.160998 Dec 25 21:17:29.848830 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1554/3203] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:17:29 2021] GET /compute/v2.1/os-security-groups => generated 707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:29.860028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca3d7d73-f776-423c-acb3-df577a9c112a tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Calling method '.version_select at 0x7fa4f705f670>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:29.862367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a3ea0ba-37e9-4e90-8dcb-b0e5c372bf87 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "PUT /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1077 microversion: 2.1 time: 0.272828 Dec 25 21:17:29.869424 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1650/3204] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:17:29 2021] PUT /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1077 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:29.876820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:29.877837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:29.884058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.884540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:29.885408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:29.885954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.027108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-ca3d7d73-f776-423c-acb3-df577a9c112a tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:30.027927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ca3d7d73-f776-423c-acb3-df577a9c112a tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] HTTP exception thrown: Insufficient rights for removing default security group. Dec 25 21:17:30.027927 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-0505dd4b-4e4e-46da-9057-760251b208db'] Dec 25 21:17:30.028525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca3d7d73-f776-423c-acb3-df577a9c112a tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Returning 400 to user: Insufficient rights for removing default security group. Dec 25 21:17:30.028525 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-0505dd4b-4e4e-46da-9057-760251b208db'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:30.030204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca3d7d73-f776-423c-acb3-df577a9c112a tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/fa8cf8fd-4445-40d4-a2d3-1a61a2347821" status: 400 len: 182 microversion: 2.1 time: 0.173174 Dec 25 21:17:30.030776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1555/3205] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:17:29 2021] DELETE /compute/v2.1/os-security-groups/fa8cf8fd-4445-40d4-a2d3-1a61a2347821 => generated 182 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:17:30.038460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:30.038460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:30.043949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.044344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.045476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.045917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.066232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:30.073944 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-006c53f7-8aa2-44fb-bd11-ac2a726fef63 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1503 microversion: 2.1 time: 0.200816 Dec 25 21:17:30.074509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1651/3206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:29 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1503 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:30.089797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:30.090424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:30.098500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.098962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.099762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.100350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.219957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:30.228271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ea4b50a-24d5-4008-8eff-90b0dd67f379 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1502 microversion: 2.1 time: 0.196461 Dec 25 21:17:30.228836 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1556/3207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:30 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:30.233114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc414541-f93b-45b7-b900-9e0c296883e0 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Calling method '.version_select at 0x7fa5005db8b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:30.263234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-fc414541-f93b-45b7-b900-9e0c296883e0 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 256868f8-fa54-42e4-9313-f2948fad3ff9 does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:30.263824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-fc414541-f93b-45b7-b900-9e0c296883e0 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Neutron security group 256868f8-fa54-42e4-9313-f2948fad3ff9 not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:30.264340 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-fc414541-f93b-45b7-b900-9e0c296883e0 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] HTTP exception thrown: Security group 256868f8-fa54-42e4-9313-f2948fad3ff9 does not exist Dec 25 21:17:30.264340 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-8f2bd5be-b214-4a3e-b040-dfdd3511b7a0'] Dec 25 21:17:30.264966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc414541-f93b-45b7-b900-9e0c296883e0 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Returning 404 to user: Security group 256868f8-fa54-42e4-9313-f2948fad3ff9 does not exist Dec 25 21:17:30.264966 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-8f2bd5be-b214-4a3e-b040-dfdd3511b7a0'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:30.265933 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc414541-f93b-45b7-b900-9e0c296883e0 tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/256868f8-fa54-42e4-9313-f2948fad3ff9" status: 404 len: 194 microversion: 2.1 time: 0.036179 Dec 25 21:17:30.266488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1557/3208] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:17:30 2021] GET /compute/v2.1/os-security-groups/256868f8-fa54-42e4-9313-f2948fad3ff9 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:30.271333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:30.271948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:30.278929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.279045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:30.279381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.280167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.280602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.287272 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea03693b-cdad-4e33-b21a-1aa292ded1dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1315 microversion: 2.1 time: 0.201375 Dec 25 21:17:30.287844 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1652/3209] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:30 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:30.292187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-007b2c13-9138-4edb-bd90-aad938bccb55 req-5631302b-918a-4556-b135-e9d404a2b06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2254a4b-e6ed-4560-a239-47903f19b47d", "name": "network-vif-plugged", "status": "completed", "tag": "285370c8-a68b-4ddd-9ceb-19642f45731c"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:30.293819 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:30.293819 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:30.301142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-007b2c13-9138-4edb-bd90-aad938bccb55 req-5631302b-918a-4556-b135-e9d404a2b06e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.301592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-007b2c13-9138-4edb-bd90-aad938bccb55 req-5631302b-918a-4556-b135-e9d404a2b06e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.313247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-007b2c13-9138-4edb-bd90-aad938bccb55 req-5631302b-918a-4556-b135-e9d404a2b06e service nova] Creating event network-vif-plugged:285370c8-a68b-4ddd-9ceb-19642f45731c for instance d2254a4b-e6ed-4560-a239-47903f19b47d on nch2-master-1 Dec 25 21:17:30.318719 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-007b2c13-9138-4edb-bd90-aad938bccb55 req-5631302b-918a-4556-b135-e9d404a2b06e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Dec 25 21:17:30.319324 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1653/3210] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:30.324405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1118929642"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:30.325106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:30.332365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.332816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.333619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.334057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.529447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:30.539460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7076f795-cbf1-4a8b-a610-8e5943211113 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1503 microversion: 2.1 time: 0.271927 Dec 25 21:17:30.540055 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1558/3211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:30 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1503 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:30.546363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a6556ef-9118-482c-9594-80537353091b tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Action: 'update', calling method: .version_select at 0x7fa4f72fe940>, body: {"security_group": {"name": "tempest-sg-271206212", "description": "tempest-description-1762776106"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:30.596066 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.network.security_group_api [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Adding security group 05129fd7-236e-4b0b-954e-4596cc33e1bb to port dfc1a5c0-22fe-4e86-8082-3ae401c78b61 Dec 25 21:17:30.602772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-0a6556ef-9118-482c-9594-80537353091b tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f55fb858-4a65-44a2-84c9-5ff5f2494f15 does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:30.603511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-0a6556ef-9118-482c-9594-80537353091b tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Neutron security group f55fb858-4a65-44a2-84c9-5ff5f2494f15 not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:30.606709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0a6556ef-9118-482c-9594-80537353091b tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] HTTP exception thrown: Security group f55fb858-4a65-44a2-84c9-5ff5f2494f15 does not exist Dec 25 21:17:30.606709 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-91101d23-8ef9-40dc-94af-769a49d399ef'] Dec 25 21:17:30.606709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a6556ef-9118-482c-9594-80537353091b tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] Returning 404 to user: Security group f55fb858-4a65-44a2-84c9-5ff5f2494f15 does not exist Dec 25 21:17:30.606709 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-91101d23-8ef9-40dc-94af-769a49d399ef'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:30.606709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0a6556ef-9118-482c-9594-80537353091b tempest-SecurityGroupsNegativeTestJSON-1168531450 tempest-SecurityGroupsNegativeTestJSON-1168531450-project] 10.222.0.32 "PUT /compute/v2.1/os-security-groups/f55fb858-4a65-44a2-84c9-5ff5f2494f15" status: 404 len: 194 microversion: 2.1 time: 0.062973 Dec 25 21:17:30.606709 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1559/3212] 10.222.0.32 () {60 vars in 1289 bytes} [Sat Dec 25 21:17:30 2021] PUT /compute/v2.1/os-security-groups/f55fb858-4a65-44a2-84c9-5ff5f2494f15 => generated 194 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:30.616566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:30.617357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:30.625732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.626395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.627907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.628454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.858507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:30.868352 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-28069f51-a87c-42d3-ac70-c9db8fc46878 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.260175 Dec 25 21:17:30.869213 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1560/3213] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:30 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:30.873813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:30.874527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:30.882500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.883390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.883847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:30.884298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:30.993391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:31.002849 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c55ff50-0bc2-497a-834e-20ae6a1403a1 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1295 microversion: 2.1 time: 0.131633 Dec 25 21:17:31.003536 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1561/3214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:30 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1295 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:31.008003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:31.009294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:31.016404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.017245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.017694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.018132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.067178 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ef6adff-60d2-4cb2-93f0-0dc9e4034b74 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.062365 Dec 25 21:17:31.071307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1562/3215] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:31 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:31.077252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:31.082848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:31.085589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.086050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.086847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.087293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.206074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fadd513-1105-48ec-a08d-7e814ec0871f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d/action" status: 202 len: 0 microversion: 2.1 time: 0.885472 Dec 25 21:17:31.207320 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1654/3216] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:30 2021] POST /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:31.215987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:31.218906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:31.223245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.223959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.224977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.225448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.251402 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-718abf71-c505-4a41-afd9-a5829124f7d8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "PUT /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1079 microversion: 2.1 time: 0.178086 Dec 25 21:17:31.253633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1563/3217] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:17:31 2021] PUT /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1079 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:31.265817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b2db7e95-7ea7-4ec7-8ada-169e75874d23 req-3c43b587-696f-43ea-8f57-cfdc3681bf8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5de591e-2d50-4b6e-8d61-887076ed592d", "tag": "dfc1a5c0-22fe-4e86-8082-3ae401c78b61"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:31.267673 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:31.267673 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:31.276304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b2db7e95-7ea7-4ec7-8ada-169e75874d23 req-3c43b587-696f-43ea-8f57-cfdc3681bf8f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.276766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b2db7e95-7ea7-4ec7-8ada-169e75874d23 req-3c43b587-696f-43ea-8f57-cfdc3681bf8f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.291359 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b2db7e95-7ea7-4ec7-8ada-169e75874d23 req-3c43b587-696f-43ea-8f57-cfdc3681bf8f service nova] Creating event network-changed:dfc1a5c0-22fe-4e86-8082-3ae401c78b61 for instance e5de591e-2d50-4b6e-8d61-887076ed592d on nch2-master-1 Dec 25 21:17:31.297120 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b2db7e95-7ea7-4ec7-8ada-169e75874d23 req-3c43b587-696f-43ea-8f57-cfdc3681bf8f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042024 Dec 25 21:17:31.298050 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1564/3218] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:31.304676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1499255848"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:31.305427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:31.321597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.321925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.322797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.323403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.640347 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Adding security group d97e5b33-925e-41f0-914b-8313cf2e46c0 to port dfc1a5c0-22fe-4e86-8082-3ae401c78b61 Dec 25 21:17:31.880328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:31.888558 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3850dc8c-c9d4-4a28-9630-e403980dba41 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1711 microversion: 2.1 time: 0.680076 Dec 25 21:17:31.889258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1655/3219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:31 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1711 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:31.894360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:31.895136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:31.901241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.901903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:31.902864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:31.903493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.283313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:32.297473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f335d7fc-b3e5-4fd9-ac0b-faf20da8b410 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1505 microversion: 2.1 time: 0.406955 Dec 25 21:17:32.298529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1656/3220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:31 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:32.306716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:32.307943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:32.316599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.318065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.319056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.319924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.562499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c749e713-8e9e-476a-b15f-80b139be221b tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d/action" status: 202 len: 0 microversion: 2.1 time: 1.262232 Dec 25 21:17:32.566385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1565/3221] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:31 2021] POST /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d/action => generated 0 bytes in 1268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:32.574443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:32.575269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:32.585434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.588478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.590275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.590909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.630374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:32.668666 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed2a8e5b-a585-4b29-856a-40caa91e78d6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1502 microversion: 2.1 time: 0.367440 Dec 25 21:17:32.669538 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1657/3222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:32 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1502 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:32.684347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:32.685009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:32.691407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.691907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.692729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.693216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.844728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:32.860006 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b9f0995-9581-41ad-afb2-295f30643e09 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.291803 Dec 25 21:17:32.860821 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1566/3223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:32 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:32.874833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:32.875815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:32.883738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.884198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.885035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.885483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.932641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:32.940721 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a4d9ef1-d50c-4195-b952-58b92e15e66f tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1325 microversion: 2.1 time: 0.269702 Dec 25 21:17:32.941520 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1658/3224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:32 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:32.946201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:32.946691 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-975ea7b9-37da-4de6-bc7f-87ce0e942d0e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.075369 Dec 25 21:17:32.947268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:32.947688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1567/3225] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:32 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:32.952911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:32.953498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:32.954520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.955704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.956693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.957474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.961496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.961958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:32.962943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:32.963385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.165151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:33.173116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b66fdb2a-667b-48fa-a41c-fbf1c46fe570 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1505 microversion: 2.1 time: 0.230409 Dec 25 21:17:33.173694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1659/3226] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:32 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:33.188537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:33.189236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:33.195897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.200395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.201528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.202115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.225750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29e51381-cb57-4dbe-a017-576e5bed5485 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.276796 Dec 25 21:17:33.226361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1568/3227] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:17:32 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d/os-security-groups => generated 1158 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:33.231231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:33.232116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:33.242849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.243308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.249747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.250465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.290257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:33.489265 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-360bdc58-6a60-4a41-98ee-c066add5b96a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d/action" status: 202 len: 0 microversion: 2.1 time: 0.314243 Dec 25 21:17:33.490236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1660/3228] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:33 2021] POST /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:33.495160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7dee60f-03e9-4848-b408-68c37162c747 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa50056b670>, body: {"security_group": {"name": " tempest-securitygroup -138513825 ", "description": "tempest-description-99350922"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:33.632441 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d62911e7-18cb-4aba-ba1e-e138a5a92d5f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "DELETE /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 204 len: 0 microversion: 2.1 time: 0.404549 Dec 25 21:17:33.634819 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1569/3229] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:33 2021] DELETE /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:33.790100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b786f952-b121-4b3b-a427-935b1e6399c9 req-7ec7d7ce-15aa-4fba-83a9-f0f18afbd167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5284da0-3efe-4fd6-b107-6eb5f66c269d", "tag": "cbb5ba94-31f2-4df4-8a61-f6af5700b77d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:33.791793 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:33.791793 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:33.802151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b786f952-b121-4b3b-a427-935b1e6399c9 req-7ec7d7ce-15aa-4fba-83a9-f0f18afbd167 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.802600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b786f952-b121-4b3b-a427-935b1e6399c9 req-7ec7d7ce-15aa-4fba-83a9-f0f18afbd167 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.815428 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b786f952-b121-4b3b-a427-935b1e6399c9 req-7ec7d7ce-15aa-4fba-83a9-f0f18afbd167 service nova] Creating event network-changed:cbb5ba94-31f2-4df4-8a61-f6af5700b77d for instance a5284da0-3efe-4fd6-b107-6eb5f66c269d on nch2-master-1 Dec 25 21:17:33.820419 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b786f952-b121-4b3b-a427-935b1e6399c9 req-7ec7d7ce-15aa-4fba-83a9-f0f18afbd167 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183852 Dec 25 21:17:33.821360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1570/3230] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:33.828854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-43bd5154-071c-49de-ae86-b94be8b75e31 req-e54e71dc-5c7b-453b-9368-973bcfaa7cbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5de591e-2d50-4b6e-8d61-887076ed592d", "tag": "dfc1a5c0-22fe-4e86-8082-3ae401c78b61"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:33.828854 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:33.828854 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:33.835165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-43bd5154-071c-49de-ae86-b94be8b75e31 req-e54e71dc-5c7b-453b-9368-973bcfaa7cbf service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.835612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-43bd5154-071c-49de-ae86-b94be8b75e31 req-e54e71dc-5c7b-453b-9368-973bcfaa7cbf service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.851474 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-43bd5154-071c-49de-ae86-b94be8b75e31 req-e54e71dc-5c7b-453b-9368-973bcfaa7cbf service nova] Creating event network-changed:dfc1a5c0-22fe-4e86-8082-3ae401c78b61 for instance e5de591e-2d50-4b6e-8d61-887076ed592d on nch2-master-1 Dec 25 21:17:33.851474 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-43bd5154-071c-49de-ae86-b94be8b75e31 req-e54e71dc-5c7b-453b-9368-973bcfaa7cbf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028313 Dec 25 21:17:33.851474 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1571/3231] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:33.856258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:33.856990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:33.863730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.864159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:33.864978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:33.865420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.011195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:34.020181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-abce70b2-e067-4c59-8d0d-b753dd33b672 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1507 microversion: 2.1 time: 0.167540 Dec 25 21:17:34.021335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1572/3232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:33 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:34.026053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:34.026400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:34.032574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.035345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.035345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.035345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.072322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:34.142517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7dee60f-03e9-4848-b408-68c37162c747 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.650341 Dec 25 21:17:34.143766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1661/3233] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:33 2021] POST /compute/v2.1/os-security-groups => generated 221 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:34.151174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:34.152657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:34.163764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.165309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.174596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.174596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.238616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Instance is already in deleting state, ignoring this request Dec 25 21:17:34.239468 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1bcf7e6f-6bf5-4fb7-9468-8bf3463059e0 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "DELETE /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 204 len: 0 microversion: 2.1 time: 0.217753 Dec 25 21:17:34.241013 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1573/3234] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:34 2021] DELETE /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:34.246782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:34.248109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:34.254554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.255006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.255803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.256242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.526394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:34.537909 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a8aabc5-2f3d-4fa0-8ce6-2c31416ae8c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.392339 Dec 25 21:17:34.538501 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1662/3235] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:34 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:34.543153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:34.544146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:34.550609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.551095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.555944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.555944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.593117 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5aa2f037-5f5d-48f9-9f6a-659218b3047d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 24510 microversion: 2.1 time: 0.053345 Dec 25 21:17:34.597404 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1663/3236] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:34 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 24510 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:34.599448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-248cf9c7-971d-4527-b36d-d5526c7e497e tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa500719c10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:34.612542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:34.620471 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d2df2c2-48e6-4487-9add-f7e9e0fa732c tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1325 microversion: 2.1 time: 0.378255 Dec 25 21:17:34.621086 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1574/3237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:34 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:34.625433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:34.626036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:34.632362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.632903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.634307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:34.634746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:34.746457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-248cf9c7-971d-4527-b36d-d5526c7e497e tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6" status: 200 len: 221 microversion: 2.1 time: 0.151314 Dec 25 21:17:34.747040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1664/3238] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:17:34 2021] GET /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6 => generated 221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:34.757838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4d651b8-d5ac-4a13-a627-460e74365403 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa50056b700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:35.011301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:35.018802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-432060ca-6b3e-45d1-a7d4-9c03ad0029a8 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1511 microversion: 2.1 time: 0.396738 Dec 25 21:17:35.019663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1575/3239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:34 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1511 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:35.037529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:35.038260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:35.044361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.044812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.045788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.046230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.697876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:35.706370 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db7406cb-cdff-43f6-9852-6641f82c442e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1487 microversion: 2.1 time: 0.673141 Dec 25 21:17:35.706956 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1576/3240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:35 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1487 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:35.711687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:35.712472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:35.725600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.726131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.726890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.727328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.786674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4d651b8-d5ac-4a13-a627-460e74365403 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6" status: 202 len: 0 microversion: 2.1 time: 1.032757 Dec 25 21:17:35.791689 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1665/3241] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:17:34 2021] DELETE /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6 => generated 0 bytes in 1038 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:35.799190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:35.800459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:35.808332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.808795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.809629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.811111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.866519 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67571da6-bf29-44ae-9c26-0fb5273f60d3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.073032 Dec 25 21:17:35.868408 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1666/3242] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:35 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:35.879576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:35.880290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:35.888570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.889052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:35.889860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:35.890294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.017546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:36.025303 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a950e0e2-6aa5-4cf7-8a83-f771ab40bbb5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.317143 Dec 25 21:17:36.026144 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1577/3243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:35 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:36.030885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:36.031600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:36.040663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.040663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.041534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.042062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.071709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:36.128576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:36.136451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03721ab9-6db7-4b36-b25d-978fa213445b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1325 microversion: 2.1 time: 0.261772 Dec 25 21:17:36.137053 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1667/3244] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:35 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:36.141368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78c6d450-b473-48d9-b5fc-6ae2f01e671f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa500693ca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:36.163147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-78c6d450-b473-48d9-b5fc-6ae2f01e671f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:36.163809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-78c6d450-b473-48d9-b5fc-6ae2f01e671f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:36.164328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-78c6d450-b473-48d9-b5fc-6ae2f01e671f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 does not exist Dec 25 21:17:36.164328 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-82123c3f-8238-4854-8055-4ff72b80d505'] Dec 25 21:17:36.165048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78c6d450-b473-48d9-b5fc-6ae2f01e671f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 does not exist Dec 25 21:17:36.165048 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-82123c3f-8238-4854-8055-4ff72b80d505'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:36.165901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78c6d450-b473-48d9-b5fc-6ae2f01e671f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6" status: 404 len: 194 microversion: 2.1 time: 0.027948 Dec 25 21:17:36.166481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1668/3245] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:17:36 2021] GET /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6 => generated 194 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:36.171783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:36.172609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:36.179642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.180137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.180974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.181425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.266486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '819fcdf5d86a46399dfb7343639f3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27d474dfd37c46f0aa14aa84e8b3ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:36.275039 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8715faf6-d4d8-476c-b61d-0dc1f0fe4534 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 200 len: 1469 microversion: 2.1 time: 0.107373 Dec 25 21:17:36.275644 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1669/3246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:36 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 1469 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:36.280105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-974e3e89-9444-4bfd-b389-8d53dc021078 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa5006938b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1303430442", "description": "tempest-description-1900400511"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:36.403052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ebf3c89-c64a-4931-9ace-cda2c97ca48a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 204 len: 0 microversion: 2.1 time: 0.375571 Dec 25 21:17:36.403668 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1578/3247] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:36 2021] DELETE /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:36.412978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-87948410-e39e-42b6-a5dc-056529fcc20e req-45a47cb5-f6b9-4b3c-9512-2556a408eb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145d49b0-3bfb-45f5-9f32-8f86e111755f", "name": "network-vif-deleted", "tag": "bcca9b59-72e2-4e80-8ac7-e478ceb19706"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:36.414867 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:36.414867 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:36.422232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-87948410-e39e-42b6-a5dc-056529fcc20e req-45a47cb5-f6b9-4b3c-9512-2556a408eb09 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.422689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-87948410-e39e-42b6-a5dc-056529fcc20e req-45a47cb5-f6b9-4b3c-9512-2556a408eb09 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.435198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-87948410-e39e-42b6-a5dc-056529fcc20e req-45a47cb5-f6b9-4b3c-9512-2556a408eb09 service nova] Creating event network-vif-deleted:bcca9b59-72e2-4e80-8ac7-e478ceb19706 for instance 145d49b0-3bfb-45f5-9f32-8f86e111755f on nch1-master-1 Dec 25 21:17:36.440417 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-87948410-e39e-42b6-a5dc-056529fcc20e req-45a47cb5-f6b9-4b3c-9512-2556a408eb09 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Dec 25 21:17:36.441045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1579/3248] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:36.446635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:36.447539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:36.457711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.458871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.460251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:36.464747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:36.635644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:36.645017 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-105f1c35-9e89-4223-a16d-e923529ea9cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1493 microversion: 2.1 time: 0.202572 Dec 25 21:17:36.645700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1580/3249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:36 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1493 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:36.682067 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-974e3e89-9444-4bfd-b389-8d53dc021078 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.405352 Dec 25 21:17:36.682847 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1670/3250] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:36 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:36.693230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12bd5121-a97c-4706-ba70-beedce07cc5c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa5007464c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1527451707", "description": "tempest-description-43443116"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:36.779538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1325116668", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:36.836005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:37.157538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12bd5121-a97c-4706-ba70-beedce07cc5c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.467670 Dec 25 21:17:37.164062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1671/3251] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:36 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:37.169266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:37.170373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.177665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.178118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.179177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.179610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.236483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b7cfcca-a2e9-400c-80f7-f5cc2a0f29b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.070769 Dec 25 21:17:37.237387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1672/3252] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:37 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:37.242517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.243394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.250702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.251138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.257992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.257992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.270373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:37.270969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:37.271472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:37.272169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:37.272671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:37.282216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.282769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.283811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.284319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.301433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:37.306970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:37.320169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:37.322669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:37.417926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:37.425704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3810be26-905b-48ba-b9cb-2ef93acbd39b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.186937 Dec 25 21:17:37.433067 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1673/3253] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:37.433067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.433067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.438945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.440302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.441042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.441486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.464971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4e946f6-0bc3-4711-8664-891f5872dc10 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798547 Dec 25 21:17:37.465696 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1581/3254] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:17:37.469971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-286711dc-b8b6-4a46-8486-a83f7e3fa1fb tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa4f6f85f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2025149006", "description": "tempest-description-1518694600"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:37.607525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:37.617461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae3a2365-65e3-49c6-be09-b46bf4668efb tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1325 microversion: 2.1 time: 0.190017 Dec 25 21:17:37.618050 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1674/3255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:37.624897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.625746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 145d49b0-3bfb-45f5-9f32-8f86e111755f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.636400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.636400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.636400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.636400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.649939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] HTTP exception thrown: Instance 145d49b0-3bfb-45f5-9f32-8f86e111755f could not be found. Dec 25 21:17:37.650544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Returning 404 to user: Instance 145d49b0-3bfb-45f5-9f32-8f86e111755f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:37.651385 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd44ef9d-6a96-48ab-b6bf-3db4df9aaecb tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f" status: 404 len: 111 microversion: 2.1 time: 0.032392 Dec 25 21:17:37.651934 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1675/3256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/145d49b0-3bfb-45f5-9f32-8f86e111755f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:37.657195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44867f3c-1f1f-4ade-8ad5-8116c0d35458 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.657855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44867f3c-1f1f-4ade-8ad5-8116c0d35458 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.716795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-44867f3c-1f1f-4ade-8ad5-8116c0d35458 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:37.725011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44867f3c-1f1f-4ade-8ad5-8116c0d35458 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1193 microversion: 2.1 time: 0.072051 Dec 25 21:17:37.725667 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1676/3257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1193 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:37.730300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.730871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.737903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.738456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.739310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.739819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.754287 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] HTTP exception thrown: Instance a665e8d7-d64e-4879-9389-ad2efb13749b could not be found. Dec 25 21:17:37.754961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Returning 404 to user: Instance a665e8d7-d64e-4879-9389-ad2efb13749b could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:37.755789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6b3a5317-4f0a-47f9-ba0d-10da34af4146 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 404 len: 111 microversion: 2.1 time: 0.029143 Dec 25 21:17:37.756339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1677/3258] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:37 2021] DELETE /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:37.762072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.762742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.768540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.769154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.769992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.770426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.878285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-286711dc-b8b6-4a46-8486-a83f7e3fa1fb tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.411660 Dec 25 21:17:37.879584 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1582/3259] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:37 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:37.888918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.890296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: a665e8d7-d64e-4879-9389-ad2efb13749b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.897451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.897910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.898715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.899191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.915051 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] HTTP exception thrown: Instance a665e8d7-d64e-4879-9389-ad2efb13749b could not be found. Dec 25 21:17:37.915744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Returning 404 to user: Instance a665e8d7-d64e-4879-9389-ad2efb13749b could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:37.916664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7d74a759-9e04-4b5f-b2c2-7ce11a761104 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b" status: 404 len: 111 microversion: 2.1 time: 0.036010 Dec 25 21:17:37.917304 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1583/3260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/a665e8d7-d64e-4879-9389-ad2efb13749b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:37.922150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:37.922295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b8fa5b94-f245-400a-aeb0-85e67a8397bf tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f70613a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.932722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-38645406-7e87-4647-94bd-b173657c921a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1493 microversion: 2.1 time: 0.174976 Dec 25 21:17:37.933438 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1678/3261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1493 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:37.938642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.939346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.949687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.949687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.949687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.949687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.963620 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] HTTP exception thrown: Instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 could not be found. Dec 25 21:17:37.964226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Returning 404 to user: Instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:37.966308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb1c81a9-9a14-495d-8e3e-b5a30eb2c59f tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 404 len: 111 microversion: 2.1 time: 0.031415 Dec 25 21:17:37.966477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1679/3262] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:37 2021] DELETE /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:37.974731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:37.975463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] [instance: 0bfb31ab-a5a4-4386-b5bd-77f172344909] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:37.985497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.986053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:37.987467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:37.988890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.021929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] HTTP exception thrown: Instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 could not be found. Dec 25 21:17:38.022505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] Returning 404 to user: Instance 0bfb31ab-a5a4-4386-b5bd-77f172344909 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:38.023405 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ee4e2ba-2348-43f9-99d4-2f49b41cbeb7 tempest-ServerDiskConfigTestJSON-1464303465 tempest-ServerDiskConfigTestJSON-1464303465-project] 10.222.0.32 "GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909" status: 404 len: 111 microversion: 2.1 time: 0.052819 Dec 25 21:17:38.023976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1680/3263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/servers/0bfb31ab-a5a4-4386-b5bd-77f172344909 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:17:38.166210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b8fa5b94-f245-400a-aeb0-85e67a8397bf tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.247749 Dec 25 21:17:38.166823 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1584/3264] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:17:37 2021] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:38.179254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a200a86-4392-4a18-90d1-675bf8e42898 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa500716550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:38.248160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:38.249050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:38.256167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.256632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.257660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.258107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.309271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2079cc4-8d09-476f-b83a-0a5fdd6db8cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.065196 Dec 25 21:17:38.310589 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1585/3265] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:38 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:17:38.443739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:38.444600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:38.451864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.452350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.453180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.453617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.693767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:38.702383 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f6c44d3-c4ed-4c0c-8372-4d772beb48b4 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.262833 Dec 25 21:17:38.703169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1586/3266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:38 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:38.716825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:38.717555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:38.725821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a200a86-4392-4a18-90d1-675bf8e42898 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6" status: 202 len: 0 microversion: 2.1 time: 0.546225 Dec 25 21:17:38.725821 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1681/3267] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:17:38 2021] DELETE /compute/v2.1/os-security-groups/1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:38.725973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.725973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.725973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.726402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.730317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ed5bf4f-2af4-4f5d-8f2c-b5dacf6491f6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa50074eca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:38.763962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-5ed5bf4f-2af4-4f5d-8f2c-b5dacf6491f6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:38.764731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-5ed5bf4f-2af4-4f5d-8f2c-b5dacf6491f6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:38.765515 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5ed5bf4f-2af4-4f5d-8f2c-b5dacf6491f6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 does not exist Dec 25 21:17:38.765515 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-2d156818-1e03-49cb-ba7d-b1f91b839e87'] Dec 25 21:17:38.766402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ed5bf4f-2af4-4f5d-8f2c-b5dacf6491f6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 does not exist Dec 25 21:17:38.766402 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-2d156818-1e03-49cb-ba7d-b1f91b839e87'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:38.768138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ed5bf4f-2af4-4f5d-8f2c-b5dacf6491f6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6" status: 404 len: 194 microversion: 2.1 time: 0.040764 Dec 25 21:17:38.768849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1682/3268] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:17:38 2021] GET /compute/v2.1/os-security-groups/1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:17:38.774645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:38.775261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:38.781811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.782261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.783249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:38.783683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:38.862091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:38.870112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa434b18-f3bf-401d-b47e-c94e74985ec2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1197 microversion: 2.1 time: 0.100112 Dec 25 21:17:38.870886 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1683/3269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:38 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:38.875466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfcf9ceb-0dfb-4b2c-a9c0-9119e8bb76e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa5006e2c10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.066285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:39.074130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27cfbebb-41c0-4ff5-b067-ed3441175943 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1325 microversion: 2.1 time: 0.360913 Dec 25 21:17:39.083180 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1587/3270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:38 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1325 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:39.088352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.089018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:39.106260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.106728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.107701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.108158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.188144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:39.198360 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb17fc10-f7d4-4e32-81f7-e850f3c00cd8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 200 len: 1451 microversion: 2.1 time: 0.113878 Dec 25 21:17:39.199423 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1588/3271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:39 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:39.212550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-070804ad-7d9a-404f-9d02-71b7f9e8732b req-b7a86450-f612-46df-b467-dcf95f89b55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2254a4b-e6ed-4560-a239-47903f19b47d", "name": "network-vif-deleted", "tag": "285370c8-a68b-4ddd-9ceb-19642f45731c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:39.215618 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:39.215618 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:39.229885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-070804ad-7d9a-404f-9d02-71b7f9e8732b req-b7a86450-f612-46df-b467-dcf95f89b55a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.233563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-070804ad-7d9a-404f-9d02-71b7f9e8732b req-b7a86450-f612-46df-b467-dcf95f89b55a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.251205 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-070804ad-7d9a-404f-9d02-71b7f9e8732b req-b7a86450-f612-46df-b467-dcf95f89b55a service nova] Creating event network-vif-deleted:285370c8-a68b-4ddd-9ceb-19642f45731c for instance d2254a4b-e6ed-4560-a239-47903f19b47d on nch2-master-1 Dec 25 21:17:39.258050 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-070804ad-7d9a-404f-9d02-71b7f9e8732b req-b7a86450-f612-46df-b467-dcf95f89b55a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057065 Dec 25 21:17:39.262240 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1589/3272] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:39.288338 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfcf9ceb-0dfb-4b2c-a9c0-9119e8bb76e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/7aab234a-65b2-4f08-a28b-36ce01fbb815" status: 202 len: 0 microversion: 2.1 time: 0.416147 Dec 25 21:17:39.293612 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1684/3273] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:17:38 2021] DELETE /compute/v2.1/os-security-groups/7aab234a-65b2-4f08-a28b-36ce01fbb815 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:39.301732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d9ebe5d-4624-4828-ac50-303a853fda95 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f70e5430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.325840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:39.328113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:39.329489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-3d9ebe5d-4624-4828-ac50-303a853fda95 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:39.330488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-3d9ebe5d-4624-4828-ac50-303a853fda95 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:39.331021 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3d9ebe5d-4624-4828-ac50-303a853fda95 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 does not exist Dec 25 21:17:39.331021 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-37775968-6cb5-4e6e-828b-471e0c8fd42e'] Dec 25 21:17:39.331653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d9ebe5d-4624-4828-ac50-303a853fda95 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 does not exist Dec 25 21:17:39.331653 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-37775968-6cb5-4e6e-828b-471e0c8fd42e'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:39.332967 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d9ebe5d-4624-4828-ac50-303a853fda95 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/7aab234a-65b2-4f08-a28b-36ce01fbb815" status: 404 len: 194 microversion: 2.1 time: 0.037326 Dec 25 21:17:39.333854 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1590/3274] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:17:39 2021] GET /compute/v2.1/os-security-groups/7aab234a-65b2-4f08-a28b-36ce01fbb815 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:39.342937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1cde6c0e-bbd5-471e-8dcd-30c6e30fa184 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f713b3a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.352635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.352635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.352635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.352635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.407464 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c2bc779-8a90-4a24-bebb-d8d5a34bc4d6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.089372 Dec 25 21:17:39.408723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1685/3275] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:39 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:39.562439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e884c456-7fb0-4006-bfb7-79f707654a4c req-9dab3482-c843-4188-b299-51db1ac22a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5284da0-3efe-4fd6-b107-6eb5f66c269d", "name": "network-vif-plugged", "status": "completed", "tag": "cbb5ba94-31f2-4df4-8a61-f6af5700b77d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:39.564981 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:39.564981 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:39.572501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e884c456-7fb0-4006-bfb7-79f707654a4c req-9dab3482-c843-4188-b299-51db1ac22a25 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.573473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e884c456-7fb0-4006-bfb7-79f707654a4c req-9dab3482-c843-4188-b299-51db1ac22a25 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.585181 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e884c456-7fb0-4006-bfb7-79f707654a4c req-9dab3482-c843-4188-b299-51db1ac22a25 service nova] Creating event network-vif-plugged:cbb5ba94-31f2-4df4-8a61-f6af5700b77d for instance a5284da0-3efe-4fd6-b107-6eb5f66c269d on nch2-master-1 Dec 25 21:17:39.591515 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e884c456-7fb0-4006-bfb7-79f707654a4c req-9dab3482-c843-4188-b299-51db1ac22a25 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181228 Dec 25 21:17:39.592604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1686/3276] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:39.627092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1cde6c0e-bbd5-471e-8dcd-30c6e30fa184 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/f815413a-79b3-4d1b-b14c-dcbdf85ac8f7" status: 202 len: 0 microversion: 2.1 time: 0.288605 Dec 25 21:17:39.627910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1591/3277] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:17:39 2021] DELETE /compute/v2.1/os-security-groups/f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:17:39.636566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73d857cf-7193-4808-bc7b-7f25059f15a7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa5006ff8b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.665686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-73d857cf-7193-4808-bc7b-7f25059f15a7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:17:39.666307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-73d857cf-7193-4808-bc7b-7f25059f15a7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:17:39.666886 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-73d857cf-7193-4808-bc7b-7f25059f15a7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 does not exist Dec 25 21:17:39.666886 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-25aeba31-8c33-4a5d-8f96-6116c6acac13'] Dec 25 21:17:39.668096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73d857cf-7193-4808-bc7b-7f25059f15a7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 does not exist Dec 25 21:17:39.668096 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-25aeba31-8c33-4a5d-8f96-6116c6acac13'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:39.668449 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-73d857cf-7193-4808-bc7b-7f25059f15a7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/f815413a-79b3-4d1b-b14c-dcbdf85ac8f7" status: 404 len: 194 microversion: 2.1 time: 0.036345 Dec 25 21:17:39.669054 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1687/3278] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:17:39 2021] GET /compute/v2.1/os-security-groups/f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:39.677633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac205beb-dd07-406d-950f-f242b955a74f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f70de550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.719792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:39.721133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:39.730876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.731549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:39.732512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:39.733151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.089293 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac205beb-dd07-406d-950f-f242b955a74f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.415894 Dec 25 21:17:40.104802 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1592/3279] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:17:39 2021] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:40.105174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:40.106774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:40.107602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:40.110782 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55f17c45-c496-48e9-b304-996cb67bbd2c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.395056 Dec 25 21:17:40.111362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1688/3280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:39 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:40.115725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.116270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.117505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:40.118787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:40.130754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.130754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.132256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.132794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.134156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.134701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.245256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:40.254362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0724c814-3302-4404-9c37-abd143519202 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1253 microversion: 2.1 time: 0.160690 Dec 25 21:17:40.255438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1593/3281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:40 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1253 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:40.260390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a28aed3e-6db0-4040-99c6-c304dc1e47b5 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa4f6e53d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-25546439", "description": "tempest-description-1950563526"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:40.366898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:40.374386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfe2049a-b206-429d-9425-ab68323e4c7e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1325 microversion: 2.1 time: 0.261860 Dec 25 21:17:40.374950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1689/3282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:40 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:40.379691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:40.380505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:40.386293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.396029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.396029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.396029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.402109 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance d2254a4b-e6ed-4560-a239-47903f19b47d could not be found. Dec 25 21:17:40.402754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance d2254a4b-e6ed-4560-a239-47903f19b47d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:40.403716 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc2be8c5-8bd1-409c-b89a-9348bee85ac1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 404 len: 111 microversion: 2.1 time: 0.027869 Dec 25 21:17:40.404527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1690/3283] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:40 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:40.420928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:40.422183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:40.431175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.431767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.432639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:40.433167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:40.494486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7247e620-335c-48df-a3c6-3cc10ad88467 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.077821 Dec 25 21:17:40.496935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1691/3284] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:40 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:40.523245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-223808016", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:40.577979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:40.889742 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a28aed3e-6db0-4040-99c6-c304dc1e47b5 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.632875 Dec 25 21:17:40.890672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1594/3285] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:40 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:40.901297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc64201c-c6c3-49b7-96df-4ccee88297fe tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa4f6f85e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1487778555", "description": "tempest-description-1337562743"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:41.168423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:41.168864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:41.169401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:41.169872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:41.170435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:41.182394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.183164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.187638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.187638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.203720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:41.210108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:41.223097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:41.225611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:41.424389 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f8cfbaa-f15d-4586-a4bc-7ca01587ab50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906020 Dec 25 21:17:41.425177 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1692/3286] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:17:41.429693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:41.431054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:41.447214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.447807 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc64201c-c6c3-49b7-96df-4ccee88297fe tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.550249 Dec 25 21:17:41.448808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.450081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.450532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.465521 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1595/3287] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:17:40 2021] POST /compute/v2.1/os-security-groups => generated 244 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:41.474591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:41.481955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:41.503412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.503874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.504687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.513314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.853455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:41.862350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c338fa0-4328-41f5-851c-d474d028b04c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.436252 Dec 25 21:17:41.863190 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1693/3288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:41 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:41.872156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:41.878373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:41.879218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:41.879555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1546be01-af4f-4df0-acd5-ea2a47b2519c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1293 microversion: 2.1 time: 0.412097 Dec 25 21:17:41.880519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1596/3289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:41 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1293 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:41.886413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22d0fe9c-13f6-4d8b-8bbd-c8c5aa4766cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:41.887327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22d0fe9c-13f6-4d8b-8bbd-c8c5aa4766cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:41.896619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.903059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.903059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:41.903059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:41.978489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-22d0fe9c-13f6-4d8b-8bbd-c8c5aa4766cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:41.991983 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22d0fe9c-13f6-4d8b-8bbd-c8c5aa4766cb tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1214 microversion: 2.1 time: 0.103208 Dec 25 21:17:41.995076 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1597/3290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:41 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1214 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:41.999928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:42.000950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:42.007654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.008115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.008931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.009382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.053042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-151d3829-d3ba-42c3-b3a5-836ee06cac0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.056625 Dec 25 21:17:42.054337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1598/3291] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:41 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:42.061450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1239954134", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "ce9b43e7-57f0-42d1-9422-f764ccb2bd06"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:42.121565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] validate_networks() for [('ce9b43e7-57f0-42d1-9422-f764ccb2bd06', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:42.149172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:42.161138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-881ccbdf-620e-4eaf-a813-fe6770abb56e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1523 microversion: 2.1 time: 0.287524 Dec 25 21:17:42.162033 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1694/3292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:41 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:42.180412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:42.180926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:42.187365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.187822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.188613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.189892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.216419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:42.543050 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ff1f0aa-0a8b-4500-ad32-c3cd3a3b9414 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 204 len: 0 microversion: 2.1 time: 0.366282 Dec 25 21:17:42.544210 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1695/3293] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:42 2021] DELETE /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:17:42.553916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:42.554688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:42.561350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.562927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.562927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.563103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.861797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:42.871284 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2ce100a-1679-499e-bc65-fbfc5e7979a9 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1529 microversion: 2.1 time: 0.322828 Dec 25 21:17:42.872457 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1696/3294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:42 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1529 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:42.878343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:42.878944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:42.886109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.886420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:42.887246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:42.887682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.191009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:43.202288 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b15ccb35-0180-4826-b3b0-1bc2bc40d19c tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.327669 Dec 25 21:17:43.213150 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1697/3295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:42 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:43.213344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:43.213344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:43.213344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:43.213344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:43.213344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:43.214083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:43.214083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:43.221110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.221414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.221752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.222405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.222682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.223146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.230161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.230631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.252505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Getting quotas for project 16a084940f024be8aee5807248918cb5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:43.258143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Getting quotas for user d9a0d56f4a364ba38235b7eccbd8db8a and project 16a084940f024be8aee5807248918cb5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:43.271978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:43.274970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:43.395773 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2f19179-ba26-458b-b84d-c4eb0651c6e7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.339789 Dec 25 21:17:43.396663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1599/3296] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:42 2021] POST /compute/v2.1/servers => generated 380 bytes in 1342 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:43.401671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:43.402547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:43.409445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.414335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.414335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.414335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.489808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:43.499334 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50d9fcfc-0bce-4885-a7d5-d8b74d1d3a2e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1293 microversion: 2.1 time: 0.292095 Dec 25 21:17:43.509053 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1698/3297] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:43 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1293 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:43.509053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:43.509053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:43.516390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:43.516685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.517794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.518612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.519465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.526707 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff646376-3736-4650-90cb-ee92b7eff0d1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1266 microversion: 2.1 time: 0.128597 Dec 25 21:17:43.527518 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1600/3298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:43 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:43.598400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9fb95877-2941-40bf-b8eb-77afa6513e1a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.096401 Dec 25 21:17:43.599069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1699/3299] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:43 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:43.613121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d2f8ec4-479b-4a6c-abc7-f204e84482ea tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:43.613842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d2f8ec4-479b-4a6c-abc7-f204e84482ea tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:43.698695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b67a5ab7-ab2e-434e-9e15-ac80ce6fc71c req-58d645fd-101b-4619-a6d5-e65dbd3a6f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6a1be38-1673-434a-ac87-a3a12f8760ce", "tag": "b548a516-5b40-4749-9286-e686f9b3d3be"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:43.700296 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:43.700296 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:43.706643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6d2f8ec4-479b-4a6c-abc7-f204e84482ea tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:43.708511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b67a5ab7-ab2e-434e-9e15-ac80ce6fc71c req-58d645fd-101b-4619-a6d5-e65dbd3a6f07 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.709210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b67a5ab7-ab2e-434e-9e15-ac80ce6fc71c req-58d645fd-101b-4619-a6d5-e65dbd3a6f07 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.721224 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d2f8ec4-479b-4a6c-abc7-f204e84482ea tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1216 microversion: 2.1 time: 0.120898 Dec 25 21:17:43.723387 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b67a5ab7-ab2e-434e-9e15-ac80ce6fc71c req-58d645fd-101b-4619-a6d5-e65dbd3a6f07 service nova] Creating event network-changed:b548a516-5b40-4749-9286-e686f9b3d3be for instance e6a1be38-1673-434a-ac87-a3a12f8760ce on nch1-master-1 Dec 25 21:17:43.723489 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1700/3300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:43 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1216 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:43.726521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b67a5ab7-ab2e-434e-9e15-ac80ce6fc71c req-58d645fd-101b-4619-a6d5-e65dbd3a6f07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198097 Dec 25 21:17:43.727114 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1601/3301] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:43.890301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:43.891310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:43.903112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.905808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:43.906872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:43.908470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.222021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:44.222734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:44.243419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.244363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.245454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.246260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.365452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:44.377340 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58c5a1db-9145-4e69-85a2-0d506645f409 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1529 microversion: 2.1 time: 0.492469 Dec 25 21:17:44.378662 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1701/3302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:43 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1529 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:44.519381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:44.520146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:44.526935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.527385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.528346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.528796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.611421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:44.619732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f977f14-45c5-428f-b662-56d4f2ff9505 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.402798 Dec 25 21:17:44.620646 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1602/3303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:44 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:44.625250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:44.626216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:44.633108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.636273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.636273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.636273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.751917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:44.760200 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-430fba98-8d2f-47ce-a177-03f50ad36d92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1272 microversion: 2.1 time: 0.138298 Dec 25 21:17:44.769126 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1603/3304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:44 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:44.769126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:44.769126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:44.775250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.775634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.776624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.777400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.821083 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-64fe5a28-9e98-4b64-965a-9a87f8097847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.058281 Dec 25 21:17:44.822325 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1604/3305] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:44 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:44.827620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:44.828562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:44.836583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.837334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.838152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:44.839453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:44.902354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:44.917674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a7320f0-1593-4f42-9324-2f1782202eaa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1293 microversion: 2.1 time: 0.401812 Dec 25 21:17:44.918935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1702/3306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:44 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1293 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:44.943116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:44.951696 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1ada933-9cc6-44f0-a7cf-a7d5530cc3bc tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1220 microversion: 2.1 time: 0.127828 Dec 25 21:17:44.952478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1605/3307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:44 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:45.139752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b2ce90cc-b7d3-4433-bd51-a448f37412a7 req-e324f1e2-8b48-4f41-834f-dbd7cbf6a567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5284da0-3efe-4fd6-b107-6eb5f66c269d", "name": "network-vif-deleted", "tag": "cbb5ba94-31f2-4df4-8a61-f6af5700b77d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:45.142036 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:45.142036 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:45.149578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b2ce90cc-b7d3-4433-bd51-a448f37412a7 req-e324f1e2-8b48-4f41-834f-dbd7cbf6a567 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.150459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b2ce90cc-b7d3-4433-bd51-a448f37412a7 req-e324f1e2-8b48-4f41-834f-dbd7cbf6a567 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.163296 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b2ce90cc-b7d3-4433-bd51-a448f37412a7 req-e324f1e2-8b48-4f41-834f-dbd7cbf6a567 service nova] Creating event network-vif-deleted:cbb5ba94-31f2-4df4-8a61-f6af5700b77d for instance a5284da0-3efe-4fd6-b107-6eb5f66c269d on nch2-master-1 Dec 25 21:17:45.169893 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b2ce90cc-b7d3-4433-bd51-a448f37412a7 req-e324f1e2-8b48-4f41-834f-dbd7cbf6a567 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035098 Dec 25 21:17:45.171021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1703/3308] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:45.394103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:45.394941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:45.402849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.403341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.404158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.404614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.439603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.440324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.440793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lazy-loading 'fault' on Instance uuid a5284da0-3efe-4fd6-b107-6eb5f66c269d {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:17:45.521252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7c7a9d6618448c9a5ade71c13a1758d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dbe1e97c3f64bee9355ec5d1b424c8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:45.529407 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0e66c436-54f7-4bd3-a8a9-1b15439ec600 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 200 len: 1315 microversion: 2.1 time: 0.139262 Dec 25 21:17:45.530608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1606/3309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:45 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:45.638346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:45.639059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:45.646111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.646802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.647834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.648281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.778689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:45.779740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:45.790172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.791363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:45.792699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:45.793612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.526364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:46.536837 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2780e4b-055b-4fcf-b01c-85ee3348016f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.903603 Dec 25 21:17:46.541761 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1704/3310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:45 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:46.547920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:46.549850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:46.561201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.561772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.562684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.563034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.614722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49794130-0ca3-4e4c-abca-3e63dfebe847 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.071148 Dec 25 21:17:46.615383 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1705/3311] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:46 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:46.621075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:46.621783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:46.634132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:46.634762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.634762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.634762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.634762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.634994 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10b99eb3-33a3-440a-b68c-f5820f231928 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.861143 Dec 25 21:17:46.644288 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1607/3312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:45 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:46.649432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:46.650335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:46.656856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.657417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.658318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.658828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.818527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:46.831964 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77d38cf1-7a2b-41b3-b642-55ea89d55bd1 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1274 microversion: 2.1 time: 0.186113 Dec 25 21:17:46.832563 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1608/3313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:46 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1274 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:46.837141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:46.837764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: a5284da0-3efe-4fd6-b107-6eb5f66c269d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:46.843816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.844274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.845639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.846091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.864037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance a5284da0-3efe-4fd6-b107-6eb5f66c269d could not be found. Dec 25 21:17:46.864658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance a5284da0-3efe-4fd6-b107-6eb5f66c269d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:46.865758 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6497c2a8-962a-4d9a-8e90-c78b9dfdef6e tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d" status: 404 len: 111 microversion: 2.1 time: 0.032222 Dec 25 21:17:46.866507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1609/3314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:46 2021] GET /compute/v2.1/servers/a5284da0-3efe-4fd6-b107-6eb5f66c269d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:46.875523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-109c097e-8e94-4dec-b307-9e0db0352a47 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '.version_select at 0x7fa4f713d430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:46.898856 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-109c097e-8e94-4dec-b307-9e0db0352a47 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Image not found. Dec 25 21:17:46.899585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-109c097e-8e94-4dec-b307-9e0db0352a47 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Image not found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:46.900705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-109c097e-8e94-4dec-b307-9e0db0352a47 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/images/fad40fd6-7996-43da-8e33-dcdcc1c4c111" status: 404 len: 62 microversion: 2.1 time: 0.029298 Dec 25 21:17:46.901421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1610/3315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:46 2021] DELETE /compute/v2.1/images/fad40fd6-7996-43da-8e33-dcdcc1c4c111 => generated 62 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:17:46.909618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:46.910371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:46.918360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.919077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.919891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.920338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.936838 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b could not be found. Dec 25 21:17:46.937474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:46.938340 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-856702aa-b0ce-4097-91f7-2fcf976742c0 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 404 len: 111 microversion: 2.1 time: 0.032899 Dec 25 21:17:46.941811 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1611/3316] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:46 2021] DELETE /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:17:46.948025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:46.948998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 6cf2c55e-9f30-4390-b13e-f7a8917aba8b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:46.955935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.956396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.957236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:46.958396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:46.980785 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b could not be found. Dec 25 21:17:46.981472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance 6cf2c55e-9f30-4390-b13e-f7a8917aba8b could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:46.982543 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2cec80ad-70ac-40c8-8521-a50cddbffb7b tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b" status: 404 len: 111 microversion: 2.1 time: 0.039330 Dec 25 21:17:46.983305 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1612/3317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:46 2021] GET /compute/v2.1/servers/6cf2c55e-9f30-4390-b13e-f7a8917aba8b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:46.993871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-42625c51-7c00-46c7-8cc2-7c2adbe6f60a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '.version_select at 0x7fa4f6f859d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:47.120646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-42625c51-7c00-46c7-8cc2-7c2adbe6f60a tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-229917077" status: 202 len: 0 microversion: 2.1 time: 0.132052 Dec 25 21:17:47.124199 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1613/3318] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:17:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-229917077 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:47.128177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:47.136390 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4310206-b238-4fb8-8e8f-fc1f3b34021e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1293 microversion: 2.1 time: 0.519268 Dec 25 21:17:47.140009 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1706/3319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:46 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1293 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:47.558404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:47.559049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:47.578950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:47.580048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:47.580892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:47.581347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:47.629580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:47.631163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:47.639894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:47.640663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:47.642676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:47.643438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:47.722400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fdc20780-9eee-4b27-8430-aa3a54e103bf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.098593 Dec 25 21:17:47.723720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1707/3320] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:47 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:47.730613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:47.730613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:47.736362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:47.737093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:47.738048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:47.738639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.019014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:48.030790 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8327a43f-b209-456a-9845-e24cd78f1bb1 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.476838 Dec 25 21:17:48.032173 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1614/3321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:47 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:48.044836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:48.046018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:48.056590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.057312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.058952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.059730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.174002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:48.183351 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3978e2d8-6398-4bcf-b327-fdb5977df566 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1274 microversion: 2.1 time: 0.149867 Dec 25 21:17:48.184176 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1615/3322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:48 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1274 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:48.190047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:48.190944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:48.203852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.204671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.205800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.206458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.248841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:48.263837 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0d16967c-11c8-42f4-ad75-3f8700b4e2b4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.539408 Dec 25 21:17:48.264519 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1708/3323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:47 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:48.420018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac00d5f1-a6ac-400b-9676-e311c3eb0c67 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '.version_select at 0x7fa5006f14c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:48.452357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ac00d5f1-a6ac-400b-9676-e311c3eb0c67 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Image not found. Dec 25 21:17:48.453153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac00d5f1-a6ac-400b-9676-e311c3eb0c67 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Image not found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:48.454162 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac00d5f1-a6ac-400b-9676-e311c3eb0c67 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/images/54520c35-8ed4-4398-906b-112cd8202410" status: 404 len: 62 microversion: 2.1 time: 0.037978 Dec 25 21:17:48.471206 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1709/3324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:48 2021] DELETE /compute/v2.1/images/54520c35-8ed4-4398-906b-112cd8202410 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Dec 25 21:17:48.494690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8e6026e6-e5dc-406b-8b51-e2ba8f024add req-9c5d946a-6881-45fe-8e92-d45cd286abda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "503df13c-2f74-4094-bbd9-a07a7ba8f4cb", "tag": "af2cd469-e53b-45dd-9334-186a6c6c612a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:48.504953 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:48.504953 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:48.525141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8e6026e6-e5dc-406b-8b51-e2ba8f024add req-9c5d946a-6881-45fe-8e92-d45cd286abda service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.525708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8e6026e6-e5dc-406b-8b51-e2ba8f024add req-9c5d946a-6881-45fe-8e92-d45cd286abda service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.551172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8e6026e6-e5dc-406b-8b51-e2ba8f024add req-9c5d946a-6881-45fe-8e92-d45cd286abda service nova] Creating event network-changed:af2cd469-e53b-45dd-9334-186a6c6c612a for instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb on nch2-master-1 Dec 25 21:17:48.559921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8e6026e6-e5dc-406b-8b51-e2ba8f024add req-9c5d946a-6881-45fe-8e92-d45cd286abda service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080592 Dec 25 21:17:48.560729 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1710/3325] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:48.566080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:48.566777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:48.573533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.574271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.575102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.575741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.590507 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance 1d343d1d-ac0a-4447-862f-e13c2facfcef could not be found. Dec 25 21:17:48.590780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance 1d343d1d-ac0a-4447-862f-e13c2facfcef could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:48.591788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e7c551ed-ab6f-4317-a743-69afbeb70283 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 404 len: 111 microversion: 2.1 time: 0.029530 Dec 25 21:17:48.592816 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1711/3326] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:48 2021] DELETE /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:48.609705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:48.611236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] [instance: 1d343d1d-ac0a-4447-862f-e13c2facfcef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:48.617458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.617921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.618733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.619506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.636058 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] HTTP exception thrown: Instance 1d343d1d-ac0a-4447-862f-e13c2facfcef could not be found. Dec 25 21:17:48.637341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] Returning 404 to user: Instance 1d343d1d-ac0a-4447-862f-e13c2facfcef could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:48.638985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-34d1ca56-1653-41ed-92d5-f85e827c3081 tempest-ImagesOneServerNegativeTestJSON-1717313213 tempest-ImagesOneServerNegativeTestJSON-1717313213-project] 10.222.0.32 "GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef" status: 404 len: 111 microversion: 2.1 time: 0.033409 Dec 25 21:17:48.639763 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1712/3327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:48 2021] GET /compute/v2.1/servers/1d343d1d-ac0a-4447-862f-e13c2facfcef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:48.675873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:48.704267 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfcfe4a9-fbba-4911-b6ad-94cd487f8929 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1293 microversion: 2.1 time: 0.518713 Dec 25 21:17:48.705637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1616/3328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:48 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1293 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:48.734968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:48.736054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:48.745633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.747341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.748184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:48.750839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:48.808477 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06ae8139-0c7d-45e6-8b05-e89b470de0a7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.076869 Dec 25 21:17:48.812423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1713/3329] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:48 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:49.047586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:49.048911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:49.056061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:49.057455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:49.058477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:49.059123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:49.202952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:49.203668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:49.216415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:49.220925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:49.224439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:49.225094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:49.966600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:49.982558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b44fe0a-df4c-49ce-b61a-1d149cdc87b5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.938700 Dec 25 21:17:49.983266 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1617/3330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:49 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:49.990479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:49.991370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:49.998468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:49.999042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.000246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:50.000760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.058987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:50.069513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43d558ac-cc3a-4d72-ace8-78f87aba9071 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.870864 Dec 25 21:17:50.072333 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1714/3331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:49 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:50.078237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:50.079111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:50.087787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:50.087787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.088471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:50.089132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.498553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:50.507280 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd704938-6fac-460e-a2ef-c61b300ba57a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.522788 Dec 25 21:17:50.513661 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1618/3332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:49 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:50.521649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:50.523140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:50.530448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:50.531070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.531983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:50.532979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.596907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:50.604790 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7edf442-c489-460d-8a47-09373fcfefc0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1293 microversion: 2.1 time: 0.530949 Dec 25 21:17:50.605408 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1715/3333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:50 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1293 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:50.630340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-df6544ac-c045-4926-a9af-a0f3e591290b req-480963d0-97f6-44a6-90ef-ab54d7e81c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1be38-1673-434a-ac87-a3a12f8760ce", "name": "network-vif-plugged", "status": "completed", "tag": "b548a516-5b40-4749-9286-e686f9b3d3be"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:50.639877 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:50.639877 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:50.650398 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5babca81-b77d-44d5-8343-3fff75f0e233 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.135272 Dec 25 21:17:50.651522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1619/3334] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:50 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:50.656492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-df6544ac-c045-4926-a9af-a0f3e591290b req-480963d0-97f6-44a6-90ef-ab54d7e81c7b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:50.657374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-df6544ac-c045-4926-a9af-a0f3e591290b req-480963d0-97f6-44a6-90ef-ab54d7e81c7b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:50.677966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-df6544ac-c045-4926-a9af-a0f3e591290b req-480963d0-97f6-44a6-90ef-ab54d7e81c7b service nova] Creating event network-vif-plugged:b548a516-5b40-4749-9286-e686f9b3d3be for instance e6a1be38-1673-434a-ac87-a3a12f8760ce on nch1-master-1 Dec 25 21:17:50.690431 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-df6544ac-c045-4926-a9af-a0f3e591290b req-480963d0-97f6-44a6-90ef-ab54d7e81c7b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072351 Dec 25 21:17:50.692088 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1716/3335] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:51.014962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:51.019839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:51.042528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:51.043163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:51.044231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:51.044841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:51.102824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1997606815", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "040e4d7b-a517-49cc-8699-70c0b9b2f222"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:51.162013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] validate_networks() for [('040e4d7b-a517-49cc-8699-70c0b9b2f222', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:51.467553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:51.481060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28feb785-0746-4f18-90fc-e14b76f489de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.484980 Dec 25 21:17:51.481981 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1717/3336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:50 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:51.487095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:51.487710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:51.505801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:51.506209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:51.507152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:51.507502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:51.862413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:51.871883 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4a8b26a-15ea-426a-9e97-ef0486149a51 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.388710 Dec 25 21:17:51.881007 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1718/3337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:51 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:51.882125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-56925a4a-50c4-4700-9d71-c9fee0d6c76c req-b1d29d93-ba60-42da-95c0-cda3acf54b61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d51e67-c044-4aa2-9b94-b50e5df7aecb", "tag": "351ad003-7628-46fe-a749-8abfe48f50a4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:51.884477 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:51.884477 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:51.894783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-56925a4a-50c4-4700-9d71-c9fee0d6c76c req-b1d29d93-ba60-42da-95c0-cda3acf54b61 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:51.895534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-56925a4a-50c4-4700-9d71-c9fee0d6c76c req-b1d29d93-ba60-42da-95c0-cda3acf54b61 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:51.919322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-56925a4a-50c4-4700-9d71-c9fee0d6c76c req-b1d29d93-ba60-42da-95c0-cda3acf54b61 service nova] Creating event network-changed:351ad003-7628-46fe-a749-8abfe48f50a4 for instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb on nch1-master-1 Dec 25 21:17:51.925075 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-56925a4a-50c4-4700-9d71-c9fee0d6c76c req-b1d29d93-ba60-42da-95c0-cda3acf54b61 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048883 Dec 25 21:17:51.925949 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1719/3338] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:52.027904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:52.028398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:52.029191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:52.029690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:52.030468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:52.042852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.044143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.045774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.046569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.069171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Getting quotas for project 3b0881f03bcb42b2af8fbbc9bd84ca78. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:52.074953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Getting quotas for user 59c504bd6e654627a5d04f6e22be1b95 and project 3b0881f03bcb42b2af8fbbc9bd84ca78. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:52.091423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:52.093432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:52.117994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-479a8969-8592-4c9d-a784-a79d700c41c9 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Action: 'create', calling method: .version_select at 0x7fa500693ca0>, body: {"keypair": {"name": "tempest-keypair-632160101"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:52.133242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-479a8969-8592-4c9d-a784-a79d700c41c9 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:52.138784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-479a8969-8592-4c9d-a784-a79d700c41c9 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:52.231812 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51155767-e2ab-4fb2-9da7-1ba8a9a60e69 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.492621 Dec 25 21:17:52.235209 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1620/3339] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:50 2021] POST /compute/v2.1/servers => generated 383 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:52.247502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:52.253446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:52.282850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.283325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.293645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.293645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.300927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-479a8969-8592-4c9d-a784-a79d700c41c9 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:52.316113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-479a8969-8592-4c9d-a784-a79d700c41c9 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:52.340744 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-479a8969-8592-4c9d-a784-a79d700c41c9 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.413692 Dec 25 21:17:52.342315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1720/3340] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:17:51 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:52.353786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:52.354869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:52.363283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.363843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.364814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.365387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.594529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:52.604488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-59791866-1dca-43b7-94fa-a6b73bfd47c5 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.367966 Dec 25 21:17:52.605105 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1621/3341] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:52 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:52.610249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:52.612048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:52.620452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.621011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.621812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.622256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.672445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:52.674073 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6de4fa66-b829-412c-a1b5-31637ccd9598 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.066754 Dec 25 21:17:52.675430 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1622/3342] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:52 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:52.682102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d1e03b0-9355-4ae3-afc2-51519051afc0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:52.682490 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86b319da-1a4e-4f9c-92d9-9b653db9505f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1474 microversion: 2.1 time: 0.332811 Dec 25 21:17:52.683361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d1e03b0-9355-4ae3-afc2-51519051afc0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:52.684631 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1721/3343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:52 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1474 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:52.702030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b3a46c1f-6369-4fcd-a4f2-15a45fefce61 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa500719700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:52.718463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b3a46c1f-6369-4fcd-a4f2-15a45fefce61 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs/tempest-keypair-632160101" status: 200 len: 691 microversion: 2.1 time: 0.032534 Dec 25 21:17:52.724060 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1722/3344] 10.222.0.32 () {58 vars in 1214 bytes} [Sat Dec 25 21:17:52 2021] GET /compute/v2.1/os-keypairs/tempest-keypair-632160101 => generated 691 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:52.734584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:52.735318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:52.743662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.744584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.745747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:52.746696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:52.855348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6d1e03b0-9355-4ae3-afc2-51519051afc0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:52.868682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d1e03b0-9355-4ae3-afc2-51519051afc0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1214 microversion: 2.1 time: 0.191605 Dec 25 21:17:52.870606 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1623/3345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:52 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:52.875807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ef91fbb-e53a-44b1-8cec-4294ca7cc3f1 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa4f6e53670>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:52.958730 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ef91fbb-e53a-44b1-8cec-4294ca7cc3f1 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-632160101" status: 202 len: 0 microversion: 2.1 time: 0.086823 Dec 25 21:17:52.960024 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1624/3346] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:17:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-632160101 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:52.966914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1944685658", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:53.055629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:53.423053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:53.435632 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3408e05-ec48-4f1c-8017-1512f2a3d9be tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.710021 Dec 25 21:17:53.437104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1723/3347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:52 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:53.449576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:53.450726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:53.461578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:53.462670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:53.464373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:53.466254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:53.703465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:53.712028 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0d43e185-832e-4f85-9d2b-c1f17163307f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.267668 Dec 25 21:17:53.712613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1724/3348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:53 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:53.717284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1382a32d-8ca3-4baa-a8a0-8aabdf287b8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Action: 'create', calling method: .version_select at 0x7fa50075ddc0>, body: {"keypair": {"name": "tempest-keypair-1312861308"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:53.732484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1382a32d-8ca3-4baa-a8a0-8aabdf287b8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:53.738298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1382a32d-8ca3-4baa-a8a0-8aabdf287b8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:53.817937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:53.818395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:53.818882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:53.819298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:53.819717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:53.828909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:53.829943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:53.830824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:53.831291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:53.848377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:53.853653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:53.866123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:53.868546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:53.927187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1382a32d-8ca3-4baa-a8a0-8aabdf287b8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:53.932676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1382a32d-8ca3-4baa-a8a0-8aabdf287b8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:53.948389 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1382a32d-8ca3-4baa-a8a0-8aabdf287b8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.234666 Dec 25 21:17:53.949145 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1725/3349] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:17:53 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:53.953975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:53.955413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:53.962357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:53.963062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:53.963959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:53.964464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.012490 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47f71476-ef81-4b6c-967b-d8e768535a34 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.050859 Dec 25 21:17:54.013601 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1625/3350] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:54.022734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:54.023791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:54.030479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.030938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.031938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.032411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.082803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-363f98b3-c146-4e44-92aa-b0a7d0240cbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.067756 Dec 25 21:17:54.084608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1626/3351] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:54 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:54.092276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:54.093239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:54.101855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.102402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.103406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.103914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.123561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:54.132167 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8651be4d-c570-4495-9577-980f225978f3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.181743 Dec 25 21:17:54.132704 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1726/3352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:53 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:54.138733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff089c30-47b9-4d3b-a4d1-a5a222394060 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa50075d9d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:54.172715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:54.181374 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b3fbec8-7b68-41ac-ad9b-2f96b2631551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1266 microversion: 2.1 time: 0.095381 Dec 25 21:17:54.181941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1627/3353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:54 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:54.195509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7d2e111-3d84-4c20-8c9f-313795d186c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:54.196008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7d2e111-3d84-4c20-8c9f-313795d186c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:54.212317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7d2e111-3d84-4c20-8c9f-313795d186c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:17:54.214935 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff089c30-47b9-4d3b-a4d1-a5a222394060 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312861308" status: 202 len: 0 microversion: 2.1 time: 0.079679 Dec 25 21:17:54.216985 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1727/3354] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:17:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312861308 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:54.227069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-447d4d6a-36d7-4991-910d-f49fcb2724de tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Action: 'create', calling method: .version_select at 0x7fa500722670>, body: {"keypair": {"name": "tempest-keypair-374119585", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:54.241935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-447d4d6a-36d7-4991-910d-f49fcb2724de tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:54.246830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-447d4d6a-36d7-4991-910d-f49fcb2724de tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:54.341457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-447d4d6a-36d7-4991-910d-f49fcb2724de tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.118147 Dec 25 21:17:54.342163 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1728/3355] 10.222.0.32 () {60 vars in 1158 bytes} [Sat Dec 25 21:17:54 2021] POST /compute/v2.1/os-keypairs => generated 573 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:54.351871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92a574ef-471a-401b-9f32-eeaa4321fb5c tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa5007228b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:54.420561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92a574ef-471a-401b-9f32-eeaa4321fb5c tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-374119585" status: 202 len: 0 microversion: 2.1 time: 0.072324 Dec 25 21:17:54.421389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1729/3356] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:17:54 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-374119585 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:17:54.432105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e8e5641-b733-41db-a6fc-7a973bf40fd7 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Action: 'create', calling method: .version_select at 0x7fa50079a430>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-231161985"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:54.447667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7e8e5641-b733-41db-a6fc-7a973bf40fd7 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:54.451532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7e8e5641-b733-41db-a6fc-7a973bf40fd7 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:54.739250 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.scheduler.client.report [None req-e7d2e111-3d84-4c20-8c9f-313795d186c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Deleted allocations for instance c4b19818-baf7-4e92-923d-58a8a34b2b44 Dec 25 21:17:54.745491 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-e7d2e111-3d84-4c20-8c9f-313795d186c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] Instance Mapping does not exist while attempting local delete cleanup. Dec 25 21:17:54.746714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e7d2e111-3d84-4c20-8c9f-313795d186c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44" status: 204 len: 0 microversion: 2.1 time: 0.554729 Dec 25 21:17:54.747307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1628/3357] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:17:54 2021] DELETE /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:17:54.752292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:54.753403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:54.759421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.759880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.760674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.761145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.780691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7e8e5641-b733-41db-a6fc-7a973bf40fd7 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:54.789067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7e8e5641-b733-41db-a6fc-7a973bf40fd7 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:54.808643 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e8e5641-b733-41db-a6fc-7a973bf40fd7 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.380720 Dec 25 21:17:54.809284 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1730/3358] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:17:54 2021] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:54.814259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:54.815116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:54.822726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.823190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.824992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:54.824992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:54.995188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:55.004334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-581f99c8-f644-4710-be7a-a6b29eb161a5 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.255744 Dec 25 21:17:55.005023 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1629/3359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:54 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:55.009605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4c40ea4-22e0-4e0d-8bdd-3dd078ae5f83 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:55.010367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4c40ea4-22e0-4e0d-8bdd-3dd078ae5f83 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:55.028247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d4c40ea4-22e0-4e0d-8bdd-3dd078ae5f83 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance c4b19818-baf7-4e92-923d-58a8a34b2b44 could not be found. Dec 25 21:17:55.028247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4c40ea4-22e0-4e0d-8bdd-3dd078ae5f83 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance c4b19818-baf7-4e92-923d-58a8a34b2b44 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:17:55.028247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4c40ea4-22e0-4e0d-8bdd-3dd078ae5f83 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44" status: 404 len: 111 microversion: 2.1 time: 0.011659 Dec 25 21:17:55.028247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1630/3360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:55 2021] GET /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:17:55.028247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66496ccd-1b16-4811-a50c-7003cab55b7d tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Action: 'create', calling method: .version_select at 0x7fa4f70120d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-217017241"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:55.044464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-66496ccd-1b16-4811-a50c-7003cab55b7d tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:55.049793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-66496ccd-1b16-4811-a50c-7003cab55b7d tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:55.092737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:55.102072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2b5bb03-5d7c-47c4-a3b3-24c24da0b66c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.291546 Dec 25 21:17:55.102988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1731/3361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:54 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:55.117170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1857079961", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:55.180094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:17:55.570607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-66496ccd-1b16-4811-a50c-7003cab55b7d tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:55.575587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-66496ccd-1b16-4811-a50c-7003cab55b7d tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:55.591750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66496ccd-1b16-4811-a50c-7003cab55b7d tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.572356 Dec 25 21:17:55.592435 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1631/3362] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:17:55 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:55.597282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:55.598204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:55.604523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.605183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.605972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.606420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.650678 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe7cac8f-d10b-4fdf-9bc6-00328854914c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.056587 Dec 25 21:17:55.656303 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1632/3363] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:55 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:55.657174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:55.657984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:55.665084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.665540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.666473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.666915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.940681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:17:55.941263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:17:55.941615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:17:55.942407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:17:55.942830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:17:55.949971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:55.958852 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4036d460-bf6f-4289-8b4d-061bfb760aed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.306224 Dec 25 21:17:55.959670 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1633/3364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:55 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:55.968389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.968389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.968389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.968389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.975084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:55.975697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:55.983066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.983528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.984323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:55.984755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:55.988252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:55.994202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:56.007648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:17:56.010335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:17:56.181928 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf0c8300-e943-4497-81fc-4c0318be30c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069423 Dec 25 21:17:56.187754 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1732/3365] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:17:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:17:56.192746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-59e73b79-9d21-44be-871b-3cc10240f9e8 req-f80f956e-e2e9-4bd7-816e-4f16bc21f54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503df13c-2f74-4094-bbd9-a07a7ba8f4cb", "name": "network-vif-plugged", "status": "completed", "tag": "af2cd469-e53b-45dd-9334-186a6c6c612a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:56.194540 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:56.194540 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:17:56.208543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-59e73b79-9d21-44be-871b-3cc10240f9e8 req-f80f956e-e2e9-4bd7-816e-4f16bc21f54b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.209067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-59e73b79-9d21-44be-871b-3cc10240f9e8 req-f80f956e-e2e9-4bd7-816e-4f16bc21f54b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.222857 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-59e73b79-9d21-44be-871b-3cc10240f9e8 req-f80f956e-e2e9-4bd7-816e-4f16bc21f54b service nova] Creating event network-vif-plugged:af2cd469-e53b-45dd-9334-186a6c6c612a for instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb on nch2-master-1 Dec 25 21:17:56.227913 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-59e73b79-9d21-44be-871b-3cc10240f9e8 req-f80f956e-e2e9-4bd7-816e-4f16bc21f54b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038946 Dec 25 21:17:56.228606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1733/3366] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:56.233864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aae1b1e6-95fe-4443-bc0b-260a74ec7090 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Action: 'create', calling method: .version_select at 0x7fa500706e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-643454174"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:56.248694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-aae1b1e6-95fe-4443-bc0b-260a74ec7090 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:56.252893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:56.263180 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48e77673-c954-49c7-b5c1-62e8ddb9aa73 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.291196 Dec 25 21:17:56.263366 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1634/3367] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:55 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:56.269128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-aae1b1e6-95fe-4443-bc0b-260a74ec7090 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:56.284384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.285038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:56.294112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.294570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.295604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.296464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.512659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-aae1b1e6-95fe-4443-bc0b-260a74ec7090 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:17:56.518264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-aae1b1e6-95fe-4443-bc0b-260a74ec7090 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Getting quotas for user bbdaf18fe63f40a7aaac9cf39095757a and project 9d760708c3d04eccb06f1e108da89ed8. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:17:56.542204 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aae1b1e6-95fe-4443-bc0b-260a74ec7090 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2323 microversion: 2.1 time: 0.312130 Dec 25 21:17:56.544928 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1734/3368] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:17:56 2021] POST /compute/v2.1/os-keypairs => generated 2323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:56.548223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.548919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:56.552384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:56.555994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.556453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.557849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.558290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.562465 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b56149d5-cf6a-4cad-95e8-785792f6ec4b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.282295 Dec 25 21:17:56.562988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1635/3369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:56 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:56.567912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00dfae95-5e88-44db-bc08-ef03cecfccea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.568589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-00dfae95-5e88-44db-bc08-ef03cecfccea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:56.642930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-00dfae95-5e88-44db-bc08-ef03cecfccea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:56.649613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00dfae95-5e88-44db-bc08-ef03cecfccea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1221 microversion: 2.1 time: 0.085092 Dec 25 21:17:56.650188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1636/3370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:56 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:56.654896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-550ce14b-3dea-45ad-a2e3-7d5c118d6678 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa4f6da90d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.659170 ncdv-master-1 devstack@n-api.service[136547]: WARNING oslo_db.sqlalchemy.utils [None req-550ce14b-3dea-45ad-a2e3-7d5c118d6678 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 25 21:17:56.665880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-550ce14b-3dea-45ad-a2e3-7d5c118d6678 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 1673 microversion: 2.1 time: 0.014591 Dec 25 21:17:56.666437 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1637/3371] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:17:56 2021] GET /compute/v2.1/os-keypairs => generated 1673 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:56.670811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:56.671682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:56.679122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.680593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.682131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.682660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.728789 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4cb2bb94-381c-4298-b704-e1a2432996be tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.061081 Dec 25 21:17:56.729481 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1638/3372] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:56 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:56.737655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-73965381-867a-4e6e-a6a5-0ede96df0b46 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa4f6ffc550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.814937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:56.822733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08b786a1-61da-4acb-974b-a2ba0350010c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.278593 Dec 25 21:17:56.823519 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1735/3373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:56 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:56.854797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-73965381-867a-4e6e-a6a5-0ede96df0b46 tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-643454174" status: 202 len: 0 microversion: 2.1 time: 0.124116 Dec 25 21:17:56.855386 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1639/3374] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:17:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-643454174 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:56.864291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6fda1d4-5712-4102-9e13-0e52d8b22e8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa5006f1310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.961098 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6fda1d4-5712-4102-9e13-0e52d8b22e8a tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-217017241" status: 202 len: 0 microversion: 2.1 time: 0.100404 Dec 25 21:17:56.961098 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1736/3375] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:17:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-217017241 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:56.970224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be6b7d30-48e7-43da-a2a8-7810f4b133ca tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] Calling method '.version_select at 0x7fa4f72acaf0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.976386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:56.977031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:56.983718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.984175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:56.985974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:56.985974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.051835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be6b7d30-48e7-43da-a2a8-7810f4b133ca tempest-KeyPairsV2TestJSON-1280820973 tempest-KeyPairsV2TestJSON-1280820973-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-231161985" status: 202 len: 0 microversion: 2.1 time: 0.086229 Dec 25 21:17:57.052418 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1640/3376] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:17:56 2021] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-231161985 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:57.059540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f2ea8801-dca5-4132-af41-b09fadc036ad req-e11c5410-ec4e-4501-aa2b-0f891284c838 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30bfda27-68a3-4a4a-bfd1-7749eaa3997c", "tag": "d3b55372-6cc1-4847-8bab-b4a3a6aec2ff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:57.061251 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:57.061251 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:57.071461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f2ea8801-dca5-4132-af41-b09fadc036ad req-e11c5410-ec4e-4501-aa2b-0f891284c838 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.072140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f2ea8801-dca5-4132-af41-b09fadc036ad req-e11c5410-ec4e-4501-aa2b-0f891284c838 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.083991 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f2ea8801-dca5-4132-af41-b09fadc036ad req-e11c5410-ec4e-4501-aa2b-0f891284c838 service nova] Creating event network-changed:d3b55372-6cc1-4847-8bab-b4a3a6aec2ff for instance 30bfda27-68a3-4a4a-bfd1-7749eaa3997c on nch2-master-1 Dec 25 21:17:57.088795 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f2ea8801-dca5-4132-af41-b09fadc036ad req-e11c5410-ec4e-4501-aa2b-0f891284c838 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034797 Dec 25 21:17:57.089628 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1641/3377] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:17:57.188236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:57.195893 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d07cb460-c9a0-4188-837f-a8a73611a5bd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1314 microversion: 2.1 time: 0.223931 Dec 25 21:17:57.196569 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1737/3378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:56 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:17:57.281079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:57.281784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:57.289882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.290337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.294139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.294139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.492326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:57.500383 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6b5cd0f9-ad81-4072-b7eb-21356ace7f3c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.224320 Dec 25 21:17:57.502918 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1642/3379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:57 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:57.579738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:57.580522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:57.587787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.588440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.589399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.589977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.668353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:57.669995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:57.679347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.680395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.681432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.682789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.790247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:57.798368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa005e40-c3ab-49c4-9306-f4d58e2ff506 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1217 microversion: 2.1 time: 0.133939 Dec 25 21:17:57.808495 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1643/3380] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:57 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:57.816255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:57.816255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:57.821770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.822392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.823910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.824350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.859818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:57.870067 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9d12d15-25c6-4a63-adaf-e0535465f629 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.294379 Dec 25 21:17:57.885089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00ef99ae-72e7-4820-a82a-2dae92263e1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.065572 Dec 25 21:17:57.885089 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1644/3381] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:57 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:57.885263 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1738/3382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:57 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:57.888286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:57.890634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:57.900792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.901413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:57.902371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:57.903743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.092612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:58.100986 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad268d21-a2e9-44ea-a985-8a9baa9a5d9c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.220155 Dec 25 21:17:58.101562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1645/3383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:57 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:58.212569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:58.213208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:58.220373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.220858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.221711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.222148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.245966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0e8168ae-aef1-4d3b-a8b2-f6d088fd9256 req-e612e072-7dc2-485c-8ebd-b477e2fdf173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d51e67-c044-4aa2-9b94-b50e5df7aecb", "name": "network-vif-plugged", "status": "completed", "tag": "351ad003-7628-46fe-a749-8abfe48f50a4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:58.247762 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:17:58.247762 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:17:58.255549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0e8168ae-aef1-4d3b-a8b2-f6d088fd9256 req-e612e072-7dc2-485c-8ebd-b477e2fdf173 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.255997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0e8168ae-aef1-4d3b-a8b2-f6d088fd9256 req-e612e072-7dc2-485c-8ebd-b477e2fdf173 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.271180 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0e8168ae-aef1-4d3b-a8b2-f6d088fd9256 req-e612e072-7dc2-485c-8ebd-b477e2fdf173 service nova] Creating event network-vif-plugged:351ad003-7628-46fe-a749-8abfe48f50a4 for instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb on nch1-master-1 Dec 25 21:17:58.276681 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0e8168ae-aef1-4d3b-a8b2-f6d088fd9256 req-e612e072-7dc2-485c-8ebd-b477e2fdf173 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034169 Dec 25 21:17:58.277534 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1646/3384] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:17:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:17:58.389200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:58.398791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8de8dec4-95a0-4684-9a12-f529c8308218 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1501 microversion: 2.1 time: 0.190031 Dec 25 21:17:58.399535 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1739/3385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:58 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1501 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:58.419742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:58.420576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:58.427656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.428568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.429413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.430021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.454842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lazy-loading 'flavor' on Instance uuid 503df13c-2f74-4094-bbd9-a07a7ba8f4cb {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:17:58.521575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:58.522191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:58.528052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.528501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.529315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.529761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.697998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:58.698591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61cab895-96ef-4bd0-8cb8-902071af8b2e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.180485 Dec 25 21:17:58.699575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1740/3386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:58 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:58.823386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:58.824785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:58.831580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.832018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.833000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.833599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.902213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:58.910300 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a23481e7-08b1-4425-bafe-ac5dbb942d9d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1281 microversion: 2.1 time: 0.090579 Dec 25 21:17:58.910874 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1741/3387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:58 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:58.918886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:58.919504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:58.926806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.927259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:58.928302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:58.928740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.031170 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9a859a3-ed46-4aff-8aa2-da38fe121640 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb/action" status: 202 len: 0 microversion: 2.1 time: 0.616250 Dec 25 21:17:59.035682 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1647/3388] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:58 2021] POST /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:17:59.049750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:17:59.050779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:59.059089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.060194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.061118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.061682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.108989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a56bcfd-f92a-42cb-a957-3fbacc3d3bd1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.074927 Dec 25 21:17:59.114228 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1648/3389] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:17:59 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:17:59.119717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:59.119717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:59.127221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.128255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.129114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.129630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.191599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:59.199788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-917862c6-a698-45c9-b718-4e41ee009469 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.285360 Dec 25 21:17:59.200792 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1742/3390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:58 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:59.206120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:59.206798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:59.213602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.214191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.214935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.215540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.392115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:59.405482 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f865359b-440f-46e9-95f4-58de61b6111e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.291658 Dec 25 21:17:59.414236 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1649/3391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:59 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:59.531111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31f44526-9040-4a38-9327-0103821ebeae tempest-AZV2TestJSON-2087453511 tempest-AZV2TestJSON-2087453511-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:59.533771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f44526-9040-4a38-9327-0103821ebeae tempest-AZV2TestJSON-2087453511 tempest-AZV2TestJSON-2087453511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.534233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f44526-9040-4a38-9327-0103821ebeae tempest-AZV2TestJSON-2087453511 tempest-AZV2TestJSON-2087453511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.535067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f44526-9040-4a38-9327-0103821ebeae tempest-AZV2TestJSON-2087453511 tempest-AZV2TestJSON-2087453511-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.535529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f44526-9040-4a38-9327-0103821ebeae tempest-AZV2TestJSON-2087453511 tempest-AZV2TestJSON-2087453511-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.560894 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31f44526-9040-4a38-9327-0103821ebeae tempest-AZV2TestJSON-2087453511 tempest-AZV2TestJSON-2087453511-project] 10.222.0.32 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.153725 Dec 25 21:17:59.564936 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1650/3392] 10.222.0.32 () {58 vars in 1163 bytes} [Sat Dec 25 21:17:59 2021] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:17:59.715809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:59.716433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:59.723445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.723900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.724697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.725427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.817630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:59.825754 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e45210d-3fc9-430a-a731-4123ea3286ec tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1316 microversion: 2.1 time: 0.623760 Dec 25 21:17:59.826344 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1743/3393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:59 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:59.914250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:17:59.922157 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-38d7c3c0-5b91-40e1-b057-bd1175259fa0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.209965 Dec 25 21:17:59.923217 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1651/3394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:59 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:17:59.927582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:17:59.934635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:17:59.934635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.934995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:17:59.935779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:17:59.936303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.000772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:00.011963 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-998f6b29-e584-481c-afb2-78888fc5da52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1279 microversion: 2.1 time: 0.088219 Dec 25 21:18:00.013183 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1744/3395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:17:59 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1279 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:00.122251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:00.123268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:00.130237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.130945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.131749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.132390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.178372 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88eb060f-ae67-4488-8aaa-7bcb044d14c6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.059762 Dec 25 21:18:00.179388 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1652/3396] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:00 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:00.217391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:00.218011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:00.225675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.228050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.228050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.228050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.425312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:00.426356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:00.438412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.438876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.439686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.440134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.478866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:00.491367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80871b2c-1699-4ee0-880a-5c16db2edf73 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.276617 Dec 25 21:18:00.492581 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1745/3397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:00 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:00.673970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:00.681886 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2d0d3676-dc9a-4739-aa72-0565c59c0f14 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.262042 Dec 25 21:18:00.682671 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1653/3398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:00 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:00.843721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:00.852528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:00.862261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.862812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.864082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.864566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.955918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:00.956569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:00.968673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.969161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:00.971642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:00.972256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.127704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:01.138127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e15eb20-f23f-4763-8d3e-3f02d9f40a84 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1503 microversion: 2.1 time: 0.297366 Dec 25 21:18:01.144940 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1746/3399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:00 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1503 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:01.146416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:01.147237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:01.154435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.154637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.155441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.155886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-650a138f-0230-433b-9c98-4187fa4d239b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.298612 Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1654/3400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:00 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-25546439"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.376284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.377797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:01.384430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d2342ca-9801-4469-bb73-b2d3e7360bab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1321 microversion: 2.1 time: 0.241781 Dec 25 21:18:01.394720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1747/3401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:01 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:01.394720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:01.394720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:01.397100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.397561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.398366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.398820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.439474 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9ba624b-c9f7-4af8-9423-9730c950f6b3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.052455 Dec 25 21:18:01.443483 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1748/3402] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:01 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:01.453359 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Adding security group 2ba33cf5-783f-47f8-ab0c-abe946a208dc to port 351ad003-7628-46fe-a749-8abfe48f50a4 Dec 25 21:18:01.508231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:01.508958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:01.515939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.516435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.517260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.517702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.853408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:01.862059 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-722bc0fd-b3f1-4f4f-9f25-b5143ebe14c9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1476 microversion: 2.1 time: 0.357841 Dec 25 21:18:01.875141 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1749/3403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:01 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1476 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:01.880799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a871b3fa-00b5-4593-9535-3fb5d43a9264 req-4d3de48b-372d-45c3-971e-c4183531ef1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5ed595e-9d45-49c6-a45b-2e014b11f9db", "tag": "a3eb73b0-73d7-475d-8adc-e559e07f85d9"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:01.885459 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:01.885459 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:01.889693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a871b3fa-00b5-4593-9535-3fb5d43a9264 req-4d3de48b-372d-45c3-971e-c4183531ef1a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.890388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a871b3fa-00b5-4593-9535-3fb5d43a9264 req-4d3de48b-372d-45c3-971e-c4183531ef1a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.902190 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a871b3fa-00b5-4593-9535-3fb5d43a9264 req-4d3de48b-372d-45c3-971e-c4183531ef1a service nova] Creating event network-changed:a3eb73b0-73d7-475d-8adc-e559e07f85d9 for instance b5ed595e-9d45-49c6-a45b-2e014b11f9db on nch1-master-1 Dec 25 21:18:01.908522 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a871b3fa-00b5-4593-9535-3fb5d43a9264 req-4d3de48b-372d-45c3-971e-c4183531ef1a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031180 Dec 25 21:18:01.909333 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1750/3404] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:01.917756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:01.918746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:01.926664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.931441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:01.931441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:01.931441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.273472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:02.283114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d66370c-3dfc-4387-91ec-f34a96e1bda2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.371691 Dec 25 21:18:02.284147 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1751/3405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:01 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:02.322465 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75c0bbf0-a53f-49ef-a62c-7de1078340a3 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb/action" status: 202 len: 0 microversion: 2.1 time: 1.075994 Dec 25 21:18:02.323613 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1655/3406] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:01 2021] POST /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb/action => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:02.334392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b8dd406a-d82b-42df-9a84-22c25ef93e99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa500732820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:02.373393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:02.374308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:02.381495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.382787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.383812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.384443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.759792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-b8dd406a-d82b-42df-9a84-22c25ef93e99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2ba33cf5-783f-47f8-ab0c-abe946a208dc in use.", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:02.761164 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b8dd406a-d82b-42df-9a84-22c25ef93e99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security Group 2ba33cf5-783f-47f8-ab0c-abe946a208dc in use. Dec 25 21:18:02.761164 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-eafebe43-0dd9-4162-a4d9-09770f734c2a'] Dec 25 21:18:02.762086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b8dd406a-d82b-42df-9a84-22c25ef93e99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 400 to user: Security Group 2ba33cf5-783f-47f8-ab0c-abe946a208dc in use. Dec 25 21:18:02.762086 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-eafebe43-0dd9-4162-a4d9-09770f734c2a'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:02.763555 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b8dd406a-d82b-42df-9a84-22c25ef93e99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/2ba33cf5-783f-47f8-ab0c-abe946a208dc" status: 400 len: 185 microversion: 2.1 time: 0.435252 Dec 25 21:18:02.764466 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1752/3407] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:02 2021] DELETE /compute/v2.1/os-security-groups/2ba33cf5-783f-47f8-ab0c-abe946a208dc => generated 185 bytes in 437 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:18:02.771343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:02.771956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:02.782190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.783113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.784623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.785248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.811916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:02.823372 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b03d4a23-768d-4650-bf2a-0200a9a6ed49 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.454185 Dec 25 21:18:02.824949 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1656/3408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:02 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:02.838748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:02.840114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:02.846539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.847126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.848024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.848590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.890092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b286639-9be3-46c5-8372-a7febe437bdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.063078 Dec 25 21:18:02.891836 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1657/3409] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:02 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:02.899274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:02.900466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:02.910329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.913570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:02.915432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:02.916191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.135585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:03.142479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e4ce8d83-946e-4f03-908b-d205a9d8260b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1321 microversion: 2.1 time: 0.376788 Dec 25 21:18:03.143132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1753/3410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:02 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:03.157071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:03.162230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:03.164576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.165121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.166052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.166564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.186013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c735c804-3602-45b8-a46b-51fa07030c36 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb/action" status: 202 len: 0 microversion: 2.1 time: 0.291608 Dec 25 21:18:03.193586 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1658/3411] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:02 2021] POST /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:03.196676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:03.197804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:03.205056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.205797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.206842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.207465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.727843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:03.736374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c71d4532-09a8-410c-89cf-dc872d42b08a tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1475 microversion: 2.1 time: 0.583225 Dec 25 21:18:03.737241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1754/3412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:03 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:03.750107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:03.751506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:03.758193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.758803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.759616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.760057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.790929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:03.814075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5dec2f43-d250-46a3-91bc-173b205e8604 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1572 microversion: 2.1 time: 0.610056 Dec 25 21:18:03.814075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1659/3413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:03 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1572 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:03.833699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5d4c8b7f-4972-4d53-b498-344fed6b30b2 req-b9a4ebd0-03b3-412d-bc9c-a1f5e76ae4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bfda27-68a3-4a4a-bfd1-7749eaa3997c", "name": "network-vif-plugged", "status": "completed", "tag": "d3b55372-6cc1-4847-8bab-b4a3a6aec2ff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:03.839865 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:03.839865 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:03.851010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5d4c8b7f-4972-4d53-b498-344fed6b30b2 req-b9a4ebd0-03b3-412d-bc9c-a1f5e76ae4d7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.851712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5d4c8b7f-4972-4d53-b498-344fed6b30b2 req-b9a4ebd0-03b3-412d-bc9c-a1f5e76ae4d7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.864463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5d4c8b7f-4972-4d53-b498-344fed6b30b2 req-b9a4ebd0-03b3-412d-bc9c-a1f5e76ae4d7 service nova] Creating event network-vif-plugged:d3b55372-6cc1-4847-8bab-b4a3a6aec2ff for instance 30bfda27-68a3-4a4a-bfd1-7749eaa3997c on nch2-master-1 Dec 25 21:18:03.870028 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5d4c8b7f-4972-4d53-b498-344fed6b30b2 req-b9a4ebd0-03b3-412d-bc9c-a1f5e76ae4d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057015 Dec 25 21:18:03.871308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1660/3414] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:03.876710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:03.877724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:03.896389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.897183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:03.900151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:03.900151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.611112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:04.626652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:04.637444 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d25f8936-67d2-48cb-b803-c583bd266f3e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.881119 Dec 25 21:18:04.638678 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1755/3415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:03 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:04.655762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f14bb1df-d019-4e18-b94b-9d0c0886acaf tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.778666 Dec 25 21:18:04.655990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:04.656894 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1661/3416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:03 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:04.666036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:04.677264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:04.678447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:04.682476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.682988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.683801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.684429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.691377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.694527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.694527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.694527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.787384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b1c9bd7f-6934-46e1-b97a-8c9688ec9a34 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.144496 Dec 25 21:18:04.793953 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1756/3417] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:04 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:04.800501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d51e67-c044-4aa2-9b94-b50e5df7aecb", "tag": "351ad003-7628-46fe-a749-8abfe48f50a4"}, {"server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "name": "network-vif-unplugged", "status": "completed", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:04.802931 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:04.802931 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:04.816152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.818203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.833128 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] Creating event network-changed:351ad003-7628-46fe-a749-8abfe48f50a4 for instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb on nch1-master-1 Dec 25 21:18:04.833646 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] Creating event network-vif-unplugged:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch2-master-1 Dec 25 21:18:04.840750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] Instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:18:04.853872 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-aacf0529-fd7d-4403-ad2b-ed184311f846 req-93fadaec-7f91-439c-a2e0-0cdc4b6b46a2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.058151 Dec 25 21:18:04.854981 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1757/3418] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:04 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:04.861192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:04.862105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:04.905538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.906047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:04.907420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:04.907872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:05.197329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:05.218438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-153836bd-c896-4075-a3af-14c1251e1c3f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1321 microversion: 2.1 time: 0.548494 Dec 25 21:18:05.220278 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1662/3419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:04 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:05.225917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:05.226878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:05.234350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:05.234989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:05.235893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:05.236461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:05.348446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:05.358903 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c801cb2-0477-47a4-b255-87b1f089ba3b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1475 microversion: 2.1 time: 0.501436 Dec 25 21:18:05.358903 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1758/3420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:04 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1475 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:05.655590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:05.656480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:05.668239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:05.669073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:05.670084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:05.670723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:05.764576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:05.774740 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f873af3-18a7-4224-b79a-3cd265d64d45 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1572 microversion: 2.1 time: 0.552482 Dec 25 21:18:05.787511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1663/3421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:05 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1572 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:05.791786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:05.795239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:05.809907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:05.810315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:05.811170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:05.811675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.164098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:06.173191 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6d36bfc-d19c-48e6-a90a-748ed2862544 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.522001 Dec 25 21:18:06.186841 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1759/3422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:05 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:06.192056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:06.193038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:06.218601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.219092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.221102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.221836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.270876 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90176d74-bdec-42dc-8ed9-6286ddce8f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.082549 Dec 25 21:18:06.271806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1760/3423] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:06 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:06.278587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:06.284155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:06.289028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.289664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.291223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.291873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.459208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:06.470479 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3c15afe-0b80-4a26-9d3c-db161824923c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1314 microversion: 2.1 time: 0.688554 Dec 25 21:18:06.471353 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1664/3424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:05 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:06.481307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:06.487498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:06.504463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.504956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.506562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.507193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.655238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:06.669743 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d12cc98-df38-47bc-9481-5ddba43aba58 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1321 microversion: 2.1 time: 0.393124 Dec 25 21:18:06.673458 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1761/3425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:06 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1321 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:06.745159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:06.753962 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-45ba1e17-b8c9-4877-bfa1-f912eb99b565 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1475 microversion: 2.1 time: 0.281112 Dec 25 21:18:06.759613 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1665/3426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:06 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1475 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:06.798377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:06.799562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:06.836054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.836454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.839141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.843869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.883017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3fc8e6e2-6b0f-4d4c-99c3-d04d432d80fb req-2a549977-02e1-4622-be60-37c96a2a0bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:06.885069 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:06.885069 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:06.894352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3fc8e6e2-6b0f-4d4c-99c3-d04d432d80fb req-2a549977-02e1-4622-be60-37c96a2a0bf1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:06.895036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3fc8e6e2-6b0f-4d4c-99c3-d04d432d80fb req-2a549977-02e1-4622-be60-37c96a2a0bf1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:06.917536 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3fc8e6e2-6b0f-4d4c-99c3-d04d432d80fb req-2a549977-02e1-4622-be60-37c96a2a0bf1 service nova] Creating event network-changed:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch2-master-1 Dec 25 21:18:06.927241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-3fc8e6e2-6b0f-4d4c-99c3-d04d432d80fb req-2a549977-02e1-4622-be60-37c96a2a0bf1 service nova] Instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:18:06.951645 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3fc8e6e2-6b0f-4d4c-99c3-d04d432d80fb req-2a549977-02e1-4622-be60-37c96a2a0bf1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074817 Dec 25 21:18:06.955743 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1666/3427] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:07.170560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:07.183314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81f6bfbb-d327-46ef-a608-00229e493985 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1570 microversion: 2.1 time: 0.391614 Dec 25 21:18:07.194734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:07.195307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:07.198910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1762/3428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:06 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1570 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:07.220045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.220799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.222377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.223799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1487778555"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:07.224419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.227883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:07.244901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.250603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.250603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.250603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.672261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:07.683001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebb5cb51-5814-4008-957a-b231b5a22581 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.493062 Dec 25 21:18:07.693888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1667/3429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:07 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:07.697784 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.network.security_group_api [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Adding security group 18bfcab3-627d-4ce2-86bd-48e027bcf973 to port 351ad003-7628-46fe-a749-8abfe48f50a4 Dec 25 21:18:07.700751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:07.702054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:07.721884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.722715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.724006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.726330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.794862 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d00cd5b-30d4-4937-8bf4-d1410b0e977b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.098917 Dec 25 21:18:07.799638 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1668/3430] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:07 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:07.810772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:07.815495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:07.835687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.836499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:07.837188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:07.837635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:08.721822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:08.733987 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f016c37-8b41-4e34-a853-6a0d74e597ae tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1500 microversion: 2.1 time: 0.931906 Dec 25 21:18:08.737841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1669/3431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:07 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1500 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:08.744129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:08.745741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:08.762939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:08.763717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:08.765161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:08.765745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.058920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:09.067230 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d890b728-fc39-4aa4-bf4b-6c09a4854a86 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1321 microversion: 2.1 time: 0.326992 Dec 25 21:18:09.067934 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1670/3432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:08 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:09.072544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:09.073251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:09.080660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.081174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.082182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.082620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.168310 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b4554b2-eb4c-4177-ac52-a9f282338639 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb/action" status: 202 len: 0 microversion: 2.1 time: 1.952898 Dec 25 21:18:09.171883 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1763/3433] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:07 2021] POST /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb/action => generated 0 bytes in 1960 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:09.189092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-98f2074a-4377-485a-993f-048bb3164ce3 req-98e0c391-03d0-4b2c-8360-be1abc386825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ed595e-9d45-49c6-a45b-2e014b11f9db", "name": "network-vif-plugged", "status": "completed", "tag": "a3eb73b0-73d7-475d-8adc-e559e07f85d9"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:09.213289 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:09.213289 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:09.242524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-98f2074a-4377-485a-993f-048bb3164ce3 req-98e0c391-03d0-4b2c-8360-be1abc386825 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.242524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-98f2074a-4377-485a-993f-048bb3164ce3 req-98e0c391-03d0-4b2c-8360-be1abc386825 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.265506 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-98f2074a-4377-485a-993f-048bb3164ce3 req-98e0c391-03d0-4b2c-8360-be1abc386825 service nova] Creating event network-vif-plugged:a3eb73b0-73d7-475d-8adc-e559e07f85d9 for instance b5ed595e-9d45-49c6-a45b-2e014b11f9db on nch1-master-1 Dec 25 21:18:09.272715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-98f2074a-4377-485a-993f-048bb3164ce3 req-98e0c391-03d0-4b2c-8360-be1abc386825 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095754 Dec 25 21:18:09.274443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1764/3434] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:09.289410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:09.290518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:09.309524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.310820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.311848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.312435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.333553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:09.341710 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2399940-5546-4d6a-a5ab-d0a4f64f0b3f tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1473 microversion: 2.1 time: 0.272677 Dec 25 21:18:09.345840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1671/3435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:09 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1473 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:09.348753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:09.349958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:09.374611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.375786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.376781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.377484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.404946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lazy-loading 'flavor' on Instance uuid 30bfda27-68a3-4a4a-bfd1-7749eaa3997c {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:18:09.560599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:09.571250 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a338b41-7ec7-40eb-8999-ec3802993f18 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.295132 Dec 25 21:18:09.581038 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1765/3436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:09 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:09.581038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:09.581038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:09.586080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.586617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.587497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.588014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.728750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d3cca4cc-cbd2-4369-a4c8-d32ac26e57b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "POST /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c/action" status: 200 len: 32 microversion: 2.1 time: 0.383771 Dec 25 21:18:09.730131 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1672/3437] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:09 2021] POST /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:09.764806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-194edbb9-69e1-4817-a730-e1152a78cb69 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.183244 Dec 25 21:18:09.764806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1766/3438] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:09 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:09.779744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04009d6d-1788-489d-81d2-20d11e85e2b9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa5007228b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:09.965300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-04009d6d-1788-489d-81d2-20d11e85e2b9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 18bfcab3-627d-4ce2-86bd-48e027bcf973 in use.", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:09.966049 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-04009d6d-1788-489d-81d2-20d11e85e2b9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security Group 18bfcab3-627d-4ce2-86bd-48e027bcf973 in use. Dec 25 21:18:09.966049 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-fda231a1-b87a-47c6-8e12-fb0ed0760262'] Dec 25 21:18:09.966657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04009d6d-1788-489d-81d2-20d11e85e2b9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 400 to user: Security Group 18bfcab3-627d-4ce2-86bd-48e027bcf973 in use. Dec 25 21:18:09.966657 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-fda231a1-b87a-47c6-8e12-fb0ed0760262'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:09.967922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04009d6d-1788-489d-81d2-20d11e85e2b9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/18bfcab3-627d-4ce2-86bd-48e027bcf973" status: 400 len: 185 microversion: 2.1 time: 0.208088 Dec 25 21:18:09.968860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1767/3439] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:09 2021] DELETE /compute/v2.1/os-security-groups/18bfcab3-627d-4ce2-86bd-48e027bcf973 => generated 185 bytes in 210 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:18:09.973802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-69d06dd6-7602-407c-bd5e-a6d5077b588f req-09e970fe-b18d-4fac-97bc-583efe1c0b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d51e67-c044-4aa2-9b94-b50e5df7aecb", "tag": "351ad003-7628-46fe-a749-8abfe48f50a4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:09.981335 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:09.981335 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:09.989893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-69d06dd6-7602-407c-bd5e-a6d5077b588f req-09e970fe-b18d-4fac-97bc-583efe1c0b49 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:09.991672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-69d06dd6-7602-407c-bd5e-a6d5077b588f req-09e970fe-b18d-4fac-97bc-583efe1c0b49 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:09.992193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7f96f93-8516-43c9-9c24-c00d3c97925f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'create', calling method: .version_select at 0x7fa4f7535040>, body: {"keypair": {"name": "tempest-keypair-818043027"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:10.013124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f7f96f93-8516-43c9-9c24-c00d3c97925f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:10.022161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f7f96f93-8516-43c9-9c24-c00d3c97925f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for user 81821563e0034d1e9743c4ec82245ed6 and project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:10.026216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-69d06dd6-7602-407c-bd5e-a6d5077b588f req-09e970fe-b18d-4fac-97bc-583efe1c0b49 service nova] Creating event network-changed:351ad003-7628-46fe-a749-8abfe48f50a4 for instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb on nch1-master-1 Dec 25 21:18:10.040866 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-69d06dd6-7602-407c-bd5e-a6d5077b588f req-09e970fe-b18d-4fac-97bc-583efe1c0b49 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070511 Dec 25 21:18:10.041919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1768/3440] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:10.059066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:10.059999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:10.073170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.073863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.074835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.075275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.424589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:10.435025 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e4173de-5d72-4836-aaea-9653daba9944 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.391697 Dec 25 21:18:10.435832 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1769/3441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:10 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:10.443487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:10.443487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:10.454699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.455148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.455936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.456371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.495705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:10.567493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f7f96f93-8516-43c9-9c24-c00d3c97925f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:10.574027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f7f96f93-8516-43c9-9c24-c00d3c97925f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for user 81821563e0034d1e9743c4ec82245ed6 and project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:10.606045 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7f96f93-8516-43c9-9c24-c00d3c97925f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.869603 Dec 25 21:18:10.612989 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1673/3442] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:18:09 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:10.617343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:10.618097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:10.624913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.632989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.632989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.632989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.918661 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b463b5d-5b8c-45ea-a2a2-bb12f1f22cb8 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 204 len: 0 microversion: 2.1 time: 0.481568 Dec 25 21:18:10.919256 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1770/3443] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:10 2021] DELETE /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:10.926123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:10.926935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:10.933558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.934752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:10.935736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:10.936755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.005778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:11.014332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-07460f2f-2667-4e71-ba97-97334114d522 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1321 microversion: 2.1 time: 0.402595 Dec 25 21:18:11.014548 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1674/3444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:10 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:11.020101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:11.020714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:11.027093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.027534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.028358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.028801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.282188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:11.290897 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7586de5e-44b2-4026-a9af-12c25a32ed81 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1470 microversion: 2.1 time: 0.369528 Dec 25 21:18:11.291623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1771/3445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:10 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1470 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:11.310179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:11.310179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:11.310179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.310179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.310179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.310772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:11.311427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.319216 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa708ea3-4d0b-4d74-9eff-52a089fdbeba tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.302999 Dec 25 21:18:11.328350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1675/3446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:11 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:11.328350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:11.328350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:11.331313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.333393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.333393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.333393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.358245 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-974bf3b9-4d89-4cc1-a4cb-f35956e99ccd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.065267 Dec 25 21:18:11.363263 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1772/3447] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:11 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:11.366790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:11.367528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:11.384616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.385173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.386107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.386628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.476428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lazy-loading 'services' on Instance uuid c169c539-29b8-4eeb-bb76-6e6eabd11098 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:18:11.518079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:11.525704 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1ecdff90-4202-4475-9416-3fcec9046dda tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1645 microversion: 2.1 time: 0.204541 Dec 25 21:18:11.526285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1676/3448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:11 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1645 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:11.538957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:11.539500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:11.546003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.546003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.546845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.547785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.838490 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8eeff6ef-fef2-44e3-81f4-f1398892e741 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-volume_attachments/9ddbed29-7029-4b8d-ab16-b904195f2582" status: 202 len: 0 microversion: 2.1 time: 0.477149 Dec 25 21:18:11.839214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1773/3449] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:18:11 2021] DELETE /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-volume_attachments/9ddbed29-7029-4b8d-ab16-b904195f2582 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:11.846532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:11.860456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:11.867975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.868514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:11.869432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:11.870087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.026251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:12.033927 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48026637-a194-49ba-bac3-24e2cfe5761d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.192235 Dec 25 21:18:12.035080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1774/3450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:11 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:12.038412 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68817e00-07c5-443e-8851-9780f9faf906 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "POST /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec/action" status: 202 len: 0 microversion: 2.1 time: 0.508347 Dec 25 21:18:12.039015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1677/3451] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:11 2021] POST /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:12.040905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:12.041658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.056224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.057466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.057829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:12.059918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.060167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.061446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.067722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.068250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.069194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.069706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.320060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:12.325656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:12.337771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-970b7a99-190b-46a7-816f-6aa1a2faf082 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1469 microversion: 2.1 time: 0.290049 Dec 25 21:18:12.338368 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1678/3452] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:12 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:12.350482 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52c3f363-81a9-40d5-8d7b-314becdee5ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1502 microversion: 2.1 time: 0.314011 Dec 25 21:18:12.351200 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1775/3453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:12 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:12.351998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:12.352631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.367168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.367624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.368613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.368728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:12.369267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.369487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.376370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.376825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.377652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.378594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.762258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:12.767024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:12.779348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfad72e4-d3f6-425c-a639-0bcf5acbf8cc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1502 microversion: 2.1 time: 0.415889 Dec 25 21:18:12.780187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1776/3454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:12 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:12.785406 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ec3ade6-384b-4fd1-afdc-cf19c04314c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.442521 Dec 25 21:18:12.788107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1679/3455] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:12 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:12.789328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:12.799567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:12.803937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.807669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.815233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.817181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.817595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.818575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.821102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.823440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.828114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.829588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.911538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e3f8f4a-8101-4a39-ba53-77c13abd82b2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.129550 Dec 25 21:18:12.915114 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1777/3456] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:12 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:12.931178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:12.934663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:12.955956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.959740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:12.962969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:12.963889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:13.030012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:13.419421 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f21f8fb9-aaf6-430f-ba5c-d6d4d19f14f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 204 len: 0 microversion: 2.1 time: 0.502479 Dec 25 21:18:13.420082 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1778/3457] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:12 2021] DELETE /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:13.430508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:13.431227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:13.450730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:13.451212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:13.452086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:13.452959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:13.887932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:13.906970 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b8d310dc-8138-4e33-8d41-8bc5871e9b37 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1645 microversion: 2.1 time: 1.106840 Dec 25 21:18:13.906970 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1680/3458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:12 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1645 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:13.907421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:13.907975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:13.914051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:13.914510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:13.915318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:13.915904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.102567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:14.111761 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1eb1763-0f1b-4508-847f-779523c99d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.686697 Dec 25 21:18:14.112575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1779/3459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:13 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:14.117156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:14.117931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:14.127849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.128588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.129635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.130274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.320987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:14.329418 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c789fb3-1fc6-41e1-ac46-532aea0e5d6e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1469 microversion: 2.1 time: 0.431702 Dec 25 21:18:14.330011 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1681/3460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:13 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:14.334634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5fe44f71-4c85-4689-b39e-c0dcb13b3897 req-40b1383f-7ec1-4c55-adb3-9a6d6f2348a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "name": "network-vif-plugged", "status": "completed", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:14.336351 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:14.336351 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:14.343612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5fe44f71-4c85-4689-b39e-c0dcb13b3897 req-40b1383f-7ec1-4c55-adb3-9a6d6f2348a7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.344702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5fe44f71-4c85-4689-b39e-c0dcb13b3897 req-40b1383f-7ec1-4c55-adb3-9a6d6f2348a7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.356390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5fe44f71-4c85-4689-b39e-c0dcb13b3897 req-40b1383f-7ec1-4c55-adb3-9a6d6f2348a7 service nova] Creating event network-vif-plugged:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch2-master-1 Dec 25 21:18:14.362477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-5fe44f71-4c85-4689-b39e-c0dcb13b3897 req-40b1383f-7ec1-4c55-adb3-9a6d6f2348a7 service nova] Instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:18:14.373583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5fe44f71-4c85-4689-b39e-c0dcb13b3897 req-40b1383f-7ec1-4c55-adb3-9a6d6f2348a7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042187 Dec 25 21:18:14.374347 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1682/3461] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:14.379743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:14.380458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:14.388526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.389401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.390392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.391565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.425851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:14.436715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-11ca124f-5d17-40fc-8c52-5c8859b7e6be tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1508 microversion: 2.1 time: 0.322912 Dec 25 21:18:14.437867 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1780/3462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:14 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:14.443363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:14.444614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:14.451241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.452067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.452928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.453940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.496575 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f55651fe-acab-4237-b57c-8f54fd9c9505 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.057068 Dec 25 21:18:14.497668 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1781/3463] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:14 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:14.503119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0fb69a0-ea78-40e7-944b-c96719c2e7bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:14.510446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0fb69a0-ea78-40e7-944b-c96719c2e7bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.510950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0fb69a0-ea78-40e7-944b-c96719c2e7bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.535832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f0fb69a0-ea78-40e7-944b-c96719c2e7bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:18:14.607398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:14.614872 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d00190a8-8451-47f5-9d9c-21fdce572c90 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.239125 Dec 25 21:18:14.615775 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1683/3464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:14 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:14.620574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-48902b5b-b735-4e71-8c13-1568f17d3335 req-519c1de1-8abe-477b-83c4-5bcc30a691b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d51e67-c044-4aa2-9b94-b50e5df7aecb", "name": "network-vif-deleted", "tag": "351ad003-7628-46fe-a749-8abfe48f50a4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:14.622903 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:14.622903 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:14.633871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-48902b5b-b735-4e71-8c13-1568f17d3335 req-519c1de1-8abe-477b-83c4-5bcc30a691b4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.634716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-48902b5b-b735-4e71-8c13-1568f17d3335 req-519c1de1-8abe-477b-83c4-5bcc30a691b4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.651694 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-48902b5b-b735-4e71-8c13-1568f17d3335 req-519c1de1-8abe-477b-83c4-5bcc30a691b4 service nova] Creating event network-vif-deleted:351ad003-7628-46fe-a749-8abfe48f50a4 for instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb on nch1-master-1 Dec 25 21:18:14.658844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-48902b5b-b735-4e71-8c13-1568f17d3335 req-519c1de1-8abe-477b-83c4-5bcc30a691b4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041402 Dec 25 21:18:14.659787 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1684/3465] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:14.754581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f0fb69a0-ea78-40e7-944b-c96719c2e7bc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 202 len: 0 microversion: 2.1 time: 0.254462 Dec 25 21:18:14.755133 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1782/3466] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:14 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:14.765340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:14.767019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:14.774349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.774791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.775611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.783829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.921084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:14.921937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:14.930176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.930698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.931734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.932365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.949465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:14.960100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff511a0e-0861-49a5-adb8-8955721291fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.199445 Dec 25 21:18:14.960688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1685/3467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:14 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:14.973449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:14.979363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:14.979363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lazy-loading 'fault' on Instance uuid 07d51e67-c044-4aa2-9b94-b50e5df7aecb {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:18:15.039226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:15.048746 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-088caf4d-3ed7-4a08-91d6-e8cab44712f9 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 200 len: 1306 microversion: 2.1 time: 0.139049 Dec 25 21:18:15.049569 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1783/3468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:14 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 1306 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:15.130542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:15.131476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:15.138125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.138831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.143297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.143297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.346774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:15.347407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:15.354306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.355042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.356073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.356596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.385405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:15.393495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3c7905c-1054-4fb6-b63d-508b172aba6a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.268273 Dec 25 21:18:15.394324 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1686/3469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:15 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:15.456261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:15.457098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:15.464338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.467490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.468325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.469871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.575066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:15.582933 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9404f791-b382-43f4-8e25-5641ba156eea tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1469 microversion: 2.1 time: 0.240334 Dec 25 21:18:15.583589 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1784/3470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:15 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1469 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:15.587834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:15.588816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:15.596198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.599067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.599067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.599067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.654959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cf5f62c7-c482-4a6a-b952-c5710823b783 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.069547 Dec 25 21:18:15.657431 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1785/3471] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:15 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:15.663784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:15.665117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:15.672669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.673154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.673956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.674644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.708390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:15.723187 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e5abb146-b9a5-4c00-aeb4-8a0b3b85bd96 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1508 microversion: 2.1 time: 0.271960 Dec 25 21:18:15.723791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1687/3472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:15 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:15.835885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:15.844386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94dcef2f-cf84-4a08-9f6c-4dc5512e221a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.184916 Dec 25 21:18:15.844979 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1786/3473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:15 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:15.977436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:15.978660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:15.986021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.986484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:15.988587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:15.988587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.067343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.068109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:16.074776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.075310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.076177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.076692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.094260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb could not be found. Dec 25 21:18:16.094260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:16.094260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f50f7c5-ca8d-4dcd-bee1-bb3339e87772 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 404 len: 111 microversion: 2.1 time: 0.029737 Dec 25 21:18:16.094260 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1787/3474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:16 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:18:16.101235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f7cd77d-75cc-489d-b3e5-3b5ab89afdbe tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f694bc10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.134088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:16.141759 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd5a6506-f573-4f25-9090-b0403eed4a26 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.168173 Dec 25 21:18:16.142428 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1688/3475] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:15 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:16.385497 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f7cd77d-75cc-489d-b3e5-3b5ab89afdbe tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/2ba33cf5-783f-47f8-ab0c-abe946a208dc" status: 202 len: 0 microversion: 2.1 time: 0.287517 Dec 25 21:18:16.386181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1788/3476] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:16 2021] DELETE /compute/v2.1/os-security-groups/2ba33cf5-783f-47f8-ab0c-abe946a208dc => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:18:16.394062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-589ebd0a-d6a0-46fe-bc17-0c92ce3477fb tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f736e700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.410680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.411400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:16.418996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.419466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.420261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.420705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.617155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:16.624793 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9d65d79-297e-455d-8089-a94638b17b99 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.218506 Dec 25 21:18:16.625995 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1789/3477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:16 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:16.630380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.630929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:16.636666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.637159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.639328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.639328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.774744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-589ebd0a-d6a0-46fe-bc17-0c92ce3477fb tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/18bfcab3-627d-4ce2-86bd-48e027bcf973" status: 202 len: 0 microversion: 2.1 time: 0.384294 Dec 25 21:18:16.780621 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1689/3478] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:16 2021] DELETE /compute/v2.1/os-security-groups/18bfcab3-627d-4ce2-86bd-48e027bcf973 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:18:16.785112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:16.790894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:16.793192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:16.798436 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d417b902-d042-4c12-9bda-863ee6456175 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1469 microversion: 2.1 time: 0.171294 Dec 25 21:18:16.799654 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1790/3479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:16 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:16.805196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f329dd32-51e3-41d8-967a-27c0437a21f3 req-b6a27232-b035-4dc8-abde-0c80cffeaaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5ed595e-9d45-49c6-a45b-2e014b11f9db", "name": "network-vif-deleted", "tag": "a3eb73b0-73d7-475d-8adc-e559e07f85d9"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:16.806760 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:16.806760 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:16.810636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.811297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.812276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.813431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.814575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f329dd32-51e3-41d8-967a-27c0437a21f3 req-b6a27232-b035-4dc8-abde-0c80cffeaaf4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.815017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f329dd32-51e3-41d8-967a-27c0437a21f3 req-b6a27232-b035-4dc8-abde-0c80cffeaaf4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.833063 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f329dd32-51e3-41d8-967a-27c0437a21f3 req-b6a27232-b035-4dc8-abde-0c80cffeaaf4 service nova] Creating event network-vif-deleted:a3eb73b0-73d7-475d-8adc-e559e07f85d9 for instance b5ed595e-9d45-49c6-a45b-2e014b11f9db on nch1-master-1 Dec 25 21:18:16.833364 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f329dd32-51e3-41d8-967a-27c0437a21f3 req-b6a27232-b035-4dc8-abde-0c80cffeaaf4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Dec 25 21:18:16.836974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1791/3480] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:16.842334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.843053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:16.850298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.850747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.851530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.851967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.863562 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-105fa0bc-7989-4f52-9f34-ff555034c615 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.081063 Dec 25 21:18:16.867662 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1690/3481] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:16 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:16.869453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eeecb8de-90f8-490d-8636-97aae136ec5d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'create', calling method: .version_select at 0x7fa4f70e5820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-751331123", "description": "tempest-description-883458621"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:16.885002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.885507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.885959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lazy-loading 'fault' on Instance uuid b5ed595e-9d45-49c6-a45b-2e014b11f9db {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:18:16.934347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:16.942528 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e4ddd34-cdd2-40c6-8101-461cf0167aee tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 200 len: 1311 microversion: 2.1 time: 0.104427 Dec 25 21:18:16.943238 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1792/3482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:16 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:16.947712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:16.948446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:16.954751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.955274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:16.956204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:16.956650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.124984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:17.133454 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c54cca13-fc8d-434d-9ff2-c1eaedde0a87 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.189036 Dec 25 21:18:17.133979 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1793/3483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:16 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:17.159457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:17.160308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:17.166592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.167039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.167823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.168257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.356814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:17.363706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eeecb8de-90f8-490d-8636-97aae136ec5d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.498205 Dec 25 21:18:17.367814 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1691/3484] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:18:16 2021] POST /compute/v2.1/os-security-groups => generated 242 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:17.370544 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ace86d8-6898-4ff3-b3eb-18c3287ad907 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.209597 Dec 25 21:18:17.371160 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1794/3485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:17 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:17.374780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1c2f6a79-507e-4f00-9fe6-156c8e15f33d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Action: 'update', calling method: .version_select at 0x7fa4f75351f0>, body: {"security_group": {"name": "tempest-sg-hth-790629508", "description": "tempest-description-hth-473543043"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:17.642300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:17.642908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:17.649208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.649914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.650650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.651083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.790892 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1c2f6a79-507e-4f00-9fe6-156c8e15f33d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "PUT /compute/v2.1/os-security-groups/b51ef9b8-c5e9-4ce9-b137-7d53f935953f" status: 200 len: 216 microversion: 2.1 time: 0.419622 Dec 25 21:18:17.791663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1692/3486] 10.222.0.32 () {60 vars in 1289 bytes} [Sat Dec 25 21:18:17 2021] PUT /compute/v2.1/os-security-groups/b51ef9b8-c5e9-4ce9-b137-7d53f935953f => generated 216 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:18:17.802569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c39d003-327b-43d4-b82c-b093b1163041 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f731c820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:17.938115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:17.955484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c39d003-327b-43d4-b82c-b093b1163041 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups/b51ef9b8-c5e9-4ce9-b137-7d53f935953f" status: 200 len: 216 microversion: 2.1 time: 0.152660 Dec 25 21:18:17.958354 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1693/3487] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:18:17 2021] GET /compute/v2.1/os-security-groups/b51ef9b8-c5e9-4ce9-b137-7d53f935953f => generated 216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:18:17.964241 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c26e3599-61c0-478b-a203-93ed69a70ea3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.326107 Dec 25 21:18:17.974944 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1795/3488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:17 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:17.975910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:17.975910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:17.979398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.981453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:17.981564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.981564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.981731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:17.981810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.987045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.987492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:17.988343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:17.988778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.030310 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c78912a-4956-43c2-ae1c-40fe9f1008d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.053934 Dec 25 21:18:18.035114 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1796/3489] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:17 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:18.036506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.037232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:18.044764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.045013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.045809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.046242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.062243 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance b5ed595e-9d45-49c6-a45b-2e014b11f9db could not be found. Dec 25 21:18:18.062875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance b5ed595e-9d45-49c6-a45b-2e014b11f9db could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:18.063713 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4408de8f-1c97-44bc-93f1-fd39d4cd5380 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 404 len: 111 microversion: 2.1 time: 0.031201 Dec 25 21:18:18.069391 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1797/3490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:18 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:18.074571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-acd02d6e-001e-4810-922d-82195dc177ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f696adc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.288938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:18.296855 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af8e9e8c-5cff-4340-a431-0dcf5e5d32eb tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1469 microversion: 2.1 time: 0.330751 Dec 25 21:18:18.307507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1694/3491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:17 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1469 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:18.315132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3005f1ec-2c0d-41a1-8712-066733fad918 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: .version_select at 0x7fa4f705f5e0>, body: {"keypair": {"name": "tempest-key-353953741"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:18.332639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3005f1ec-2c0d-41a1-8712-066733fad918 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:18.337687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3005f1ec-2c0d-41a1-8712-066733fad918 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:18.559048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-acd02d6e-001e-4810-922d-82195dc177ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/b51ef9b8-c5e9-4ce9-b137-7d53f935953f" status: 202 len: 0 microversion: 2.1 time: 0.487870 Dec 25 21:18:18.560401 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1798/3492] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:18 2021] DELETE /compute/v2.1/os-security-groups/b51ef9b8-c5e9-4ce9-b137-7d53f935953f => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:18.567047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.569388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:18.575842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.576346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.577402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.578651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.813611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3005f1ec-2c0d-41a1-8712-066733fad918 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:18.819935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3005f1ec-2c0d-41a1-8712-066733fad918 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:18.827535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:18.845606 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae3e350f-1103-4f6c-981f-f70777760be7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.283428 Dec 25 21:18:18.846820 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1799/3493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:18 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:18.866116 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3005f1ec-2c0d-41a1-8712-066733fad918 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2296 microversion: 2.1 time: 0.567349 Dec 25 21:18:18.871508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1695/3494] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:18:18 2021] POST /compute/v2.1/os-keypairs => generated 2296 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:18.876835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.877412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:18.880140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.883675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:18.886700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.886831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.887293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.887749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.888095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.888539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.889332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.889920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.908595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb could not be found. Dec 25 21:18:18.909695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:18.911308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-210ea84e-adc4-440d-92a4-c9241d2a66c6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 404 len: 111 microversion: 2.1 time: 0.042610 Dec 25 21:18:18.912132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1696/3495] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:18 2021] DELETE /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:18.917892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "name": "network-vif-unplugged", "status": "completed", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}, {"name": "network-changed", "server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:18.919775 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:18.919775 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:18.927733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.928293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.941047 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] Creating event network-vif-unplugged:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch1-master-1 Dec 25 21:18:18.941648 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] Creating event network-changed:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch1-master-1 Dec 25 21:18:18.947289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] Instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:18:18.958870 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-46d84d6c-c161-41a0-b184-2ec59c79927b req-d30bcf34-6794-45fd-81cc-28c90b961314 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.045119 Dec 25 21:18:18.959517 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1697/3496] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:18 2021] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:18.964774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab8aa0d5-c376-4200-89ee-7ce9de8e8901 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '.version_select at 0x7fa4f72f9670>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.967680 ncdv-master-1 devstack@n-api.service[136547]: WARNING oslo_db.sqlalchemy.utils [None req-ab8aa0d5-c376-4200-89ee-7ce9de8e8901 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Unique keys not in sort_keys. The sorting order may be unstable. Dec 25 21:18:18.972756 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab8aa0d5-c376-4200-89ee-7ce9de8e8901 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/os-keypairs" status: 200 len: 544 microversion: 2.1 time: 0.011977 Dec 25 21:18:18.974199 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1698/3497] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:18:18 2021] GET /compute/v2.1/os-keypairs => generated 544 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:18.978416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:18.979146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: 07d51e67-c044-4aa2-9b94-b50e5df7aecb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:18.993254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.993254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:18.993254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:18.993254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:19.007186 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb could not be found. Dec 25 21:18:19.008066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Instance 07d51e67-c044-4aa2-9b94-b50e5df7aecb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:19.013164 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b92388ea-1286-41ce-bd84-30e92c803993 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb" status: 404 len: 111 microversion: 2.1 time: 0.038064 Dec 25 21:18:19.014097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1699/3498] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:18 2021] GET /compute/v2.1/servers/07d51e67-c044-4aa2-9b94-b50e5df7aecb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:19.018540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:19.019166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:19.027786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:19.027786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:19.027786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:19.027786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:19.215498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:19.224704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13fb191d-42d0-4392-a35b-7b65f7f303c2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.355237 Dec 25 21:18:19.225344 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1800/3499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:18 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:19.229715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1c247c1-254d-46db-ab3f-c058e68bd0ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa500716790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:19.334742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-e1c247c1-254d-46db-ab3f-c058e68bd0ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 18bfcab3-627d-4ce2-86bd-48e027bcf973 does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:19.335473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-e1c247c1-254d-46db-ab3f-c058e68bd0ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 18bfcab3-627d-4ce2-86bd-48e027bcf973 not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:18:19.336840 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e1c247c1-254d-46db-ab3f-c058e68bd0ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 18bfcab3-627d-4ce2-86bd-48e027bcf973 does not exist Dec 25 21:18:19.336840 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-db872b04-d154-4706-a271-fefc6e6e854c'] Dec 25 21:18:19.338128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1c247c1-254d-46db-ab3f-c058e68bd0ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 18bfcab3-627d-4ce2-86bd-48e027bcf973 does not exist Dec 25 21:18:19.338128 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-db872b04-d154-4706-a271-fefc6e6e854c'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:19.339237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1c247c1-254d-46db-ab3f-c058e68bd0ff tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/18bfcab3-627d-4ce2-86bd-48e027bcf973" status: 404 len: 194 microversion: 2.1 time: 0.112964 Dec 25 21:18:19.340002 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1801/3500] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:19 2021] DELETE /compute/v2.1/os-security-groups/18bfcab3-627d-4ce2-86bd-48e027bcf973 => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:19.348718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:19.349758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:19.357455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:19.358110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:19.358909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:19.360053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:19.394904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:19.399956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41fc53d1-cb18-4c49-bc86-50c2de6994d5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.057726 Dec 25 21:18:19.400613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1802/3501] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:19 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:19.404005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae81a087-db81-4118-a52e-3d8c898720ab tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.389112 Dec 25 21:18:19.404773 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1700/3502] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:19 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:19.405604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-973550633", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "key_name": "tempest-key-353953741", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:19.410516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-143084489", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "98581356-69b5-4e98-93ff-2ca77d3cb056"}], "security_groups": [{"name": "tempest-securitygroup--1906790644"}], "key_name": "tempest-keypair-818043027", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "ed6b3e76-7317-467c-b37b-47dd7301c918", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "AUTO"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:19.461903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:18:19.685377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] validate_networks() for [('98581356-69b5-4e98-93ff-2ca77d3cb056', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:18:20.895366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:18:20.895815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:18:20.896283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:18:20.896690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:18:20.897121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:18:20.907153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:20.907597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:20.908409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:20.908859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:20.926042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:20.931424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:20.943580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:18:20.946101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:18:21.048023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:21.053423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for user 81821563e0034d1e9743c4ec82245ed6 and project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:21.061523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fafdd8e-3831-4d11-a816-538773cf991a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.659486 Dec 25 21:18:21.062176 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1803/3503] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:18:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:18:21.068927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:18:21.069648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:18:21.070562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.071130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.071518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:18:21.072132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:18:21.073584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:18:21.079103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.079103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.079633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.080162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.088245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.088955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.090091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.090778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.115794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:21.124071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Getting quotas for user 81821563e0034d1e9743c4ec82245ed6 and project ba1ca2fcc2ce4d41b609fa6a753fc806. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:21.217761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:18:21.221843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed6b3e76-7317-467c-b37b-47dd7301c918',volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:18:21.247787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:21.269985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9473de5b-a070-4a16-8aef-ec19d8d0410b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1469 microversion: 2.1 time: 0.206600 Dec 25 21:18:21.270609 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1804/3504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:21 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1469 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:21.279654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb26c582-999f-4dc3-be28-78f923c2e597 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa50074ec10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.303076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-fb26c582-999f-4dc3-be28-78f923c2e597 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2ba33cf5-783f-47f8-ab0c-abe946a208dc does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:21.303773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-fb26c582-999f-4dc3-be28-78f923c2e597 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 2ba33cf5-783f-47f8-ab0c-abe946a208dc not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:18:21.304301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-fb26c582-999f-4dc3-be28-78f923c2e597 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 2ba33cf5-783f-47f8-ab0c-abe946a208dc does not exist Dec 25 21:18:21.304301 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-a5f5ebf4-4c90-40f0-b1cd-7dc4064881df'] Dec 25 21:18:21.304925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb26c582-999f-4dc3-be28-78f923c2e597 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 2ba33cf5-783f-47f8-ab0c-abe946a208dc does not exist Dec 25 21:18:21.304925 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-a5f5ebf4-4c90-40f0-b1cd-7dc4064881df'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:21.309331 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb26c582-999f-4dc3-be28-78f923c2e597 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/2ba33cf5-783f-47f8-ab0c-abe946a208dc" status: 404 len: 194 microversion: 2.1 time: 0.034093 Dec 25 21:18:21.309331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1805/3505] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:21 2021] DELETE /compute/v2.1/os-security-groups/2ba33cf5-783f-47f8-ab0c-abe946a208dc => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:21.311044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.311669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.319034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.319492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.320298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.320736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.464851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:21.472329 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a61a76a9-c686-4d1a-bfba-2112dda296af tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.164950 Dec 25 21:18:21.473112 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1806/3506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:21 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:21.477178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.477782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.483442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.483895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.484680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.485153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.646901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:21.654605 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c32acc8d-f1a3-4b33-9e91-81a6a9e57a52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.180730 Dec 25 21:18:21.655182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1807/3507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:21 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:21.659710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:21.660667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.666718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.669983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.669983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.669983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.711392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a7daa6d-20af-4282-b605-734f7c9656dd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.054960 Dec 25 21:18:21.712435 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1808/3508] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:21 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:21.717574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.718475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.725788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.727419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.727419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:21.727695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:21.801613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3d1dbde-0c8a-4f5f-b574-8fe59a7cce73 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.395641 Dec 25 21:18:21.802939 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1701/3509] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:18:19 2021] POST /compute/v2.1/servers => generated 407 bytes in 2397 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:18:21.808048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db240ce7-c390-4333-be1d-5a98c7a49e8d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.808048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db240ce7-c390-4333-be1d-5a98c7a49e8d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.876868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db240ce7-c390-4333-be1d-5a98c7a49e8d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:21.891527 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db240ce7-c390-4333-be1d-5a98c7a49e8d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1227 microversion: 2.1 time: 0.086689 Dec 25 21:18:21.901268 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1702/3510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:21 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1227 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:21.905885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:21.908237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1529f5af-0775-4cb0-9a94-8c5c58964321 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f6935a60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.917217 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30dc80dc-b3ca-4426-aa94-f072c843410b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.200098 Dec 25 21:18:21.917217 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1809/3511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:21 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:21.919087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02cc9cf5-5b00-4208-8fdc-d5f252d7ef52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.919704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02cc9cf5-5b00-4208-8fdc-d5f252d7ef52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:21.944516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-1529f5af-0775-4cb0-9a94-8c5c58964321 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:21.945193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-1529f5af-0775-4cb0-9a94-8c5c58964321 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:18:21.945989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-1529f5af-0775-4cb0-9a94-8c5c58964321 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 does not exist Dec 25 21:18:21.945989 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-5fe594f3-de7a-4fd2-a179-9ab2c0c87f85'] Dec 25 21:18:21.947039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1529f5af-0775-4cb0-9a94-8c5c58964321 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 does not exist Dec 25 21:18:21.947039 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-5fe594f3-de7a-4fd2-a179-9ab2c0c87f85'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:21.947939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1529f5af-0775-4cb0-9a94-8c5c58964321 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/f815413a-79b3-4d1b-b14c-dcbdf85ac8f7" status: 404 len: 194 microversion: 2.1 time: 0.045574 Dec 25 21:18:21.948608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1703/3512] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:21 2021] DELETE /compute/v2.1/os-security-groups/f815413a-79b3-4d1b-b14c-dcbdf85ac8f7 => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:21.964582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcd384ef-20df-4d8f-9069-bd3e0da798e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f6ffc550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:21.992945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02cc9cf5-5b00-4208-8fdc-d5f252d7ef52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:21.999351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02cc9cf5-5b00-4208-8fdc-d5f252d7ef52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1120 microversion: 2.1 time: 0.083990 Dec 25 21:18:22.000626 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1810/3513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:21 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1120 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:22.004542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-bcd384ef-20df-4d8f-9069-bd3e0da798e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:22.005150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-bcd384ef-20df-4d8f-9069-bd3e0da798e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:18:22.005727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-bcd384ef-20df-4d8f-9069-bd3e0da798e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 does not exist Dec 25 21:18:22.005727 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-963e6137-db0b-429c-964c-a51d2917c682'] Dec 25 21:18:22.007771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcd384ef-20df-4d8f-9069-bd3e0da798e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 7aab234a-65b2-4f08-a28b-36ce01fbb815 does not exist Dec 25 21:18:22.007771 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-963e6137-db0b-429c-964c-a51d2917c682'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:22.008623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcd384ef-20df-4d8f-9069-bd3e0da798e2 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/7aab234a-65b2-4f08-a28b-36ce01fbb815" status: 404 len: 194 microversion: 2.1 time: 0.054237 Dec 25 21:18:22.009212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1704/3514] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:21 2021] DELETE /compute/v2.1/os-security-groups/7aab234a-65b2-4f08-a28b-36ce01fbb815 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:22.025261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da6fce28-8680-49bd-8987-a91f54dbfd0d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f68f1700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.049771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG neutronclient.v2_0.client [None req-da6fce28-8680-49bd-8987-a91f54dbfd0d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 does not exist", "detail": ""}} {{(pid=136548) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:22.050409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-da6fce28-8680-49bd-8987-a91f54dbfd0d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 not found {{(pid=136548) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:18:22.050929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-da6fce28-8680-49bd-8987-a91f54dbfd0d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 does not exist Dec 25 21:18:22.050929 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-282670cf-e1e8-4619-82f8-2d9d06b31f54'] Dec 25 21:18:22.051516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da6fce28-8680-49bd-8987-a91f54dbfd0d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 does not exist Dec 25 21:18:22.051516 ncdv-master-1 devstack@n-api.service[136548]: Neutron server returns request_ids: ['req-282670cf-e1e8-4619-82f8-2d9d06b31f54'] {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:22.052660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da6fce28-8680-49bd-8987-a91f54dbfd0d tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6" status: 404 len: 194 microversion: 2.1 time: 0.031413 Dec 25 21:18:22.053259 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1811/3515] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:22 2021] DELETE /compute/v2.1/os-security-groups/1c4949cd-b458-4b77-8ea0-ea8f7d49b7a6 => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:22.061487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3954c6b-c3f7-452f-ad82-c2e06931b047 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f738d040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.085288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG neutronclient.v2_0.client [None req-c3954c6b-c3f7-452f-ad82-c2e06931b047 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 does not exist", "detail": ""}} {{(pid=136547) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Dec 25 21:18:22.085884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.security_group_api [None req-c3954c6b-c3f7-452f-ad82-c2e06931b047 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Neutron security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 not found {{(pid=136547) get /opt/stack/nova/nova/network/security_group_api.py:313}} Dec 25 21:18:22.086404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c3954c6b-c3f7-452f-ad82-c2e06931b047 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 does not exist Dec 25 21:18:22.086404 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-b3b8cd90-42f5-443a-b29b-40c5660002b9'] Dec 25 21:18:22.086991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3954c6b-c3f7-452f-ad82-c2e06931b047 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Security group 873a1b84-0d85-4a75-a3a2-94fba05a40a6 does not exist Dec 25 21:18:22.086991 ncdv-master-1 devstack@n-api.service[136547]: Neutron server returns request_ids: ['req-b3b8cd90-42f5-443a-b29b-40c5660002b9'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:22.087817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3954c6b-c3f7-452f-ad82-c2e06931b047 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6" status: 404 len: 194 microversion: 2.1 time: 0.030257 Dec 25 21:18:22.088382 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1705/3516] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:22 2021] DELETE /compute/v2.1/os-security-groups/873a1b84-0d85-4a75-a3a2-94fba05a40a6 => generated 194 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:22.098152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.098913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.105542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.106082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.106941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.107527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.134308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:22.286850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.287471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.294330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.294795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.295885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.297671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.437589 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e921705-1074-4f65-bc0b-7dd52c31bc99 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 204 len: 0 microversion: 2.1 time: 0.335948 Dec 25 21:18:22.437589 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1812/3517] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:22 2021] DELETE /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:22.441653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.442361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.444068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:22.448559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.449070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.449919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.450367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.451891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e8a9fcc-0b71-4224-8eb4-fb2443d7e465 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1462 microversion: 2.1 time: 0.169627 Dec 25 21:18:22.452475 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1706/3518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:22 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1462 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:22.474045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.474506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.480930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.481381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.482176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.482614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.690679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d6d5b18-69e8-4a31-87d1-bd4e4e398057 tempest-MigrationsAdminTest-1524580803 tempest-MigrationsAdminTest-1524580803-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1613 microversion: 2.1 time: 0.220525 Dec 25 21:18:22.691452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1707/3519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:22 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1613 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:22.692296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:22.701250 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed32335c-9a0b-4d7c-acdd-c5413eed7ae6 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1646 microversion: 2.1 time: 0.265761 Dec 25 21:18:22.702129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1813/3520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:22 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1646 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:22.707669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.708339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.719350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.719350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.719350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.719350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.719787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.719936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.727284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.727754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.728588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.729087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.920574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:22.929758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd517777-b80f-4103-8cc1-88523175a157 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.226318 Dec 25 21:18:22.930673 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1814/3521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:22 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:22.930782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:22.935899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:22.936401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.940030 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0d20e2d-8dcc-402b-828a-11b54a16159c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.237060 Dec 25 21:18:22.940542 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1708/3522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:22 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:22.943403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.943868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.949025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:22.949025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:22.952306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.953612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.953836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.954073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.954652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:22.955250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:22.983526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:22.997507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11a9989d-1c85-4d37-aa6f-064426582a6a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.055659 Dec 25 21:18:22.998160 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1709/3523] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:22 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:23.003882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:23.004585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:23.011591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.012047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.012846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.013310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.076679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:23.085105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d9244e4-4348-4c3e-ad60-a1804b27cf64 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1279 microversion: 2.1 time: 0.085455 Dec 25 21:18:23.085687 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1710/3524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:22 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1279 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:23.089907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:23.090507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:23.096311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.096760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.097575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.098061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.236236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:23.243948 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a11a3b90-5968-4a60-b19f-440ac2440ee2 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.157306 Dec 25 21:18:23.244519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1711/3525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:23 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:23.248900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:23.249564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:23.256177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.256629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.257448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.257888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.292415 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41faec56-ef45-40ce-a8da-1ed2dd0a076d tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "DELETE /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 204 len: 0 microversion: 2.1 time: 0.360452 Dec 25 21:18:23.293069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1815/3526] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:22 2021] DELETE /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:23.303480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:23.304284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:23.310927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.311388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.312757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.313289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.321424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:23.330681 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c228534e-c8af-43f4-9942-f58e1fd40dc5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1170 microversion: 2.1 time: 0.085085 Dec 25 21:18:23.331463 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1712/3527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:23 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1170 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:23.453064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:23.461987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab26bd65-7f5e-472c-a077-5ebff912db91 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1468 microversion: 2.1 time: 0.162978 Dec 25 21:18:23.462566 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1816/3528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:23 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1468 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:23.722604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:23.723212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:23.729900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.730345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.731111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.731543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.947758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:23.948393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:23.956725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.957293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:23.958215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:23.958600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.077139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:24.085940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bbfbd3b-3ab6-4943-ac45-06f2ba93d27f tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1646 microversion: 2.1 time: 0.367527 Dec 25 21:18:24.086971 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1713/3529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:23 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1646 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:24.092542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:24.093969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:24.100405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.101011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.101916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.102560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.373699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:24.382459 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff996e54-fd03-4b85-8230-5541a114035a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1675 microversion: 2.1 time: 0.438709 Dec 25 21:18:24.391587 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1817/3530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:23 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1675 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:24.391587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:24.391587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:24.396729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.397268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.398064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.398527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.439994 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd8d1438-f937-4546-9976-0e88f7c60ba1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.054094 Dec 25 21:18:24.444084 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1818/3531] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:24 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:24.446873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:24.447662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:24.458554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.459011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.459818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.460262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.614522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:24.619058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:24.625291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-689bbded-e10c-4b3c-adcb-e73edba1fafe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.534987 Dec 25 21:18:24.627439 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1714/3532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:24 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:24.637460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:24.639314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:24.642421 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8e3b5a8-9c01-4f73-bd0d-0f2bccefd05a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1285 microversion: 2.1 time: 0.199350 Dec 25 21:18:24.643218 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1819/3533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:24 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1285 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:24.647108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.647748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.649119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.649603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:24.649894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.650391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:24.657352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.658005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.658967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.659691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.769909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:24.790862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e13248f-1532-48a1-8a44-2fa0863dfaef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1236 microversion: 2.1 time: 0.137151 Dec 25 21:18:24.790862 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1820/3534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:24 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1236 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:24.790862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:24.790862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:24.796965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.797434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:24.798244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:24.798686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:25.213573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:25.225453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3083ed95-a9cb-4170-bf93-883d025682f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.596068 Dec 25 21:18:25.228129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1715/3535] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:24 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:25.236672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:25.237809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:25.248393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:25.249439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:25.250423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:25.250972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:25.752741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:25.760633 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55cdd93c-79c6-47b6-8a1b-7dfd638d44b6 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 200 len: 1468 microversion: 2.1 time: 0.976416 Dec 25 21:18:25.761341 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1821/3536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:24 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 1468 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:25.766246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:25.766832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:25.774579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:25.775250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:25.776203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:25.776833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.174995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a0d56f4a364ba38235b7eccbd8db8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a084940f024be8aee5807248918cb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:26.184933 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7494176-0f54-46b5-85ad-1a1b6b6edda7 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 200 len: 1646 microversion: 2.1 time: 0.952888 Dec 25 21:18:26.186449 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1716/3537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:25 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 1646 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:26.191632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:26.192619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:26.199804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.200266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.201357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.201813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.252376 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b07a51a9-0703-4516-bfe6-598e6ba83522 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.065508 Dec 25 21:18:26.253168 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1717/3538] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:26 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:26.260408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-776b63ca-963d-44f1-b211-5bbe9a91d22b req-79eb9ee1-4a59-418a-a086-daecf0be7b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e09da5c-da55-4216-89ee-8cbdaf24ecec", "name": "network-vif-deleted", "tag": "6260aad7-fac9-455a-b6ea-92f0abdfd81d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:26.262202 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:26.262202 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:26.270606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-776b63ca-963d-44f1-b211-5bbe9a91d22b req-79eb9ee1-4a59-418a-a086-daecf0be7b94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.271098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-776b63ca-963d-44f1-b211-5bbe9a91d22b req-79eb9ee1-4a59-418a-a086-daecf0be7b94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.282560 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-776b63ca-963d-44f1-b211-5bbe9a91d22b req-79eb9ee1-4a59-418a-a086-daecf0be7b94 service nova] Creating event network-vif-deleted:6260aad7-fac9-455a-b6ea-92f0abdfd81d for instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec on nch1-master-1 Dec 25 21:18:26.287381 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-776b63ca-963d-44f1-b211-5bbe9a91d22b req-79eb9ee1-4a59-418a-a086-daecf0be7b94 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033020 Dec 25 21:18:26.288989 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1718/3539] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:26.294043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:26.294748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:26.301570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.302299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.303099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.303736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.306640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:26.316383 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-580cf2de-0481-4ef1-9662-b60752babd0a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1652 microversion: 2.1 time: 0.553997 Dec 25 21:18:26.317541 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1822/3540] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:25 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1652 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:26.322359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:26.323339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:26.331904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.332658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.334044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.334689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.741435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:26.746363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:26.754555 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c17d372c-8458-4bda-8d4f-bb71d123fb32 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.435742 Dec 25 21:18:26.756836 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1823/3541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:26 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:26.761000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2f935c1-58aa-4160-b5f7-32258181e801 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.470677 Dec 25 21:18:26.761137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:26.761589 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1719/3542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:26 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:26.762021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:26.768284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.768737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.769528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c29b4c69-7766-40e1-8fbd-f472af08de28 req-ba0a4a79-4f81-4508-9bc3-c83a638c705e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5de591e-2d50-4b6e-8d61-887076ed592d", "name": "network-vif-deleted", "tag": "dfc1a5c0-22fe-4e86-8082-3ae401c78b61"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:26.769723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.770163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.774860 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:26.774860 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:26.791124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c29b4c69-7766-40e1-8fbd-f472af08de28 req-ba0a4a79-4f81-4508-9bc3-c83a638c705e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.791124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c29b4c69-7766-40e1-8fbd-f472af08de28 req-ba0a4a79-4f81-4508-9bc3-c83a638c705e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.802321 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c29b4c69-7766-40e1-8fbd-f472af08de28 req-ba0a4a79-4f81-4508-9bc3-c83a638c705e service nova] Creating event network-vif-deleted:dfc1a5c0-22fe-4e86-8082-3ae401c78b61 for instance e5de591e-2d50-4b6e-8d61-887076ed592d on nch2-master-1 Dec 25 21:18:26.807149 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c29b4c69-7766-40e1-8fbd-f472af08de28 req-ba0a4a79-4f81-4508-9bc3-c83a638c705e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044463 Dec 25 21:18:26.807775 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1720/3543] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:26.812677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:26.813400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:26.819458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.819920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.820699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.821166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.853673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:26.862868 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c3c497e5-e664-4b69-8ecc-8dfd855a17d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1224 microversion: 2.1 time: 0.105612 Dec 25 21:18:26.863764 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1824/3544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:26 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:26.868423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2cece8f7-6d49-46f9-ac72-a92b508168b0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:26.877005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cece8f7-6d49-46f9-ac72-a92b508168b0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:26.877467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cece8f7-6d49-46f9-ac72-a92b508168b0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:26.900644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2cece8f7-6d49-46f9-ac72-a92b508168b0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Going to try to start instance {{(pid=136548) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 21:18:27.095920 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2cece8f7-6d49-46f9-ac72-a92b508168b0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action" status: 202 len: 0 microversion: 2.1 time: 0.230819 Dec 25 21:18:27.096551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1825/3545] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:26 2021] POST /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:27.102057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:27.102966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 4e09da5c-da55-4216-89ee-8cbdaf24ecec] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:27.109369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.109830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.110795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.111404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.125805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] HTTP exception thrown: Instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec could not be found. Dec 25 21:18:27.126529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Returning 404 to user: Instance 4e09da5c-da55-4216-89ee-8cbdaf24ecec could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:27.127383 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63824507-950c-4bdc-be0b-bb1403f34a36 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec" status: 404 len: 111 microversion: 2.1 time: 0.029565 Dec 25 21:18:27.127957 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1826/3546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:27 2021] GET /compute/v2.1/servers/4e09da5c-da55-4216-89ee-8cbdaf24ecec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:27.132965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:27.133593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:27.141364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.142066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.142891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.143343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.150406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:27.169671 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c765a68-fd1d-4686-bb64-4d22861bc4d7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.360677 Dec 25 21:18:27.170547 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1721/3547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:26 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:27.196552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:27.198380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:27.209509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.210497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.211507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.212229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.274669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:27.464445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:27.472742 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7214a10-749a-4d1c-a79d-19a74cac829a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1661 microversion: 2.1 time: 0.343747 Dec 25 21:18:27.473613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1827/3548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:27 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1661 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:27.478254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:27.479002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] [instance: e5de591e-2d50-4b6e-8d61-887076ed592d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:27.487367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.493473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.493473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.493473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.508859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] HTTP exception thrown: Instance e5de591e-2d50-4b6e-8d61-887076ed592d could not be found. Dec 25 21:18:27.509612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Returning 404 to user: Instance e5de591e-2d50-4b6e-8d61-887076ed592d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:27.510737 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b7a8928-a6d9-436e-945a-e7aef1456e1c tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d" status: 404 len: 111 microversion: 2.1 time: 0.036058 Dec 25 21:18:27.511383 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1828/3549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:27 2021] GET /compute/v2.1/servers/e5de591e-2d50-4b6e-8d61-887076ed592d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:27.517394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:27.518489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:27.525349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.526047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.526850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.527290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.572427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c294b238-01a1-4049-9474-f2824f3af76f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.059614 Dec 25 21:18:27.580036 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1829/3550] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:27 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:27.580036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c2f4272-22b4-4680-b38e-bb9c054edb0a tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa5007460d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:27.598296 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4dc15ddc-657e-43a0-be14-2ba9faddc461 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "DELETE /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 204 len: 0 microversion: 2.1 time: 0.425968 Dec 25 21:18:27.598908 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1722/3551] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:27 2021] DELETE /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:27.607371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:27.608125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:27.614413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.614886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:27.615689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:27.616154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:28.152931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:28.161112 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad90afea-ce1e-4611-82db-775a4792e92b tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1534 microversion: 2.1 time: 0.557827 Dec 25 21:18:28.161691 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1723/3552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:27 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1534 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:28.175559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:28.176174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:28.182758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:28.183215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:28.184034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:28.184471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:28.834900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c2f4272-22b4-4680-b38e-bb9c054edb0a tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/d97e5b33-925e-41f0-914b-8313cf2e46c0" status: 202 len: 0 microversion: 2.1 time: 1.259401 Dec 25 21:18:28.835496 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1830/3553] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:27 2021] DELETE /compute/v2.1/os-security-groups/d97e5b33-925e-41f0-914b-8313cf2e46c0 => generated 0 bytes in 1261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:28.840319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:28.841302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:28.847518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:28.847970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:28.848755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:28.849217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:28.983787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:28.991820 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-102e437a-aff4-433e-a632-5854a5ba349a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.820289 Dec 25 21:18:29.002246 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1724/3554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:28 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:29.007253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:29.008368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:29.014677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.015877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.016753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.017335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.328063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:29.336779 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cbc6c2ef-8a62-4f5c-9f29-a0299d84a3a1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1507 microversion: 2.1 time: 0.500231 Dec 25 21:18:29.337509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1831/3555] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:28 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1507 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:29.343357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:29.344344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:29.351821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.352283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.353126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.353893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.379041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:29.387506 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a046a43b-d137-4568-86f9-6aa509f782fc tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.383860 Dec 25 21:18:29.397021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1725/3556] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:29 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:29.402914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:29.403822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:29.410665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.411428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.412447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.413140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.690981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:29.703071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:29.707002 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82a1a17b-9660-434e-b4ec-3aef60fba02f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.368079 Dec 25 21:18:29.707606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1832/3557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:29 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:29.723249 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c13d377f-d3ac-4fab-9aba-0413a5a79471 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1661 microversion: 2.1 time: 0.322225 Dec 25 21:18:29.724921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:29.725516 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1726/3558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:29 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1661 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:29.727975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:29.737497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-aa661687-582a-454c-9d46-fe8cfe09260d req-f9af45a6-36b9-4caa-9ea2-f655bd6c906f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b8a5b8-636e-4965-bb02-a799fdf8524f", "tag": "fd420be1-a16d-4f62-bae1-854747080d4d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:29.743652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.743978 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:29.743978 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:29.746231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.747290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.750088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.760823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-aa661687-582a-454c-9d46-fe8cfe09260d req-f9af45a6-36b9-4caa-9ea2-f655bd6c906f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.764524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-aa661687-582a-454c-9d46-fe8cfe09260d req-f9af45a6-36b9-4caa-9ea2-f655bd6c906f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.791287 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-aa661687-582a-454c-9d46-fe8cfe09260d req-f9af45a6-36b9-4caa-9ea2-f655bd6c906f service nova] Creating event network-changed:fd420be1-a16d-4f62-bae1-854747080d4d for instance 48b8a5b8-636e-4965-bb02-a799fdf8524f on nch1-master-1 Dec 25 21:18:29.797145 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-aa661687-582a-454c-9d46-fe8cfe09260d req-f9af45a6-36b9-4caa-9ea2-f655bd6c906f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069292 Dec 25 21:18:29.797717 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1727/3559] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:29.806276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78caab36-72f6-42b6-981d-8e9b53d7d7d4 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] Calling method '.version_select at 0x7fa4f73631f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:29.811538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-218a5b73-9eb7-47e7-8508-e4122cfc1c70 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.102643 Dec 25 21:18:29.812368 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1833/3560] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:29 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:29.818632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:29.819434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:29.827252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.828121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.830988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:29.830988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:29.981314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:29.996912 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f509b2fb-d010-4d44-a056-b21818172c02 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 200 len: 1492 microversion: 2.1 time: 0.180688 Dec 25 21:18:29.997886 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1834/3561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:29 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 1492 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:30.004984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7d8d7109-6b9c-47d1-984b-1741141d4f20 req-88d1cfff-09df-4fc3-8459-68655a45db85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36168d53-184a-47fb-a60b-6f72689c760c", "name": "network-vif-deleted", "tag": "a97266bc-054b-4f05-9507-8f17f9e55d8f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:30.007948 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:30.007948 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:30.020926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7d8d7109-6b9c-47d1-984b-1741141d4f20 req-88d1cfff-09df-4fc3-8459-68655a45db85 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.020926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7d8d7109-6b9c-47d1-984b-1741141d4f20 req-88d1cfff-09df-4fc3-8459-68655a45db85 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.033318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7d8d7109-6b9c-47d1-984b-1741141d4f20 req-88d1cfff-09df-4fc3-8459-68655a45db85 service nova] Creating event network-vif-deleted:a97266bc-054b-4f05-9507-8f17f9e55d8f for instance 36168d53-184a-47fb-a60b-6f72689c760c on nch2-master-1 Dec 25 21:18:30.039134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7d8d7109-6b9c-47d1-984b-1741141d4f20 req-88d1cfff-09df-4fc3-8459-68655a45db85 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038409 Dec 25 21:18:30.039875 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1835/3562] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:30.046177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:30.047101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:30.056449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.057283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.058275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.059121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.501920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:30.511297 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40cd5c87-60fd-4162-8c31-f15c07c9611d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.468110 Dec 25 21:18:30.511904 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1836/3563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:30 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:30.517278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:30.517901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:30.523793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.524248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.525067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.525546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.625904 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78caab36-72f6-42b6-981d-8e9b53d7d7d4 tempest-SecurityGroupsTestJSON-1559584135 tempest-SecurityGroupsTestJSON-1559584135-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/05129fd7-236e-4b0b-954e-4596cc33e1bb" status: 202 len: 0 microversion: 2.1 time: 0.823929 Dec 25 21:18:30.627006 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1728/3564] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:18:29 2021] DELETE /compute/v2.1/os-security-groups/05129fd7-236e-4b0b-954e-4596cc33e1bb => generated 0 bytes in 826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:30.632407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:30.633430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:30.640626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.641395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.642288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.642804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.927381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:30.936318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-edcf1194-10ac-46e3-87be-b726c7f8582f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1528 microversion: 2.1 time: 0.423281 Dec 25 21:18:30.937495 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1837/3565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:30 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1528 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:30.944261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:30.944261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:30.949838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.950285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:30.951082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:30.951517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.066541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:31.076246 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa32fd53-ac06-429d-be3f-28ec39503706 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.447862 Dec 25 21:18:31.085957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1729/3566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:30 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:31.090694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:31.091380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.100204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.100733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.102116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.102771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.164179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:31.173216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1aa164e5-89f0-4ff3-9bea-d6492996fc60 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.234347 Dec 25 21:18:31.174135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1838/3567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:30 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:31.179260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:31.180253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.186762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.187448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.188451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.189112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.230851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8e4631a-58f6-4d07-9010-3f509d1305fe tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.055370 Dec 25 21:18:31.231524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1839/3568] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:31 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:31.237205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:31.238056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 36168d53-184a-47fb-a60b-6f72689c760c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.244955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.245417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.246219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.246662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.253018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:31.260987 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d6295d2-0c26-4d29-887f-aeb018534dd8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1665 microversion: 2.1 time: 0.173832 Dec 25 21:18:31.261152 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] HTTP exception thrown: Instance 36168d53-184a-47fb-a60b-6f72689c760c could not be found. Dec 25 21:18:31.261567 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1730/3569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:31 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1665 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:31.261765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Returning 404 to user: Instance 36168d53-184a-47fb-a60b-6f72689c760c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:31.262617 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a4c53171-6ab7-4841-8fec-dd223311a7de tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c" status: 404 len: 111 microversion: 2.1 time: 0.029832 Dec 25 21:18:31.263456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1840/3570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:31 2021] GET /compute/v2.1/servers/36168d53-184a-47fb-a60b-6f72689c760c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:31.270673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:31.271214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.277065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.277514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.278286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.278712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.304427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:31.528966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:31.529628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.537231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.537689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.538489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.538936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.651912 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ba2d56c-9a3d-4620-923e-97afb8fe6c44 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 204 len: 0 microversion: 2.1 time: 0.384376 Dec 25 21:18:31.652573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1731/3571] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:31 2021] DELETE /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:18:31.663108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:31.665324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.672249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.672716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.678655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.678655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.694794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:31.702192 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52601119-b705-409a-8acb-948b4ad22b0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.177022 Dec 25 21:18:31.703287 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1841/3572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:31 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:31.812752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a2932f3f-9433-4630-9fd9-f5737d1e63ef req-220ef14b-4151-493a-a814-e25d3bf75c80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e524c2c3-e248-42dd-82e5-49cb6b3a3b2c", "tag": "94ab1ddd-760b-4f0c-b396-3eeca500e583"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:31.814346 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:31.814346 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:31.822651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a2932f3f-9433-4630-9fd9-f5737d1e63ef req-220ef14b-4151-493a-a814-e25d3bf75c80 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.823117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a2932f3f-9433-4630-9fd9-f5737d1e63ef req-220ef14b-4151-493a-a814-e25d3bf75c80 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.851264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a2932f3f-9433-4630-9fd9-f5737d1e63ef req-220ef14b-4151-493a-a814-e25d3bf75c80 service nova] Creating event network-changed:94ab1ddd-760b-4f0c-b396-3eeca500e583 for instance e524c2c3-e248-42dd-82e5-49cb6b3a3b2c on nch1-master-1 Dec 25 21:18:31.854750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:31.857334 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a2932f3f-9433-4630-9fd9-f5737d1e63ef req-220ef14b-4151-493a-a814-e25d3bf75c80 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048842 Dec 25 21:18:31.857948 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1842/3573] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:18:31.867940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c118a4b5-711c-4868-a832-73dc5a6bfc31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1469 microversion: 2.1 time: 0.210286 Dec 25 21:18:31.878166 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1732/3574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:31 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1469 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:31.969306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:31.973420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:31.984423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.985139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:31.986541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:31.987199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.094518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:32.095749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:32.107740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.108508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.109623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.110175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dba96e7b-e309-477a-a9d8-caaedf5f0833 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1528 microversion: 2.1 time: 0.341743 Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1843/3575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:31 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1528 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.384432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.414100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:32.422454 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6fffe87-ba64-49cd-867d-cffec5358881 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.332920 Dec 25 21:18:32.429249 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1733/3576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:32 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:32.429249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:32.429249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:32.434545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.435004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.435793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.436378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.477638 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-45ecdcb8-8050-406c-99a1-2c8b020d03f6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.053235 Dec 25 21:18:32.478691 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1734/3577] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:32 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:32.554578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:32.564825 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6b4dcb7-1e72-44c2-9e7c-9040bf3b6d22 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.258817 Dec 25 21:18:32.574673 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1844/3578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:32 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:32.720456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:32.721382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:32.729773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.730679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.731323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.731659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.884958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:32.885645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:32.892701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.893600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.894626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:32.895161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:32.897875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:32.906761 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d7ec772-7b06-4a38-bf54-a96c4dbd90c1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.190802 Dec 25 21:18:32.907855 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1735/3579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:32 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:33.051718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:33.059228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d6de1e0-7c60-49ac-94dc-cd3a9442c61e tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1469 microversion: 2.1 time: 0.178388 Dec 25 21:18:33.061022 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1845/3580] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:32 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1469 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:33.384377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:33.385336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:33.393952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.409258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.410384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.410994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.445479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:33.446123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:33.456534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.457057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.457850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.458294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.664587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:33.674220 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc6c2f87-5cae-45ff-9747-ff82cf1d5378 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.293451 Dec 25 21:18:33.678928 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1736/3581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:33 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:33.683834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:33.686024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:33.712717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.712717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.712717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.712717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.772657 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-162ca13e-567d-4771-a3a6-7604e4fe855f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.091844 Dec 25 21:18:33.778660 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1737/3582] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:33 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:33.779256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:33.781011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:33.782617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:33.790337 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d2caab8-1152-42d8-b84b-bfade5f5773f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.350195 Dec 25 21:18:33.791230 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1846/3583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:33 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:33.803578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.804065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.806045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f7bfecc0-48da-4b78-9a24-ac5af9ef1594 req-a3dfd0b2-e2ee-4f54-8823-756b884bbcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503df13c-2f74-4094-bbd9-a07a7ba8f4cb", "name": "network-vif-plugged", "status": "completed", "tag": "af2cd469-e53b-45dd-9334-186a6c6c612a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:33.806586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.807086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.808268 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:33.808268 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:33.816386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f7bfecc0-48da-4b78-9a24-ac5af9ef1594 req-a3dfd0b2-e2ee-4f54-8823-756b884bbcbc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.817071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f7bfecc0-48da-4b78-9a24-ac5af9ef1594 req-a3dfd0b2-e2ee-4f54-8823-756b884bbcbc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.830430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f7bfecc0-48da-4b78-9a24-ac5af9ef1594 req-a3dfd0b2-e2ee-4f54-8823-756b884bbcbc service nova] Creating event network-vif-plugged:af2cd469-e53b-45dd-9334-186a6c6c612a for instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb on nch2-master-1 Dec 25 21:18:33.837126 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f7bfecc0-48da-4b78-9a24-ac5af9ef1594 req-a3dfd0b2-e2ee-4f54-8823-756b884bbcbc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035608 Dec 25 21:18:33.838300 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1847/3584] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:33.926285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:33.927634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:33.954978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.962444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:33.962444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:33.962444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.148012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:34.160640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d417d925-46c5-45cf-8705-8f5166948fbc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.384205 Dec 25 21:18:34.164356 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1738/3585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:33 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:34.201034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f6be919e-20cd-484d-b3a6-7a031bc0a06d req-13064b57-bf82-46a4-a369-2632e1bf9db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3308bcb1-0f06-470f-913d-ae09dfc92a3a", "name": "network-vif-deleted", "tag": "860d1670-d6af-4fc5-80bd-08f9b6582dac"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:34.204633 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:34.204633 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:34.240519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f6be919e-20cd-484d-b3a6-7a031bc0a06d req-13064b57-bf82-46a4-a369-2632e1bf9db5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.241533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f6be919e-20cd-484d-b3a6-7a031bc0a06d req-13064b57-bf82-46a4-a369-2632e1bf9db5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.298359 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f6be919e-20cd-484d-b3a6-7a031bc0a06d req-13064b57-bf82-46a4-a369-2632e1bf9db5 service nova] Creating event network-vif-deleted:860d1670-d6af-4fc5-80bd-08f9b6582dac for instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a on nch2-master-1 Dec 25 21:18:34.315382 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f6be919e-20cd-484d-b3a6-7a031bc0a06d req-13064b57-bf82-46a4-a369-2632e1bf9db5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134230 Dec 25 21:18:34.325859 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1739/3586] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:34.344107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:34.345988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:34.356538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.357187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.359189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.359767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.404400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:34.427691 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3cfd91b2-d3d4-41fd-b190-0d593f77e72c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.507056 Dec 25 21:18:34.442980 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1848/3587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:33 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:34.486128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:34.494492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21066db6-8c40-443e-9532-027625cf2ea9 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 200 len: 1298 microversion: 2.1 time: 0.167146 Dec 25 21:18:34.495454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1740/3588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:34 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 1298 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:34.697116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:34.697116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:34.702978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.703442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.704246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.704692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.786770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:34.787665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:34.793928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.794610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.805878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.806593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.890802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-911ee0c4-51ef-4d0c-83fe-f144d29eab14 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.106122 Dec 25 21:18:34.892803 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1741/3589] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:34 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:34.903382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:34.906316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:34.916203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:34.917214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.919084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.920326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:34.922415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:34.927609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b225be2e-e85f-4822-a600-7b00e6a5c3b2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.235835 Dec 25 21:18:34.938258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1849/3590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:34 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:35.134520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:35.143396 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be7db128-526e-480b-be24-66422867826a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.249211 Dec 25 21:18:35.152799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1742/3591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:34 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:35.184771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:35.185812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:35.194165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.195500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.196543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.197252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.389044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:35.397992 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de3eacec-8798-4af8-ab6f-311e6d4d5c34 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.218198 Dec 25 21:18:35.399219 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1850/3592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:35 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:35.459885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:35.460924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:35.467526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.468030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.468841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.469314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.512583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:35.515983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: 3308bcb1-0f06-470f-913d-ae09dfc92a3a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:35.524709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.539292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.540739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.544222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.579148 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] HTTP exception thrown: Instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a could not be found. Dec 25 21:18:35.579148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Returning 404 to user: Instance 3308bcb1-0f06-470f-913d-ae09dfc92a3a could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:35.579148 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e610f040-a0a7-4034-a8b6-456de471c8ab tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a" status: 404 len: 111 microversion: 2.1 time: 0.070202 Dec 25 21:18:35.580307 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1851/3593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:35 2021] GET /compute/v2.1/servers/3308bcb1-0f06-470f-913d-ae09dfc92a3a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:35.589717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:35.590519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:35.597769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.598832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.600145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.600859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.649527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:35.697971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:35.708770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-93cb66c2-6996-4138-ac9f-61a186a45a40 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.252319 Dec 25 21:18:35.719590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1743/3594] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:35 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:35.891457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f166c96f-31b8-4181-8d22-284df92bf037 req-d261ecb3-f4ab-4c98-844f-e69882ee561d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b8a5b8-636e-4965-bb02-a799fdf8524f", "name": "network-vif-plugged", "status": "completed", "tag": "fd420be1-a16d-4f62-bae1-854747080d4d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:35.894098 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:35.894098 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:35.910463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f166c96f-31b8-4181-8d22-284df92bf037 req-d261ecb3-f4ab-4c98-844f-e69882ee561d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.912920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f166c96f-31b8-4181-8d22-284df92bf037 req-d261ecb3-f4ab-4c98-844f-e69882ee561d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.933041 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f166c96f-31b8-4181-8d22-284df92bf037 req-d261ecb3-f4ab-4c98-844f-e69882ee561d service nova] Creating event network-vif-plugged:fd420be1-a16d-4f62-bae1-854747080d4d for instance 48b8a5b8-636e-4965-bb02-a799fdf8524f on nch1-master-1 Dec 25 21:18:35.940952 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f166c96f-31b8-4181-8d22-284df92bf037 req-d261ecb3-f4ab-4c98-844f-e69882ee561d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053470 Dec 25 21:18:35.945845 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1744/3595] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:18:35.956481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:35.965294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:35.975689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.976149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:35.985096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:35.985704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.046891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-208dc29d-9873-48e0-b221-fe9967e55f8d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.098880 Dec 25 21:18:36.048943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1745/3596] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:35 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:36.054861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:36.055579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:36.074577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.079207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.079207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.081215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.102517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9861fbc2-4c74-4e84-9ace-a9e1d0c625da tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 204 len: 0 microversion: 2.1 time: 0.517295 Dec 25 21:18:36.103339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1852/3597] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:35 2021] DELETE /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:36.111841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:36.119273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:36.126026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.126403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.127250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.127703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.373093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:36.388159 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f3c3be20-cc7f-45ae-8199-594314a47d29 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1468 microversion: 2.1 time: 0.279867 Dec 25 21:18:36.401832 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1853/3598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:36 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1468 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:36.407780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:36.410249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:36.427936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:36.432034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.433967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.435025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.437432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.438097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89da7ad5-d253-4632-b36f-2b370dd56a67 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.389221 Dec 25 21:18:36.438745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1746/3599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:36 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:36.453555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:36.455470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:36.460929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.461453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:36.462370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:36.462891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.038562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:37.055831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf212356-90de-4358-909d-42dfa01e40f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.606602 Dec 25 21:18:37.061870 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1747/3600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:36 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:37.077904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:37.087309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:37.100758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.106619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.107671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.108364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.110884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:37.121155 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02a069fc-218c-4599-a5f5-081e463158f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.715608 Dec 25 21:18:37.132161 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1854/3601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:36 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:37.138268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:37.145071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:37.152118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.152593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.153502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.153954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.251494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9af43998-ec93-4b12-ac9f-ca20d5a9e6c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.117797 Dec 25 21:18:37.255570 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1855/3602] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:37 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:37.380742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:37.398234 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-897d55be-564e-42bb-b397-fa2c273b1caf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1327 microversion: 2.1 time: 0.335093 Dec 25 21:18:37.413506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:37.414125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:37.425482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.425622 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1748/3603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:37 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1327 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:37.425717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.425944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.426648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.459123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:37.459397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:37.481879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.482352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.484964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:37.485403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:37.785391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:37.805771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:37.820074 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a2ab10b-051f-4ae7-b9df-d6d1570c0818 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.366384 Dec 25 21:18:37.820994 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e6aed3c-8b8d-4a72-90fc-e2eae72f9d86 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1468 microversion: 2.1 time: 0.411841 Dec 25 21:18:37.821867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1749/3604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:37 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:37.837864 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1856/3605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:37 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1468 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:38.076470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:38.077910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:38.084627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.085170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.085974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.086466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.138912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:38.139713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:38.154983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.155944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.156842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.157229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.289288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:38.298697 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88073d22-617f-44f8-8ce8-70f0f382eb9e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.226947 Dec 25 21:18:38.305286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1750/3606] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:38 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:38.319380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:38.321398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:38.341791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.341791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.341791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.349311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.417634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de252a1a-1d41-4761-a4fd-ea2e6945a536 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.110615 Dec 25 21:18:38.436203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1751/3607] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:38 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:38.445377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:38.445377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:38.447904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:38.456775 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a5f4b15-58c5-4ee8-9456-65c2ac41116e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.321628 Dec 25 21:18:38.472589 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1857/3608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:38 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:38.475180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.475839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.476834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.477454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.596048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0d579887-6a0c-4782-a0da-997f45d51997 req-90f06909-e51e-4672-8ef8-31c186e957ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e524c2c3-e248-42dd-82e5-49cb6b3a3b2c", "name": "network-vif-plugged", "status": "completed", "tag": "94ab1ddd-760b-4f0c-b396-3eeca500e583"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:38.597701 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:38.597701 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:38.607044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0d579887-6a0c-4782-a0da-997f45d51997 req-90f06909-e51e-4672-8ef8-31c186e957ea service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.608195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0d579887-6a0c-4782-a0da-997f45d51997 req-90f06909-e51e-4672-8ef8-31c186e957ea service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.641447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0d579887-6a0c-4782-a0da-997f45d51997 req-90f06909-e51e-4672-8ef8-31c186e957ea service nova] Creating event network-vif-plugged:94ab1ddd-760b-4f0c-b396-3eeca500e583 for instance e524c2c3-e248-42dd-82e5-49cb6b3a3b2c on nch1-master-1 Dec 25 21:18:38.650765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0d579887-6a0c-4782-a0da-997f45d51997 req-90f06909-e51e-4672-8ef8-31c186e957ea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057026 Dec 25 21:18:38.651994 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1858/3609] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:38.730934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:38.740032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e32c5501-302c-4bb7-8ae6-16b68fcd7549 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1508 microversion: 2.1 time: 0.302166 Dec 25 21:18:38.740751 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1752/3610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:38 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1508 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:38.763026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:38.763925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:38.788452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.788934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.790077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.790520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.831554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fabf8d2a-0d47-4205-84ea-f01ae0b38bd7 req-e0400705-eba3-4c6c-bfba-8adeca4c4466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b248cb56-18c2-4ff2-a8da-8e0993879a65", "name": "network-vif-deleted", "tag": "5a73a242-a477-40db-9b6d-7ac1d38d6950"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:38.835878 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:38.835878 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:38.859549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fabf8d2a-0d47-4205-84ea-f01ae0b38bd7 req-e0400705-eba3-4c6c-bfba-8adeca4c4466 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.859549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fabf8d2a-0d47-4205-84ea-f01ae0b38bd7 req-e0400705-eba3-4c6c-bfba-8adeca4c4466 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.888441 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fabf8d2a-0d47-4205-84ea-f01ae0b38bd7 req-e0400705-eba3-4c6c-bfba-8adeca4c4466 service nova] Creating event network-vif-deleted:5a73a242-a477-40db-9b6d-7ac1d38d6950 for instance b248cb56-18c2-4ff2-a8da-8e0993879a65 on nch2-master-1 Dec 25 21:18:38.913401 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fabf8d2a-0d47-4205-84ea-f01ae0b38bd7 req-e0400705-eba3-4c6c-bfba-8adeca4c4466 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084014 Dec 25 21:18:38.913401 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1753/3611] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:38.919889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:38.920812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:38.932994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.934141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:38.935437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:38.936021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.477766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:39.507647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4784f36-b30a-4c23-901c-8ea0d9c7e2b8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1508 microversion: 2.1 time: 0.732153 Dec 25 21:18:39.525129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1859/3612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:38 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1508 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:39.531016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:39.531794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:39.539750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.540436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.541432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.542050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.559900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:39.586658 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78fbe521-9395-408e-aad6-dd0cfc300d75 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.661097 Dec 25 21:18:39.586658 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1754/3613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:38 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:39.601070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:39.602640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:39.603529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.604057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.604527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lazy-loading 'fault' on Instance uuid b248cb56-18c2-4ff2-a8da-8e0993879a65 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:18:39.615110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.615840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.616833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.617527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.652313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9e59d219fa640e48533e0efdf150b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed880d80bcfb4641b02f26da5fad21b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:39.661377 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c94d2599-51c0-460e-bab4-351a685fcc79 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 200 len: 1302 microversion: 2.1 time: 0.134424 Dec 25 21:18:39.662435 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1860/3614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:39 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 1302 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:39.670485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:39.670485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:39.690086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.690825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.691804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.692554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.760906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c61ab4ce-bc92-4cc8-b6ee-e55a550a133d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.096346 Dec 25 21:18:39.762297 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1861/3615] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:39 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:39.768321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:39.769441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:39.777884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.778732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:39.780378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:39.781017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.273040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:40.291617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3f6315f-5691-450e-b78a-ce3413d62a15 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.709434 Dec 25 21:18:40.292428 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1755/3616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:39 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:40.297720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:40.298394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:40.310796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.311296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.312120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.316734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.333632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:40.341625 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e1d39f6-9fdf-40cd-8332-1798d74a670a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1292 microversion: 2.1 time: 0.577857 Dec 25 21:18:40.345083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:18:40.345614 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1862/3617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:39 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1292 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:40.600277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:40.601722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:40.612257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.614581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.618158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.618801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.771576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95f3ef68-10ec-4a96-b0a4-7d2cafb6af9f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 204 len: 0 microversion: 2.1 time: 0.477441 Dec 25 21:18:40.773666 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1756/3618] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:18:40 2021] DELETE /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:18:40.789905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:40.790933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] [instance: b248cb56-18c2-4ff2-a8da-8e0993879a65] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:40.806044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.807640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.808843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.809552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.869559 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] HTTP exception thrown: Instance b248cb56-18c2-4ff2-a8da-8e0993879a65 could not be found. Dec 25 21:18:40.872088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] Returning 404 to user: Instance b248cb56-18c2-4ff2-a8da-8e0993879a65 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:40.873222 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e9a27a1-0d5b-4622-b352-a1ed9f565f31 tempest-MigrationsAdminTest-1932570903 tempest-MigrationsAdminTest-1932570903-project] 10.222.0.32 "GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65" status: 404 len: 111 microversion: 2.1 time: 0.087580 Dec 25 21:18:40.879342 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1757/3619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:40 2021] GET /compute/v2.1/servers/b248cb56-18c2-4ff2-a8da-8e0993879a65 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:40.894033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:40.900154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:40.923610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.924264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.925619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:40.926490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:40.941727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:40.957960 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fefb0794-b7b6-4d25-9d8b-4065da814a50 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.357369 Dec 25 21:18:40.971604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1863/3620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:40 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:40.982944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:40.994565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:41.018051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:41.029202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:41.030352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:41.031010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:41.095777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2281723-d27c-4360-b763-717486231629 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.214724 Dec 25 21:18:41.097226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1758/3621] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:40 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:41.310434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:41.311686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:41.328182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:41.329029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:41.330253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:41.332848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:41.334190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:41.349752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-365b6a6c-da4d-43ae-b776-641581fff82c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1514 microversion: 2.1 time: 0.369912 Dec 25 21:18:41.367257 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1864/3622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:40 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1514 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:41.372836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:41.379866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:41.397317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:41.398131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:41.399577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:41.400274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:41.971458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:41.984579 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78ff8f85-fc31-4a5d-8311-e7e851a309ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1484 microversion: 2.1 time: 0.615975 Dec 25 21:18:41.985531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:41.989281 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1865/3623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:41 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1484 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:41.993433 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cdf0f8a7-2ffe-46b7-ad1b-7bc2510a7d24 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.687275 Dec 25 21:18:42.007051 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1759/3624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:41 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:42.007211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:42.007316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:42.007316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:42.012940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.013407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.014217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.017243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:42.018040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.033743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.035877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.040747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.041422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.314958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6a229ee-0e15-49cd-9660-0a60a6ae6f6f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.312344 Dec 25 21:18:42.316181 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1760/3625] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:18:42 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/os-interface => generated 285 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:42.325644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:42.327070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:42.334648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.335338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.336461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.341193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.416795 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d888714f-1b76-417b-be51-4a1c7bbcba32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.098464 Dec 25 21:18:42.419893 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1761/3626] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:42 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:42.434129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:42.435234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:42.453353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.454363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.463142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:42.463142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:42.562430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:42.571952 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dac075a2-0d11-4438-9289-a6823ed611bc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.579027 Dec 25 21:18:42.576580 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1866/3627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:41 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:42.996060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:43.015443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-996fa141-6b63-42b9-8c61-cdfbe204cd8b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1514 microversion: 2.1 time: 0.584200 Dec 25 21:18:43.019518 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1762/3628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:42 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1514 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:43.026909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:43.028110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:43.039878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:43.049703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:43.049703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:43.049703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:43.430018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:43.431867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:43.453348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:43.467938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:43.469143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:43.469632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:43.557713 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f8251ae8-2fdf-4da0-a1d2-a5581db99ef7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 32581 microversion: 2.1 time: 0.131153 Dec 25 21:18:43.559715 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1763/3629] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:43 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 32581 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:43.606692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:43.607759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:43.616207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:43.616851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:43.617995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:43.631518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:43.643225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:43.645900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a86c5f24-6c61-454b-8737-6427e5bdbef8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1506 microversion: 2.1 time: 0.622894 Dec 25 21:18:43.658175 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1867/3630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:43 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1506 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:43.961342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:43.969878 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9e18775-1e1f-47be-b3bf-986fac3e058c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.381831 Dec 25 21:18:43.970469 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1764/3631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:43 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:44.027791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:44.028422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:44.039458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.045090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.047378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.048059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.507893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:44.522124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d60c0b2-b905-44cd-9f9c-c134db0666f9 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 200 len: 1472 microversion: 2.1 time: 0.498220 Dec 25 21:18:44.524225 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1868/3632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:44 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 1472 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:44.570866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:44.572571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:44.580757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.581519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.583204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.583204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.666981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9f0c9920-ca59-4586-83c0-337f18a058cd req-87a41ef8-f456-4474-896e-fd084e4198b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b8a5b8-636e-4965-bb02-a799fdf8524f", "name": "network-vif-deleted", "tag": "fd420be1-a16d-4f62-bae1-854747080d4d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:44.670564 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:44.670564 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:44.680851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f6a9214-d697-4b04-a365-2815728ee01c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 40736 microversion: 2.1 time: 0.113616 Dec 25 21:18:44.681666 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1765/3633] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:44 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 40736 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:44.714856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9f0c9920-ca59-4586-83c0-337f18a058cd req-87a41ef8-f456-4474-896e-fd084e4198b2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.715778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9f0c9920-ca59-4586-83c0-337f18a058cd req-87a41ef8-f456-4474-896e-fd084e4198b2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.725611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:44.737546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:44.758901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.759599 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9f0c9920-ca59-4586-83c0-337f18a058cd req-87a41ef8-f456-4474-896e-fd084e4198b2 service nova] Creating event network-vif-deleted:fd420be1-a16d-4f62-bae1-854747080d4d for instance 48b8a5b8-636e-4965-bb02-a799fdf8524f on nch1-master-1 Dec 25 21:18:44.761631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.763287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.767340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.772986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9f0c9920-ca59-4586-83c0-337f18a058cd req-87a41ef8-f456-4474-896e-fd084e4198b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110376 Dec 25 21:18:44.773618 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1869/3634] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:44.786808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:44.792467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:44.809637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.810301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:44.812684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:44.814128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.330681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:45.340656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e77aeac5-093b-4473-9f73-047ee9f1342a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1486 microversion: 2.1 time: 0.638542 Dec 25 21:18:45.350032 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1766/3635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:44 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1486 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:45.356352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:45.359483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:45.382160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.382404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:45.383365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.384345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.385435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.394351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6428d01d-d2a5-4f05-bbf6-936104a12a20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.610723 Dec 25 21:18:45.394351 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1870/3636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:44 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:45.397946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-cb5ebf4f-b521-4909-a4e8-3e2c876d9523 req-5a1fd707-5b4e-4dcc-8093-4627a2fbaf43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e524c2c3-e248-42dd-82e5-49cb6b3a3b2c", "tag": "94ab1ddd-760b-4f0c-b396-3eeca500e583"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:45.399637 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:45.399637 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:45.408401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cb5ebf4f-b521-4909-a4e8-3e2c876d9523 req-5a1fd707-5b4e-4dcc-8093-4627a2fbaf43 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.409182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cb5ebf4f-b521-4909-a4e8-3e2c876d9523 req-5a1fd707-5b4e-4dcc-8093-4627a2fbaf43 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.424276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cb5ebf4f-b521-4909-a4e8-3e2c876d9523 req-5a1fd707-5b4e-4dcc-8093-4627a2fbaf43 service nova] Creating event network-changed:94ab1ddd-760b-4f0c-b396-3eeca500e583 for instance e524c2c3-e248-42dd-82e5-49cb6b3a3b2c on nch1-master-1 Dec 25 21:18:45.430634 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-cb5ebf4f-b521-4909-a4e8-3e2c876d9523 req-5a1fd707-5b4e-4dcc-8093-4627a2fbaf43 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036292 Dec 25 21:18:45.432146 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1871/3637] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:45.439579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:45.440498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:45.447547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.448231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.450306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.452192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.474426 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-778be287-3f08-4caf-a0b0-7816bf63886a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.117427 Dec 25 21:18:45.476978 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1767/3638] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:45 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:45.485313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-123747162"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:45.495121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:45.514254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.515364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:45.517934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:45.518404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:46.045901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:46.063230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c185e8a-72ff-446b-a4c8-f7954fc634a7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.629288 Dec 25 21:18:46.064134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1872/3639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:45 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:46.079451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:46.085784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:46.117416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:46.117946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:46.118923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:46.119869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:46.190545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 48b8a5b8-636e-4965-bb02-a799fdf8524f could not be found. Dec 25 21:18:46.195375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 48b8a5b8-636e-4965-bb02-a799fdf8524f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:18:46.198958 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96387e6a-84d5-4eed-b89a-51eb0df3ce65 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 404 len: 111 microversion: 2.1 time: 0.130446 Dec 25 21:18:46.202759 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1873/3640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:46 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:18:46.220091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-401162509", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "040e4d7b-a517-49cc-8699-70c0b9b2f222"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:46.353669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] validate_networks() for [('040e4d7b-a517-49cc-8699-70c0b9b2f222', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:18:46.359822 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3aa881d9-e692-489c-b8ef-6a5284e07d40 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.881020 Dec 25 21:18:46.363533 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1768/3641] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:45 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Dec 25 21:18:46.393134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3de6b8f2-4f40-4707-9e95-9e2229f7b79e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '.version_select at 0x7fa4f6d493a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:46.516168 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3de6b8f2-4f40-4707-9e95-9e2229f7b79e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-key-353953741" status: 202 len: 0 microversion: 2.1 time: 0.151239 Dec 25 21:18:46.528993 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1769/3642] 10.222.0.32 () {58 vars in 1205 bytes} [Sat Dec 25 21:18:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-key-353953741 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:18:46.549111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:46.549111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:46.594400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:46.598939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:46.599876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:46.600345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:46.681219 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b8174695-b645-49b2-94fa-01ad12d9bfef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.162430 Dec 25 21:18:46.687649 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1770/3643] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:46 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:46.857171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1668704311", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:47.043768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:18:47.594829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:18:47.595894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:18:47.596532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:18:47.597151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:18:47.597935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:18:47.615122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:47.615587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:47.616484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:47.616869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:47.671416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Getting quotas for project 3b0881f03bcb42b2af8fbbc9bd84ca78. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:47.682561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Getting quotas for user 59c504bd6e654627a5d04f6e22be1b95 and project 3b0881f03bcb42b2af8fbbc9bd84ca78. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:47.719146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:18:47.719523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:18:47.869245 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d9d4789-959b-4471-b85b-49ec45bf5743 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.660144 Dec 25 21:18:47.869914 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1874/3644] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:18:46 2021] POST /compute/v2.1/servers => generated 383 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:18:47.882345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:47.883209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:47.898478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:47.899341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:47.902457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:47.904197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:48.068931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:18:48.070138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:18:48.071254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:18:48.071837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:18:48.072438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:18:48.092847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:48.097774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:48.097774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:48.097774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:48.147440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:18:48.178815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:18:48.237230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:48.250086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f560ddba-0187-4b5d-9843-591b4370eb34 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.376617 Dec 25 21:18:48.260891 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1875/3645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:47 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:48.268287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:18:48.289119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:18:48.291623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:48.297130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:48.319897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:48.322733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:48.327216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:48.327912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:48.399803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90a2ae9e-58d7-4b90-8fe0-2c7e7c9dc126 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.130329 Dec 25 21:18:48.403366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1876/3646] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:48 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:48.408633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab1dc5b5-62d3-46a8-904b-6bc104a55bbe tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:48.409379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab1dc5b5-62d3-46a8-904b-6bc104a55bbe tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:48.536663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e37ee41a-f7cd-4d63-9941-db8ad31ab235 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684371 Dec 25 21:18:48.539995 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1771/3647] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:18:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:18:48.548404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebbd93b7-64d0-4353-b653-f1cc2e9782f1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:48.553105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebbd93b7-64d0-4353-b653-f1cc2e9782f1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:48.613724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ab1dc5b5-62d3-46a8-904b-6bc104a55bbe tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:48.621903 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab1dc5b5-62d3-46a8-904b-6bc104a55bbe tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1213 microversion: 2.1 time: 0.217250 Dec 25 21:18:48.653434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1877/3648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:48 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1213 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:48.719753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ebbd93b7-64d0-4353-b653-f1cc2e9782f1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:48.740501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebbd93b7-64d0-4353-b653-f1cc2e9782f1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1209 microversion: 2.1 time: 0.195743 Dec 25 21:18:48.741128 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1772/3649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:48 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1209 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:49.267612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:49.268451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:49.282103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:49.282953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:49.284045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:49.284731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:49.412820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:49.414406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:49.441610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:49.445562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:49.447916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:49.453698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:49.587625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d7a5b52-316a-43be-b582-4e540c70bb1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.180203 Dec 25 21:18:49.588792 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1773/3650] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:49 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:18:49.664349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:49.664349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:49.677424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:49.681125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:49.682249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:49.683095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:49.940130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:49.965063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8682f1d-ae04-4f43-8033-51512d97dff5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1217 microversion: 2.1 time: 0.308936 Dec 25 21:18:49.979715 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1774/3651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:49 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1217 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:50.007397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:50.008046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:50.025241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:50.027669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:50.030553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:50.033325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:50.137879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:50.145844 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d17cc635-ca6e-4d54-91cc-517e52673866 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 0.883156 Dec 25 21:18:50.156117 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1878/3652] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:49 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:50.229201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:50.240806 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6520b37c-e660-41f8-8a1a-58b29cc8e267 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1213 microversion: 2.1 time: 0.259694 Dec 25 21:18:50.241987 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1775/3653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:49 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1213 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:50.605648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:50.606690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:50.616431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:50.617185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:50.618201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:50.618792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:50.778707 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d7fd291-e70d-4693-b668-b1d4c9534378 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.181579 Dec 25 21:18:50.780663 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1879/3654] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:50 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:50.995512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:50.996130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:51.018975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.019451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.036592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.037189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.173295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:51.174008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:51.194840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.195265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.196073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.196511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.437151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:51.451829 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54c832c5-437e-49a3-8233-2bc26ea8f48f tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1273 microversion: 2.1 time: 0.454498 Dec 25 21:18:51.455923 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1776/3655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:50 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1273 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:51.475234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:51.482210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:51.509937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.511815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.514070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.516024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.792617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:51.805845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6c3b16f-c70d-44cd-8d51-609ecee205af tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1261 microversion: 2.1 time: 0.347499 Dec 25 21:18:51.823162 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1777/3656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:51 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1261 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:51.836097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:51.841534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:51.859837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.864123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.865604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:51.866219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:51.929485 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b90bbad-8c11-4fca-951b-41c91f559348 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.104618 Dec 25 21:18:51.930436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1778/3657] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:51 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:52.262103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:52.297280 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea7fdf49-3a91-4e6b-8169-72f6805d001d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 1.124378 Dec 25 21:18:52.302135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1880/3658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:51 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:18:52.476515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:52.477288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:52.530039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.533687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:52.536432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.538941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:52.670504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:52.683824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eeb3c387-2d2e-4447-adcf-ea18f440812e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1271 microversion: 2.1 time: 0.214745 Dec 25 21:18:52.686324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d5f8ecfc-0626-4be6-af5e-3533eb4d0cd6 req-caad55b5-6ae5-421a-9174-2df70d481715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-plugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:52.688185 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:52.688185 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:18:52.695379 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1779/3659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:52 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1271 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:52.702669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d5f8ecfc-0626-4be6-af5e-3533eb4d0cd6 req-caad55b5-6ae5-421a-9174-2df70d481715 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.703370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d5f8ecfc-0626-4be6-af5e-3533eb4d0cd6 req-caad55b5-6ae5-421a-9174-2df70d481715 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:52.737557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d5f8ecfc-0626-4be6-af5e-3533eb4d0cd6 req-caad55b5-6ae5-421a-9174-2df70d481715 service nova] Creating event network-vif-plugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:18:52.747064 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d5f8ecfc-0626-4be6-af5e-3533eb4d0cd6 req-caad55b5-6ae5-421a-9174-2df70d481715 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064584 Dec 25 21:18:52.749049 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1881/3660] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:18:52.823888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:52.824801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:52.838994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.840021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:52.844221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.845177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:52.942002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:52.953350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:52.984815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.986836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:52.991663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:52.992014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:53.147915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9fc6fa03-8970-4b52-b501-3c28108db15b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.210856 Dec 25 21:18:53.156458 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1882/3661] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:52 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:53.321902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:53.323515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:53.345824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:53.354860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:53.361143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:53.364899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:53.512298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:53.540852 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b78318c-3b9f-4068-b880-f6464bc0d9bb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1267 microversion: 2.1 time: 0.720797 Dec 25 21:18:53.543813 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1780/3662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:52 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1267 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:53.704337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:53.705817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:53.724062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:53.730366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:53.733094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:53.741073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:54.590578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:54.611446 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e06efc93-de6c-4c6d-a2f1-34cb23f5e186 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1271 microversion: 2.1 time: 0.913515 Dec 25 21:18:54.612299 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1781/3663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:53 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1271 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:54.617636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:54.619346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:54.627630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:54.628388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:54.629715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:54.630393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:54.677925 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e6272f5-5d80-47fc-8906-1239b48873d8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.063969 Dec 25 21:18:54.681158 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1782/3664] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:54 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:54.705493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:54.710503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:54.721282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:54.726989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:54.727451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:54.728333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:54.733508 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-528d3a78-5ada-4e9f-8336-0e1e2cf5c50f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1523 microversion: 2.1 time: 1.413965 Dec 25 21:18:54.735357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:54.746901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1883/3665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:53 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1523 bytes in 1431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:54.862569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:54.878452 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-575fb564-c974-480d-a282-b1bc176d974c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1267 microversion: 2.1 time: 0.198811 Dec 25 21:18:54.896939 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1783/3666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:54 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:55.628047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:55.629502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:55.642751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:55.645379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:55.646245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:55.646703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:55.692948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:55.694632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:55.703212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:55.720090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:55.720090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:55.720090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:55.775960 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f4f01777-d726-423b-8cad-c0dff296a633 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 14 microversion: 2.1 time: 0.087376 Dec 25 21:18:55.780771 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1784/3667] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:55 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:18:55.788657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:55.789755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:55.800691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:55.801610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:55.803344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:55.803978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:56.614500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:56.622550 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3643d198-a450-45ac-b888-39bc9fb799d4 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1505 microversion: 2.1 time: 0.840213 Dec 25 21:18:56.637166 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1785/3668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:55 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1505 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:56.650566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:56.651411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:56.678821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:56.679557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:56.680573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:56.686722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:56.726058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:56.736148 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a2113b2e-f733-4aa1-ae7b-4f71a4f68066 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1313 microversion: 2.1 time: 1.111817 Dec 25 21:18:56.749837 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1884/3669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:55 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1313 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:56.788470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:56.789818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:56.801842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:56.806435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:56.807479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:56.808077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:56.906317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22446957-3ce0-4b28-849a-23f513c807a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 8208 microversion: 2.1 time: 0.122046 Dec 25 21:18:56.907673 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1885/3670] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:56 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 8208 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:57.303920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-acb93d70-9b90-47be-84a4-5c83bb542f22 tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] Action: 'create', calling method: .version_select at 0x7fa4f71b0430>, body: {"security_group": {"name": "tempest-securitygroup-2129640823", "description": "tempest-description-1661185255"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:57.812432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:57.825624 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f4773729-033f-40e6-9230-e10463268154 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 1.186783 Dec 25 21:18:57.827358 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1786/3671] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:56 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:57.836316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:57.839540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:57.848609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:57.849674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:57.850827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:57.852185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:58.211138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:58.224191 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0b2c137-8e7c-4530-b5b5-a10f23fc1a6c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1505 microversion: 2.1 time: 0.395066 Dec 25 21:18:58.225586 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1787/3672] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:57 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:58.230778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:58.240580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:58.252222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:58.253866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:58.257286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:58.257286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:58.855146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:58.883705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9c7d3d1-1ce9-4c1c-8537-fa46f1ab6876 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1313 microversion: 2.1 time: 0.656252 Dec 25 21:18:58.884488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1788/3673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:58 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:58.890526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:58.892618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:58.916116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:58.916626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:58.917487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:58.917930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:59.012095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80ab6c8b-5cc7-443a-9132-66be26027275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 16400 microversion: 2.1 time: 0.126028 Dec 25 21:18:59.013100 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1789/3674] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:18:58 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 16400 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:18:59.021486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9a2dccef-4f4b-4d5a-b210-9bef54b4b1e7 req-d31a1acb-3f21-44f3-9bfe-90e928adb323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843046c2-4f29-489f-bce9-b4862b3636be", "tag": "e7c63a15-3218-4c35-bfa1-ef91d39c458a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:18:59.023346 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:18:59.023346 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:18:59.038926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9a2dccef-4f4b-4d5a-b210-9bef54b4b1e7 req-d31a1acb-3f21-44f3-9bfe-90e928adb323 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:59.039387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9a2dccef-4f4b-4d5a-b210-9bef54b4b1e7 req-d31a1acb-3f21-44f3-9bfe-90e928adb323 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9a2dccef-4f4b-4d5a-b210-9bef54b4b1e7 req-d31a1acb-3f21-44f3-9bfe-90e928adb323 service nova] Creating event network-changed:e7c63a15-3218-4c35-bfa1-ef91d39c458a for instance 843046c2-4f29-489f-bce9-b4862b3636be on nch1-master-1 Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9a2dccef-4f4b-4d5a-b210-9bef54b4b1e7 req-d31a1acb-3f21-44f3-9bfe-90e928adb323 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051865 Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1790/3675] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:18:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:59.144444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:59.261282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-acb93d70-9b90-47be-84a4-5c83bb542f22 tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 2.320695 Dec 25 21:18:59.263947 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1886/3676] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:18:56 2021] POST /compute/v2.1/os-security-groups => generated 221 bytes in 2323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:18:59.272219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:18:59.273242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:18:59.295129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:59.295941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:59.304008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:18:59.305410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:18:59.618045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:18:59.629512 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1365cfbe-088f-4959-a774-02dfae809c50 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 0.560158 Dec 25 21:18:59.645854 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1791/3677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:59 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:18:59.650873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9047c2b-6bf2-488b-b939-cd5758235b0f tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] Action: 'create', calling method: .version_select at 0x7fa4f62190d0>, body: {"security_group": {"name": "tempest-securitygroup-724072335", "description": "tempest-description-458401360"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:00.334216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:00.355562 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aca50013-3a9a-4cac-b8b7-6cdf2b423590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1505 microversion: 2.1 time: 1.090052 Dec 25 21:19:00.368251 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1887/3678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:18:59 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1505 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:00.382343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1011a757-0f41-416a-82ea-6e9de74d00c9 req-2c4a026c-3506-4dce-9250-2d5aef0253f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503df13c-2f74-4094-bbd9-a07a7ba8f4cb", "name": "network-vif-unplugged", "status": "completed", "tag": "af2cd469-e53b-45dd-9334-186a6c6c612a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:00.387181 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:00.387181 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:00.418453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1011a757-0f41-416a-82ea-6e9de74d00c9 req-2c4a026c-3506-4dce-9250-2d5aef0253f9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:00.420615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1011a757-0f41-416a-82ea-6e9de74d00c9 req-2c4a026c-3506-4dce-9250-2d5aef0253f9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:00.465247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_external_events [req-1011a757-0f41-416a-82ea-6e9de74d00c9 req-2c4a026c-3506-4dce-9250-2d5aef0253f9 service nova] Unable to find a host for instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb. Dropping event network-vif-unplugged {{(pid=136548) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 21:19:00.471538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1011a757-0f41-416a-82ea-6e9de74d00c9 req-2c4a026c-3506-4dce-9250-2d5aef0253f9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.100678 Dec 25 21:19:00.473687 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1888/3679] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:00 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 105 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 25 21:19:00.483436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:00.484775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:00.493833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:00.494580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:00.499310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:00.499310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:00.997235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:01.007851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43f544c2-3da2-4605-9c1c-27a0666b0415 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1313 microversion: 2.1 time: 0.532819 Dec 25 21:19:01.012646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1889/3680] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:00 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:01.027457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:01.028798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:01.039893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.040743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:01.042065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.042718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:01.128365 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-958ecf16-55c8-4ee3-b789-2f5acff05053 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 16400 microversion: 2.1 time: 0.114136 Dec 25 21:19:01.129823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1890/3681] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:01 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 16400 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:01.135042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:01.137026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:01.152115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.156049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:01.157132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.159298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:01.238684 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9047c2b-6bf2-488b-b939-cd5758235b0f tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.589632 Dec 25 21:19:01.238684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1792/3682] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:18:59 2021] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:01.242682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ef7a38d0-722e-45d3-8380-fcd37032864b req-8250bef9-6488-4865-b7ad-df66975de904 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1246c4c7-a769-4e4e-9a42-2138119611b8", "tag": "ae3f3cc3-d73b-4b19-ae8d-52d95e61449e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:01.245184 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:01.245184 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:01.259111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ef7a38d0-722e-45d3-8380-fcd37032864b req-8250bef9-6488-4865-b7ad-df66975de904 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.262227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ef7a38d0-722e-45d3-8380-fcd37032864b req-8250bef9-6488-4865-b7ad-df66975de904 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:01.319472 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ef7a38d0-722e-45d3-8380-fcd37032864b req-8250bef9-6488-4865-b7ad-df66975de904 service nova] Creating event network-changed:ae3f3cc3-d73b-4b19-ae8d-52d95e61449e for instance 1246c4c7-a769-4e4e-9a42-2138119611b8 on nch1-master-1 Dec 25 21:19:01.337487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ef7a38d0-722e-45d3-8380-fcd37032864b req-8250bef9-6488-4865-b7ad-df66975de904 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097800 Dec 25 21:19:01.338683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1793/3683] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:01.470208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3083ee5f-ca7c-4e3c-bcc4-cee7b39a3a25 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] Action: 'create', calling method: .version_select at 0x7fa4f73ecf70>, body: {"security_group": {"name": "tempest-securitygroup-36635400", "description": "tempest-description-502712452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:01.797985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:01.822495 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f3f8fc2-a0b4-4235-bc66-cfc0a9587c08 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 0.688450 Dec 25 21:19:01.823214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1891/3684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:01 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:01.833885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:01.838015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:01.856761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.858149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:01.859685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:01.860686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.323821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:02.323821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20eebe5b-a48a-4f2c-84d8-ec5633338cd0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 200 len: 1448 microversion: 2.1 time: 0.492501 Dec 25 21:19:02.332257 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1892/3685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:01 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 1448 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:02.338266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:02.339413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:02.348762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:02.349743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.351137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:02.351832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.688775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:02.696809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-56c32045-fa2a-4d5c-8e12-745c4b4852b8 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1313 microversion: 2.1 time: 0.365484 Dec 25 21:19:02.703040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1893/3686] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:02 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:02.708002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:02.721324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:02.740059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:02.741843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.743733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:02.744347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.770474 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3083ee5f-ca7c-4e3c-bcc4-cee7b39a3a25 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 218 microversion: 2.1 time: 1.430399 Dec 25 21:19:02.771564 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1794/3687] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:19:01 2021] POST /compute/v2.1/os-security-groups => generated 218 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:02.790042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:02.792744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:02.829746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:02.831176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.839905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:02.840815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:02.880059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:02.888114 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Working on deleting snapshot 41527677-14b4-4723-a3da-3a18c3eb28e4 from shelved instance... Dec 25 21:19:02.922541 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20349816-3731-4ad2-8c6d-aef1f47fce9f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 16400 microversion: 2.1 time: 0.218108 Dec 25 21:19:02.926143 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1894/3688] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:02 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 16400 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:02.943657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac63e9e2-9bfb-4869-be60-3d1c45a0b656 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] Action: 'create', calling method: .version_select at 0x7fa4f70f1820>, body: {"security_group": {"name": "tempest-securitygroup-114468242", "description": "tempest-description-2051221313"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:03.599439 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac63e9e2-9bfb-4869-be60-3d1c45a0b656 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.671325 Dec 25 21:19:03.599593 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1895/3689] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:19:02 2021] POST /compute/v2.1/os-security-groups => generated 220 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:03.604514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:03.607835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:03.622489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:03.623103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:03.624077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:03.624592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:03.833180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:03.843123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-050676dc-03b1-479b-8851-0da23fbaa678 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 0.241907 Dec 25 21:19:03.855672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1896/3690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:03 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:03.860990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c318cb57-0043-4445-90b2-efb6fc66abb7 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] Calling method '.version_select at 0x7fa4f70f1f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:05.489891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Doing local delete in cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=136547) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 25 21:19:05.491427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:05.491849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:05.492276 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 25 21:19:05.503268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] deallocate_for_instance() {{(pid=136547) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 25 21:19:06.369797 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c318cb57-0043-4445-90b2-efb6fc66abb7 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] 10.222.0.32 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11608 microversion: 2.1 time: 2.512965 Dec 25 21:19:06.370559 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1897/3691] 10.222.0.32 () {58 vars in 1190 bytes} [Sat Dec 25 21:19:03 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11608 bytes in 2514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:06.383618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:06.391664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:06.399315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.400052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.401110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.401707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.627209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Updating instance_info_cache with network_info: [] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:19:06.664257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:06.672757 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39a6090d-97f9-445e-a364-959385b32d7b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1313 microversion: 2.1 time: 0.300929 Dec 25 21:19:06.673370 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1898/3692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:06 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:06.679099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:06.681026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:06.689475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.690725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.692145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.693366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.785294 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-515f6615-7bfd-4cef-b224-21a91c6c509f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.109781 Dec 25 21:19:06.792617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1899/3693] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:06 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:06.799915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:06.801768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:06.827636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.828549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.833361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.833361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.896748 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6aceb20c-ee0d-41a7-b73b-eb215b751f44 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.102056 Dec 25 21:19:06.903145 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1900/3694] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:19:06 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098/os-volume_attachments => generated 25 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:06.917031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:06.917964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:06.939010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.941292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:06.948311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:06.952569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.213538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:07.221548 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45b8312d-68f8-4064-b4ab-32f6f3efa160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 0.316486 Dec 25 21:19:07.233246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1901/3695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:06 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:07.239641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87ae53a2-f416-4184-9666-cd48b8cbb0ea tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] Calling method '.version_select at 0x7fa4f7533700>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:07.431782 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec1f84c1-7a3e-42a4-8f0b-82d8a09ecb86 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 204 len: 0 microversion: 2.1 time: 4.658655 Dec 25 21:19:07.432509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1795/3696] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:02 2021] DELETE /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 0 bytes in 4660 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:07.445226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6b0a972c-2eb1-496a-97bd-094cc2a0888d req-77afa97b-de1f-4ae2-a31c-c78d6ab52171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "503df13c-2f74-4094-bbd9-a07a7ba8f4cb", "name": "network-vif-deleted", "tag": "af2cd469-e53b-45dd-9334-186a6c6c612a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:07.448286 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:07.448286 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:07.458664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6b0a972c-2eb1-496a-97bd-094cc2a0888d req-77afa97b-de1f-4ae2-a31c-c78d6ab52171 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:07.458664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6b0a972c-2eb1-496a-97bd-094cc2a0888d req-77afa97b-de1f-4ae2-a31c-c78d6ab52171 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.478602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.server_external_events [req-6b0a972c-2eb1-496a-97bd-094cc2a0888d req-77afa97b-de1f-4ae2-a31c-c78d6ab52171 service nova] Unable to find a host for instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb. Dropping event network-vif-deleted {{(pid=136547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 21:19:07.481685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6b0a972c-2eb1-496a-97bd-094cc2a0888d req-77afa97b-de1f-4ae2-a31c-c78d6ab52171 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.046078 Dec 25 21:19:07.481685 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1796/3697] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:07 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 25 21:19:07.488193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a8fd0651-febd-4a66-9197-ab54c14dc779 req-3df5c299-978e-40a9-8498-7f902e0c109e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843046c2-4f29-489f-bce9-b4862b3636be", "name": "network-vif-plugged", "status": "completed", "tag": "e7c63a15-3218-4c35-bfa1-ef91d39c458a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:07.489915 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:07.489915 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:07.501927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a8fd0651-febd-4a66-9197-ab54c14dc779 req-3df5c299-978e-40a9-8498-7f902e0c109e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:07.502615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a8fd0651-febd-4a66-9197-ab54c14dc779 req-3df5c299-978e-40a9-8498-7f902e0c109e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.514706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a8fd0651-febd-4a66-9197-ab54c14dc779 req-3df5c299-978e-40a9-8498-7f902e0c109e service nova] Creating event network-vif-plugged:e7c63a15-3218-4c35-bfa1-ef91d39c458a for instance 843046c2-4f29-489f-bce9-b4862b3636be on nch1-master-1 Dec 25 21:19:07.520777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a8fd0651-febd-4a66-9197-ab54c14dc779 req-3df5c299-978e-40a9-8498-7f902e0c109e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038531 Dec 25 21:19:07.525672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1797/3698] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:07.530682 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87ae53a2-f416-4184-9666-cd48b8cbb0ea tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] 10.222.0.32 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.295842 Dec 25 21:19:07.532009 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1902/3699] 10.222.0.32 () {58 vars in 1190 bytes} [Sat Dec 25 21:19:07 2021] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:07.534388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:07.535853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:07.537331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:07.538194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:07.545658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:07.546110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.547094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:07.547526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.557690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:07.558383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.559278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:07.559792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:07.566903 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb could not be found. Dec 25 21:19:07.567910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:07.569457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9937bf1e-98fa-404a-8b10-5e4c976d8108 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 404 len: 111 microversion: 2.1 time: 0.036148 Dec 25 21:19:07.572847 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1903/3700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:07 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:07.575457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b87191c0-18be-4f99-900f-ec6a1a22da97 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] Calling method '.version_select at 0x7fa4f6fecc10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:07.633020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:08.003638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b87191c0-18be-4f99-900f-ec6a1a22da97 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/4053d4aa-64ba-4ded-8d4e-e4198a0f7f40" status: 202 len: 0 microversion: 2.1 time: 0.432144 Dec 25 21:19:08.004404 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1904/3701] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:19:07 2021] DELETE /compute/v2.1/os-security-groups/4053d4aa-64ba-4ded-8d4e-e4198a0f7f40 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:08.010880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:08.015405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:08.033596 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dfd34785-a076-4fbf-b527-6183799cd88f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 204 len: 0 microversion: 2.1 time: 0.504566 Dec 25 21:19:08.035340 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1798/3702] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:07 2021] DELETE /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:08.036678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:08.037331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:08.038674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:08.039267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:08.047174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1289154026", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:08.148283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:08.288403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:08.302932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85ff5414-123b-4203-9722-208b93a83f70 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1313 microversion: 2.1 time: 0.297010 Dec 25 21:19:08.304082 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1905/3703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:08 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:08.313894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:08.315478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:08.322528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:08.323239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:08.324210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:08.324811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:08.409413 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4867458-7a0e-46f3-85a5-edab0363a551 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.103521 Dec 25 21:19:08.413285 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1906/3704] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:08 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:08.415564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-074d9300-9422-4b7e-a822-a95dca8745a8 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] Calling method '.version_select at 0x7fa4f751c940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:08.995117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:08.995591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:08.996153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:08.996671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:08.997199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:09.007355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.007813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.008785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.009247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.026241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:09.031600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:09.043871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:09.046983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:09.317144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-281d90fe-0fcd-4fd8-9b69-b20336653006 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.276700 Dec 25 21:19:09.317782 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1799/3705] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:19:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:19:09.322290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:09.323266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:09.329055 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-074d9300-9422-4b7e-a822-a95dca8745a8 tempest-SecurityGroupsTestAdminJSON-2051445158 tempest-SecurityGroupsTestAdminJSON-2051445158-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/eb7f3ec4-8776-4775-8f5a-2dd2f22f16a4" status: 202 len: 0 microversion: 2.1 time: 0.917689 Dec 25 21:19:09.333398 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1907/3706] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:19:08 2021] DELETE /compute/v2.1/os-security-groups/eb7f3ec4-8776-4775-8f5a-2dd2f22f16a4 => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:09.333519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.333519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.333519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.333519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.339591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:09.340409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:09.384462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.388033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.391456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.393497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.715797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:09.719741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:09.721199 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fcf6f43f-0dd3-40ab-923b-09a486c1f6a3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1671 microversion: 2.1 time: 0.402359 Dec 25 21:19:09.722037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1800/3707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:09 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1671 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:09.727368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:09.727965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:09.732178 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52c82a5d-211a-466d-8aa1-a04afc21ea1b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 0.398353 Dec 25 21:19:09.737257 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1908/3708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:09 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:09.742635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.742635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.742635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:09.742635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:09.747234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de537e52-312b-4baf-9684-432c6225bb92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:09.748792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de537e52-312b-4baf-9684-432c6225bb92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:09.814561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de537e52-312b-4baf-9684-432c6225bb92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:09.826985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de537e52-312b-4baf-9684-432c6225bb92 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1215 microversion: 2.1 time: 0.083780 Dec 25 21:19:09.828241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1909/3709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:09 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:09.833038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54c87111-5820-40df-98b5-e3e6af082ac8 tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] Calling method '.version_select at 0x7fa4f74699d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:10.020414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:10.030195 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0406ad68-78ab-4047-ad6d-b47c65d785f0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1499 microversion: 2.1 time: 0.307367 Dec 25 21:19:10.035538 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1801/3710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:09 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1499 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:10.040396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:10.046190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:10.060560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.061066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.064711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.065136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.139511 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66f877f7-65c1-41f0-bfe6-299550e568de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.102390 Dec 25 21:19:10.140202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1802/3711] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:10 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:10.145278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9c37fb8b-257b-454c-9aa3-f5509688304a req-6e07154e-d522-43ea-9923-0567b3c21f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1246c4c7-a769-4e4e-9a42-2138119611b8", "name": "network-vif-plugged", "status": "completed", "tag": "ae3f3cc3-d73b-4b19-ae8d-52d95e61449e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:10.146778 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:10.146778 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:10.179159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9c37fb8b-257b-454c-9aa3-f5509688304a req-6e07154e-d522-43ea-9923-0567b3c21f46 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.180060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9c37fb8b-257b-454c-9aa3-f5509688304a req-6e07154e-d522-43ea-9923-0567b3c21f46 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.202593 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9c37fb8b-257b-454c-9aa3-f5509688304a req-6e07154e-d522-43ea-9923-0567b3c21f46 service nova] Creating event network-vif-plugged:ae3f3cc3-d73b-4b19-ae8d-52d95e61449e for instance 1246c4c7-a769-4e4e-9a42-2138119611b8 on nch1-master-1 Dec 25 21:19:10.212353 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9c37fb8b-257b-454c-9aa3-f5509688304a req-6e07154e-d522-43ea-9923-0567b3c21f46 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070830 Dec 25 21:19:10.215283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1803/3712] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:10.225169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:10.227019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:10.236589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.237102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.238002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.238448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.272103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lazy-loading 'flavor' on Instance uuid 843046c2-4f29-489f-bce9-b4862b3636be {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:19:10.398158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54c87111-5820-40df-98b5-e3e6af082ac8 tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/5f9ac08a-6b63-4df1-a644-2fcd7e654536" status: 202 len: 0 microversion: 2.1 time: 0.568752 Dec 25 21:19:10.399411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1910/3713] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:19:09 2021] DELETE /compute/v2.1/os-security-groups/5f9ac08a-6b63-4df1-a644-2fcd7e654536 => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:10.408202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5fef5269-b71b-4fa1-8e0a-4a04d6ce75ce tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] Calling method '.version_select at 0x7fa4f73b41f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:10.786456 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5fef5269-b71b-4fa1-8e0a-4a04d6ce75ce tempest-SecurityGroupsTestAdminJSON-834040197 tempest-SecurityGroupsTestAdminJSON-834040197-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/b76391b3-c0ab-4903-a590-70a6c7bd9b15" status: 202 len: 0 microversion: 2.1 time: 0.382697 Dec 25 21:19:10.787134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1911/3714] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:19:10 2021] DELETE /compute/v2.1/os-security-groups/b76391b3-c0ab-4903-a590-70a6c7bd9b15 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:10.791656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:10.792212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:10.798460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.798946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.800261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.801129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.895596 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad44d965-7255-44fd-a0c0-872b760abd0c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "POST /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be/action" status: 200 len: 32 microversion: 2.1 time: 0.677791 Dec 25 21:19:10.896794 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1804/3715] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:10 2021] POST /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be/action => generated 32 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:10.902210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:10.902555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:10.919821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.925493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.925493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.925493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:10.960002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:10.977614 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2963914c-b280-46ce-83c5-2f79fce4e8e8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1671 microversion: 2.1 time: 0.189413 Dec 25 21:19:10.978512 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1912/3716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:10 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1671 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:10.991240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:10.991865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:10.998679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:10.999140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.000084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.000536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.125374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:11.133932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5d6dce2-b8d1-4f45-8bff-f56d50d48a65 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1219 microversion: 2.1 time: 0.147106 Dec 25 21:19:11.135117 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1913/3717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:10 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1219 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:11.148908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:11.149947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:11.157151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.157948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.159860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.163847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:11.164794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.175696 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef0de3d2-d4fb-4942-aa85-36008e3dc681 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1309 microversion: 2.1 time: 0.277087 Dec 25 21:19:11.176732 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1805/3718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:10 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:11.181635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:11.182776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:11.190574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.191228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.192287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.192970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.327842 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d349bd40-a980-4f56-b48e-1c3646567cb1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.145225 Dec 25 21:19:11.333838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1806/3719] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:11 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:11.414343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e0106535-395a-4621-84ae-ee9e9397d10d req-c115d9d0-371e-44af-b7f3-46537f060b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c169c539-29b8-4eeb-bb76-6e6eabd11098", "name": "network-vif-deleted", "tag": "305a9e22-e716-452b-815d-1b4b804fad15"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:11.416794 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:11.416794 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:11.470206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e0106535-395a-4621-84ae-ee9e9397d10d req-c115d9d0-371e-44af-b7f3-46537f060b75 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.470720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e0106535-395a-4621-84ae-ee9e9397d10d req-c115d9d0-371e-44af-b7f3-46537f060b75 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.514025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e0106535-395a-4621-84ae-ee9e9397d10d req-c115d9d0-371e-44af-b7f3-46537f060b75 service nova] Creating event network-vif-deleted:305a9e22-e716-452b-815d-1b4b804fad15 for instance c169c539-29b8-4eeb-bb76-6e6eabd11098 on nch2-master-1 Dec 25 21:19:11.516560 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e0106535-395a-4621-84ae-ee9e9397d10d req-c115d9d0-371e-44af-b7f3-46537f060b75 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108113 Dec 25 21:19:11.517327 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1807/3720] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:19:11.531175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:11.542780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f44fa683-cb8b-425d-82ef-6776d73b0afc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.404422 Dec 25 21:19:11.543933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1914/3721] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:11 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:11.653314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:11.654582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:11.670917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.672197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.673050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:11.673495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:11.995507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:11.996132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:12.004542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.005035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.007845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.008290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.017257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:12.030102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8bbeda18-56f0-4b0d-a3aa-1aa6bc46ee3d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.378988 Dec 25 21:19:12.031234 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1808/3722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:11 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:12.047114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-364974799"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:12.048518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:12.072472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.073569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.076705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.077529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.078386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.078851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.079319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lazy-loading 'fault' on Instance uuid c169c539-29b8-4eeb-bb76-6e6eabd11098 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:19:12.147658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:12.156608 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-defd9698-6225-4b01-85eb-f1afbc55a6fa tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 200 len: 1327 microversion: 2.1 time: 0.164775 Dec 25 21:19:12.163423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1915/3723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:11 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 1327 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:12.168237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:12.172859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:12.175509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.175969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.176768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.177232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.280297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:12.315703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2546883b-d0a7-45d2-a948-2c98e5413ae1 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1267 microversion: 2.1 time: 0.150959 Dec 25 21:19:12.316615 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1916/3724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:12 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:12.321038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:12.321815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:12.328207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.328656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.329627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.330064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.505298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:12.517242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa063513-f8ad-4104-96b5-10abbeb1156e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1491 microversion: 2.1 time: 0.195714 Dec 25 21:19:12.517895 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1917/3725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:12 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1491 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:12.541567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:12.542681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:12.555584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.556060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.557412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.558038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.613968 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42fd8803-dc87-42c6-9d66-a8fb38b0cb64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.092049 Dec 25 21:19:12.614656 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1918/3726] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:12 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:12.625741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:12.626693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:12.635446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.635933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.637039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:12.637512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:12.752035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d30b9816-0f0f-4658-893d-6211fb910e9c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.709189 Dec 25 21:19:12.753735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1809/3727] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:12 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Dec 25 21:19:12.774852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1668704311", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:12.832359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:12.843841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39b6cb83-38f9-42a2-9bb1-111711d8ded9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.227971 Dec 25 21:19:12.844429 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1919/3728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:12 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:12.845152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:13.179826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:13.180846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:13.187673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.191258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.191258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.191258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.204334 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] HTTP exception thrown: Instance c169c539-29b8-4eeb-bb76-6e6eabd11098 could not be found. Dec 25 21:19:13.205206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Returning 404 to user: Instance c169c539-29b8-4eeb-bb76-6e6eabd11098 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:13.206237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ea08c5d-389b-4147-8134-9fe50b3dc648 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 404 len: 111 microversion: 2.1 time: 0.030240 Dec 25 21:19:13.207313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1920/3729] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:13 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:19:13.217391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-152ecc6c-cdac-47ff-85e9-66b41c567493 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '.version_select at 0x7fa4f6df7040>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:13.324502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-152ecc6c-cdac-47ff-85e9-66b41c567493 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-327730817" status: 202 len: 0 microversion: 2.1 time: 0.112856 Dec 25 21:19:13.325628 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1921/3730] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:19:13 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-327730817 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:13.333331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:13.334274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:13.338423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:13.338853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:13.339334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:13.339751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:13.340169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:13.342531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.343214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.343943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.344680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.353102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.353560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.354387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.354991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.373203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:13.378446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:13.391544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:13.394310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:13.493677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:13.514886 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e53dd75-b127-40f4-bdd4-284318aa8d3d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.173734 Dec 25 21:19:13.514886 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1922/3731] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:13 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:13.588741 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9015bb54-5c04-4161-b441-5f80d84cedc1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833558 Dec 25 21:19:13.589614 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1810/3732] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:19:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:19:13.603827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f08f5d93-1869-4e04-b7f3-5b198a41d157 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:13.603827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f08f5d93-1869-4e04-b7f3-5b198a41d157 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:13.633162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:13.634141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:13.651081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.651524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.652323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.652760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.699194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f08f5d93-1869-4e04-b7f3-5b198a41d157 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:13.707628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f08f5d93-1869-4e04-b7f3-5b198a41d157 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1209 microversion: 2.1 time: 0.111885 Dec 25 21:19:13.708248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1923/3733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:13 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:13.722644 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36323e16-10ce-40e8-b0a8-f8e5f1d1fcbf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.095310 Dec 25 21:19:13.723942 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1811/3734] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:13 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:13.866641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:13.867987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:13.880223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.883822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:13.883822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:13.906649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:14.187815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:14.202199 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23be966c-ed47-4076-bad1-2b8bb57edabc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.340763 Dec 25 21:19:14.207745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1924/3735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:13 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:14.521525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:14.522896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:14.530711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:14.531244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:14.532381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:14.532929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:14.615565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c3a175fb-52fc-4b82-8c73-5e8c6e382227 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: .version_select at 0x7fa4f6df79d0>, body: {"keypair": {"name": "tempest-keypair-2007250198"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:14.630540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c3a175fb-52fc-4b82-8c73-5e8c6e382227 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:14.636505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c3a175fb-52fc-4b82-8c73-5e8c6e382227 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for user d0383b7f61484347ba9875a2636e1057 and project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:14.694550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:14.704070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-844a3b82-a78e-4db0-8b94-639db2e617bf tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.186738 Dec 25 21:19:14.704825 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1812/3736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:14 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:14.724805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25c3139f-81cc-45be-b34d-71e6bbffbcb5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:14.725524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25c3139f-81cc-45be-b34d-71e6bbffbcb5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:14.798663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25c3139f-81cc-45be-b34d-71e6bbffbcb5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:14.819881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25c3139f-81cc-45be-b34d-71e6bbffbcb5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1209 microversion: 2.1 time: 0.100227 Dec 25 21:19:14.822700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1813/3737] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:14 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:14.828079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:14.829074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:14.857292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:14.863950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:14.863950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:14.863950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:14.938147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b8576094-189a-4b91-aa84-a9d78225ff4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.113996 Dec 25 21:19:14.943346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1814/3738] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:14 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:14.969763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fbae6eda-4e45-424b-9b93-4669f2ae3095 req-afa74157-033f-4951-a349-a90f18e56d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4de75a7-d672-42e2-b76c-476113efaa1c", "tag": "3a34eced-5439-48d3-9513-deac24aff981"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:14.973000 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:14.973000 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:14.988935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fbae6eda-4e45-424b-9b93-4669f2ae3095 req-afa74157-033f-4951-a349-a90f18e56d4b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:14.989557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fbae6eda-4e45-424b-9b93-4669f2ae3095 req-afa74157-033f-4951-a349-a90f18e56d4b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.002598 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fbae6eda-4e45-424b-9b93-4669f2ae3095 req-afa74157-033f-4951-a349-a90f18e56d4b service nova] Creating event network-changed:3a34eced-5439-48d3-9513-deac24aff981 for instance a4de75a7-d672-42e2-b76c-476113efaa1c on nch2-master-1 Dec 25 21:19:15.007311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fbae6eda-4e45-424b-9b93-4669f2ae3095 req-afa74157-033f-4951-a349-a90f18e56d4b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062415 Dec 25 21:19:15.007970 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1815/3739] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:15.224007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:15.225547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:15.238685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.240691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.243425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.244380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.426192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:15.436561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7930b6be-6c1f-4601-b295-90e2fb0c0496 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.220223 Dec 25 21:19:15.438107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1816/3740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:15 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:15.447517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c3a175fb-52fc-4b82-8c73-5e8c6e382227 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:15.453855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c3a175fb-52fc-4b82-8c73-5e8c6e382227 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for user d0383b7f61484347ba9875a2636e1057 and project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:15.470654 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c3a175fb-52fc-4b82-8c73-5e8c6e382227 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.859095 Dec 25 21:19:15.471766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1925/3741] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:19:14 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:15.721217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:15.723232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:15.732920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.733733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.739230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.739230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.838561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:15.839503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:15.845902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.846606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.847181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.847660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.869539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:15.884486 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb3feaa5-c1f5-4cad-bfcb-5bc67d4b75ed tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.167117 Dec 25 21:19:15.885350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1817/3742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:15 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:15.917789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:15.928661 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a48eee79-4b09-4da0-b35b-cbf00e45bfa8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1261 microversion: 2.1 time: 0.094264 Dec 25 21:19:15.942565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1926/3743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:15 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:15.953434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:15.954835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:15.966617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.967079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:15.967922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:15.968307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:16.037373 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f3b19b7-ddf5-4ecf-811c-16d182b793fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.089113 Dec 25 21:19:16.038606 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1818/3744] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:15 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:16.455489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:16.456582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:16.475497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:16.476602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:16.479454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:16.480121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:16.719766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1273671001", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:16.747210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:16.756007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abd4d40b-2072-49d9-b3d2-962c0a01cc7d tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.304888 Dec 25 21:19:16.764817 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1927/3745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:16 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:16.770377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-106427f6-9205-4109-b644-e017d9417261 req-6baf7aef-64de-4ee5-a31c-72ae43109b54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:16.772341 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:16.772341 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:16.776719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:16.780747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-106427f6-9205-4109-b644-e017d9417261 req-6baf7aef-64de-4ee5-a31c-72ae43109b54 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:16.786487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-106427f6-9205-4109-b644-e017d9417261 req-6baf7aef-64de-4ee5-a31c-72ae43109b54 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:16.793223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-106427f6-9205-4109-b644-e017d9417261 req-6baf7aef-64de-4ee5-a31c-72ae43109b54 service nova] Creating event network-vif-unplugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:19:16.798253 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-106427f6-9205-4109-b644-e017d9417261 req-6baf7aef-64de-4ee5-a31c-72ae43109b54 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031753 Dec 25 21:19:16.798937 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1928/3746] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:16 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:16.902614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:16.903308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:16.909787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:16.910275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:16.911247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:16.911683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.162265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:17.162265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:17.163977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:17.163977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:17.163977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:17.175106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.175557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.176579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.177050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.201420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Getting quotas for project 0ecfd75e0530430eaad8f0531a3a5244. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:17.206699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Getting quotas for user 8c034f7076e74d55a96b99bebf22a343 and project 0ecfd75e0530430eaad8f0531a3a5244. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:17.220144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:17.222648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:17.234645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:17.243277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b16bb303-3e2e-4811-a8f8-d1088ceb737a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.344223 Dec 25 21:19:17.243277 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1929/3747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:16 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:17.257802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:17.257802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:17.272535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.272929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.273858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.274299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.349744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55ee5ce1-a77f-4f28-8acb-f757329e4285 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.810199 Dec 25 21:19:17.351892 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1819/3748] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:19:16 2021] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:19:17.362567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:17.363896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:17.372762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:17.372859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87ca0f33-ad7b-44e9-a7ce-545b7e6097dd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1267 microversion: 2.1 time: 0.127719 Dec 25 21:19:17.372859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1930/3749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:17 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1267 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:17.386737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-874c3881-5201-405d-af89-1ab393912339 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:17.387056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-874c3881-5201-405d-af89-1ab393912339 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:17.394750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.395901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.400430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.400430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.442881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce7790ad-56f0-4a2b-b431-17fdbbadc109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.089721 Dec 25 21:19:17.446508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1820/3750] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:17 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:17.495315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-874c3881-5201-405d-af89-1ab393912339 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:17.517016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-874c3881-5201-405d-af89-1ab393912339 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1222 microversion: 2.1 time: 0.133425 Dec 25 21:19:17.517772 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1931/3751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:17 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:17.774448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:17.775416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:17.786196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.787792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:17.788701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:17.789712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.194321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:18.203318 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a16883d-8476-4e2c-ba70-295fb634f723 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.433714 Dec 25 21:19:18.206021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1821/3752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:17 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:18.260489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:18.261154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:18.271733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.272434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.273393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.273839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.390029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:18.391342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:18.402172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.406305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.410406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.414232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.794923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:18.807405 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd54d095-c2b9-4cf8-8f63-2d21d72c2080 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.551068 Dec 25 21:19:18.817277 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1932/3753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:18 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:18.823028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:18.824262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:18.840196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.841510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.843902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.844645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.926115 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15fa1780-1f9f-42af-8ffc-d5963a3f9350 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.106907 Dec 25 21:19:18.932988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1933/3754] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:18 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:18.941861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:18.945654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:18.982054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.990943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:18.992021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:18.992654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:19.154787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:19.166825 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45d76cab-12ef-49b9-9047-7154bbdcec0c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1226 microversion: 2.1 time: 0.232095 Dec 25 21:19:19.167756 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1934/3755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:18 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1226 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:19.189222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:19.200455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f9586ac-da1d-4650-acae-b174d4909a25 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 0.814695 Dec 25 21:19:19.203571 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1822/3756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:18 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:19.220988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:19.222270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:19.232194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:19.232907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:19.233902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:19.234496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:19.827743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:19.829172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:19.838525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:19.839231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:19.840309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:19.840960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.120483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:20.132523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-62c9474a-201d-42b5-950c-c0c8e3f94b32 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.915412 Dec 25 21:19:20.136236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1935/3757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:19 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:20.148001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:20.151620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:20.164494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.170929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.173589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.175781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.215918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:20.226211 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-42d35ee7-ae3a-4620-8323-7f5a7ca312da tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.403421 Dec 25 21:19:20.236270 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15914090-772e-403b-94b3-a206a2519755 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.093487 Dec 25 21:19:20.236270 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1936/3758] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:20 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:20.237390 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1823/3759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:19 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:20.244394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-557054ea-c284-496e-b8c7-80fcc3d573c9 req-6357ef0f-8c0c-49e9-bc77-06074b5123df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4de75a7-d672-42e2-b76c-476113efaa1c", "name": "network-vif-plugged", "status": "completed", "tag": "3a34eced-5439-48d3-9513-deac24aff981"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:20.245495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:20.246284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:20.248756 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:20.248756 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:20.253939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.254610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.255581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.256182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.267008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-557054ea-c284-496e-b8c7-80fcc3d573c9 req-6357ef0f-8c0c-49e9-bc77-06074b5123df service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.269284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-557054ea-c284-496e-b8c7-80fcc3d573c9 req-6357ef0f-8c0c-49e9-bc77-06074b5123df service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.301542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-557054ea-c284-496e-b8c7-80fcc3d573c9 req-6357ef0f-8c0c-49e9-bc77-06074b5123df service nova] Creating event network-vif-plugged:3a34eced-5439-48d3-9513-deac24aff981 for instance a4de75a7-d672-42e2-b76c-476113efaa1c on nch2-master-1 Dec 25 21:19:20.308301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-557054ea-c284-496e-b8c7-80fcc3d573c9 req-6357ef0f-8c0c-49e9-bc77-06074b5123df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074062 Dec 25 21:19:20.309075 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1937/3760] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:20.319425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:20.320978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:20.352256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.352810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.353731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:20.354253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:20.423054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:20.433480 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f29db95-cfca-4887-b385-d4d627b8054b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1282 microversion: 2.1 time: 0.192980 Dec 25 21:19:20.436254 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1824/3761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:20 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:20.847818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:20.865394 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1000f3eb-5066-4e45-b026-c4c46619cfd7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 0.553480 Dec 25 21:19:20.874749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1938/3762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:20 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:20.946423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1473873702", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb028617-ca4b-4888-809e-8a74d7f084f8"}], "security_groups": [{"name": "tempest-securitygroup--1116856633"}], "key_name": "tempest-keypair-2007250198", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:21.133673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] validate_networks() for [('cb028617-ca4b-4888-809e-8a74d7f084f8', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:21.154518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:21.155341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:21.167893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.168351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:21.169269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.169712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:21.510533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:21.534422 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0dc6a54-256b-4057-a3ea-edf0bf017c6e tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.384089 Dec 25 21:19:21.545915 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1939/3763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:21 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:21.547984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d6e67639-c1d9-461f-b250-f53235e87759 req-80aab317-3c4c-4ef4-8022-037d895dad07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1dcb2aa4-3186-4c62-a704-70ced44d42ca", "tag": "596692a1-86ae-4ad5-865e-d9310e0fd70e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:21.553885 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:21.553885 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:21.577238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d6e67639-c1d9-461f-b250-f53235e87759 req-80aab317-3c4c-4ef4-8022-037d895dad07 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.577731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d6e67639-c1d9-461f-b250-f53235e87759 req-80aab317-3c4c-4ef4-8022-037d895dad07 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:21.615618 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d6e67639-c1d9-461f-b250-f53235e87759 req-80aab317-3c4c-4ef4-8022-037d895dad07 service nova] Creating event network-changed:596692a1-86ae-4ad5-865e-d9310e0fd70e for instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca on nch2-master-1 Dec 25 21:19:21.633087 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d6e67639-c1d9-461f-b250-f53235e87759 req-80aab317-3c4c-4ef4-8022-037d895dad07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094946 Dec 25 21:19:21.633884 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1940/3764] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:21.644823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:21.649431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:21.667133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.669367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:21.670419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.670868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:21.733989 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d71d787f-a633-4955-b645-2bd1c53176ea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.098480 Dec 25 21:19:21.737312 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1941/3765] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:21 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:21.753745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:21.756065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:21.796007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.799085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:21.802759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:21.803411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.214985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:22.216231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:22.216842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:22.217181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:22.218231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:22.257013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.257750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.258938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.259579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.303681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:22.319472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e6974a2d-02a2-46c4-8504-451af8df1e1c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1315 microversion: 2.1 time: 0.578219 Dec 25 21:19:22.319827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:22.322348 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1942/3766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:21 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:22.332192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:22.337239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:22.345061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Getting quotas for user d0383b7f61484347ba9875a2636e1057 and project 7ed80be6e633499b9d1dc61c05014afc. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:22.350076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.350826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.352028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.352717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.393310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:22.395878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:22.594075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e1479f88-5237-40d4-9278-603c21d7dfa9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.649928 Dec 25 21:19:22.605965 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1825/3767] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:19:20 2021] POST /compute/v2.1/servers => generated 402 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:19:22.624988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:22.628863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:22.670983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.672448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.673493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.681533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.779548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:22.791471 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f87d589-1dd8-4031-91d4-ede86de9bd50 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.464050 Dec 25 21:19:22.807188 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1943/3768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:22 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:22.817275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-60a70c37-37b3-497c-b39e-49d5d3afcbfb req-9f11d8ad-5448-4d9c-98be-4ef1e6047032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-plugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:22.826107 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:22.826107 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:22.882461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-60a70c37-37b3-497c-b39e-49d5d3afcbfb req-9f11d8ad-5448-4d9c-98be-4ef1e6047032 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.882461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-60a70c37-37b3-497c-b39e-49d5d3afcbfb req-9f11d8ad-5448-4d9c-98be-4ef1e6047032 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.892140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-60a70c37-37b3-497c-b39e-49d5d3afcbfb req-9f11d8ad-5448-4d9c-98be-4ef1e6047032 service nova] Creating event network-vif-plugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:19:22.902941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-60a70c37-37b3-497c-b39e-49d5d3afcbfb req-9f11d8ad-5448-4d9c-98be-4ef1e6047032 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093155 Dec 25 21:19:22.903793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1944/3769] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:22.912291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:22.913204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:22.936700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.937448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:22.938531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:22.939253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.115782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:23.124862 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5432c759-6afa-4ea7-943c-3cb36d93736e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 0.516768 Dec 25 21:19:23.125773 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1826/3770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:22 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:23.145350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b01e0272-e0a9-4e67-99a5-8969a3d9522b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:23.146225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b01e0272-e0a9-4e67-99a5-8969a3d9522b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:23.267481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b01e0272-e0a9-4e67-99a5-8969a3d9522b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:23.312615 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b01e0272-e0a9-4e67-99a5-8969a3d9522b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1238 microversion: 2.1 time: 0.184174 Dec 25 21:19:23.313748 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1827/3771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:23 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1238 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:23.343858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:23.343858 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf98990f-591a-4a42-9fe8-6af7a8622eb7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.424507 Dec 25 21:19:23.357343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:23.360315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1945/3772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:22 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:23.367461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:23.377832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:23.381673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:23.400241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:23.401910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.405395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:23.410541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.410732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:23.412066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.412182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:23.412560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.527520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7eca8b0-4968-44f2-885c-9116700ba9db tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.209726 Dec 25 21:19:23.529827 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1828/3773] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:23 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:23.813827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:23.814672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:23.831168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:23.853119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.853119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:23.853119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:23.976665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:23.984666 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6761455-94f4-45ce-9dfe-dbda7e3aa861 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1502 microversion: 2.1 time: 0.623497 Dec 25 21:19:23.985403 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1946/3774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:23 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1502 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:24.006439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8bb51810-d02e-48c0-9a0d-4c2b882b4cbd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:24.030883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb51810-d02e-48c0-9a0d-4c2b882b4cbd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:24.035082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb51810-d02e-48c0-9a0d-4c2b882b4cbd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:24.095911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8bb51810-d02e-48c0-9a0d-4c2b882b4cbd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:19:24.294085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:24.304551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-05b1c3ad-2333-48d9-a89d-278053d3f96e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.496011 Dec 25 21:19:24.315909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1829/3775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:23 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:24.328181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:24.329123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:24.336572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:24.337385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:24.338447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:24.339210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:24.443958 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8bb51810-d02e-48c0-9a0d-4c2b882b4cbd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c/action" status: 202 len: 0 microversion: 2.1 time: 0.440896 Dec 25 21:19:24.453132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1947/3776] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:24 2021] POST /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:24.471233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7b212366-d27a-4d39-b2df-33f967b21cdd req-fd4d42d4-71de-4a1f-b5f2-53fb4af0d6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3eb3b9-51e6-4fb9-87e8-3122867c3a42", "tag": "60d06ee7-b2a0-4b58-9871-903596124a14"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:24.481758 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:24.481758 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:24.510101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7b212366-d27a-4d39-b2df-33f967b21cdd req-fd4d42d4-71de-4a1f-b5f2-53fb4af0d6e5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:24.510612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7b212366-d27a-4d39-b2df-33f967b21cdd req-fd4d42d4-71de-4a1f-b5f2-53fb4af0d6e5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:24.562227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7b212366-d27a-4d39-b2df-33f967b21cdd req-fd4d42d4-71de-4a1f-b5f2-53fb4af0d6e5 service nova] Creating event network-changed:60d06ee7-b2a0-4b58-9871-903596124a14 for instance dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 on nch2-master-1 Dec 25 21:19:24.576220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7b212366-d27a-4d39-b2df-33f967b21cdd req-fd4d42d4-71de-4a1f-b5f2-53fb4af0d6e5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120519 Dec 25 21:19:24.577808 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1948/3777] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:24.588145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:24.589209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:24.598164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:24.600285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:24.605552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:24.607620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.181774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:25.191862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a165a8f-1f1c-4b46-9c2f-a2f48021d3b0 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.612478 Dec 25 21:19:25.201169 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1949/3778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:24 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:25.230511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:25.232034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:25.259616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.260462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.264160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.265016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.341398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:25.355572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-08b69294-5b76-45cc-8ca5-e2477b9f4008 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 1.038391 Dec 25 21:19:25.360500 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1830/3779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:24 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:25.369925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:25.372697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:25.389714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.390255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.391121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.391570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.430111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:25.446872 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e58fcb6-d4e0-4369-a1a2-7be949e6938a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1290 microversion: 2.1 time: 0.244244 Dec 25 21:19:25.449426 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1950/3780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:25 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1290 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:25.464974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:25.464974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:25.485378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.486790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.490317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.491431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.557411 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc0ef902-0da8-4842-bc1d-b3cf2b93ecc4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.102076 Dec 25 21:19:25.561993 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1951/3781] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:25 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:25.575102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:25.578217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:25.598697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.599410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:25.602248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:25.602972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:26.128765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:26.141871 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-804049b0-ed43-4138-b6b1-10143a5e2ac2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.778991 Dec 25 21:19:26.157016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1831/3782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:25 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:26.222061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:26.223800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:26.247667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:26.248572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:26.250037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:26.251030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:26.298047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:26.311435 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c74e8f6c-06df-4593-9042-ee98de16c91a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.745591 Dec 25 21:19:26.313615 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1952/3783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:25 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:26.377296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:26.378313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:26.390185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:26.391321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:26.392756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:26.396273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.409864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:27.417938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7d22173-e8cf-463a-83f4-d5321ef45156 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 1.044621 Dec 25 21:19:27.425815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:27.429401 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1953/3784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:26 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:27.441930 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6cb41ca5-1330-4076-8e24-a6a560c9b4f3 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 1.226747 Dec 25 21:19:27.447043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:27.448076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:27.452522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1832/3785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:26 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:27.457355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:27.459004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:27.459891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.460408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.466490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.467443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.468517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.470106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.473688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.474286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.541352 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3107fee-2284-4212-bdd5-03f21193c5a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.087354 Dec 25 21:19:27.542787 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1833/3786] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:27 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:27.566272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:27.568014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:27.594717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.595550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.596775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.597449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.655921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:27.665349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b1b60cc-14c3-47a0-803b-05911b8d1460 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1296 microversion: 2.1 time: 0.235636 Dec 25 21:19:27.666093 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1954/3787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:27 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1296 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:27.683872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:27.688067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:27.710255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.710869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:27.711791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:27.713112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:28.256597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:28.270374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e632cde-5dd9-4e7a-91e4-4a9318356318 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.598914 Dec 25 21:19:28.271111 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1955/3788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:27 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:28.276999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:28.294899 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-578a4e91-8655-498c-8395-f73e143468ff tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.748402 Dec 25 21:19:28.298787 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1834/3789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:27 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:28.439069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:28.439796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:28.450109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:28.450895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:28.452033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:28.452719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:28.459980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:28.461283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:28.478933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:28.479809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:28.480899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:28.486033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:28.963470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:28.977328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-313a7da0-9ba8-4c70-b9c0-c99d311a51c3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 0.542483 Dec 25 21:19:28.977920 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1956/3790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:28 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:28.982491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:28.983448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:28.994532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:28.995135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:28.995942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:28.996928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.008599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:29.017534 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4fe79d1-ce25-4967-ad6f-643e47866ab4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.561405 Dec 25 21:19:29.029201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1835/3791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:28 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:29.033917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:29.034682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:29.041093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:29.041856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.043992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:29.044674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.060163 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28580795-ebeb-48aa-b947-7964a0c5d73b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.080307 Dec 25 21:19:29.060965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1957/3792] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:28 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:29.288229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:29.289416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:29.302708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:29.307684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.308707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:29.309942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.378609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:29.390906 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c2de51c-669e-44fc-b77a-db5900801857 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.360437 Dec 25 21:19:29.395371 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1836/3793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:29 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:29.406114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:29.406757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:29.425753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:29.426328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.427186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:29.427636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:29.844380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:29.855004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:29.858552 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be5a2dd5-4168-4809-8b53-e22649aa56dd tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.461664 Dec 25 21:19:29.862462 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1837/3794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:29 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:29.872516 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22974eda-3b9c-455c-9bae-850270da247c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.588373 Dec 25 21:19:29.873167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa82e6f5-06ea-4715-b496-76aadd05b4a2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'create', calling method: .version_select at 0x7fa4f67e8430>, body: {"keypair": {"name": "tempest-keypair-1989741099"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:29.874017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1958/3795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:29 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:29.922938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-aa82e6f5-06ea-4715-b496-76aadd05b4a2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Getting quotas for project d4571ece0fa3450b83fde221178518c8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:29.929849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-aa82e6f5-06ea-4715-b496-76aadd05b4a2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Getting quotas for user a85842dabc3d4a219d28c154e36c293c and project d4571ece0fa3450b83fde221178518c8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:29.995111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:29.997501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:30.010383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.011074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.015498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.017690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.293580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:30.302724 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-46b108a4-595e-4973-a141-ed9950f44d6a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 0.311988 Dec 25 21:19:30.313217 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1959/3796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:29 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:30.318351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3e093349-fe0a-4709-ae67-a4ad0589330a req-d41ae481-a259-4e1c-9767-a7856f10f190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcb2aa4-3186-4c62-a704-70ced44d42ca", "name": "network-vif-plugged", "status": "completed", "tag": "596692a1-86ae-4ad5-865e-d9310e0fd70e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:30.320112 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:30.320112 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:30.333107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3e093349-fe0a-4709-ae67-a4ad0589330a req-d41ae481-a259-4e1c-9767-a7856f10f190 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.333107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3e093349-fe0a-4709-ae67-a4ad0589330a req-d41ae481-a259-4e1c-9767-a7856f10f190 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.344483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3e093349-fe0a-4709-ae67-a4ad0589330a req-d41ae481-a259-4e1c-9767-a7856f10f190 service nova] Creating event network-vif-plugged:596692a1-86ae-4ad5-865e-d9310e0fd70e for instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca on nch2-master-1 Dec 25 21:19:30.362278 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3e093349-fe0a-4709-ae67-a4ad0589330a req-d41ae481-a259-4e1c-9767-a7856f10f190 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042259 Dec 25 21:19:30.368379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1960/3797] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:30.386191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:30.388161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:30.396995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.397592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.397961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.398591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.484050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-aa82e6f5-06ea-4715-b496-76aadd05b4a2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Getting quotas for project d4571ece0fa3450b83fde221178518c8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:30.506640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-aa82e6f5-06ea-4715-b496-76aadd05b4a2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Getting quotas for user a85842dabc3d4a219d28c154e36c293c and project d4571ece0fa3450b83fde221178518c8. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:30.539773 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa82e6f5-06ea-4715-b496-76aadd05b4a2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.42 time: 0.675992 Dec 25 21:19:30.542056 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1838/3798] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:19:29 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 679 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:19:30.547063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:30.550633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:30.566655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.569485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.635910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.635910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.653619 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7cb4736b-f634-45a1-8a87-0dc7fa1e505d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.109844 Dec 25 21:19:30.655527 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1839/3799] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:30 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:30.662367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:30.663776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:30.672066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.676344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.677327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.677848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.705025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:30.713936 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c06c163c-843b-47b3-9411-ef58e1e084bd tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.344069 Dec 25 21:19:30.714577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1961/3800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:30 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:30.822373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:30.829766 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d560610e-93f8-4c91-bc44-f2517dda6ffe tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.172852 Dec 25 21:19:30.830333 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1840/3801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:30 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:30.878090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:30.878708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:30.884776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.885267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.886146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.886762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.889431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:30.890079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:30.895954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.896410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:30.897225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:30.897665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.239730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:31.248411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:31.256512 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-976eb19f-3797-481f-b0d9-4c6f3777973b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.382012 Dec 25 21:19:31.258168 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1962/3802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:30 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:31.258891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3efe473e-1bf0-4b21-8462-13ed6316b55a tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.372284 Dec 25 21:19:31.263164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7deaf684-e200-4b37-afaa-8fd2b9eaa63b req-e59e295e-6d86-4162-bf5f-aa78e2e8dc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f8bfda-0dfb-4159-89b2-bf30653ddcb2", "tag": "468e4b8e-2b46-4578-81eb-d2bfd34de1bb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:31.266198 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:31.266198 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:31.269364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1841/3803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:30 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:31.274545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7deaf684-e200-4b37-afaa-8fd2b9eaa63b req-e59e295e-6d86-4162-bf5f-aa78e2e8dc7f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.275403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7deaf684-e200-4b37-afaa-8fd2b9eaa63b req-e59e295e-6d86-4162-bf5f-aa78e2e8dc7f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.301085 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7deaf684-e200-4b37-afaa-8fd2b9eaa63b req-e59e295e-6d86-4162-bf5f-aa78e2e8dc7f service nova] Creating event network-changed:468e4b8e-2b46-4578-81eb-d2bfd34de1bb for instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 on nch2-master-1 Dec 25 21:19:31.306821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7deaf684-e200-4b37-afaa-8fd2b9eaa63b req-e59e295e-6d86-4162-bf5f-aa78e2e8dc7f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047287 Dec 25 21:19:31.308335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1963/3804] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:31.319985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:31.328689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:31.342828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.343536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.344600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.345083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.607008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:31.625604 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8087f4b-81aa-4b0e-9b72-6981bd2f38b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1309 microversion: 2.1 time: 0.306716 Dec 25 21:19:31.626551 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1842/3805] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:31 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1309 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:31.667034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:31.669147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:31.687813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.688608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.691114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.691637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.732462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:31.733989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:31.743516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.744813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.747068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.747750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.768468 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-edbaea67-ac01-4f1b-994f-99685d1edc04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.105940 Dec 25 21:19:31.769274 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1964/3806] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:31 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:31.848413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:31.849151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:31.859245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.859987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.861451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:31.862083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:31.984567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:31.997568 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb41e3eb-d4f7-48c3-be78-0cd3c0b0b4c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.269856 Dec 25 21:19:31.998493 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1843/3807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:31 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:32.132785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:32.156765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-904602af-b30a-4ad8-b426-d7bcd0f24e74 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.313649 Dec 25 21:19:32.157746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1965/3808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:31 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:32.276100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:32.276727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:32.277865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:32.278712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:32.283199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.283663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.284465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.285093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.292060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.297365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.297365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.297365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.644231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:32.653006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82e0bfcc-cf37-464c-8783-08d362c5abb4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.378474 Dec 25 21:19:32.662727 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1966/3809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:32 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:32.664774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:32.668099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4a213dda-8fcd-4251-8260-98d553e5ee82 req-d5a1346e-2ee0-484b-89e5-96704658a71f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3eb3b9-51e6-4fb9-87e8-3122867c3a42", "name": "network-vif-plugged", "status": "completed", "tag": "60d06ee7-b2a0-4b58-9871-903596124a14"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:32.671022 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:32.671022 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:32.684560 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2e871e0-ff8d-40f6-9b62-632df5f2ee95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.413153 Dec 25 21:19:32.687053 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1844/3810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:32 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:32.697035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4a213dda-8fcd-4251-8260-98d553e5ee82 req-d5a1346e-2ee0-484b-89e5-96704658a71f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.699023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4a213dda-8fcd-4251-8260-98d553e5ee82 req-d5a1346e-2ee0-484b-89e5-96704658a71f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.701882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:32.702892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:32.712228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.713133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.719670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.720363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.721744 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4a213dda-8fcd-4251-8260-98d553e5ee82 req-d5a1346e-2ee0-484b-89e5-96704658a71f service nova] Creating event network-vif-plugged:60d06ee7-b2a0-4b58-9871-903596124a14 for instance dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 on nch2-master-1 Dec 25 21:19:32.731581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4a213dda-8fcd-4251-8260-98d553e5ee82 req-d5a1346e-2ee0-484b-89e5-96704658a71f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066699 Dec 25 21:19:32.736268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1967/3811] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:32.783323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:32.784737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:32.791490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.792263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.793928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:32.794617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:32.837855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48e52424-fbcd-4a0a-aa41-b5ac25f10616 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.061625 Dec 25 21:19:32.838533 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1968/3812] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:32 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:32.981244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:32.994300 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75ca61bd-4fcf-4d0a-9d71-afdf08ef7d6c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1491 microversion: 2.1 time: 0.305881 Dec 25 21:19:33.012924 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1845/3813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:32 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1491 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:33.013853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:33.014589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:33.017953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:33.018666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:33.025639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.026207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.027090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.028182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.029564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.032816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.033656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.034061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.259221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:33.268497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e552ff67-5526-4a19-a4a3-3ffd82f015c9 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.254310 Dec 25 21:19:33.271609 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1846/3814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:33 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:33.281996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:33.282630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:33.297188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.297679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.298500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.299232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.311383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:33.336510 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fdde5d39-43fc-429d-bb6d-c31e0c46a6e3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1491 microversion: 2.1 time: 0.328183 Dec 25 21:19:33.354496 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1969/3815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:33 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1491 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:33.361896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:33.361896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:33.367270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.367954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.369238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.369843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.565052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:33.574910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-45e1bfe7-7afa-420b-bd0d-dc3b61d43482 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.301771 Dec 25 21:19:33.576273 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1847/3816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:33 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:33.588287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:33.596218 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-471180c8-252b-4ad2-9f1b-8015c2c767b1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1491 microversion: 2.1 time: 0.240563 Dec 25 21:19:33.597010 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1970/3817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:33 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1491 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:33.615415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:33.616333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:33.629273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.630009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.631568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.632224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.678945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:33.679980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:33.691296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:33.693476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.694131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.703731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:33.705212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:33.964383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:33.990867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08875b3a-bb81-4364-b449-ee429d2d3692 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1322 microversion: 2.1 time: 0.316462 Dec 25 21:19:33.992601 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1971/3818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:33 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:34.006745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:34.007868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:34.017015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.017722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.018661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.019114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.210990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:34.222218 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09a6516d-ab05-4222-a583-d8efcb5e2159 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.228415 Dec 25 21:19:34.227913 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1972/3819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:33 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:34.234049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:34.239841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:34.241935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.242528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.243409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.243941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.283552 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e66107ef-0b96-446a-beba-87ae13b92b8a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 204 len: 0 microversion: 2.1 time: 0.671845 Dec 25 21:19:34.291227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1848/3820] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:33 2021] DELETE /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 0 bytes in 677 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:34.291449 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd7cc3f8-2161-40f3-b3be-34e66d73c573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060648 Dec 25 21:19:34.295358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1949466789", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b8d0c0f5-4a55-4519-afa5-15b47bd47c1f"}, {"port": "7d584498-0a66-4020-96ff-ac37bb6bf33e", "tag": "port-1"}, {"port": "fd6aa216-385a-41e5-8c5e-3aae2253a5ab", "tag": "port-2"}, {"uuid": "f7ed1632-2ec3-4974-9097-8fe2ac8f3ba4", "tag": "net-1"}, {"uuid": "f7ed1632-2ec3-4974-9097-8fe2ac8f3ba4"}, {"uuid": "3822397d-3d72-44cf-9fd0-b3119ec81123", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "3822397d-3d72-44cf-9fd0-b3119ec81123", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a5c1ad6f-a4c5-4f08-a59c-fa1afed02065", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "801c9bae-0e8c-4c69-99a2-93bfda7668af", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "15822ef8-a596-47a7-bea5-391cbe2651d7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--385716866"}], "key_name": "tempest-keypair-1989741099", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:34.296351 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1973/3821] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:34 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:34.317866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:34.322783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:34.339049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.342542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.345564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.347529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.471806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] validate_networks() for [('b8d0c0f5-4a55-4519-afa5-15b47bd47c1f', None, None, None, None, None), (None, None, '7d584498-0a66-4020-96ff-ac37bb6bf33e', None, None, None), (None, None, 'fd6aa216-385a-41e5-8c5e-3aae2253a5ab', None, None, None), ('f7ed1632-2ec3-4974-9097-8fe2ac8f3ba4', None, None, None, None, None), ('f7ed1632-2ec3-4974-9097-8fe2ac8f3ba4', None, None, None, None, None), ('3822397d-3d72-44cf-9fd0-b3119ec81123', '10.2.2.100', None, None, None, None), ('3822397d-3d72-44cf-9fd0-b3119ec81123', '10.2.2.200', None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:34.728657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:34.733919 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55fa8c9b-73cd-4663-af8e-e7e211f93843 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.423919 Dec 25 21:19:34.734629 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1974/3822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:34 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:34.739851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:34.740567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:34.747830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.748379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:34.749657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:34.750690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c5cf9ec-4300-4877-9ab4-961b42866e54 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1497 microversion: 2.1 time: 0.299268 Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1975/3823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:34 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1497 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:35.057624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:35.268693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:35.280705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3aaa1d91-a25b-434c-9f2e-6c47ca5e116e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.242602 Dec 25 21:19:35.283482 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1976/3824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:35 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:35.291635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:35.292408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:35.302445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:35.303242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:35.303905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:35.304350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:35.913532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:35.924591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-922e524c-38b7-49b9-9489-3a6eafc5d841 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1472 microversion: 2.1 time: 0.639544 Dec 25 21:19:35.925242 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1977/3825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:35 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1472 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:35.931255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:35.931874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:35.951147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:35.951602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:35.952417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:35.952857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.256966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:36.265482 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28cb952c-7af1-40d0-b311-0f068d07e78e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.338967 Dec 25 21:19:36.266019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1978/3826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:35 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:36.280065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:36.281108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:36.287199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.287662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.288467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.288947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.336207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb4b7e8b-b18a-4bbb-9c5d-a5be9b0dfb3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060109 Dec 25 21:19:36.337104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1979/3827] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:36 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:36.341901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:36.342606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:36.349455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.349952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.350719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.351165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.588797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:36.596820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e84a47dd-a4e9-4b58-a06f-5a6d09284638 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.258624 Dec 25 21:19:36.606736 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1980/3828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:36 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:36.675917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a4b8fa2-5cef-4abd-8094-1c10d180e9ae tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:36.676494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2a4b8fa2-5cef-4abd-8094-1c10d180e9ae tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] [instance: e70cdcbb-0b4b-491d-bf2b-547cd13f8809] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:36.684218 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2a4b8fa2-5cef-4abd-8094-1c10d180e9ae tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] HTTP exception thrown: Instance e70cdcbb-0b4b-491d-bf2b-547cd13f8809 could not be found. Dec 25 21:19:36.685082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a4b8fa2-5cef-4abd-8094-1c10d180e9ae tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Returning 404 to user: Instance e70cdcbb-0b4b-491d-bf2b-547cd13f8809 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:36.686083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a4b8fa2-5cef-4abd-8094-1c10d180e9ae tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/e70cdcbb-0b4b-491d-bf2b-547cd13f8809/action" status: 404 len: 111 microversion: 2.1 time: 0.087339 Dec 25 21:19:36.686871 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1981/3829] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:36 2021] POST /compute/v2.1/servers/e70cdcbb-0b4b-491d-bf2b-547cd13f8809/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:36.691514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:36.695817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:36.704330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.704973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.705922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.706411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.797976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:36.807502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30e4b8bf-d24d-4572-b1f6-281826ab5e2c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 200 len: 1294 microversion: 2.1 time: 0.119342 Dec 25 21:19:36.808080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1982/3830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:36 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 1294 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:36.814003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f68bf8c6-b372-4121-8956-d895be3b4a8f req-60946a30-435b-487e-8bcb-0d523478b2cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f8bfda-0dfb-4159-89b2-bf30653ddcb2", "name": "network-vif-plugged", "status": "completed", "tag": "468e4b8e-2b46-4578-81eb-d2bfd34de1bb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:36.816095 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:36.816095 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:36.825005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f68bf8c6-b372-4121-8956-d895be3b4a8f req-60946a30-435b-487e-8bcb-0d523478b2cb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.825639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f68bf8c6-b372-4121-8956-d895be3b4a8f req-60946a30-435b-487e-8bcb-0d523478b2cb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.838601 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f68bf8c6-b372-4121-8956-d895be3b4a8f req-60946a30-435b-487e-8bcb-0d523478b2cb service nova] Creating event network-vif-plugged:468e4b8e-2b46-4578-81eb-d2bfd34de1bb for instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 on nch2-master-1 Dec 25 21:19:36.844333 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f68bf8c6-b372-4121-8956-d895be3b4a8f req-60946a30-435b-487e-8bcb-0d523478b2cb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033892 Dec 25 21:19:36.844988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1983/3831] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:36.850192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:36.850881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:36.858387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.858856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:36.859673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:36.860279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.103029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:37.112679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-412d64a2-3f02-4239-aed6-9b99d2b011d7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.266472 Dec 25 21:19:37.116700 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1984/3832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:36 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:37.137452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-500832f1-ba66-43e8-96fe-b02440aef093 req-291dccd8-ccd4-4beb-af48-30051da487e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1dcb2aa4-3186-4c62-a704-70ced44d42ca", "name": "network-vif-deleted", "tag": "596692a1-86ae-4ad5-865e-d9310e0fd70e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:37.139172 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:37.139172 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:37.149657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-500832f1-ba66-43e8-96fe-b02440aef093 req-291dccd8-ccd4-4beb-af48-30051da487e2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.150340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-500832f1-ba66-43e8-96fe-b02440aef093 req-291dccd8-ccd4-4beb-af48-30051da487e2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.172615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-500832f1-ba66-43e8-96fe-b02440aef093 req-291dccd8-ccd4-4beb-af48-30051da487e2 service nova] Creating event network-vif-deleted:596692a1-86ae-4ad5-865e-d9310e0fd70e for instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca on nch2-master-1 Dec 25 21:19:37.179416 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-500832f1-ba66-43e8-96fe-b02440aef093 req-291dccd8-ccd4-4beb-af48-30051da487e2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045489 Dec 25 21:19:37.183135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1985/3833] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:37.186793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-321641838", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:37.246692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:37.601555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:37.604895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:37.604895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:37.604895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:37.604895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:37.610800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:37.611352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:37.612046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:37.612512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:37.613040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:37.613283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.613731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.614540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.614976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.623017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.623508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.627799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.627799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.632891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Getting quotas for project d4571ece0fa3450b83fde221178518c8. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:37.638602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Getting quotas for user a85842dabc3d4a219d28c154e36c293c and project d4571ece0fa3450b83fde221178518c8. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:37.642268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Getting quotas for project 0ecfd75e0530430eaad8f0531a3a5244. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:37.647666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Getting quotas for user 8c034f7076e74d55a96b99bebf22a343 and project 0ecfd75e0530430eaad8f0531a3a5244. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:37.661696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:37.664540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:37.809781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:37.812670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a5c1ad6f-a4c5-4f08-a59c-fa1afed02065',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='801c9bae-0e8c-4c69-99a2-93bfda7668af',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15822ef8-a596-47a7-bea5-391cbe2651d7',volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:37.840108 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d909e0f-c514-4612-8e8d-cc7f6c695676 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658114 Dec 25 21:19:37.841124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1986/3834] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:19:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:19:37.846001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:37.846697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:37.853414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.854047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:37.855012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:37.855456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.002390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:38.010616 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-378403b5-ff95-4d0b-89dd-0d6ffb7fddf0 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.168336 Dec 25 21:19:38.011198 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1987/3835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:37 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:38.016278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:38.017298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.025199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.025663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.026454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.026941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.069788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7a7dbc2-7773-41de-bbb0-2af58b504dea tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.056772 Dec 25 21:19:38.070471 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1988/3836] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:38 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:38.075862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:38.076562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.083510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.083963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.084743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.085220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.234106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:38.241922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4040fed8-0741-479a-887b-987ec68c0551 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.170326 Dec 25 21:19:38.242514 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1989/3837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:38 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:38.247463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:38.248134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.262040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.262040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.262040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.262040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.394420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:38.401959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90da3a68-7cec-4a1e-a7b5-91ff8555febb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.158510 Dec 25 21:19:38.404547 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1990/3838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:38 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:38.414952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:38.419857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.421898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.422353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.423145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.423588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.437851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca could not be found. Dec 25 21:19:38.438449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:38.439279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4bb11fc9-93a9-41d5-bc0d-863745385c63 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 404 len: 111 microversion: 2.1 time: 0.033785 Dec 25 21:19:38.439830 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1991/3839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:38 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:38.445408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7b7703b-5128-4086-b2aa-f19c51db1ba4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:38.445408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7b7703b-5128-4086-b2aa-f19c51db1ba4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.494670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7b7703b-5128-4086-b2aa-f19c51db1ba4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:38.501909 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7b7703b-5128-4086-b2aa-f19c51db1ba4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1221 microversion: 2.1 time: 0.061039 Dec 25 21:19:38.507073 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1992/3840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:38 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1221 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:38.507073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:38.507326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.512976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.513378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.514161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.514604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.663324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:38.671951 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28fc60de-45f0-4a93-8d46-5e7a7f874ba8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1364 microversion: 2.1 time: 0.168559 Dec 25 21:19:38.672585 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1993/3841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:38 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:38.677711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1690190798"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:38.679090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:38.686032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.686032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:38.686615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:38.687094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.164741 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4af7ab0f-8741-4c80-8988-ff06aed62416 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 4.874991 Dec 25 21:19:39.165631 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1849/3842] 10.222.0.32 () {62 vars in 1188 bytes} [Sat Dec 25 21:19:34 2021] POST /compute/v2.1/servers => generated 405 bytes in 4877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:19:39.170411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.171029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.178880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.179321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.180146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.180584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.207941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:39.208523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a38becd-6172-4592-88e1-47744d8333c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.534642 Dec 25 21:19:39.210080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1994/3843] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:38 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Dec 25 21:19:39.228854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.228854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.235546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.236142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.237065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.238310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.407069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.418447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-988233c9-4cdb-4ca0-9956-d5097c1c498f tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.203778 Dec 25 21:19:39.418447 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1995/3844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:39.421234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:39.422200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.429393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.429854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.430636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.431080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.471315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e5fec2e9-13ea-43aa-bf11-2aeb536c564b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.053965 Dec 25 21:19:39.471998 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1996/3845] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:39 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:39.477024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e7bd735-69e8-4f67-8bb5-3df856724032 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.477712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e7bd735-69e8-4f67-8bb5-3df856724032 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.534470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e7bd735-69e8-4f67-8bb5-3df856724032 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.542372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e7bd735-69e8-4f67-8bb5-3df856724032 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.545028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e7bd735-69e8-4f67-8bb5-3df856724032 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.546858 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e7bd735-69e8-4f67-8bb5-3df856724032 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1286 microversion: 2.42 time: 0.073423 Dec 25 21:19:39.547908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1997/3846] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:39.565763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.566367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.575544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.578074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.578074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.578074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.719551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.727326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-988fe964-33d6-46be-b121-e773b3a609d4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.176886 Dec 25 21:19:39.728083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1998/3847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:39.730285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d87c8cf5-c236-41a2-891f-0d7c2309414e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 204 len: 0 microversion: 2.1 time: 0.563102 Dec 25 21:19:39.730994 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1850/3848] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:39 2021] DELETE /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:39.736301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.737022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.741852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.742473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.743224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.743675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.744458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.744923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.748342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.759772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.759772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.759772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.830708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.839060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8e2d4c4-3355-4561-b949-bb10c6f6c4e8 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1273 microversion: 2.1 time: 0.106890 Dec 25 21:19:39.849714 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1851/3849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:39.853242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.858105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.860261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.860754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.861609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.862055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.907463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:39.915082 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0b3974dc-31c1-4268-a23c-ef749f7df88c tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.176803 Dec 25 21:19:39.915658 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 1999/3850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:39.924868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:39.924868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:39.927118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.927573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:39.928362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:39.928795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.049083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.057013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95e2f65a-c287-41fa-977c-286a7946f26c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1549 microversion: 2.1 time: 0.215336 Dec 25 21:19:40.057590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1852/3851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1549 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:40.075626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:40.076158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:40.086252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.087558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.087882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.088326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.119048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.127808 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a65089f-4858-491f-b616-96bb3bab5c20 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1497 microversion: 2.1 time: 0.211024 Dec 25 21:19:40.128397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2000/3852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:39 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:40.180023 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-548a443e-15ec-447e-babe-bd68a78d4dc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108816 Dec 25 21:19:40.180636 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1853/3853] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:19:40 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:19:40.435431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:40.436252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:40.443301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.445436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.445436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.445436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.484335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:40.485368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:40.495094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.497982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.499116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.499556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.548396 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f81f0a0-a502-4061-9d26-7977dd7b77b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069768 Dec 25 21:19:40.552004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1854/3854] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:40 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:40.568440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3950534-f19a-4abc-9e71-352f18203fa1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:40.572711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3950534-f19a-4abc-9e71-352f18203fa1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:40.679700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3950534-f19a-4abc-9e71-352f18203fa1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.689291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3950534-f19a-4abc-9e71-352f18203fa1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.690497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3950534-f19a-4abc-9e71-352f18203fa1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.691801 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3950534-f19a-4abc-9e71-352f18203fa1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1286 microversion: 2.42 time: 0.127872 Dec 25 21:19:40.692564 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1855/3855] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:40 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:40.745053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:40.745677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:40.751918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.760502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de71b74d-d2a6-4d28-bba5-0c5618bb0049 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.330489 Dec 25 21:19:40.761122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2001/3856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:40 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:40.773799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.774254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.775083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.775690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.857194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:40.857992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:40.864123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.864571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.865382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:40.865820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:40.986443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.992214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:40.994610 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-38a9ee2b-83cb-46d7-b59d-85f2a29cde58 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1279 microversion: 2.1 time: 0.142169 Dec 25 21:19:40.995366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2002/3857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:40 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:40.999945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:41.000237 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d49f37a-3011-480b-9a4e-2a684f476b6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.259038 Dec 25 21:19:41.001186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:41.006992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1856/3858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:40 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:41.007412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.010173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.010173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.010173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.145806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:41.146625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:41.154288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.168499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.169471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.169932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.436283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:41.450330 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be02b82a-7db7-41e6-8bc0-9103e3819136 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.454092 Dec 25 21:19:41.451107 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2003/3859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:40 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:41.560916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:41.562461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:41.569517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.570624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.570830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.571219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.615372 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a43f76ff-0797-4a99-90c3-c26f525b9bec tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058790 Dec 25 21:19:41.616676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2004/3860] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:41 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:41.637533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:41.645894 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a51d1f8f-e73d-46f3-89b4-74b91e62be3e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1497 microversion: 2.1 time: 0.503913 Dec 25 21:19:41.655040 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1857/3861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:41 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1497 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:41.711524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:41.712476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:41.720474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.721079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.721997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.722540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.777775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:41.778346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:41.785711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.786172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:41.787218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:41.787711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.107798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:42.118220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:42.119843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:42.122040 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7515c418-8e2e-4fec-9338-8fd6fc20c3f5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1576 microversion: 2.42 time: 0.414779 Dec 25 21:19:42.123315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2005/3862] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:41 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1576 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:42.128564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:42.129570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:42.144498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.145600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.146826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.147484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.667056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:42.681395 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-642dafd8-38b1-415f-968a-1b2ca1330616 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.907300 Dec 25 21:19:42.687206 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1858/3863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:41 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:42.693411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:42.696580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:42.708082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.708986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.710387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.711743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.795467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:42.803317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e5c268b-732f-4b6b-8507-b93d0b1c4234 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1321 microversion: 2.1 time: 0.678086 Dec 25 21:19:42.803921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2006/3864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:42 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1321 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:42.818023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-bbcf7f2b-3784-4782-8ae8-105f5b7aa845 req-b7cb6920-d059-491e-95d9-aba7c0184bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9012c6-d4d3-4575-bc3c-7cabf98171e2", "tag": "73f7190f-617f-419d-8f40-aa6aad25bf15"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:42.824509 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:42.824509 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:42.832241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bbcf7f2b-3784-4782-8ae8-105f5b7aa845 req-b7cb6920-d059-491e-95d9-aba7c0184bda service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.833460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bbcf7f2b-3784-4782-8ae8-105f5b7aa845 req-b7cb6920-d059-491e-95d9-aba7c0184bda service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.847660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bbcf7f2b-3784-4782-8ae8-105f5b7aa845 req-b7cb6920-d059-491e-95d9-aba7c0184bda service nova] Creating event network-changed:73f7190f-617f-419d-8f40-aa6aad25bf15 for instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 on nch2-master-1 Dec 25 21:19:42.853513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-bbcf7f2b-3784-4782-8ae8-105f5b7aa845 req-b7cb6920-d059-491e-95d9-aba7c0184bda service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039036 Dec 25 21:19:42.858242 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2007/3865] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:42.863709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:42.864612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:42.871403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.872061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:42.873061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:42.873688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.194071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:43.207880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20dfa9a2-85bc-4fe3-806b-b1e62478f06b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1686 microversion: 2.1 time: 0.520946 Dec 25 21:19:43.212509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1859/3866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:42 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1686 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:43.223205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:43.225717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:43.260507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.264400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.268401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.279536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.331338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:43.339346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-17d552c9-9ac2-4725-84c6-eeefc67897f5 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.479574 Dec 25 21:19:43.351706 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2008/3867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:42 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:43.356813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3a4625e3-3c3d-4fc8-9e68-e7997447f104 req-baf80c52-b0a2-4fbe-8632-0df3da2c9c9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f8bfda-0dfb-4159-89b2-bf30653ddcb2", "tag": "468e4b8e-2b46-4578-81eb-d2bfd34de1bb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:43.364714 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:43.364714 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:43.374393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3a4625e3-3c3d-4fc8-9e68-e7997447f104 req-baf80c52-b0a2-4fbe-8632-0df3da2c9c9a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.379192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3a4625e3-3c3d-4fc8-9e68-e7997447f104 req-baf80c52-b0a2-4fbe-8632-0df3da2c9c9a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.390397 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e510808a-6d1c-4961-ad21-6f0d6cca45a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 14 microversion: 2.1 time: 0.176379 Dec 25 21:19:43.390795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3a4625e3-3c3d-4fc8-9e68-e7997447f104 req-baf80c52-b0a2-4fbe-8632-0df3da2c9c9a service nova] Creating event network-changed:468e4b8e-2b46-4578-81eb-d2bfd34de1bb for instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 on nch2-master-1 Dec 25 21:19:43.391706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1860/3868] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:43 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:43.400769 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3a4625e3-3c3d-4fc8-9e68-e7997447f104 req-baf80c52-b0a2-4fbe-8632-0df3da2c9c9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047573 Dec 25 21:19:43.403674 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2009/3869] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:43.409070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:43.417324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:43.431015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:43.431490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.432239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.434818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.435506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.436920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:43.479343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.483615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.484812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.486430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.560911 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bac8778f-11f9-42bc-a157-401b30430d54 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.167704 Dec 25 21:19:43.566065 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1861/3870] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:43 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:43.577249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9f9b9076-c83f-42e2-bd47-50c961fc236d req-0a245880-7757-41e0-98cf-2ed5466163a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:43.577950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:43.584332 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:43.584332 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:43.591972 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bdd80795-e5b0-4e89-b973-ba3776094437 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1455 microversion: 2.1 time: 0.181196 Dec 25 21:19:43.592746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2010/3871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:43 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1455 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:43.598098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9f9b9076-c83f-42e2-bd47-50c961fc236d req-0a245880-7757-41e0-98cf-2ed5466163a1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.598706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9f9b9076-c83f-42e2-bd47-50c961fc236d req-0a245880-7757-41e0-98cf-2ed5466163a1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.603763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:43.604584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:43.617762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.622801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.624159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.624812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.638512 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9f9b9076-c83f-42e2-bd47-50c961fc236d req-0a245880-7757-41e0-98cf-2ed5466163a1 service nova] Creating event network-vif-unplugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:19:43.653387 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9f9b9076-c83f-42e2-bd47-50c961fc236d req-0a245880-7757-41e0-98cf-2ed5466163a1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084691 Dec 25 21:19:43.654578 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1862/3872] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:43 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:43.711155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:43.712135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:43.730736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.731207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.732037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.754420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.912274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:43.933916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:43.935461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:43.939374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0eae4014-c614-40d4-a409-0c3ebdc6d2b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1594 microversion: 2.42 time: 0.345317 Dec 25 21:19:43.940734 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2011/3873] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:43 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1594 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:43.946184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:43.946975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:43.953858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.954038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:43.955191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:43.955646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:44.443295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:44.457152 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46abdb56-d1c3-4785-8438-67fa91436e5b tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.759789 Dec 25 21:19:44.458327 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1863/3874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:43 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:44.463096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:44.486667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:44.502922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:44.504434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:44.510975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:44.510975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:44.689333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:44.704114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c452d43a-045b-4734-b26d-fe387f828f02 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1321 microversion: 2.1 time: 0.761945 Dec 25 21:19:44.716441 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2012/3875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:43 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1321 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:44.719310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:44.719963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:44.738039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:44.739006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:44.740486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:44.741323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.021118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:45.030880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1fbf3155-7951-410c-9781-6a64ea578526 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.571232 Dec 25 21:19:45.040766 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1864/3876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:44 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:45.040766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:45.040766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:45.049985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.050461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.051439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.054921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.151965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56b2a784-5984-44e3-bc9e-fcbaebe71cf8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 14 microversion: 2.1 time: 0.117932 Dec 25 21:19:45.153689 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1865/3877] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:45 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 14 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:45.162326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:45.163359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:45.179389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.180111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.181238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.181893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.186846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:45.198810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b97c750-c096-4e86-877c-4bfd681d7501 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.488883 Dec 25 21:19:45.199950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2013/3878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:44 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:45.209200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:45.209970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:45.227023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.227622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.228463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.228933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.279039 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ea7bfd4-87da-48f9-a124-f73f771351c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.122036 Dec 25 21:19:45.280479 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1866/3879] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:45 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:45.283178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.283838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.284465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lazy-loading 'fault' on Instance uuid 1246c4c7-a769-4e4e-9a42-2138119611b8 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:19:45.288006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:45.289066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:45.297927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.298797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.299735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.300940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.444083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:45.454347 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e45a34ea-5c46-4b0b-8adc-434d96c4b220 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 200 len: 1299 microversion: 2.1 time: 0.252671 Dec 25 21:19:45.463745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2014/3880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:45 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:45.470967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fa4a4f81-4f3d-44f0-af69-47ccac0c5730 req-367e9242-3318-4985-9408-d1c10cc9529b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1246c4c7-a769-4e4e-9a42-2138119611b8", "name": "network-vif-deleted", "tag": "ae3f3cc3-d73b-4b19-ae8d-52d95e61449e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:45.488064 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:45.488064 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:19:45.513023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fa4a4f81-4f3d-44f0-af69-47ccac0c5730 req-367e9242-3318-4985-9408-d1c10cc9529b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.515026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fa4a4f81-4f3d-44f0-af69-47ccac0c5730 req-367e9242-3318-4985-9408-d1c10cc9529b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.552688 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fa4a4f81-4f3d-44f0-af69-47ccac0c5730 req-367e9242-3318-4985-9408-d1c10cc9529b service nova] Creating event network-vif-deleted:ae3f3cc3-d73b-4b19-ae8d-52d95e61449e for instance 1246c4c7-a769-4e4e-9a42-2138119611b8 on nch1-master-1 Dec 25 21:19:45.585837 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fa4a4f81-4f3d-44f0-af69-47ccac0c5730 req-367e9242-3318-4985-9408-d1c10cc9529b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122798 Dec 25 21:19:45.587381 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2015/3881] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:45.616155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:45.619243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:45.645404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.646681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.648380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:45.649767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:45.939709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:45.993251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:46.010228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:46.012676 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e373be7-2b29-499b-9421-451e43ad7656 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1661 microversion: 2.42 time: 0.730220 Dec 25 21:19:46.026525 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1867/3882] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:45 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1661 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:46.063419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:46.065083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:46.089228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.092272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.096533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.097627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.327579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:46.343677 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea06d3c8-6f0c-4dbd-827d-e83b179edd2e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.749489 Dec 25 21:19:46.344560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2016/3883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:45 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:46.349369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:46.366109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:46.373196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.373956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.375085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.375839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.534192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:46.555614 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e75767c-38f3-45bc-b814-a960adceb916 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1321 microversion: 2.1 time: 0.519154 Dec 25 21:19:46.565051 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1868/3884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:46 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:46.569026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:46.570428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:46.583193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.584469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.585391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.585843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.630305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:46.637906 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-169b1f97-38dd-4aec-b698-401249adadd5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 14 microversion: 2.1 time: 0.079881 Dec 25 21:19:46.639676 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1869/3885] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:46 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:46.641588 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c85c8301-8630-4172-9d65-33413a246ac6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.295580 Dec 25 21:19:46.651360 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2017/3886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:46 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:46.651360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:46.651360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:46.655350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.655869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.662380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.663641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:46.664319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:46.665212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.671362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.671820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.672619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.673105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.737377 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f69698b0-1e87-4cd9-af3c-a574ebeffe82 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.093066 Dec 25 21:19:46.741208 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2018/3887] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:46 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:46.751625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:46.752340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:46.769730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.770189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.771086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:46.771431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:46.799378 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 1246c4c7-a769-4e4e-9a42-2138119611b8 could not be found. Dec 25 21:19:46.799757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 1246c4c7-a769-4e4e-9a42-2138119611b8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:46.800619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a58ebb4a-9cc2-4415-b10a-a10db91afe0a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 404 len: 111 microversion: 2.1 time: 0.060092 Dec 25 21:19:46.809019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2019/3888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:46 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:46.928343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-17783857", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:46.952787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:46.969943 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2fa6b12e-87ec-431b-b2f9-721706360737 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1485 microversion: 2.1 time: 0.328691 Dec 25 21:19:46.970621 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1870/3889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:46 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1485 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:47.007455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6ec1faf4-bb5c-4490-a3e2-cd396b593b46 req-11520417-d10e-441b-819e-4b0f804fb87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-plugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:47.012135 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:47.012135 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:47.017705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6ec1faf4-bb5c-4490-a3e2-cd396b593b46 req-11520417-d10e-441b-819e-4b0f804fb87d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:47.018247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6ec1faf4-bb5c-4490-a3e2-cd396b593b46 req-11520417-d10e-441b-819e-4b0f804fb87d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:47.035458 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6ec1faf4-bb5c-4490-a3e2-cd396b593b46 req-11520417-d10e-441b-819e-4b0f804fb87d service nova] Creating event network-vif-plugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:19:47.039138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:19:47.049062 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6ec1faf4-bb5c-4490-a3e2-cd396b593b46 req-11520417-d10e-441b-819e-4b0f804fb87d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055568 Dec 25 21:19:47.053959 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1871/3890] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:47.061703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:47.062544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:47.069567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:47.070362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:47.076275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:47.076951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:47.380356 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36ddfffc-c89a-4fa4-9c21-3bfe224eb049 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "POST /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be/action" status: 202 len: 0 microversion: 2.1 time: 0.324511 Dec 25 21:19:47.381941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1872/3891] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:47 2021] POST /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:47.394956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:47.397026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:47.408850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:47.409975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:47.411246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:47.412028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:48.245859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:48.265747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:48.268452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:48.273856 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-667b970d-a578-4f59-80e6-cf5536213ec0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1661 microversion: 2.42 time: 0.890317 Dec 25 21:19:48.285727 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1873/3892] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:47 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1661 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:48.285727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:48.285727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:48.304172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:48.305043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:48.306091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:48.306747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:48.778721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:48.792843 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94833262-0650-4e41-b392-13f48dd350ee tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.512517 Dec 25 21:19:48.802467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1874/3893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:48 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:48.807257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:48.807905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:48.828679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:48.829183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:48.830000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:48.830452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:48.965874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:19:48.967365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:19:48.968417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:19:48.969208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:19:48.969944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:19:48.982122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:48.982865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:48.983927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:48.984537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.007804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:19:49.014810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:19:49.030503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:19:49.034389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:19:49.216006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:49.225212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b538f60c-7849-4134-9bbf-28b9dd1bc2cc tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1493 microversion: 2.1 time: 0.421524 Dec 25 21:19:49.225805 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1875/3894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:48 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1493 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:49.231170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:49.231777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.237944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.238327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.239130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.239563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.329468 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23454d29-63b4-4c4a-8129-a66551c71bb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.404452 Dec 25 21:19:49.330315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2020/3895] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:19:46 2021] POST /compute/v2.1/servers => generated 380 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:19:49.343050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:49.344089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.353695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.356238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.356238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.356238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.410222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8be4a61c-39c6-46a7-aac9-a80ec9b4739c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 14 microversion: 2.1 time: 0.071470 Dec 25 21:19:49.413919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2021/3896] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:49 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:49.418120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:49.418120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.427022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.427603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.428961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.429249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.576803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:49.601942 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f86cf488-65a5-4ff9-b6eb-5940c7440fae tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1321 microversion: 2.1 time: 0.374559 Dec 25 21:19:49.602568 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1876/3897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:49 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:49.608246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:49.609266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.616181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.616645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.617479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.618094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.672509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:49.680916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e928762d-50ea-44bd-9595-33ebf5033ba4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.077020 Dec 25 21:19:49.682000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1877/3898] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:49 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:49.682318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abfb1a08-1a81-4ef5-8160-f14ba9df60c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.269818 Dec 25 21:19:49.685241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2022/3899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:49 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:49.696726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:49.697948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.698100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0768e637-42cc-4788-a783-bd233fcf615b req-d04acd62-4ae2-417f-83ab-5d53b4e0ed39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9012c6-d4d3-4575-bc3c-7cabf98171e2", "name": "network-vif-plugged", "status": "completed", "tag": "73f7190f-617f-419d-8f40-aa6aad25bf15"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:49.703398 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:49.703398 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:49.711922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.712391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.713250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.713700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.722701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0768e637-42cc-4788-a783-bd233fcf615b req-d04acd62-4ae2-417f-83ab-5d53b4e0ed39 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.723169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0768e637-42cc-4788-a783-bd233fcf615b req-d04acd62-4ae2-417f-83ab-5d53b4e0ed39 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.736687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0768e637-42cc-4788-a783-bd233fcf615b req-d04acd62-4ae2-417f-83ab-5d53b4e0ed39 service nova] Creating event network-vif-plugged:73f7190f-617f-419d-8f40-aa6aad25bf15 for instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 on nch2-master-1 Dec 25 21:19:49.744070 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0768e637-42cc-4788-a783-bd233fcf615b req-d04acd62-4ae2-417f-83ab-5d53b4e0ed39 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059683 Dec 25 21:19:49.745444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1878/3900] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:49.756995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6355f86c-ea45-4f3e-9ba7-5c43f525754b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:49.758222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6355f86c-ea45-4f3e-9ba7-5c43f525754b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.891835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6355f86c-ea45-4f3e-9ba7-5c43f525754b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:49.899445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6355f86c-ea45-4f3e-9ba7-5c43f525754b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1207 microversion: 2.1 time: 0.152523 Dec 25 21:19:49.900007 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1879/3901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:49 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1207 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:49.904579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:49.905229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:49.912191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.912646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:49.913480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:49.913918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.227655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:50.239071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:50.240618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:50.241819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f250592e-d3bb-4971-a8b8-f1e3c2ba88f2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1695 microversion: 2.42 time: 0.555398 Dec 25 21:19:50.253920 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2023/3902] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:49 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1695 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:50.253920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:50.253920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:50.258359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.258824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.259623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.260065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.269102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:50.277504 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-496334bf-3374-459b-b7b8-0a86b408231d tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.376451 Dec 25 21:19:50.278166 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1880/3903] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:49 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:50.421924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:50.423808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:50.430383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.430836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.431753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.432210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.482606 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5512b029-c738-48d3-824e-7eae20f7a379 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 14 microversion: 2.1 time: 0.064914 Dec 25 21:19:50.483607 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1881/3904] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:50 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:19:50.507748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:50.516048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37406f4c-e844-49b7-9ee3-f8aeed4014c7 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1493 microversion: 2.1 time: 0.272682 Dec 25 21:19:50.516852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2024/3905] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:50 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1493 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:50.648736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:50.649553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:50.664768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.669702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.672405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.678606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.693630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:50.697011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:50.708799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.710846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.711851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.715086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.777998 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c479149e-1c03-4e05-a1e8-245358b23c72 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.085666 Dec 25 21:19:50.779431 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2025/3906] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:50 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:19:50.788095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:50.789600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:50.804605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.805870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.806904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:50.808018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:50.982120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:50.989872 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4cb64d62-1297-4ba2-a514-29490bac6773 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1321 microversion: 2.1 time: 0.345267 Dec 25 21:19:50.991234 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1882/3907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:50 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:50.996655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:50.997931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:51.011934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.012720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.013767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.014421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.149973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:51.185815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb2fc4cc-ad82-4412-9355-bd285e8d88ab tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1211 microversion: 2.1 time: 0.192102 Dec 25 21:19:51.190059 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1883/3908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:50 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1211 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:51.261944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:51.263143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:51.273455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.274644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.275707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.276560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.303136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:51.311551 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be5dd66c-7225-4b72-9cc3-81bd33e94c2e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.530632 Dec 25 21:19:51.312161 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2026/3909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:50 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:51.317779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:51.318434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:51.326859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.327326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.328143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.328596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.585313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:51.594785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:51.596334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:51.597529 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30944da8-9006-4d9b-949c-ab4a55d1f14d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1741 microversion: 2.42 time: 0.339926 Dec 25 21:19:51.608387 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1884/3910] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:51 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:19:51.658974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:51.660703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:51.668144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.668825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.669691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.670135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.720045 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ef0db32-803c-4f27-984c-9fbd2764c754 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 14 microversion: 2.1 time: 0.117388 Dec 25 21:19:51.724389 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1885/3911] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:51 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:19:51.729188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:51.730663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:51.737844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.738330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.739111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.739554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.781174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:51.791987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1237fcdc-1a58-4718-9db6-102b736c2ce3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.478763 Dec 25 21:19:51.808910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2027/3912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:51 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:51.808910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:51.818331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:51.822176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.822639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.826131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:51.826554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:51.884148 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-019488a9-e07e-4f96-8c18-44ded67041a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.082860 Dec 25 21:19:51.885249 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2028/3913] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:51 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:52.007507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:52.013085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:52.043421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.044286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.053922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.056049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.056730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:52.072371 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e202a57f-0518-47b4-9a92-090c33537ade tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1499 microversion: 2.1 time: 0.347701 Dec 25 21:19:52.075302 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1886/3914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:51 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1499 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:52.093975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:52.097029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:52.101136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.101805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.102870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.103533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.140620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:52.426168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:52.434312 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5270631a-77f4-4423-a815-0263230ba5b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1471 microversion: 2.1 time: 0.430839 Dec 25 21:19:52.435106 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2029/3915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:52 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1471 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:52.457880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:52.458521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:52.472645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.473137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.473951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.474518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.484623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5792a3f0-ccd4-4bba-afd9-e002dc3ec45a tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 204 len: 0 microversion: 2.1 time: 0.393457 Dec 25 21:19:52.489719 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1887/3916] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:52 2021] DELETE /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:52.490809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:52.491617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:52.507488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.507977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.508805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.509411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.584204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:52.598043 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0caed2a1-c447-4fa6-9540-860abaf5ad5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1267 microversion: 2.1 time: 0.144427 Dec 25 21:19:52.599987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2030/3917] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:52 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:52.612315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:52.613195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:52.630411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.631119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.633826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:52.634445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:52.691850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lazy-loading 'flavor' on Instance uuid 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:19:53.187241 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3f9aba1b-e2c8-4dda-94b4-a14635ca2b76 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2/action" status: 202 len: 0 microversion: 2.1 time: 0.585351 Dec 25 21:19:53.189198 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2031/3918] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:52 2021] POST /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:19:53.209404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:53.213222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:53.222687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.223485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.224600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.225285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.570069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:53.609229 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-76181364-38d2-4e31-a04f-730778363ad7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 1.121698 Dec 25 21:19:53.610789 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1888/3919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:52 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:53.622686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:53.623565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:53.636448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.637586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.638503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.638919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.771037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:53.789821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f90eba48-f15a-4ecf-96ba-0c3d9eb77b33 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.599125 Dec 25 21:19:53.792517 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2032/3920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:53 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:53.797772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:53.799427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:53.807512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.825781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.830050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.830987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.911018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc9e5c26-79dc-489f-b8ec-8fbc8724d828 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 16399 microversion: 2.1 time: 0.116665 Dec 25 21:19:53.916627 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2033/3921] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:53 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 16399 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:53.924217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:53.925339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:53.947017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.962734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:53.974575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:53.975782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.147060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:54.159519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:54.161093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:54.162722 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-025a414e-1d91-43ae-bbbb-caca3d937a61 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1787 microversion: 2.42 time: 0.550136 Dec 25 21:19:54.163311 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1889/3922] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:53 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1787 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:54.176297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:54.183633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:54.187048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.187505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.188504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.188967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.265116 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b60fd40-9e42-4f10-9452-c0206ebb52a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.100258 Dec 25 21:19:54.266472 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1890/3923] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:54 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:54.272326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:54.273079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:54.280215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.280676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.281795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.282227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.607268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:54.615770 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8fec4d0-3e7b-4e27-b216-af9f54ce5bbe tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1512 microversion: 2.1 time: 0.697521 Dec 25 21:19:54.616868 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2034/3924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:53 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:54.622332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:54.622332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:54.629808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.633380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.633380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.633380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.774229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:54.786014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36f1aa23-c799-473a-a377-054faf11c4da tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1265 microversion: 2.1 time: 0.168507 Dec 25 21:19:54.789540 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2035/3925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:54 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:54.805676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:54.806618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:54.818656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.819473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:54.820434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:54.821204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:55.385198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:55.398815 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fe858a4-8609-4439-9e12-227b495df60f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.606038 Dec 25 21:19:55.409068 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2036/3926] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:54 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:55.429684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:55.433771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:55.447433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:55.447989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:55.449750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:55.450268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:55.677491 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f980a9a-e0d6-4df8-9cfb-e1f3fc823990 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1613 microversion: 2.1 time: 1.404279 Dec 25 21:19:55.679902 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1891/3927] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:54 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1613 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:55.699488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:55.701329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:55.721879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:55.723115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:55.725860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:55.728728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:55.792643 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c8d60fd-f1fb-44bd-92bb-ba0c545887fc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 16399 microversion: 2.1 time: 0.107885 Dec 25 21:19:55.793364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1892/3928] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:55 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 16399 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:55.802317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:55.803249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:55.823568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:55.829543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:55.829543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:55.829543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.445641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:56.456021 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36bca0da-e21c-4fc3-8a53-eb4d037ebb9b tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 1.054190 Dec 25 21:19:56.457320 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2037/3929] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:55 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:56.462034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:56.463305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:56.470219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.472761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.472761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.472761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.528292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df4728b7-095d-434b-a13f-0fd46176a78f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069568 Dec 25 21:19:56.529115 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2038/3930] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:56 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:56.534535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:56.535347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:56.544964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.544964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.545825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.546364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.746007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:56.756184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:56.758237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:56.759614 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43decf4f-5064-4d3e-b3c1-5c3fe9f837ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1833 microversion: 2.42 time: 0.964838 Dec 25 21:19:56.777811 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1893/3931] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:55 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1833 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:56.784140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:56.785287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:56.793211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.794172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.795346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.795838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.847149 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] HTTP exception thrown: Cannot 'migrate' instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 while it is in vm_state suspended Dec 25 21:19:56.847987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Returning 409 to user: Cannot 'migrate' instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 while it is in vm_state suspended {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:56.849675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0839660b-da86-4ca1-bbb2-a0c33910831f tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2/action" status: 409 len: 148 microversion: 2.1 time: 0.069620 Dec 25 21:19:56.852339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1894/3932] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:56 2021] POST /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2/action => generated 148 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:19:56.861970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:56.865723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:56.870587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.871296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:56.872328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:56.873008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.132597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:57.142277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0ab0a94-a9f2-4f88-81a9-1bd5a02e33c2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1489 microversion: 2.1 time: 0.611790 Dec 25 21:19:57.147623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2039/3933] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:56 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1489 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:57.156675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:57.157341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:57.164325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.165045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.166010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.167346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.430585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:57.444691 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a634a98-6a8f-4f4f-ab32-208661f9451e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.590476 Dec 25 21:19:57.455086 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1895/3934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:56 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:57.455086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:57.455086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:57.460473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.461119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.462017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.462697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.509584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9a68115-5ead-4739-840a-c2ebad08ad7c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 16399 microversion: 2.1 time: 0.062179 Dec 25 21:19:57.510414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1896/3935] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:57 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 16399 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:57.516797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14d99726-5dd7-4b5e-baad-69461476db92 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:57.518125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14d99726-5dd7-4b5e-baad-69461476db92 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:57.519172 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14d99726-5dd7-4b5e-baad-69461476db92 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42/action" status: 400 len: 144 microversion: 2.1 time: 0.006544 Dec 25 21:19:57.524160 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1897/3936] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:57 2021] POST /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42/action => generated 144 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:19:57.529067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:57.529767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:57.541101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.541738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.543351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.543881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.575909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:57.627249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:57.636730 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d320c79-ef07-4035-b285-1555e9c4337f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.486970 Dec 25 21:19:57.647380 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2040/3937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:57 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:57.652071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:57.652796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:57.659420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.659990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.660957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:57.662125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:57.927630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:57.938392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b954c51-9bc4-43fb-8da3-708ede8d0148 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 200 len: 1505 microversion: 2.1 time: 0.289882 Dec 25 21:19:57.953765 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3006753b-35c8-4ef7-9b74-373d0e8d6451 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 204 len: 0 microversion: 2.1 time: 0.427698 Dec 25 21:19:57.957633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1898/3938] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:57 2021] DELETE /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:57.977396 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2041/3939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:57 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:57.978746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7c04e68-df9e-4bb2-9ec7-90a74dcc0576 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:57.989602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7c04e68-df9e-4bb2-9ec7-90a74dcc0576 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:58.002117 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7c04e68-df9e-4bb2-9ec7-90a74dcc0576 tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42/action" status: 400 len: 120 microversion: 2.1 time: 0.042407 Dec 25 21:19:58.005394 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1899/3940] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:57 2021] POST /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42/action => generated 120 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:19:58.007483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:58.011191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.019898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:58.023458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.028041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.030328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.033216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.035243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.043402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.044413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.049555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.051742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.121807 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a51ca8e6-a8e7-4fce-bdbf-4353478ab947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.138977 Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2042/3941] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:57 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.182337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.422429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:58.431748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:58.433482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:58.434735 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ba6fa76-abc4-40fd-8943-70c1d0db80d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1833 microversion: 2.42 time: 0.427818 Dec 25 21:19:58.435567 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1900/3942] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:58 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1833 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:19:58.439837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4249e0b6-abc3-4695-a069-45eb559c144c tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:58.440757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4249e0b6-abc3-4695-a069-45eb559c144c tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Failed to fetch instance by id 999 {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:19:58.441304 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4249e0b6-abc3-4695-a069-45eb559c144c tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] HTTP exception thrown: Instance 999 could not be found. Dec 25 21:19:58.441868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4249e0b6-abc3-4695-a069-45eb559c144c tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:58.442663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4249e0b6-abc3-4695-a069-45eb559c144c tempest-ServersAdminNegativeTestJSON-1101065756 tempest-ServersAdminNegativeTestJSON-1101065756-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.006372 Dec 25 21:19:58.449644 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1901/3943] 10.222.0.32 () {60 vars in 1178 bytes} [Sat Dec 25 21:19:58 2021] POST /compute/v2.1/servers/999/action => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:19:58.454498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-cade62e5-62c5-4d6e-92a1-058ec5f58008 req-b735829c-2aa3-4e7d-8866-a659b6c69b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843046c2-4f29-489f-bce9-b4862b3636be", "name": "network-vif-deleted", "tag": "e7c63a15-3218-4c35-bfa1-ef91d39c458a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:58.456205 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:19:58.456205 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:19:58.465574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cade62e5-62c5-4d6e-92a1-058ec5f58008 req-b735829c-2aa3-4e7d-8866-a659b6c69b13 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.466021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cade62e5-62c5-4d6e-92a1-058ec5f58008 req-b735829c-2aa3-4e7d-8866-a659b6c69b13 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.466140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:58.474300 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd6914d2-c179-4425-97f5-b9aad623ec95 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1495 microversion: 2.1 time: 0.349713 Dec 25 21:19:58.476707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2043/3944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:58 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1495 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:58.481245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:58.481804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.484867 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-cade62e5-62c5-4d6e-92a1-058ec5f58008 req-b735829c-2aa3-4e7d-8866-a659b6c69b13 service nova] Creating event network-vif-deleted:e7c63a15-3218-4c35-bfa1-ef91d39c458a for instance 843046c2-4f29-489f-bce9-b4862b3636be on nch1-master-1 Dec 25 21:19:58.488129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.489104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.489435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.490109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.496818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-cade62e5-62c5-4d6e-92a1-058ec5f58008 req-b735829c-2aa3-4e7d-8866-a659b6c69b13 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045764 Dec 25 21:19:58.498692 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1902/3945] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:19:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:19:58.506443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:58.507541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.514823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.515656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.516625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.517315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.528890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:19:58.706431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:58.732033 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04465119-6949-42c9-a799-5cac61450ca1 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.229524 Dec 25 21:19:58.734494 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1903/3946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:58 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:58.757642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:58.759308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.774396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.774986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.775985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.776727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.844611 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-962099ba-0ad0-47c5-a6b9-44b49737db4a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.107527 Dec 25 21:19:58.848866 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1904/3947] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:58 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:58.851561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:58.857669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.866797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.867566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.868626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.869367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.922527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79b75ef4-2008-4489-b94a-84c839eeb2fd tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "DELETE /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 204 len: 0 microversion: 2.1 time: 0.444595 Dec 25 21:19:58.924238 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2044/3948] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:19:58 2021] DELETE /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:19:58.939074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:58.939789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:58.952644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.953145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:58.953990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:58.954597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.661786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:59.669915 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a8b3a74-a4b4-4059-b59e-3b7933aed6c7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1681 microversion: 2.1 time: 0.822432 Dec 25 21:19:59.684645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1905/3949] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:58 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1681 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:19:59.684645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:59.684645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 843046c2-4f29-489f-bce9-b4862b3636be] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:59.684645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.684645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.684645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.685416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.699367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] HTTP exception thrown: Instance 843046c2-4f29-489f-bce9-b4862b3636be could not be found. Dec 25 21:19:59.699968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Returning 404 to user: Instance 843046c2-4f29-489f-bce9-b4862b3636be could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:19:59.700812 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de191adc-ba39-46f9-9602-11e6ee20b506 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be" status: 404 len: 111 microversion: 2.1 time: 0.029415 Dec 25 21:19:59.701403 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1906/3950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:59 2021] GET /compute/v2.1/servers/843046c2-4f29-489f-bce9-b4862b3636be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:19:59.705940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:19:59.707032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:59.717108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.717567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.718382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.718822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.766590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa1991c9-9728-4b77-8163-5567459a6b12 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057654 Dec 25 21:19:59.766590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1907/3951] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:19:59 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:19:59.767429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:59.767985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:59.774758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.775233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.775978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.776455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.784464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:19:59.792978 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89df0a62-9835-4509-9e3b-be72d488c60e tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1468 microversion: 2.1 time: 0.864256 Dec 25 21:19:59.805504 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2045/3952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:58 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1468 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:19:59.805504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:19:59.805504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:19:59.809687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.810447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:19:59.811564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:19:59.812070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.289120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:00.300523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:00.302357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:00.303914 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5d8f39a-17fe-470f-8672-9222171469b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1833 microversion: 2.42 time: 0.540689 Dec 25 21:20:00.305016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1908/3953] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:19:59 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1833 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:00.310328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:00.311024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:00.318583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.319247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.320707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.321706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.348805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:20:00.351326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:00.362101 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-842f96f0-6792-40d4-9748-d6a650b069aa tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1495 microversion: 2.1 time: 0.567206 Dec 25 21:20:00.372405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2046/3954] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:19:59 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1495 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:00.377434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:00.378251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:00.385086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.393944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.393944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.393944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.705573 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-96ba33e5-d827-4457-9c64-35f373b30b04 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "DELETE /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 204 len: 0 microversion: 2.1 time: 0.398687 Dec 25 21:20:00.706791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1909/3955] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:00 2021] DELETE /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:20:00.716178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:00.717160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:00.740100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.740805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.749869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.750343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.780711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:00.803656 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18bcb76d-ebe6-4111-a4c4-311b7573687a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.419281 Dec 25 21:20:00.804356 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2047/3956] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:00 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:00.821920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a9aac53c-29de-403b-8b07-2239417eb406 req-d8748c2e-8712-4472-bc18-81c3f66dbfb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "714d5f5c-ef35-4c4a-8bb3-05dec010fd61", "tag": "3a19bd46-150e-4b0a-b87d-54e59821aacd"}, {"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "634d748d-c261-4855-913b-beb5992df4cb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:00.828244 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:00.828244 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:00.830498 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ebc15f9-e7bd-41f9-a4c0-714c3e0755f5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.119139 Dec 25 21:20:00.837333 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1910/3957] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:00 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:00.839103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a9aac53c-29de-403b-8b07-2239417eb406 req-d8748c2e-8712-4472-bc18-81c3f66dbfb5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.839662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a9aac53c-29de-403b-8b07-2239417eb406 req-d8748c2e-8712-4472-bc18-81c3f66dbfb5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.845929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:00.846662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:00.853641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.854104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.855594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.856050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.858322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a9aac53c-29de-403b-8b07-2239417eb406 req-d8748c2e-8712-4472-bc18-81c3f66dbfb5 service nova] Creating event network-changed:3a19bd46-150e-4b0a-b87d-54e59821aacd for instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 on nch1-master-1 Dec 25 21:20:00.859052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a9aac53c-29de-403b-8b07-2239417eb406 req-d8748c2e-8712-4472-bc18-81c3f66dbfb5 service nova] Creating event network-changed:634d748d-c261-4855-913b-beb5992df4cb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:00.872685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a9aac53c-29de-403b-8b07-2239417eb406 req-d8748c2e-8712-4472-bc18-81c3f66dbfb5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.053353 Dec 25 21:20:00.873986 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2048/3958] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:00 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:00.890114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:00.894109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:00.901258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.901713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:00.902619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:00.903223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.309098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:01.320213 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd2af5f1-4294-4d07-a859-34f4712af274 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.483516 Dec 25 21:20:01.321053 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1911/3959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:00 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:01.326010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:01.327154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:01.341610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.341610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.341610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.341610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.409507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:01.427283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-198434e3-374e-4799-957b-643b2f92ae67 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1492 microversion: 2.1 time: 0.548843 Dec 25 21:20:01.428368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be4ffa42-3880-421d-a230-babfeb944f1f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.104137 Dec 25 21:20:01.429822 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1912/3960] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:01 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:01.433100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2049/3961] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:00 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1492 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:01.444498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:01.445835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:01.453273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.457558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:01.463069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:01.463190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.463190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.467186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.476151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.477286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.479294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.481201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.674840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:01.687906 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68db0de0-6a94-4e75-a096-cfc62736d4f6 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1426 microversion: 2.1 time: 0.256136 Dec 25 21:20:01.691090 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1913/3962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:01 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1426 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:01.696103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:01.697258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:01.705023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.705837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:01.707536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:01.708180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.140362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.148489 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4c6701b-1f1d-4d38-afb0-b20bf895f1ad tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 200 len: 1287 microversion: 2.1 time: 0.455952 Dec 25 21:20:02.149672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1914/3963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:01 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 1287 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:02.154359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3b0833d4-1a0b-49d3-84e1-59d7b4e8fb35 req-2c75c430-bf13-433b-9b79-f723a2691da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9012c6-d4d3-4575-bc3c-7cabf98171e2", "name": "network-vif-deleted", "tag": "73f7190f-617f-419d-8f40-aa6aad25bf15"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:02.155949 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:02.155949 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:02.163286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3b0833d4-1a0b-49d3-84e1-59d7b4e8fb35 req-2c75c430-bf13-433b-9b79-f723a2691da5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.163740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3b0833d4-1a0b-49d3-84e1-59d7b4e8fb35 req-2c75c430-bf13-433b-9b79-f723a2691da5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.178734 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3b0833d4-1a0b-49d3-84e1-59d7b4e8fb35 req-2c75c430-bf13-433b-9b79-f723a2691da5 service nova] Creating event network-vif-deleted:73f7190f-617f-419d-8f40-aa6aad25bf15 for instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 on nch2-master-1 Dec 25 21:20:02.184190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3b0833d4-1a0b-49d3-84e1-59d7b4e8fb35 req-2c75c430-bf13-433b-9b79-f723a2691da5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033231 Dec 25 21:20:02.184826 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1915/3964] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:02.192733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:02.193483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:02.200318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.200777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.201598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.202047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.431444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.443062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.445218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.446585 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa152d67-0bf9-4051-a271-385e0742b84e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1854 microversion: 2.42 time: 1.012138 Dec 25 21:20:02.447248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2050/3965] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:01 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1854 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:02.453987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:02.455236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:02.462500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.463061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.463950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.464442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.511200 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a58e163c-7b87-49bc-81d4-b7b45e8901a8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.061071 Dec 25 21:20:02.519781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2051/3966] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:02 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:02.525470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:02.527341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:02.534532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.535307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.536204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.536847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.586242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0028f05a-8b28-4748-8c76-ead4fb9b3a8b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064662 Dec 25 21:20:02.589088 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2052/3967] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:02 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:02.596417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:02.597210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:02.605301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.605969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.606759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.607194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.677732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.685166 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-307c5c5f-1f93-4b0a-b132-4d07563e05f0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.496550 Dec 25 21:20:02.694467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1916/3968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:02 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:02.694467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:02.694467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:02.697137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.697600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.698407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.698853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.899367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.908767 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cc32c59-0657-495e-be3b-16f15f5cc1b4 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1492 microversion: 2.1 time: 0.317061 Dec 25 21:20:02.909393 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2053/3969] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:02 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1492 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:02.914240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:02.914847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:02.921388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.921841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.922622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.923325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.956296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.956758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:02.957288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lazy-loading 'fault' on Instance uuid 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:20:02.964218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:02.971973 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e74ec135-4cda-4a7b-a02a-ae2a2123288f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.284886 Dec 25 21:20:02.972568 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1917/3970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:02 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:02.977042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8f004203-ab8b-498f-b76e-1ef4f92d8958 req-b755eeff-c5e8-4547-9817-a78ac832b189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4de75a7-d672-42e2-b76c-476113efaa1c", "name": "network-vif-deleted", "tag": "3a34eced-5439-48d3-9513-deac24aff981"}, {"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "7d584498-0a66-4020-96ff-ac37bb6bf33e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:02.978660 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:02.978660 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:02.986689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8f004203-ab8b-498f-b76e-1ef4f92d8958 req-b755eeff-c5e8-4547-9817-a78ac832b189 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:02.987313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8f004203-ab8b-498f-b76e-1ef4f92d8958 req-b755eeff-c5e8-4547-9817-a78ac832b189 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:03.000634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8f004203-ab8b-498f-b76e-1ef4f92d8958 req-b755eeff-c5e8-4547-9817-a78ac832b189 service nova] Creating event network-vif-deleted:3a34eced-5439-48d3-9513-deac24aff981 for instance a4de75a7-d672-42e2-b76c-476113efaa1c on nch2-master-1 Dec 25 21:20:03.001410 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8f004203-ab8b-498f-b76e-1ef4f92d8958 req-b755eeff-c5e8-4547-9817-a78ac832b189 service nova] Creating event network-changed:7d584498-0a66-4020-96ff-ac37bb6bf33e for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:03.008384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:03.009384 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8f004203-ab8b-498f-b76e-1ef4f92d8958 req-b755eeff-c5e8-4547-9817-a78ac832b189 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.035180 Dec 25 21:20:03.010927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1918/3971] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:02 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:03.022320 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f03d704-1aec-48a5-9daa-ab8980736e20 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 200 len: 1311 microversion: 2.1 time: 0.107626 Dec 25 21:20:03.022320 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2054/3972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:02 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:03.171608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:03.177213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:03.182381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:03.183599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:03.184776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:03.185447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:03.205810 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance a4de75a7-d672-42e2-b76c-476113efaa1c could not be found. Dec 25 21:20:03.206384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance a4de75a7-d672-42e2-b76c-476113efaa1c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:03.207982 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9439314-025e-4ea0-864f-4670126add04 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 404 len: 111 microversion: 2.1 time: 0.045097 Dec 25 21:20:03.208933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1919/3973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:03 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:03.346015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1412723139", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2c732578-b39b-40c1-8a55-147e577043a0"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:03.414032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] validate_networks() for [('2c732578-b39b-40c1-8a55-147e577043a0', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:03.465832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:03.466372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:03.474341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:03.474795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:03.475598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:03.476279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:03.938733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:03.947821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:03.949404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:03.950571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-76b08e64-5aea-4403-89c9-942eaa99c12c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.488600 Dec 25 21:20:03.951135 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1920/3974] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:03 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:03.955777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:03.957393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:03.969202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:03.969702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:03.970475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:03.970925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.014625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3b3ea1e-2652-4943-88c3-e805dc332666 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.062066 Dec 25 21:20:04.015755 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1921/3975] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:03 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:04.025286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:04.026529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.047565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.048573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.049633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.054405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.128588 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5c3f818-718c-4365-9643-bc7621f18382 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.110082 Dec 25 21:20:04.133094 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1922/3976] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:04 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:04.143424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:04.144134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.151966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.152426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.153264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.153704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.275187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:04.275663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:04.275859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:04.276807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:04.277371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:04.289023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.289481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.290299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.290738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.320253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:04.325830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Getting quotas for user ed831822eb3542a88f70914466c36603 and project 8154e82a58434a60b677d150202a5312. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:04.377991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:04.381594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:04.399750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:04.408457 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a721f1ea-4d17-45e1-814b-240654265a7c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.273768 Dec 25 21:20:04.418273 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1923/3977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:04 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:04.423676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:04.424381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.430972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.431431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.432262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.432707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.502279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59c504bd6e654627a5d04f6e22be1b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0881f03bcb42b2af8fbbc9bd84ca78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:04.517096 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85aabedc-3ecf-4818-aa94-5aabb0513683 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 200 len: 1285 microversion: 2.1 time: 0.098093 Dec 25 21:20:04.517684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1924/3978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:04 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 1285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:04.527045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:04.527045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: 5b9012c6-d4d3-4575-bc3c-7cabf98171e2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.544315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.544995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.546116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.546879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.573792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] HTTP exception thrown: Instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 could not be found. Dec 25 21:20:04.574752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Returning 404 to user: Instance 5b9012c6-d4d3-4575-bc3c-7cabf98171e2 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:04.576101 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6226930f-2220-40f5-837a-5d12abb45941 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2" status: 404 len: 111 microversion: 2.1 time: 0.056720 Dec 25 21:20:04.579687 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1925/3979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:04 2021] GET /compute/v2.1/servers/5b9012c6-d4d3-4575-bc3c-7cabf98171e2 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:04.583715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-961e78d9-3046-48fb-99d1-feb5cb0bf37d req-60380fe9-dab9-4e8d-99d9-d3dbd836ebc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30bfda27-68a3-4a4a-bfd1-7749eaa3997c", "name": "network-vif-deleted", "tag": "d3b55372-6cc1-4847-8bab-b4a3a6aec2ff"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:04.602558 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:04.602558 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:04.612646 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1acb242-c80b-4fae-a5c8-40674199ada9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.274752 Dec 25 21:20:04.614052 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2055/3980] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:20:04.621320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:04.622170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.630744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-961e78d9-3046-48fb-99d1-feb5cb0bf37d req-60380fe9-dab9-4e8d-99d9-d3dbd836ebc2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.637347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-961e78d9-3046-48fb-99d1-feb5cb0bf37d req-60380fe9-dab9-4e8d-99d9-d3dbd836ebc2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.650709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.651703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.652755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.654148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.659599 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-961e78d9-3046-48fb-99d1-feb5cb0bf37d req-60380fe9-dab9-4e8d-99d9-d3dbd836ebc2 service nova] Creating event network-vif-deleted:d3b55372-6cc1-4847-8bab-b4a3a6aec2ff for instance 30bfda27-68a3-4a4a-bfd1-7749eaa3997c on nch2-master-1 Dec 25 21:20:04.668768 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-961e78d9-3046-48fb-99d1-feb5cb0bf37d req-60380fe9-dab9-4e8d-99d9-d3dbd836ebc2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090282 Dec 25 21:20:04.682820 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1926/3981] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:04.694802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-350c6c13-8513-4f17-9e60-e4d92803c632 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:04.699168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:20:04.703024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-350c6c13-8513-4f17-9e60-e4d92803c632 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-350c6c13-8513-4f17-9e60-e4d92803c632 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-350c6c13-8513-4f17-9e60-e4d92803c632 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1215 microversion: 2.1 time: 0.147694 Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1927/3982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:04 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f421cac9-efce-40b1-a885-beb73a385649 req-64ac3c80-430b-4a19-8cb3-51969dffa82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-unplugged", "status": "completed", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f421cac9-efce-40b1-a885-beb73a385649 req-64ac3c80-430b-4a19-8cb3-51969dffa82d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f421cac9-efce-40b1-a885-beb73a385649 req-64ac3c80-430b-4a19-8cb3-51969dffa82d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f421cac9-efce-40b1-a885-beb73a385649 req-64ac3c80-430b-4a19-8cb3-51969dffa82d service nova] Creating event network-vif-unplugged:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f421cac9-efce-40b1-a885-beb73a385649 req-64ac3c80-430b-4a19-8cb3-51969dffa82d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043636 Dec 25 21:20:04.934488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1928/3983] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:04 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:04.971976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:04.973359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:04.984036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.984572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:04.985665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:04.986254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.178973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:05.190564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:05.192297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:05.194475 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f39c4b2-4457-48e9-9439-e324392f7772 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.228280 Dec 25 21:20:05.195602 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1929/3984] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:04 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:05.203493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-92da291c-add4-46c9-b895-6b8787a9c44d req-0e6a24c1-2388-497a-9f5f-0afaf2f926cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "fd6aa216-385a-41e5-8c5e-3aae2253a5ab"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:05.212277 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:05.212277 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:05.215097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-92da291c-add4-46c9-b895-6b8787a9c44d req-0e6a24c1-2388-497a-9f5f-0afaf2f926cb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.215792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-92da291c-add4-46c9-b895-6b8787a9c44d req-0e6a24c1-2388-497a-9f5f-0afaf2f926cb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.229067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-92da291c-add4-46c9-b895-6b8787a9c44d req-0e6a24c1-2388-497a-9f5f-0afaf2f926cb service nova] Creating event network-changed:fd6aa216-385a-41e5-8c5e-3aae2253a5ab for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:05.245206 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-92da291c-add4-46c9-b895-6b8787a9c44d req-0e6a24c1-2388-497a-9f5f-0afaf2f926cb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047156 Dec 25 21:20:05.247005 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1930/3985] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:05.254085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:05.255300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.263511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.264109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.265549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.266092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.317361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d5c2c25-d724-4092-828d-bbd068b2a944 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "DELETE /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 204 len: 0 microversion: 2.1 time: 0.701133 Dec 25 21:20:05.329354 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b7bf494-e039-422f-a94a-4282c173cbfb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.068977 Dec 25 21:20:05.329354 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1931/3987] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:05 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:05.333727 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2056/3987] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:04 2021] DELETE /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:20:05.335763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:05.338089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.345088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:05.348830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.353765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.354361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.355900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.356945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.365127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.365880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.366908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.367724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.434872 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee24e25b-6646-4ae7-bb35-c4539d5eb511 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.106594 Dec 25 21:20:05.436958 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1932/3988] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:05 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:05.449978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:05.451175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.460232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.460691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.461601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.462178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.858422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:05.865968 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-47a2d6d9-be37-441c-9dff-8660720dd74c tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1478 microversion: 2.1 time: 0.530737 Dec 25 21:20:05.867006 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2057/3989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:05 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1478 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:05.874310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:05.875366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:05.877378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] [instance: 30bfda27-68a3-4a4a-bfd1-7749eaa3997c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.883343 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4bee505-e2dc-40c2-a010-e88362c6eadd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.440908 Dec 25 21:20:05.883926 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1933/3990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:05 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:05.891790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.896291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.897565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.898115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.915194 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] HTTP exception thrown: Instance 30bfda27-68a3-4a4a-bfd1-7749eaa3997c could not be found. Dec 25 21:20:05.915793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] Returning 404 to user: Instance 30bfda27-68a3-4a4a-bfd1-7749eaa3997c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:05.916665 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e1533fc-5a37-48fa-9c31-dad36cc0ac90 tempest-ServerRescueTestJSON-1336662106 tempest-ServerRescueTestJSON-1336662106-project] 10.222.0.32 "GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c" status: 404 len: 111 microversion: 2.1 time: 0.048544 Dec 25 21:20:05.917249 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2058/3991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:05 2021] GET /compute/v2.1/servers/30bfda27-68a3-4a4a-bfd1-7749eaa3997c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:05.938349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9bd2309c-8b53-4efe-8ddc-56734003d493 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:05.939301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9bd2309c-8b53-4efe-8ddc-56734003d493 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.982571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:05.983199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:05.989484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.989940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:05.990732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:05.991341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.004983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9bd2309c-8b53-4efe-8ddc-56734003d493 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:06.014040 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9bd2309c-8b53-4efe-8ddc-56734003d493 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1215 microversion: 2.1 time: 0.079409 Dec 25 21:20:06.014645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1934/3992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:05 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:06.214753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:06.215680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:06.222533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.223265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.224233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.224837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.451992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:06.460939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7efce376-eef3-44ce-9535-e76f094d1d68 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.482534 Dec 25 21:20:06.472797 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2059/3993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:05 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:06.478069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:06.479909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:06.487326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.487779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.488564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.489026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.545999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec202942-e296-4eef-bfd7-4fff94dd6646 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.071407 Dec 25 21:20:06.550175 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2060/3994] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:06 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:06.553014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:06.554655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:06.581661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:06.585941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:06.587962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:06.589744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d034efa8-1a2c-4973-88cb-050b85ec4797 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.380317 Dec 25 21:20:06.590632 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1935/3995] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:06 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:06.590939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.591557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.595318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.595771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.595885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:06.596759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:06.602892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.603571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.605131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.605740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.674785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-feeb8f7d-9a4e-4fe4-854f-b8618712c4a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.125062 Dec 25 21:20:06.677319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2061/3996] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:06 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:06.722833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6cbac890-d147-4c40-8abd-a118c6e0926a req-b7944e2f-c6b1-46bd-85cd-5d91ce52bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "8de83a8d-9b83-433c-af96-f34c522b12b1"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:06.724524 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:06.724524 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:06.734051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6cbac890-d147-4c40-8abd-a118c6e0926a req-b7944e2f-c6b1-46bd-85cd-5d91ce52bbcd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.734565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6cbac890-d147-4c40-8abd-a118c6e0926a req-b7944e2f-c6b1-46bd-85cd-5d91ce52bbcd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.747569 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6cbac890-d147-4c40-8abd-a118c6e0926a req-b7944e2f-c6b1-46bd-85cd-5d91ce52bbcd service nova] Creating event network-changed:8de83a8d-9b83-433c-af96-f34c522b12b1 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:06.754052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6cbac890-d147-4c40-8abd-a118c6e0926a req-b7944e2f-c6b1-46bd-85cd-5d91ce52bbcd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037508 Dec 25 21:20:06.761941 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2062/3997] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:20:06.877326 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c837da3e-b015-49f4-80d2-c0d82a7b5f47 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.284706 Dec 25 21:20:06.879350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1936/3998] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:06 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:06.888535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:06.889563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:06.900653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.901506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:06.902279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.903240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.904110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.904593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:06.923532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.927009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:06.929298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:06.929633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.496487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:07.510909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:07.516616 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a83c1c80-4d8e-4170-8202-a2967fd4cb3b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1478 microversion: 2.1 time: 0.624447 Dec 25 21:20:07.516616 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2063/3999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:06 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1478 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:07.522216 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-340345d7-73f4-4f36-8dfb-521def5c7e7e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1670 microversion: 2.1 time: 0.639025 Dec 25 21:20:07.523514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:07.528689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:07.535916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1937/4000] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:06 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1670 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:07.541110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.544911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.545046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:07.545046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:07.545500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.546321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.555534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.556464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.559381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.560167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.731967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:07.745388 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f8bf727c-7ba1-4076-9f63-ecfe7d6b53dc tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1275 microversion: 2.1 time: 0.206529 Dec 25 21:20:07.754903 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1938/4001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:07 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:07.754903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-705ced0c-e9fd-4e83-b674-f4352091f395 req-92816116-ae58-4edd-99ac-6f027d6567c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714d5f5c-ef35-4c4a-8bb3-05dec010fd61", "name": "network-vif-plugged", "status": "completed", "tag": "3a19bd46-150e-4b0a-b87d-54e59821aacd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:07.754903 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:07.754903 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:07.782192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-705ced0c-e9fd-4e83-b674-f4352091f395 req-92816116-ae58-4edd-99ac-6f027d6567c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.782192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-705ced0c-e9fd-4e83-b674-f4352091f395 req-92816116-ae58-4edd-99ac-6f027d6567c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.803578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-705ced0c-e9fd-4e83-b674-f4352091f395 req-92816116-ae58-4edd-99ac-6f027d6567c7 service nova] Creating event network-vif-plugged:3a19bd46-150e-4b0a-b87d-54e59821aacd for instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 on nch1-master-1 Dec 25 21:20:07.813929 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-705ced0c-e9fd-4e83-b674-f4352091f395 req-92816116-ae58-4edd-99ac-6f027d6567c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065180 Dec 25 21:20:07.815358 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1939/4002] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:07.833789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9c67460c-a5ef-49c3-bf87-8eea591b1bc4 req-95c9ba7d-106b-4970-b30e-2a9cd1d8baae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:07.833789 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:07.833789 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:07.845870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9c67460c-a5ef-49c3-bf87-8eea591b1bc4 req-95c9ba7d-106b-4970-b30e-2a9cd1d8baae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.846368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9c67460c-a5ef-49c3-bf87-8eea591b1bc4 req-95c9ba7d-106b-4970-b30e-2a9cd1d8baae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.873470 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9c67460c-a5ef-49c3-bf87-8eea591b1bc4 req-95c9ba7d-106b-4970-b30e-2a9cd1d8baae service nova] Creating event network-changed:2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:07.885283 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9c67460c-a5ef-49c3-bf87-8eea591b1bc4 req-95c9ba7d-106b-4970-b30e-2a9cd1d8baae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067194 Dec 25 21:20:07.886280 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1940/4003] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:07.894399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:07.896100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:07.906765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.909976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.909976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.909976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.952916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1a70389-4930-453a-823f-861b54c7d4ae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.064902 Dec 25 21:20:07.955007 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1941/4004] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:07 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:07.961988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:07.963001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:07.972162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.972548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:07.973762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:07.973895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.095627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:08.107083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b268933-c1e5-40e1-acd6-d7005f023fcf tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.588495 Dec 25 21:20:08.109405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2064/4005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:07 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:08.124841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:08.130596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:08.140499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.141485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.143207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.143888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.207882 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1aad0684-968f-4440-aba0-ce96942bd02d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.097535 Dec 25 21:20:08.212186 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2065/4006] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:08 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:08.532649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:08.534766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:08.544218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.544685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.545849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.546445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.888836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:08.901136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:08.903703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:08.905206 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7420032-b03d-4f87-ab1d-d70fad0f6382 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.948618 Dec 25 21:20:08.906014 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1942/4007] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:07 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:08.917449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:08.917449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:08.924022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:08.926709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.927345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.929497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.930110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.941488 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e980d48-374c-4c02-a176-3db54b3d3cf4 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1436 microversion: 2.1 time: 0.413407 Dec 25 21:20:08.942090 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2066/4008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:08 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1436 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:08.955071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:08.955693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:08.968685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.969081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:08.969894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:08.970328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.130972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:09.148728 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07d82b65-c425-44f0-9883-0078e966db94 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1273 microversion: 2.1 time: 0.205128 Dec 25 21:20:09.150343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2067/4009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:08 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:09.156322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f4e3ec8f-ec0a-433c-81e1-fd0b8eef5913 req-ec3ce964-4d31-4175-a4f2-6dca84ccf59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "9c0613e4-0268-4ae9-8585-76b021617ef8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:09.160769 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:09.160769 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:09.174315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f4e3ec8f-ec0a-433c-81e1-fd0b8eef5913 req-ec3ce964-4d31-4175-a4f2-6dca84ccf59a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.178305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f4e3ec8f-ec0a-433c-81e1-fd0b8eef5913 req-ec3ce964-4d31-4175-a4f2-6dca84ccf59a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.199971 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f4e3ec8f-ec0a-433c-81e1-fd0b8eef5913 req-ec3ce964-4d31-4175-a4f2-6dca84ccf59a service nova] Creating event network-changed:9c0613e4-0268-4ae9-8585-76b021617ef8 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:09.205884 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f4e3ec8f-ec0a-433c-81e1-fd0b8eef5913 req-ec3ce964-4d31-4175-a4f2-6dca84ccf59a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053979 Dec 25 21:20:09.208348 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2068/4010] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:09.219999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:09.223794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:09.232970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.234459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.235682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.236680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.298211 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-639f5ab7-c632-4e0e-bfe9-6aa46abf1fae tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.087474 Dec 25 21:20:09.299208 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2069/4011] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:09 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:09.306496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:09.308269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:09.315715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.316254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.317122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.320708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.454943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:09.467539 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5af6202e-8fa4-448a-a445-bee395a76f7d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1670 microversion: 2.1 time: 0.559865 Dec 25 21:20:09.468509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1943/4012] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:08 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1670 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:09.474396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:09.512148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:09.531947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.531947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.532138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.532844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.603208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9b9719e-8303-45ef-abd6-231e0888be59 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.133046 Dec 25 21:20:09.607808 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1944/4013] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:09 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:09.655297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:09.665810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1d6c5c4-a986-4c18-a0b2-c9dad990576f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1307 microversion: 2.1 time: 0.365105 Dec 25 21:20:09.681420 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2070/4014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:09 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1307 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:09.935150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:09.936029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9b2842a8-6d31-43b0-b661-d60788afe25d req-bbab9b2c-7d5b-451b-a434-479e73877b2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3eb3b9-51e6-4fb9-87e8-3122867c3a42", "name": "network-vif-deleted", "tag": "60d06ee7-b2a0-4b58-9871-903596124a14"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:09.937121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:09.942773 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:09.942773 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:09.970855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.975801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.975801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.975801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:09.977630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9b2842a8-6d31-43b0-b661-d60788afe25d req-bbab9b2c-7d5b-451b-a434-479e73877b2b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:09.979844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9b2842a8-6d31-43b0-b661-d60788afe25d req-bbab9b2c-7d5b-451b-a434-479e73877b2b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.001066 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9b2842a8-6d31-43b0-b661-d60788afe25d req-bbab9b2c-7d5b-451b-a434-479e73877b2b service nova] Creating event network-vif-deleted:60d06ee7-b2a0-4b58-9871-903596124a14 for instance dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 on nch2-master-1 Dec 25 21:20:10.006727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9b2842a8-6d31-43b0-b661-d60788afe25d req-bbab9b2c-7d5b-451b-a434-479e73877b2b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089620 Dec 25 21:20:10.007778 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1945/4015] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:20:10.013917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:10.015135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.023214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.024308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.024595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.025096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.070559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.071290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.086171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lazy-loading 'fault' on Instance uuid dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:20:10.232112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c034f7076e74d55a96b99bebf22a343', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ecfd75e0530430eaad8f0531a3a5244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.240013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e487d0b2-8030-4846-ba5f-a17596b94e8b tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 200 len: 1312 microversion: 2.1 time: 0.230857 Dec 25 21:20:10.240603 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1946/4016] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:10 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:10.250207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:10.254549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.272786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.280766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.280766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.280766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.399297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.409805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.411756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.413507 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f55e901e-c40f-4088-88ae-1cc9312a7477 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.492506 Dec 25 21:20:10.414316 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2071/4017] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:09 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:10.419580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:10.420976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.428220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.429026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.430044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.430676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.479292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81b8ba55-62df-42d5-b674-07b17b55c477 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.062895 Dec 25 21:20:10.482620 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2072/4018] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:10 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:10.489246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:10.491012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.502570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.503520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.503655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.507756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.509533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.511712 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-90720bcc-99d0-495b-9977-05bcd5238e63 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.270052 Dec 25 21:20:10.514803 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1947/4019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:10 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:10.622483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:10.623477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.635851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.638691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.641741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.642804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.719184 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ae701e6-e7d3-40fd-b147-9546a7059f93 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.106028 Dec 25 21:20:10.720250 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1948/4020] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:10 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:10.725539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:10.726504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.731317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.734662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.735124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.735990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.736435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.741207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87b1c5f7-8ce9-4e27-a229-697e6d20c0d2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.257189 Dec 25 21:20:10.754867 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2073/4021] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:10 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:10.760718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:10.762049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.769107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.770025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.770848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.771460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.825782 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c0b202e-1547-4018-b236-cf8aa26c6fea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 322 microversion: 2.1 time: 0.068882 Dec 25 21:20:10.826450 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2074/4022] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:10 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 322 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:20:10.836948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:10.837970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.846272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.846817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.847699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.848637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.893155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:10.904254 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52544fb9-060a-4d36-a1a7-71921d928b5a tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1489 microversion: 2.1 time: 0.182531 Dec 25 21:20:10.905175 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1949/4023] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:10 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1489 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:10.924006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:10.925215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:10.931893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.932333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:10.933167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:10.933674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.009545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.017907 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e5e5a55-a6e9-44da-b226-7efb90505977 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.185949 Dec 25 21:20:11.018503 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2075/4024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:10 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:11.038239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:11.038862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.046452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.047021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.048148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.048845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.093269 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-668e946b-3a49-4c92-b2d0-e3e7649db443 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "PUT /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1084 microversion: 2.1 time: 0.172656 Dec 25 21:20:11.094935 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1950/4025] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:20:10 2021] PUT /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1084 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:11.114145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:11.123006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.124378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.125267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.127208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.127894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.269671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.282995 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60b3ff2b-b59c-4329-a167-e7da2e977484 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.248345 Dec 25 21:20:11.283592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2076/4026] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:11 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:11.288818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3fdd67e8-3031-4e61-823f-bc4b695051f1 req-3ef27891-416f-4aa6-86be-1d7f1546e86d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "0daa1ac7-be03-4d72-b2a5-72b1ee145ecb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:11.290978 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:11.290978 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:11.313960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3fdd67e8-3031-4e61-823f-bc4b695051f1 req-3ef27891-416f-4aa6-86be-1d7f1546e86d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.317119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3fdd67e8-3031-4e61-823f-bc4b695051f1 req-3ef27891-416f-4aa6-86be-1d7f1546e86d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.345810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3fdd67e8-3031-4e61-823f-bc4b695051f1 req-3ef27891-416f-4aa6-86be-1d7f1546e86d service nova] Creating event network-changed:0daa1ac7-be03-4d72-b2a5-72b1ee145ecb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:11.368533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.368855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3fdd67e8-3031-4e61-823f-bc4b695051f1 req-3ef27891-416f-4aa6-86be-1d7f1546e86d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075963 Dec 25 21:20:11.368855 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2077/4027] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:11.370192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:11.372019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3432bd4d-d162-4d3b-8b39-cdd4241f5570 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1510 microversion: 2.1 time: 0.265800 Dec 25 21:20:11.373313 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1951/4028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:11 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1510 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:11.381842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] [instance: dd3eb3b9-51e6-4fb9-87e8-3122867c3a42] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.396308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:11.396308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.396754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.397494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.400273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.401672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.401833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.402439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.403960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.404552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.432153 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] HTTP exception thrown: Instance dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 could not be found. Dec 25 21:20:11.435078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] Returning 404 to user: Instance dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:11.436970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a9f73c1-f98a-4e41-bd01-d383af8652b2 tempest-ServersAdminNegativeTestJSON-1924497653 tempest-ServersAdminNegativeTestJSON-1924497653-project] 10.222.0.32 "GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42" status: 404 len: 111 microversion: 2.1 time: 0.071331 Dec 25 21:20:11.438475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2078/4029] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:11 2021] GET /compute/v2.1/servers/dd3eb3b9-51e6-4fb9-87e8-3122867c3a42 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:11.444059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:11.446662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.459925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.460385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.467969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.468470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.695000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.704381 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c7266ed-e633-4f82-adcd-fb56f1593ddc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1510 microversion: 2.1 time: 0.316139 Dec 25 21:20:11.705442 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1952/4030] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:11 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:11.710791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1116877659", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "050fe506-29b6-4536-b03a-6d4fd9d4993c"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:11.751174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.766759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.769602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] validate_networks() for [('050fe506-29b6-4536-b03a-6d4fd9d4993c', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:11.769732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:11.770328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7aedf18-1df4-4a04-a962-35d75932ab11 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.330282 Dec 25 21:20:11.771571 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2079/4031] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:11 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:11.776389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:11.777465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.789367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.789847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.794340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.794340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.846825 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-386b1b13-5e88-4535-8b6a-6a58ba09c6a7 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 24571 microversion: 2.1 time: 0.073628 Dec 25 21:20:11.847493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2080/4032] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:11 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:11.853067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:11.853798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:11.860677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.861160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:11.862343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:11.862959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.109932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:12.118278 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-876f2f86-7cc4-45d4-a721-2d31067fdb3a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.269288 Dec 25 21:20:12.120837 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2081/4033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:11 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:12.131734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:12.132543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:12.141626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.142374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.143377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.144016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.177180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:20:12.375722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:12.377032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:12.378260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:12.378873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:12.380062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:12.397965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.398915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.401154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.401828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.442683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:12.451596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:12.470599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:12.473491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:12.561094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-123880fb-dec9-4d27-ae09-a64ecd148514 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 204 len: 0 microversion: 2.1 time: 0.438553 Dec 25 21:20:12.565209 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2082/4034] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:12 2021] DELETE /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:20:12.570450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:12.571738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:12.579735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.580200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.581278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.581968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.604855 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75792a91-b378-4240-a982-536ddc2ac494 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.896306 Dec 25 21:20:12.606247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1953/4035] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:20:12.615015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:12.615949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:12.628326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.628326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.628326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.628326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.637496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c8fb855-ad2f-4f0c-bf0a-d0e0f2c057d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.072727 Dec 25 21:20:12.639930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2083/4036] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:12 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:12.645206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ff7c69d-180d-48b0-a7ff-d36766d74329 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:12.646276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ff7c69d-180d-48b0-a7ff-d36766d74329 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:12.763475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ff7c69d-180d-48b0-a7ff-d36766d74329 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:12.773386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ff7c69d-180d-48b0-a7ff-d36766d74329 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1215 microversion: 2.1 time: 0.131921 Dec 25 21:20:12.776829 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2084/4037] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:12 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1215 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:12.791057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:12.791779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:12.800812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.803792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:12.803792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:12.803792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.006788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:13.017043 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-17a74fac-f4b6-4367-9dc8-899c5c911f8c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1516 microversion: 2.1 time: 0.409482 Dec 25 21:20:13.018080 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1954/4038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:12 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1516 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:13.024162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:13.025165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:13.034209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.034800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.035464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.035911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.134386 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-608060dc-792d-4706-b2b9-de5cfdd851bb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.113848 Dec 25 21:20:13.137408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1955/4039] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:13 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:13.151813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:13.152623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:13.163007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.163687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.165171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.166010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.201382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:13.216829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:13.221101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:13.221101 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4021c82-a710-466a-9d5c-d1b8a710d162 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.433230 Dec 25 21:20:13.221101 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2085/4040] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:12 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:13.377183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d9c9db8d-b236-4815-a406-3126cebe7bff req-64f95a74-41f5-4186-b380-23d709e0db6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bc9caeb-6686-4332-99c6-4ec54e0549ce", "tag": "62c529f7-9fe3-4314-a727-f4d44e96de8d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:13.378949 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:13.378949 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:13.388581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d9c9db8d-b236-4815-a406-3126cebe7bff req-64f95a74-41f5-4186-b380-23d709e0db6a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.389384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d9c9db8d-b236-4815-a406-3126cebe7bff req-64f95a74-41f5-4186-b380-23d709e0db6a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.409478 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d9c9db8d-b236-4815-a406-3126cebe7bff req-64f95a74-41f5-4186-b380-23d709e0db6a service nova] Creating event network-changed:62c529f7-9fe3-4314-a727-f4d44e96de8d for instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce on nch2-master-1 Dec 25 21:20:13.414850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d9c9db8d-b236-4815-a406-3126cebe7bff req-64f95a74-41f5-4186-b380-23d709e0db6a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041467 Dec 25 21:20:13.416583 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2086/4041] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:20:13.422889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:13.446063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88492007-55ce-4634-aed0-13e9a1dd558c tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.306850 Dec 25 21:20:13.446917 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1956/4042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:13 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:13.650309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:13.651712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:13.672081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.674045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.675244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.675860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.729572 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b01e475-931e-4b0c-9ac2-baa90b9b9aac tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.083214 Dec 25 21:20:13.730770 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2087/4043] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:13 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:13.792028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:13.792645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:13.800541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.801026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.801861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:13.802302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:13.868290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:13.879003 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7b8b95d-283e-4628-8989-081a94fadfdf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1219 microversion: 2.1 time: 0.088893 Dec 25 21:20:13.879003 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1957/4044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:13 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:14.040209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:14.042805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:14.054001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.054660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.056790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.057502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.148532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:14.149488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:14.161784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.162659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.163678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.164275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.215323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7dc15eb-a0a6-457a-a9a4-99041411d244 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.070408 Dec 25 21:20:14.228500 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1958/4045] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:14 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:14.242177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:14.245042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:14.256175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.256994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.258152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.259017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.344713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:14.362850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a5482f6-47b6-432a-8780-19e1aa715e71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1516 microversion: 2.1 time: 0.330234 Dec 25 21:20:14.368568 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2088/4046] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:14 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1516 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:14.464154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:14.465167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:14.471575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.473522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.473522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.474043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.862984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:14.878640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:14.883924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:14.889016 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e5b8011-f6d9-41ff-99d5-41bb6d31cd55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.655399 Dec 25 21:20:14.891105 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1959/4047] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:14 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:14.906626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:14.907916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:14.927611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.930143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:14.931060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:14.931799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.001508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:15.011102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7c25e6c5-f73c-4728-8bed-4d3662c650a3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.549537 Dec 25 21:20:15.020374 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2089/4048] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:14 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:15.020374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:15.020374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:15.033313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.038283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.042040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.042643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.053527 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a990cf5-d03d-4ae4-a12b-905727373535 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.158324 Dec 25 21:20:15.059356 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1960/4049] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:14 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:15.061813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-069ced07-5014-47b6-ad88-7a626a3c5d19 req-0140f143-5c6f-4204-82a5-e0b315d16ba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "714d5f5c-ef35-4c4a-8bb3-05dec010fd61", "name": "network-vif-deleted", "tag": "3a19bd46-150e-4b0a-b87d-54e59821aacd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:15.068493 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:15.068493 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:15.096003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-069ced07-5014-47b6-ad88-7a626a3c5d19 req-0140f143-5c6f-4204-82a5-e0b315d16ba4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.098215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-069ced07-5014-47b6-ad88-7a626a3c5d19 req-0140f143-5c6f-4204-82a5-e0b315d16ba4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.113982 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-069ced07-5014-47b6-ad88-7a626a3c5d19 req-0140f143-5c6f-4204-82a5-e0b315d16ba4 service nova] Creating event network-vif-deleted:3a19bd46-150e-4b0a-b87d-54e59821aacd for instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 on nch1-master-1 Dec 25 21:20:15.126217 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-069ced07-5014-47b6-ad88-7a626a3c5d19 req-0140f143-5c6f-4204-82a5-e0b315d16ba4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068001 Dec 25 21:20:15.126217 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1961/4050] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:15.150732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:15.163099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a133e6a-1f6a-4f5c-a382-c16a7b4b1287 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1267 microversion: 2.1 time: 0.149921 Dec 25 21:20:15.165392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2090/4051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:15 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:15.231278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:15.232421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:15.238974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.239490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.240282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.241076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.301018 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1ee45d68-1671-4a83-b906-c132ec82e5b1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.074273 Dec 25 21:20:15.303064 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1962/4052] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:15 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:15.384642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:15.386425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:15.395284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.396034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.397246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.397876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.481600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:15.493921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-731cb3c5-9756-44ac-af92-ad4a0c3f8ea8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 200 len: 1313 microversion: 2.1 time: 0.113250 Dec 25 21:20:15.529828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2091/4053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:15 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 1313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:15.739720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1190858467", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:15.801880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:15.912508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:15.913824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:15.924058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.926329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:15.928330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:15.930057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.314850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:16.315924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:16.316508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:16.317145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:16.317561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:16.330595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.330595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.330595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.330595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.356239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:16.367044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Getting quotas for project d2b5edef5e3349c2bf221f47c5457b4f. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:16.372830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Getting quotas for user 17d7a8ba1616448f823d45787d82920f and project d2b5edef5e3349c2bf221f47c5457b4f. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:16.377392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:16.379235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:16.381905 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6544126d-de51-4d44-8462-97108a0ec8ed tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.476156 Dec 25 21:20:16.386035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2092/4054] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:15 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:16.387993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:16.390987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:16.392078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:16.402913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:16.410018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.410846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.412427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.413224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.526771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a2d65c8-bf9d-4a9e-a128-42c77e92559f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.942022 Dec 25 21:20:16.533379 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1963/4055] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:20:16.539203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:16.540599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:16.548055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.548758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.549747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.550337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.599233 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-611d46f1-42bb-450b-a86a-ccc3ce44bd19 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064209 Dec 25 21:20:16.605567 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1964/4056] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:16 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:16.617582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:16.621607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:16.633684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:16.641194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.641302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.642132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.642569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.648106 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b6274adf-18a8-47d0-951b-5878271fce6e tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.257530 Dec 25 21:20:16.648759 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2093/4057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:16 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:16.657919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:16.659304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:16.677416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.678364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.678930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.681338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.786247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8fab5b35-303d-4d49-bc4b-34c72023948d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.135603 Dec 25 21:20:16.787565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2094/4058] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:16 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:16.793448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d177e86-fcd6-4c6a-9ff1-6c3cbce39418 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:16.794333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d177e86-fcd6-4c6a-9ff1-6c3cbce39418 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:16.883277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6d177e86-fcd6-4c6a-9ff1-6c3cbce39418 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:16.892674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d177e86-fcd6-4c6a-9ff1-6c3cbce39418 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1216 microversion: 2.1 time: 0.103698 Dec 25 21:20:16.893923 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2095/4059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:16 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:16.899622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:16.901447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:16.910149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.910784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.911985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:16.912574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:16.937787 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 could not be found. Dec 25 21:20:16.938568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:16.939539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc47c344-c54e-42b4-916b-09ce6d6c47b0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 404 len: 111 microversion: 2.1 time: 0.043589 Dec 25 21:20:16.940345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2096/4060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:16 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:16.963938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:16.973151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70e48a5b-4005-4987-9906-8f1b75c6501c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.368201 Dec 25 21:20:16.973735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1965/4061] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:16 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:17.066908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1973032329", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de2cf5f5-0f83-4089-a263-5ec0a5e6f1de"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:17.155436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] validate_networks() for [('de2cf5f5-0f83-4089-a263-5ec0a5e6f1de', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:17.410102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:17.410818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:17.418541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.419083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.420207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.420723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.773988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:17.785135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:17.787008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:17.788990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ccab020-aa46-48d2-9a8c-0d3ee0407f30 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.382876 Dec 25 21:20:17.789667 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1966/4062] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:17 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:17.796512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:17.798035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:17.806459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.807174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.808092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.808635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.850275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e082df5-7388-40e1-94d1-f44371740558 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058336 Dec 25 21:20:17.851202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1967/4063] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:17 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:17.856228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:17.857148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:17.864387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.864845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.865666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.866105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.915788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:17.916287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:17.916753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:17.920792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:17.920792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:17.929177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.929843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.930790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:17.931238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:17.959033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:17.978378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Getting quotas for user 1d23db9414d34853ae04f7f032694f12 and project 38d7cbaffc1340f59e994569e8e33e1d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:18.000285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:18.003213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:18.135923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:18.143188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7fb92544-b5e6-4e6e-9b72-dbea898d22a8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.290623 Dec 25 21:20:18.143993 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1968/4064] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:17 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:18.149439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:18.150618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:18.170615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.171468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.172804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.174130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.180920 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-667be0a7-7fc9-4c92-9ede-4bb5338c908f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.116396 Dec 25 21:20:18.187885 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2097/4065] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:20:18.206225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:18.209817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:18.246860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.247327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.248155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.248601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.249495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74167cd6-0e70-4299-8690-53d9808d1e55 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.089303 Dec 25 21:20:18.251075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1969/4066] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:18 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:18.257933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:18.258805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:18.267307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.268003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.268988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.269580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.409750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:18.420458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dcb1c7fb-2a18-4e8f-ba41-3ffc972a836c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1220 microversion: 2.1 time: 0.229842 Dec 25 21:20:18.426944 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2098/4067] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:18 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1220 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:18.440145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa94a725-8d6c-4052-aafc-0018e66f3be2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:18.440927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa94a725-8d6c-4052-aafc-0018e66f3be2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:18.572707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fa94a725-8d6c-4052-aafc-0018e66f3be2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:18.587139 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa94a725-8d6c-4052-aafc-0018e66f3be2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1209 microversion: 2.1 time: 0.157931 Dec 25 21:20:18.588621 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2099/4068] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:18 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1209 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:18.596113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-cbdf9b43-1a69-4a03-9588-f0e7f036f16b req-2bd68f1c-080b-4c1c-872f-6603c435f3b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc9caeb-6686-4332-99c6-4ec54e0549ce", "name": "network-vif-plugged", "status": "completed", "tag": "62c529f7-9fe3-4314-a727-f4d44e96de8d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:18.598185 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:18.598185 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:18.609533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cbdf9b43-1a69-4a03-9588-f0e7f036f16b req-2bd68f1c-080b-4c1c-872f-6603c435f3b2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.610507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cbdf9b43-1a69-4a03-9588-f0e7f036f16b req-2bd68f1c-080b-4c1c-872f-6603c435f3b2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.643641 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cbdf9b43-1a69-4a03-9588-f0e7f036f16b req-2bd68f1c-080b-4c1c-872f-6603c435f3b2 service nova] Creating event network-vif-plugged:62c529f7-9fe3-4314-a727-f4d44e96de8d for instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce on nch2-master-1 Dec 25 21:20:18.662381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:18.671689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7b8c085-0516-4f0d-9503-8db2735e1e05 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.417907 Dec 25 21:20:18.672565 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1970/4069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:18 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:18.681318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-cbdf9b43-1a69-4a03-9588-f0e7f036f16b req-2bd68f1c-080b-4c1c-872f-6603c435f3b2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081737 Dec 25 21:20:18.681318 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2100/4070] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:18.687232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8cab0d58-179c-482b-8ee4-e89f2c2212a1 req-25621890-f649-435a-b6c8-ad70060782dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c440c6c-f195-45df-bc8f-62cfb0a36698", "tag": "815adaf6-6cd2-46df-a541-c0f11b539b22"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:18.689738 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:18.689738 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:18.700467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8cab0d58-179c-482b-8ee4-e89f2c2212a1 req-25621890-f649-435a-b6c8-ad70060782dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.701422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8cab0d58-179c-482b-8ee4-e89f2c2212a1 req-25621890-f649-435a-b6c8-ad70060782dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.716369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8cab0d58-179c-482b-8ee4-e89f2c2212a1 req-25621890-f649-435a-b6c8-ad70060782dc service nova] Creating event network-changed:815adaf6-6cd2-46df-a541-c0f11b539b22 for instance 8c440c6c-f195-45df-bc8f-62cfb0a36698 on nch1-master-1 Dec 25 21:20:18.729543 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8cab0d58-179c-482b-8ee4-e89f2c2212a1 req-25621890-f649-435a-b6c8-ad70060782dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055105 Dec 25 21:20:18.730554 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1971/4071] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:18.810541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:18.811656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:18.819206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.819863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.820832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.821975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.865323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:18.868181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:18.882775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.883259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.888440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:18.888944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:18.932119 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7bf1d326-0892-4c8a-b4ec-1ecb510c732f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.073464 Dec 25 21:20:18.933316 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1972/4072] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:18 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:19.078238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:19.089453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:19.091220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:19.092625 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8cead99a-cca7-49f3-8ad9-8f4888fd8478 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.286201 Dec 25 21:20:19.093215 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2101/4073] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:18 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:19.160367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:19.161284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:19.168556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.169040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.169836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.170357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.262289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:19.263679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:19.269884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.270701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.271662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.272104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.319749 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-979e7851-ce94-4c95-b0d2-4483fa1c2ea1 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.061338 Dec 25 21:20:19.321594 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2102/4074] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:19 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:19.414478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:19.423651 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9dc4d26-62f1-4db2-aa81-e37520337800 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1315 microversion: 2.1 time: 0.267562 Dec 25 21:20:19.424237 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1973/4075] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:19 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:19.443866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:19.444615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:19.464668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.465578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.466386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.466972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.567887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:19.576804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3cfb8f9f-ccb9-4ef2-938b-1a630fc5ce23 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1276 microversion: 2.1 time: 0.137005 Dec 25 21:20:19.586779 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2103/4076] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:19 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1276 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:19.606113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:19.611398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:19.629578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.630165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.631049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.632111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.689075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:19.689640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:19.696545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.697764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.700596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:19.700596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:19.989201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:19.998869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d58e655e-ca06-4643-a3fe-7cbf2a20bb28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1213 microversion: 2.1 time: 0.397545 Dec 25 21:20:20.009103 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1974/4077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:19 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1213 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:20.015673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:20.017078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:20.025488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.026379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.027590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.034834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.086654 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-91e7c1f5-d31a-4691-8280-7b8c22a0a02f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.075632 Dec 25 21:20:20.088201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1975/4078] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:20 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:20.111084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:20.112016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:20.130908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.132127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.133313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.133867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.218354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:20.226210 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-334d3714-0d26-43b1-af8a-b9c1e7ced4f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.541117 Dec 25 21:20:20.226787 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2104/4079] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:19 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:20.332024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:20.333088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:20.340147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.340758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.341641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.342371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.383351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6335f2b4-c41f-4e16-9c2d-15a315869277 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.055178 Dec 25 21:20:20.387534 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2105/4080] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:20 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:20.440469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:20.441383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:20.456332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.456959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.457967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.458568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.471933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:20.488043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:20.489942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:20.495261 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-150eebcd-fc76-4191-a9dd-bbe9acd33792 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.384369 Dec 25 21:20:20.495924 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1976/4081] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:20 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:20.595699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:20.596604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:20.614275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.614747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.615555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.616013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.772318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:20.786798 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-465eb2ea-da0d-4bed-b949-3d7445a5b58c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1274 microversion: 2.1 time: 0.194862 Dec 25 21:20:20.788386 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1977/4082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:20 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1274 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:20.832480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:20.840740 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f885707-4652-4d3e-92e4-65578a8e2996 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1502 microversion: 2.1 time: 0.404826 Dec 25 21:20:20.841865 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2106/4083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:20 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1502 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:20.857398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:20.858193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:20.864705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.865616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.867287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:20.867923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:20.895420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lazy-loading 'flavor' on Instance uuid 6bc9caeb-6686-4332-99c6-4ec54e0549ce {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:20:21.022941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:21.024521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.036420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.037226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.038369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.039724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.190114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:21.200078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41fded67-fdd9-49a9-97de-35491fa921e4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1269 microversion: 2.1 time: 0.182437 Dec 25 21:20:21.212122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2107/4084] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:21 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1269 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:21.217858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:21.219201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.239273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.240136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.241165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.241847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.289682 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-025e51bf-d7d7-4daf-89d1-20b12ffa48a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.075551 Dec 25 21:20:21.290503 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2108/4085] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:21 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:21.290622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ddf90d97-4b72-472d-be44-9943000f6e76 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "POST /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce/action" status: 202 len: 0 microversion: 2.1 time: 0.436809 Dec 25 21:20:21.291257 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1978/4086] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:20 2021] POST /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:21.302038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:21.303043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.305596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:21.307828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.311113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.311787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.312907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.313365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.324995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.329287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.331148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.332338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.642557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:21.650223 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23e5b649-79e3-427c-889c-e2959b5881d7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1510 microversion: 2.1 time: 0.353184 Dec 25 21:20:21.667618 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1979/4087] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:21 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1510 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:21.673881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:21.675069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.687695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.690548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.691669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.692342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.718633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:21.726740 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-581fa42a-197d-473b-81b0-0829289174f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.434881 Dec 25 21:20:21.736919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2109/4088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:21 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:21.742212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:21.742903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.749468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.749786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.750736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.751679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.754725 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e10e0e1-7992-43c7-90d2-81fed60bd246 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.085116 Dec 25 21:20:21.755395 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1980/4089] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:21 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:21.805083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:21.806267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:21.813589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.814346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:21.815238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:21.815683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.157982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:22.175268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:22.176839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:22.178123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42492bec-6f3b-4ace-8192-69986b58bb01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.440168 Dec 25 21:20:22.182420 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2110/4090] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:21 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:22.219226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:22.219871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:22.226249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.226923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.228054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.228685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.320758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:22.321508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:22.337370 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e33f526b-c64a-428e-8ac6-97ecc09d7629 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.536293 Dec 25 21:20:22.338146 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5445a528-c120-44a4-9e9a-be4a1a0ed17e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1267 microversion: 2.1 time: 0.121908 Dec 25 21:20:22.339577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2111/4091] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:22 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:22.342420 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1981/4092] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:21 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:22.353411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:22.354675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:22.362439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.363168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.364789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.365513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.447652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b88a1394-fe5d-48b9-a81e-93cca45b7231 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.106113 Dec 25 21:20:22.449925 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2112/4093] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:22 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:22.671979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:22.672967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:22.682142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.683519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.690201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.692344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.744422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:22.745149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:22.752853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.762452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:22.763400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:22.764086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.183856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:23.194047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d004475-72ee-437d-9d7e-e706fa9d17bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.454038 Dec 25 21:20:23.195101 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2113/4094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:22 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:23.205367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:23.209816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:23.211575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:23.218970 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-283ceee6-ac42-48c7-8cbf-3c34a04c36d8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1493 microversion: 2.1 time: 0.553014 Dec 25 21:20:23.218970 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1982/4095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:22 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1493 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:23.221321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.222335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.223348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.223558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:23.224221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.224333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:23.234332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.235324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.236528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.237244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.332765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4632cd67-9b98-4ca2-b930-ed2c6a9b030d tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.136203 Dec 25 21:20:23.334237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2114/4096] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:23 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:23.344283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:23.351329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:23.364697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.371889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.372899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.373374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.435104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:20:23.613653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:23.627310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:23.633683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:23.635595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-298c9a48-ab31-4cdd-b034-9b998712814a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.416595 Dec 25 21:20:23.639156 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1983/4097] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:23 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:23.651436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:23.662016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:23.671619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.672391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.678619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.679873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.801325 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5885890b-d3c0-40a2-9f95-3e203bad58f6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 204 len: 0 microversion: 2.1 time: 0.460640 Dec 25 21:20:23.802578 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2115/4098] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:23 2021] DELETE /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:20:23.808009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:23.809428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:23.829691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.831239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:23.832355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:23.835003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.128303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:24.149765 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4d3a642-e2e9-40a5-aa09-c6a691bd2cae tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.508999 Dec 25 21:20:24.150549 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1984/4099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:23 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:24.166132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:24.169791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:24.182872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.183332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.186484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.187201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.269901 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98d6be35-e8f0-4fb3-af3b-b188e8ae5701 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.118168 Dec 25 21:20:24.271535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1985/4100] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:24 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:24.289596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-344ca250-be36-4a27-a801-a0167fb2d526 req-4557cc5f-d533-491e-9f3e-aff5fe821fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb1b09d3-5625-472f-beea-2338a1ab5b4a", "tag": "06a6d407-75ff-436c-a36c-cd7f85e5face"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:24.292716 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:24.292716 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:24.293589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:24.304187 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aabb1091-c6f0-4eaa-ac79-4125c52b7cb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.500113 Dec 25 21:20:24.304807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2116/4101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:23 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:24.314722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:24.315203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-344ca250-be36-4a27-a801-a0167fb2d526 req-4557cc5f-d533-491e-9f3e-aff5fe821fb1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.315402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:24.316603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-344ca250-be36-4a27-a801-a0167fb2d526 req-4557cc5f-d533-491e-9f3e-aff5fe821fb1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.334747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.336180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.337525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.339259 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-344ca250-be36-4a27-a801-a0167fb2d526 req-4557cc5f-d533-491e-9f3e-aff5fe821fb1 service nova] Creating event network-changed:06a6d407-75ff-436c-a36c-cd7f85e5face for instance eb1b09d3-5625-472f-beea-2338a1ab5b4a on nch1-master-1 Dec 25 21:20:24.341743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.354053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-344ca250-be36-4a27-a801-a0167fb2d526 req-4557cc5f-d533-491e-9f3e-aff5fe821fb1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078755 Dec 25 21:20:24.356421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1986/4102] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:24.368488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:24.374226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:24.384695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.385747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.387553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.388165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.725111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:24.741764 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6bf944d-1a4a-4cd1-bc74-d179c2f6c590 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1499 microversion: 2.1 time: 0.430040 Dec 25 21:20:24.752187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2117/4103] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:24 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1499 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:24.755444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:24.756938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:24.781128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.781583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.785436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.785436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.817096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:24.823648 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b1b2854-b391-4f0d-9124-9e7089ae6e98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.464328 Dec 25 21:20:24.824239 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1987/4104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:24 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:24.839156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e879b08a-6e12-4e71-bf2f-c7fbbcc92f70 req-c727cbfa-14f1-432d-9cb7-136113e04931 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89ed46e1-4b7a-40ec-a9f8-923852705e90", "tag": "50029fbf-b328-4b5f-80c2-bcc4da3c4b96"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:24.842872 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:24.842872 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:24.848497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e879b08a-6e12-4e71-bf2f-c7fbbcc92f70 req-c727cbfa-14f1-432d-9cb7-136113e04931 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.849712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e879b08a-6e12-4e71-bf2f-c7fbbcc92f70 req-c727cbfa-14f1-432d-9cb7-136113e04931 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.865068 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d20a2ad3-a35d-4001-9d91-374f46ba67e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.107361 Dec 25 21:20:24.866166 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e879b08a-6e12-4e71-bf2f-c7fbbcc92f70 req-c727cbfa-14f1-432d-9cb7-136113e04931 service nova] Creating event network-changed:50029fbf-b328-4b5f-80c2-bcc4da3c4b96 for instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 on nch1-master-1 Dec 25 21:20:24.866680 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2118/4105] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:24 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:24.874410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:24.877181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e879b08a-6e12-4e71-bf2f-c7fbbcc92f70 req-c727cbfa-14f1-432d-9cb7-136113e04931 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040402 Dec 25 21:20:24.877412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:24.877495 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1988/4106] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:24.886449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.886998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:24.887873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:24.888460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.167358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:25.168083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:25.180345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:25.180797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.181687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:25.183889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.613554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:25.623748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:25.625783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:25.627244 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9334d82b-93ae-4759-adb8-6d9e106b33cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.759220 Dec 25 21:20:25.639394 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2119/4107] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:24 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:25.644381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:25.655197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:25.655197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:25.655197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.655197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:25.655197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.735583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9af6b2e6-62ef-4e6f-bdfa-b7fac2f00290 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.094349 Dec 25 21:20:25.739561 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2120/4108] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:25 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:25.750046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:25.787054 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c681302-013f-4fbf-9007-1af288932c9f tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.623770 Dec 25 21:20:25.791257 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1989/4109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:25 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:25.803922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:25.807423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:25.819641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:25.820281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.820898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:25.821628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:25.981120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-717010764", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5e3e14c1-fa4f-4065-b9e3-19dd5f8f11c3"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:26.050074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] validate_networks() for [('5e3e14c1-fa4f-4065-b9e3-19dd5f8f11c3', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:26.105209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:26.114376 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-124f52d4-7a1a-4b4c-a479-56204b39d7cd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.320790 Dec 25 21:20:26.115317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1990/4110] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:25 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:26.131837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:26.132056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:26.139675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.140235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.141308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.142056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.442704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:26.451461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65ebb0d7-0a8a-411f-8677-68f57bdcbea8 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1499 microversion: 2.1 time: 0.323829 Dec 25 21:20:26.452354 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1991/4111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:26 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1499 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:26.458613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:26.459534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:26.470735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.471314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.473412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.473412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.737219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:26.748710 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8363ad4b-a88b-4424-a2c3-d2be4de45378 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.295024 Dec 25 21:20:26.749565 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1992/4112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:26 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:26.754317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:26.755292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:26.762468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.765926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:26.769732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:26.769732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:26.769732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:26.769732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:26.770222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.771823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.772265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.783970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.784420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.786833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.787280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.808096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Getting quotas for project bfd1b67368c34701bcdc20105e48ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:26.813707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Getting quotas for user 7ec911a0e281430f98062b734b3d4de3 and project bfd1b67368c34701bcdc20105e48ad41. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:26.828132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:26.830652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:26.839394 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-866f75cc-822d-4610-b5ca-69300cd74c38 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.088509 Dec 25 21:20:26.840314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1993/4113] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:26 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:26.845885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:26.846682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:26.853948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.854390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.855249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.855947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.967276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e7143ee-1d4b-4347-892a-f0a69a99cc02 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.229130 Dec 25 21:20:26.968135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2121/4114] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:25 2021] POST /compute/v2.1/servers => generated 383 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:20:26.975368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:26.976448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:26.983449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.983901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:26.985533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:26.985977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.037129 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43539192-2765-4650-83a3-ae6a5d380371 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.066534 Dec 25 21:20:27.038563 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2122/4115] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:26 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:27.044243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:27.044971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:27.054090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.054315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.055119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.055563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.099123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.108655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.110222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.111401 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db634948-b536-4ed4-85d9-48ee35091cbf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.269766 Dec 25 21:20:27.112609 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1994/4116] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:26 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:27.131178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d6603016-9cd4-436d-a135-3b65e8f50256 req-e62d3234-d9d0-4b48-b477-e4268c33b947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bc9caeb-6686-4332-99c6-4ec54e0549ce", "name": "network-vif-deleted", "tag": "62c529f7-9fe3-4314-a727-f4d44e96de8d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:27.135521 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:27.135521 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:27.153623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d6603016-9cd4-436d-a135-3b65e8f50256 req-e62d3234-d9d0-4b48-b477-e4268c33b947 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.154075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d6603016-9cd4-436d-a135-3b65e8f50256 req-e62d3234-d9d0-4b48-b477-e4268c33b947 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.183460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d6603016-9cd4-436d-a135-3b65e8f50256 req-e62d3234-d9d0-4b48-b477-e4268c33b947 service nova] Creating event network-vif-deleted:62c529f7-9fe3-4314-a727-f4d44e96de8d for instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce on nch2-master-1 Dec 25 21:20:27.188431 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d6603016-9cd4-436d-a135-3b65e8f50256 req-e62d3234-d9d0-4b48-b477-e4268c33b947 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074932 Dec 25 21:20:27.193262 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1995/4117] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:27.194466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b42503bb-93e0-4cb5-a051-3fb00ae2df08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:27.195170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b42503bb-93e0-4cb5-a051-3fb00ae2df08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:27.270153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b42503bb-93e0-4cb5-a051-3fb00ae2df08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.277646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b42503bb-93e0-4cb5-a051-3fb00ae2df08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1222 microversion: 2.1 time: 0.086955 Dec 25 21:20:27.278500 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1996/4118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:27 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:27.283846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:27.284535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:27.290854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.291394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.292261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.292811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.297303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.305072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba41e6ee-0ef4-4fd6-9623-a213dfcfd0ce tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.265596 Dec 25 21:20:27.307575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2123/4119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:27 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:27.446711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.454413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7104ce91-d04b-4ba3-b2c5-d5d5050a35ea tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.174103 Dec 25 21:20:27.455091 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1997/4120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:27 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:27.467588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:27.468204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:27.474770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.475219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.476001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.476443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.510656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.511113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.511567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lazy-loading 'fault' on Instance uuid 6bc9caeb-6686-4332-99c6-4ec54e0549ce {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:20:27.573483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed831822eb3542a88f70914466c36603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8154e82a58434a60b677d150202a5312', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:27.581645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e444dce3-6f3e-4e47-83a4-07eaddb76b02 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 200 len: 1305 microversion: 2.1 time: 0.117916 Dec 25 21:20:27.582404 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2124/4121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:27 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:27.757713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3143a14e-07c3-42e9-bf56-41756bd87229 req-8d455af2-2215-4954-a28b-b495dfa0c57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c440c6c-f195-45df-bc8f-62cfb0a36698", "name": "network-vif-plugged", "status": "completed", "tag": "815adaf6-6cd2-46df-a541-c0f11b539b22"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:27.759547 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:27.759547 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:27.765529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:27.767168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:27.768812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3143a14e-07c3-42e9-bf56-41756bd87229 req-8d455af2-2215-4954-a28b-b495dfa0c57b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.769446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3143a14e-07c3-42e9-bf56-41756bd87229 req-8d455af2-2215-4954-a28b-b495dfa0c57b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.775735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.776648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.778716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.779684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.784512 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3143a14e-07c3-42e9-bf56-41756bd87229 req-8d455af2-2215-4954-a28b-b495dfa0c57b service nova] Creating event network-vif-plugged:815adaf6-6cd2-46df-a541-c0f11b539b22 for instance 8c440c6c-f195-45df-bc8f-62cfb0a36698 on nch1-master-1 Dec 25 21:20:27.790053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3143a14e-07c3-42e9-bf56-41756bd87229 req-8d455af2-2215-4954-a28b-b495dfa0c57b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036145 Dec 25 21:20:27.791997 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1998/4122] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:27.852504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:27.854097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:27.860840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.861399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.862117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:27.862554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:27.904317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9028b7da-7b79-4df1-aeff-6de552e94b52 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.055525 Dec 25 21:20:27.905196 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 1999/4123] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:27 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:28.010674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.018900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e2d8c99-a5a4-4681-888e-0c6dd0ff4bb2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.257582 Dec 25 21:20:28.020052 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2125/4124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:27 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:28.049569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:28.051331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.058338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.058788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.059572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.060000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.129816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.130345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.137173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.137626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.138437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.138854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.212236 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b50feb0f-9074-4434-bb20-5dfce22cc5a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.166817 Dec 25 21:20:28.213848 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2000/4125] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:28 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:28.294790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.295640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.303633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.304177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.305095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.305613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.339226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.350025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.352556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.358057 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-265021e9-b6fd-4da5-bc9f-ed54f376d2c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.232007 Dec 25 21:20:28.361254 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2126/4126] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:28.366001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.366651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.375668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.376093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.382707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.382707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.405694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.415501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b6866cc-356c-4c31-b75d-81a2f027f250 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1226 microversion: 2.1 time: 0.125237 Dec 25 21:20:28.416112 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2001/4127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1226 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:28.475140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.475891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.482383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.486421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.486421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.486421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.581960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.595896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9402f6d2-d4e0-4392-b6fc-20c47bd25cab tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.232291 Dec 25 21:20:28.595896 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2127/4128] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:28.605544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.606461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.613480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.615507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.615507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.616243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.633109 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce could not be found. Dec 25 21:20:28.633952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.635555 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db01c4dc-b9ef-4307-9b27-fad86c46b2e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 404 len: 111 microversion: 2.1 time: 0.033842 Dec 25 21:20:28.636492 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2128/4129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:20:28.647744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.648478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.655102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.655853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.657216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.657826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.673440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:28.673948 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce could not be found. Dec 25 21:20:28.674994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.676019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63026b5a-caba-4360-8dd2-b706d7b08877 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 404 len: 111 microversion: 2.1 time: 0.032228 Dec 25 21:20:28.677232 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2129/4130] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:28 2021] DELETE /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:20:28.685004 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e5211e97-94b6-4304-bb40-2cb808c7e2db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.216380 Dec 25 21:20:28.686019 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2002/4131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:28.697342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.698492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 6bc9caeb-6686-4332-99c6-4ec54e0549ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.705229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.705968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.707117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.707917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.724712 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce could not be found. Dec 25 21:20:28.725613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 6bc9caeb-6686-4332-99c6-4ec54e0549ce could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.726637 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1d7bc1d-215a-41b1-a92d-6b7c2ba81b22 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce" status: 404 len: 111 microversion: 2.1 time: 0.036794 Dec 25 21:20:28.728051 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2130/4132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/6bc9caeb-6686-4332-99c6-4ec54e0549ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.736697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.737388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.748059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.748527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.749536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.749988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.766267 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance a4de75a7-d672-42e2-b76c-476113efaa1c could not be found. Dec 25 21:20:28.766874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance a4de75a7-d672-42e2-b76c-476113efaa1c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.767914 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff102b7c-3d2a-4bea-9f90-ae6d965ed32a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 404 len: 111 microversion: 2.1 time: 0.036027 Dec 25 21:20:28.768788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2003/4133] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:28 2021] DELETE /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.778843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.779526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: a4de75a7-d672-42e2-b76c-476113efaa1c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.787106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.787701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.788537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.789028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.812976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance a4de75a7-d672-42e2-b76c-476113efaa1c could not be found. Dec 25 21:20:28.812976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance a4de75a7-d672-42e2-b76c-476113efaa1c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.812976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5ec262d-1687-4b77-90a5-92529a7de4de tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c" status: 404 len: 111 microversion: 2.1 time: 0.031657 Dec 25 21:20:28.812976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2131/4134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/a4de75a7-d672-42e2-b76c-476113efaa1c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.817839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.818350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.825562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.826245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.827222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.827861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.842472 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb could not be found. Dec 25 21:20:28.843141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.843999 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c17b1469-3d74-48b8-bc53-4b9e46da5c8a tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 404 len: 111 microversion: 2.1 time: 0.029889 Dec 25 21:20:28.844590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2004/4135] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:28 2021] DELETE /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.855913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.856983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 503df13c-2f74-4094-bbd9-a07a7ba8f4cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.863973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.864704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.865797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.866463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.881867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb could not be found. Dec 25 21:20:28.882470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 503df13c-2f74-4094-bbd9-a07a7ba8f4cb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.883364 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48319b36-9bbb-4bd6-8183-783212d60af6 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb" status: 404 len: 111 microversion: 2.1 time: 0.032989 Dec 25 21:20:28.883859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2132/4136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/503df13c-2f74-4094-bbd9-a07a7ba8f4cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.891994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.892491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.899184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.899644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.900688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.901226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.916188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance d2254a4b-e6ed-4560-a239-47903f19b47d could not be found. Dec 25 21:20:28.917321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance d2254a4b-e6ed-4560-a239-47903f19b47d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.917432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:28.917683 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc61493a-d849-4322-912b-216a5207ae16 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 404 len: 111 microversion: 2.1 time: 0.029415 Dec 25 21:20:28.918498 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2005/4137] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:28 2021] DELETE /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.922129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.927364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.927981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: d2254a4b-e6ed-4560-a239-47903f19b47d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.929181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.929742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.930639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.932253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.936093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.936550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.937548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.938156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.953549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance d2254a4b-e6ed-4560-a239-47903f19b47d could not be found. Dec 25 21:20:28.954150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance d2254a4b-e6ed-4560-a239-47903f19b47d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:28.955054 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-122388a5-4d3a-4572-b44a-98e486a094c7 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d" status: 404 len: 111 microversion: 2.1 time: 0.031346 Dec 25 21:20:28.955989 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2006/4138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:28 2021] GET /compute/v2.1/servers/d2254a4b-e6ed-4560-a239-47903f19b47d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:28.968906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:28.969599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:28.984984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.985964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.986790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:28.987233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:28.991732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-69546990-d4f1-41b6-a08e-d1775aa7f5b2 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.079560 Dec 25 21:20:28.996496 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2133/4139] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:28 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:29.020366 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance e338781e-8257-4f80-8001-d9d3b7422f48 could not be found. Dec 25 21:20:29.021300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance e338781e-8257-4f80-8001-d9d3b7422f48 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:29.022330 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70b92c45-7fb2-4296-abff-9435b3a954e9 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48" status: 404 len: 111 microversion: 2.1 time: 0.060172 Dec 25 21:20:29.026461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2007/4140] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:28 2021] DELETE /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:20:29.031772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:29.032482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: e338781e-8257-4f80-8001-d9d3b7422f48] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.041472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:29.041962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.042412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.042518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.043203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.043636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.052432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.053225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.054855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.055458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.061931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance e338781e-8257-4f80-8001-d9d3b7422f48 could not be found. Dec 25 21:20:29.062533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance e338781e-8257-4f80-8001-d9d3b7422f48 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:29.063381 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-328452d4-6bbe-45f7-9c5a-4cb2831830e2 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48" status: 404 len: 111 microversion: 2.1 time: 0.035848 Dec 25 21:20:29.064325 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2134/4141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:29 2021] GET /compute/v2.1/servers/e338781e-8257-4f80-8001-d9d3b7422f48 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:20:29.225647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:29.226848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.243330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.243929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.249114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:29.253278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.253867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.259064 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e35a3d4f-ab9b-4b97-9a62-d317ddad2a7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1315 microversion: 2.1 time: 0.225115 Dec 25 21:20:29.268308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2008/4142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:29 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:29.313288 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7298e918-cafd-4f21-bc84-d3e9f0070487 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.092711 Dec 25 21:20:29.317220 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2135/4143] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:29 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:29.377849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:29.378642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.394180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.395678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.396911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.398396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.432229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:29.432971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.451822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.452278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.453091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.453577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.537286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:29.550545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-476a1e88-2e29-460c-87dc-a9b87542c953 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1274 microversion: 2.1 time: 0.122240 Dec 25 21:20:29.555802 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2136/4144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:29 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:29.611594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:29.612297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.627427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.627887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.628685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.629158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.724759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:29.749663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:29.754551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:29.765118 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ba9ba32f-0a83-4c16-85eb-c9df605d9fdf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.384998 Dec 25 21:20:29.767686 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2009/4145] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:29 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:29.775603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:29.776357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:29.784479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.785319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.786381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:29.787084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:29.976664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:29.996557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d20f96bd-94a5-4632-b523-976455a272a2 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.388007 Dec 25 21:20:30.011085 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2137/4146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:29 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:30.016344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:30.017558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:30.025971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.026678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.027644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.028289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.081357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:30.090814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-561a6377-a9b9-469c-81c6-014c6e91787a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.078329 Dec 25 21:20:30.092232 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2138/4147] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:30 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:30.096451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0185ff76-1eb5-43aa-b3b0-2d137efaaba4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.325439 Dec 25 21:20:30.098516 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2010/4148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:29 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:30.126091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9ffe3422-e369-454d-9218-1bf2c25d9a9c req-a11b4557-96cc-42d3-a1a8-6d1079e3336f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "0daa1ac7-be03-4d72-b2a5-72b1ee145ecb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:30.127569 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:30.127569 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:30.136035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9ffe3422-e369-454d-9218-1bf2c25d9a9c req-a11b4557-96cc-42d3-a1a8-6d1079e3336f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.136035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9ffe3422-e369-454d-9218-1bf2c25d9a9c req-a11b4557-96cc-42d3-a1a8-6d1079e3336f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.149525 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9ffe3422-e369-454d-9218-1bf2c25d9a9c req-a11b4557-96cc-42d3-a1a8-6d1079e3336f service nova] Creating event network-vif-plugged:0daa1ac7-be03-4d72-b2a5-72b1ee145ecb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:30.155612 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9ffe3422-e369-454d-9218-1bf2c25d9a9c req-a11b4557-96cc-42d3-a1a8-6d1079e3336f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035197 Dec 25 21:20:30.156511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2139/4149] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:30.275860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:30.276500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:30.283232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.283686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.284704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.284925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.328443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:30.329519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:30.339438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.339895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.340844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.345650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.386502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15ab8030-64fb-4b6d-9224-bd4cfb9ff597 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064731 Dec 25 21:20:30.387675 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2140/4150] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:30 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:30.437563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:30.445881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8b926aa-7c6d-44d7-be5e-0fae699139e7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1503 microversion: 2.1 time: 0.174804 Dec 25 21:20:30.446457 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2011/4151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:30 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:30.463265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-629451ca-1a98-4907-bc0e-8d93f51a1ebd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:30.470727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-629451ca-1a98-4907-bc0e-8d93f51a1ebd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.471380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-629451ca-1a98-4907-bc0e-8d93f51a1ebd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.496268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-629451ca-1a98-4907-bc0e-8d93f51a1ebd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:20:30.571418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:30.572072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:30.578909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.579366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.580159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.580597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.645889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:30.655298 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-321da3c3-b1da-47d9-9578-96240c8fa91d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1280 microversion: 2.1 time: 0.087498 Dec 25 21:20:30.656139 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2012/4152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:30 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1280 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:30.713728 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-629451ca-1a98-4907-bc0e-8d93f51a1ebd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698/action" status: 202 len: 0 microversion: 2.1 time: 0.253392 Dec 25 21:20:30.714265 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2141/4153] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:30 2021] POST /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:30.734456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:30.735122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:30.741294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.747366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.747366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.747366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.787526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:30.789806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:30.797380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.798160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.799532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:30.800067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:30.985747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:30.995043 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c0985b97-41fe-4bbd-9c5f-e31f47d371e2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.276354 Dec 25 21:20:31.004811 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2013/4154] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:30 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:31.018819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:31.019444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:31.027311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.027764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.028564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.029024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.050019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:31.062087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:31.064051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:31.065483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1fca2f20-362a-4328-8819-7a1cff50f80f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.283383 Dec 25 21:20:31.077602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2142/4155] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:30 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:31.106459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:31.108018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:31.118094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.118853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.120131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.121404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.172348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96d562de-062d-4641-9660-c127edda9fe5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.071287 Dec 25 21:20:31.173280 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2143/4156] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:31 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:31.180048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:31.180772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:31.188016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.188480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.189373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.189755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.191643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:31.216318 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e769a78-bf70-488c-8ac3-fdd16d35dbe3 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.202976 Dec 25 21:20:31.217635 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2014/4157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:31 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:31.343677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:31.352623 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e7b45955-b7ab-443e-b181-8d6940f0e1fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.177630 Dec 25 21:20:31.353256 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2144/4158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:31 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:31.397664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:31.399092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:31.407499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.407965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.409538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.409646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.454859 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-000fa4a5-87ff-498a-9f9b-b3b23375d780 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060660 Dec 25 21:20:31.455927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2015/4159] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:31 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:31.672158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:31.673768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:31.681717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.682462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.684956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.685712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.704542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f307307a-59e7-43ff-8ded-1acc5cee9189 req-0167e19f-4999-42ac-bd0d-ec5031d56bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:31.706716 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:31.706716 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:31.716380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f307307a-59e7-43ff-8ded-1acc5cee9189 req-0167e19f-4999-42ac-bd0d-ec5031d56bf7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:31.716958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f307307a-59e7-43ff-8ded-1acc5cee9189 req-0167e19f-4999-42ac-bd0d-ec5031d56bf7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:31.728578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f307307a-59e7-43ff-8ded-1acc5cee9189 req-0167e19f-4999-42ac-bd0d-ec5031d56bf7 service nova] Creating event network-changed:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:20:31.733294 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f307307a-59e7-43ff-8ded-1acc5cee9189 req-0167e19f-4999-42ac-bd0d-ec5031d56bf7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034412 Dec 25 21:20:31.734448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2016/4160] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:31.846604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:31.857507 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32b2f21f-39fe-45d3-838d-19e6163d4acb tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.189513 Dec 25 21:20:31.858684 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2145/4161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:31 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:32.012523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:32.013250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.019353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.019799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.020580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.021046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.086169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:32.087349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.103536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.104050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.105099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.105704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.217377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:32.229052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34a4776d-56a0-4599-8edd-941cb748af20 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.221032 Dec 25 21:20:32.230087 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2017/4162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:32 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:32.235160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "fd6aa216-385a-41e5-8c5e-3aae2253a5ab"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "9c0613e4-0268-4ae9-8585-76b021617ef8"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "7d584498-0a66-4020-96ff-ac37bb6bf33e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:32.237295 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:32.237295 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:32.245971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.246624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.266026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Creating event network-vif-plugged:2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:32.266026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Creating event network-vif-plugged:fd6aa216-385a-41e5-8c5e-3aae2253a5ab for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:32.266026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Creating event network-vif-plugged:9c0613e4-0268-4ae9-8585-76b021617ef8 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:32.266026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] Creating event network-vif-plugged:7d584498-0a66-4020-96ff-ac37bb6bf33e for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:32.266851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c3ee5db6-6b73-4fb4-abb2-f5809e7365f4 req-14f7184c-40e6-412b-97f1-a7f286bbf470 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.035318 Dec 25 21:20:32.267812 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2018/4163] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:32 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:32.273874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:32.275620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.284057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.284784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.285871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.286469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.349840 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5c77713-85f1-4555-bc0a-0990bb78849e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.080471 Dec 25 21:20:32.351502 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2019/4164] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:32 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:32.361210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:32.362174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.370214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.370678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.371487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.371930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.388701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:32.397996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:32.400282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:32.401599 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-16c3d9ca-519a-4072-9ced-35c654de63e5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.320721 Dec 25 21:20:32.402483 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2146/4165] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:32 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:32.406685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:32.407382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.418715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.419258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.420962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.420962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.559368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:32.559368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c71e05a-b845-4633-9efc-b83d2d3e8849 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.196220 Dec 25 21:20:32.559368 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2020/4166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:32 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:32.559368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:32.560161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.566831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.567377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.568246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.568761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.611189 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35edf9db-749f-4089-95fd-a523fc49088f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.056015 Dec 25 21:20:32.612912 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2021/4167] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:32 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:32.613190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:32.620714 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5567f94d-2f38-420d-9220-c6ac3df2239e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.217349 Dec 25 21:20:32.621317 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2147/4168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:32 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:32.874136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:32.874833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:32.882132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.882580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:32.883393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:32.883826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.029904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.037285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-861799c8-3cab-48d6-9eaf-b90e02c872c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.167284 Dec 25 21:20:33.037855 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2022/4169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:32 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:33.247487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:33.248096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:33.254549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.255008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.255790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.256234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.362950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:33.364152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:33.370996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.374814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.374814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.374814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.393581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.402456 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01067ad9-9a07-43a1-805d-0d49e767e079 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.159181 Dec 25 21:20:33.403019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2148/4170] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:33 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:33.413115 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1baa95c-7e85-4077-b146-5abf3a092cc0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.053615 Dec 25 21:20:33.413938 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2023/4171] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:33 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:33.419785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:33.420399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:33.426991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.427449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.428242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.428814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.570987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:33.571683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:33.578957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.580390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.581226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.581665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.620234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.629512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.631173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.632442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-097f61de-85db-4607-814e-02aefae8e43a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.216226 Dec 25 21:20:33.634345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2149/4172] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:33 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:33.637591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:33.638563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:33.644758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.645334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.646785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.646785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.689959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32a358fa-2e1a-453a-ac49-041e9f58c75a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055521 Dec 25 21:20:33.690749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2150/4173] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:33 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:33.697766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:33.698468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:33.705193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.705651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.707047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:33.707493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:33.728998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.736751 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6e5fe17-da70-47dd-80b9-859261cfa3aa tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.170168 Dec 25 21:20:33.737357 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2024/4174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:33 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:33.840798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:33.848717 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2aff01b2-27f9-45aa-92a7-958afeea1ca0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.155782 Dec 25 21:20:33.849330 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2151/4175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:33 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:34.053181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:34.053922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:34.060619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.061120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.061924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.062386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.202392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:34.210233 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e0bc8c1-fb60-4148-9172-86238aa6dc48 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.160820 Dec 25 21:20:34.212768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2025/4176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:34 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:34.283572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "634d748d-c261-4855-913b-beb5992df4cb"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-plugged", "status": "completed", "tag": "8de83a8d-9b83-433c-af96-f34c522b12b1"}, {"server_uuid": "89ed46e1-4b7a-40ec-a9f8-923852705e90", "name": "network-vif-plugged", "status": "completed", "tag": "50029fbf-b328-4b5f-80c2-bcc4da3c4b96"}, {"server_uuid": "eb1b09d3-5625-472f-beea-2338a1ab5b4a", "name": "network-vif-plugged", "status": "completed", "tag": "06a6d407-75ff-436c-a36c-cd7f85e5face"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:34.285547 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:34.285547 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:34.295620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.296068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.309592 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Creating event network-vif-plugged:634d748d-c261-4855-913b-beb5992df4cb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:34.310106 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Creating event network-vif-plugged:8de83a8d-9b83-433c-af96-f34c522b12b1 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:34.310613 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Creating event network-vif-plugged:50029fbf-b328-4b5f-80c2-bcc4da3c4b96 for instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 on nch1-master-1 Dec 25 21:20:34.311114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] Creating event network-vif-plugged:06a6d407-75ff-436c-a36c-cd7f85e5face for instance eb1b09d3-5625-472f-beea-2338a1ab5b4a on nch1-master-1 Dec 25 21:20:34.321127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-bf22d8bd-4573-4bf0-93cd-065fdff02794 req-5663ab30-6211-417e-9b56-757d2e789a1e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041608 Dec 25 21:20:34.322361 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2152/4177] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:34 2021] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:34.422177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:34.422806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:34.431674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:34.432679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:34.439130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.439661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.442238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.442238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.451974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.452436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.453287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.453789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.507357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26443e7c-7cb4-4436-99bd-7ad1ec99a721 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.079429 Dec 25 21:20:34.509565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2153/4178] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:34 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:34.651572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:34.652272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:34.659679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.660139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.660966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.661411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.922362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:34.927552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:34.930203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29df5c1d-6fd3-4e45-a957-fd8382090529 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.514347 Dec 25 21:20:34.931465 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2026/4179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:34 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:34.936412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:34.937486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:34.937910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:34.939618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:34.940779 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-723c5313-de83-4eae-ba3e-2920c7ee221f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.293514 Dec 25 21:20:34.941363 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2154/4180] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:34 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:34.944229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.944680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.945488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.945798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:34.945924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.946407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:34.952555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.952964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.953757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:34.954198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:34.987939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66016e2a-ec9d-425b-a04c-aeb02975bf3a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055196 Dec 25 21:20:34.988663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2027/4181] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:34 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:34.994272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:34.994946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:35.002289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.002739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.003530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.003964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.126356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:35.129220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88b5bdc8-15d2-453d-9984-db74f56e5e09 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1316 microversion: 2.1 time: 0.186828 Dec 25 21:20:35.129974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2155/4182] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:34 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:35.168443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:35.176409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-609c0886-bbb3-43f4-b6b9-de4a1dbaf5fd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1309 microversion: 2.1 time: 0.186409 Dec 25 21:20:35.176983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2028/4183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:34 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1309 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:35.227408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:35.228574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:35.235339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.235796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.236584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.237073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.366476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:35.373905 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db851e54-32bf-4ba7-bca6-51a9fb5b8c0f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.150240 Dec 25 21:20:35.374450 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2156/4184] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:35 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:35.519622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:35.520591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:35.528596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.529091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.529879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.530322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.570367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f80874d-bef1-47b1-9130-a70c244fafcc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.054432 Dec 25 21:20:35.571023 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2029/4185] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:35 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:35.953349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:35.953995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:35.965174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:35.965882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:35.972276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.972729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.974657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.975233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.975405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.975898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:35.976327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:35.976949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.225776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.233668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37718492-2e34-4d62-b49d-dca80b6cdc94 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.289949 Dec 25 21:20:36.234246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2157/4186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:35 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:36.239088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:36.240161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.245395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.248339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.248867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.249742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.250247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.254833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.256359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.257541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e724760f-e31c-4fc0-8f73-c4b002555a2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.297063 Dec 25 21:20:36.258094 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2030/4187] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:35 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:36.263012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:36.263623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.269434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.269888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.270670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.271106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.293679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a086d8b8-b35e-45a6-8c7b-6f7e4627764a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058224 Dec 25 21:20:36.294721 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2158/4188] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:36 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:36.299775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:36.300462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.308261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.308576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.309388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.309824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.445577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.453297 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67094bf5-81d9-48ff-a622-27e979240e18 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1465 microversion: 2.1 time: 0.194212 Dec 25 21:20:36.453863 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2031/4189] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:36 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1465 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:36.468327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:36.468952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.474737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.476504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.476504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.476504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.488382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.496727 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18ed7c53-8d1a-4a40-bc94-a8bd92770e0f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1491 microversion: 2.1 time: 0.201064 Dec 25 21:20:36.497334 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2159/4190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:36 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1491 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:36.501853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:36.505196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.508571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.509071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.509852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.510285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.535584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:20:36.613145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:36.621785 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-69b90f01-c41c-4b29-99f7-dff4b2cf3d08 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.157087 Dec 25 21:20:36.622353 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2032/4191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:36 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:36.626696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-633405716"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:36.627858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.633543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.637737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.637737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.637737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.794808 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4bcba253-c0a6-4293-a98d-286bbc62cce3 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "PUT /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1075 microversion: 2.1 time: 0.171357 Dec 25 21:20:36.795643 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2033/4192] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:20:36 2021] PUT /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1075 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:36.800397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:36.805712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.810630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.811091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.811909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.812385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.853982 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d604f2e-5a06-4565-a4e8-351230268936 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057212 Dec 25 21:20:36.854677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2034/4193] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:36 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:36.859543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:36.860284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.867241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.867645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.868443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.868901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.925936 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1dc6bab4-70b7-4443-a2dc-6e0cbe45272c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "DELETE /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 204 len: 0 microversion: 2.1 time: 0.427345 Dec 25 21:20:36.926681 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2160/4194] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:36 2021] DELETE /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:20:36.935008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:36.935949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:36.942211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.942663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:36.943478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:36.943909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.034818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.043044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a51f8480-bf31-448b-94ea-c7536520c6d5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1501 microversion: 2.1 time: 0.187202 Dec 25 21:20:37.043724 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2035/4195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:36 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:37.058936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:37.059667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.068389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.069521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.070314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.070757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.107884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.116534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27f9b49f-085b-4e9b-b3ed-2d743626a1f8 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1471 microversion: 2.1 time: 0.185552 Dec 25 21:20:37.119731 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2161/4196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:36 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:37.212835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.220694 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7eed00eb-343c-407c-86bb-6a1570fd1c6b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1501 microversion: 2.1 time: 0.165403 Dec 25 21:20:37.221298 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2036/4197] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:37 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:37.236391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5f6ab29-1d6c-4518-8d1c-7a16844eaabd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:37.242377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5f6ab29-1d6c-4518-8d1c-7a16844eaabd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.242834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5f6ab29-1d6c-4518-8d1c-7a16844eaabd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.250223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:37.250849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.257088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.260163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.260163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.260163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.265515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5f6ab29-1d6c-4518-8d1c-7a16844eaabd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:20:37.395336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.403853 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7283320-aad6-43ab-9001-06f1960498fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.157384 Dec 25 21:20:37.407993 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2037/4198] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:37 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:37.409230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:37.409828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.415526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.415987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.416777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.417248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.523951 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5f6ab29-1d6c-4518-8d1c-7a16844eaabd tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "POST /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90/action" status: 202 len: 0 microversion: 2.1 time: 0.290999 Dec 25 21:20:37.527831 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2162/4199] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:37 2021] POST /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:37.530868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:37.532216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.538914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.539479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.540385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.540942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.587879 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4fab5766-927a-4cc8-8f39-99567f1d2f51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.061566 Dec 25 21:20:37.591527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2163/4200] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:37 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:37.593419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:37.594106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.601095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.601548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.602338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.602929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.614929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.625301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.627023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.628429 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc3d6b7a-2e70-4874-8f1c-caefe16608f8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1875 microversion: 2.42 time: 0.222976 Dec 25 21:20:37.629101 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2038/4201] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:37 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1875 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:37.648918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:37.649957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.657282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.660927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.660927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.660927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.784774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.793236 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e246ba9c-9f9e-44e1-8a22-59a150ccac73 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.203441 Dec 25 21:20:37.799233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2164/4202] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:37 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:37.839619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:37.847581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a49545f1-73bb-4661-93df-f8d53f76e32c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.202534 Dec 25 21:20:37.848583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2039/4203] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:37 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:37.873714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4f71a1ac-7a87-40ae-a515-c80b80bf054f req-c922dd99-e805-4e18-a0c5-f0606017942e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "name": "network-vif-plugged", "status": "completed", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:37.875298 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:37.875298 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:37.878743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:37.879702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:37.894339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.894828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.895631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.896126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.904604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4f71a1ac-7a87-40ae-a515-c80b80bf054f req-c922dd99-e805-4e18-a0c5-f0606017942e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:37.905024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4f71a1ac-7a87-40ae-a515-c80b80bf054f req-c922dd99-e805-4e18-a0c5-f0606017942e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:37.918300 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4f71a1ac-7a87-40ae-a515-c80b80bf054f req-c922dd99-e805-4e18-a0c5-f0606017942e service nova] Creating event network-vif-plugged:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:20:37.923567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4f71a1ac-7a87-40ae-a515-c80b80bf054f req-c922dd99-e805-4e18-a0c5-f0606017942e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053391 Dec 25 21:20:37.924331 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2040/4204] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:37.941933 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4a1fe3a-1205-4ada-931b-7899913cd559 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.076521 Dec 25 21:20:37.942860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2165/4205] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:37 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:38.134106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:38.134798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:38.141040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.141489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.142623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.142723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.287720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:38.295810 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-232f5c2b-0f4e-4059-a95a-a14905cbff05 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1471 microversion: 2.1 time: 0.165837 Dec 25 21:20:38.296371 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2041/4206] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:38 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:38.422156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:38.422812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:38.430284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.430736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.431581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.432026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.566724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:38.574966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-823d267d-f0c5-4202-a894-09f2ba434ae0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.157186 Dec 25 21:20:38.575542 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2166/4207] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:38 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:38.599207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:38.600135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:38.607024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.607616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.608488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.609045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.647357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:38.647929 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4677f1d9-8bbe-4351-8e48-530260f42962 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052239 Dec 25 21:20:38.648383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:38.649006 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2042/4208] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:38 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:38.655039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.655565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.656592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.657065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.810708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:38.814843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:38.818448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.818908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.819712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.820158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.860481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:38.870198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:38.871895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:38.873204 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9463b219-e1c3-4d23-8f8d-f4b43b819800 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2833 microversion: 2.42 time: 0.229580 Dec 25 21:20:38.873781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2167/4209] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:20:38 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2833 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:38.878866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:38.879484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:38.887056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.887710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:38.888694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:38.889422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.283241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:39.290932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ec9da19-0a40-415a-8f9a-de30a07b1209 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.484457 Dec 25 21:20:39.291804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2043/4210] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:38 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:39.296227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.297234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.303082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.303485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.304218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.304686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.307180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:39.315158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa421eca-3337-46f9-9ec4-394b5f3411ed tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1322 microversion: 2.1 time: 0.440353 Dec 25 21:20:39.315823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2168/4211] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:38 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1322 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:39.320629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.321866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.328443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.329075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.330000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.330608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.345985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. Dec 25 21:20:39.346733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:39.347925 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dbaf0053-effd-4f26-b0f8-f3bc1673f422 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 404 len: 111 microversion: 2.1 time: 0.030869 Dec 25 21:20:39.351562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2169/4212] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:39 2021] DELETE /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:39.354111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:39.355186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.361921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.363065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.363540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.364055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.407122 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-977f312b-8dc0-4155-b76c-9e7becc616d9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057053 Dec 25 21:20:39.408090 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2170/4213] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:39 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:39.417594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-cfebd1c9-fea5-40a7-9ab3-2785143ef3e1 req-fcb7bc95-7606-4127-9136-afcdbfc1b005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb1b09d3-5625-472f-beea-2338a1ab5b4a", "name": "network-vif-deleted", "tag": "06a6d407-75ff-436c-a36c-cd7f85e5face"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:39.419118 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:39.419118 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:39.428633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cfebd1c9-fea5-40a7-9ab3-2785143ef3e1 req-fcb7bc95-7606-4127-9136-afcdbfc1b005 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.429108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-cfebd1c9-fea5-40a7-9ab3-2785143ef3e1 req-fcb7bc95-7606-4127-9136-afcdbfc1b005 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.443806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-cfebd1c9-fea5-40a7-9ab3-2785143ef3e1 req-fcb7bc95-7606-4127-9136-afcdbfc1b005 service nova] Creating event network-vif-deleted:06a6d407-75ff-436c-a36c-cd7f85e5face for instance eb1b09d3-5625-472f-beea-2338a1ab5b4a on nch1-master-1 Dec 25 21:20:39.449448 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-cfebd1c9-fea5-40a7-9ab3-2785143ef3e1 req-fcb7bc95-7606-4127-9136-afcdbfc1b005 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040363 Dec 25 21:20:39.450031 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2171/4214] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:39.454928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.455615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.461538 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8e253e7-82ff-467a-9e63-28da37a8bf2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.168773 Dec 25 21:20:39.461799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.462251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.462384 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2044/4215] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Dec 25 21:20:39 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/os-interface => generated 1831 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:20:39.463045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.463462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.467421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.468108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: 05cf3a17-49d6-43d2-9b08-505f1e637900] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.479870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.479870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.479870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.480339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.495584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. Dec 25 21:20:39.496182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance 05cf3a17-49d6-43d2-9b08-505f1e637900 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:39.497292 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4709a1de-3a02-4b46-a667-de7250a4f9c3 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900" status: 404 len: 111 microversion: 2.1 time: 0.033864 Dec 25 21:20:39.497861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.498018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2045/4216] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:39 2021] GET /compute/v2.1/servers/05cf3a17-49d6-43d2-9b08-505f1e637900 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:39.498631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.499235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lazy-loading 'fault' on Instance uuid eb1b09d3-5625-472f-beea-2338a1ab5b4a {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:20:39.505836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.506539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.513572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.514147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.514955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.515396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.529067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance fcc7022a-66f7-4481-80f6-03320c1f3a53 could not be found. Dec 25 21:20:39.529666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance fcc7022a-66f7-4481-80f6-03320c1f3a53 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:39.530592 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-edda5a37-6572-4a6e-8d30-0531acebdd29 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 404 len: 111 microversion: 2.1 time: 0.028559 Dec 25 21:20:39.531285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2046/4217] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:39 2021] DELETE /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:20:39.539027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.539633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] [instance: fcc7022a-66f7-4481-80f6-03320c1f3a53] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.546827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.547288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.548086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.548529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.551047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d7a8ba1616448f823d45787d82920f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b5edef5e3349c2bf221f47c5457b4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:39.559276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-856bfd30-03c2-4905-812a-593ac1fa3e2e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 200 len: 1306 microversion: 2.1 time: 0.108099 Dec 25 21:20:39.560189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2172/4218] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:39 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 1306 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:39.563204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] HTTP exception thrown: Instance fcc7022a-66f7-4481-80f6-03320c1f3a53 could not be found. Dec 25 21:20:39.563854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] Returning 404 to user: Instance fcc7022a-66f7-4481-80f6-03320c1f3a53 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:39.564684 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-17cac743-fad2-4f01-bac9-2e11a5fbed51 tempest-DeleteServersTestJSON-404477660 tempest-DeleteServersTestJSON-404477660-project] 10.222.0.32 "GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53" status: 404 len: 111 microversion: 2.1 time: 0.029136 Dec 25 21:20:39.565413 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2047/4219] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:39 2021] GET /compute/v2.1/servers/fcc7022a-66f7-4481-80f6-03320c1f3a53 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:39.592167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:39.593010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.599931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.600390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.601259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.601875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.660845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:39.662162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:39.669102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.669689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.670577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:39.671118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:39.721390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b5780cd0-2ddd-46c3-b715-fc726c6ddba5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064119 Dec 25 21:20:39.722955 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2048/4220] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:39 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:39.900587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:39.910260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fb553ea-91be-4ce7-94ff-d3d83a2caf91 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.321906 Dec 25 21:20:39.910948 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2173/4221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:39 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:40.309981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:40.310833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.319166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.319743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.320648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.321730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.332490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:40.333188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.340463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.342575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.342575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.342575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.668334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:40.673390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:40.679782 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0233acef-4593-46e6-8624-69450fb35ef8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1518 microversion: 2.1 time: 0.351375 Dec 25 21:20:40.682399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2174/4222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:40 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1518 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:40.690443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:40.692190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.694717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d3ee352a-5646-44cb-8784-66a3c322ece8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.389849 Dec 25 21:20:40.704636 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2049/4223] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:40 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:40.704636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:40.704636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.708162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.708627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.709464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.710040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.711104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.711905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.712904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.713495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.727875 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. Dec 25 21:20:40.728822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:40.729917 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b8d52ff-32af-432e-8501-a69b46a117a4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 404 len: 111 microversion: 2.1 time: 0.032724 Dec 25 21:20:40.730967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2050/4224] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:40 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:40.737128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:40.740229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.744755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.745330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.746142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.746581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.771330 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-29d07e2a-5a5c-497a-9a36-d9a0b55abd5b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.086758 Dec 25 21:20:40.772259 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2175/4225] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:40 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:40.772832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lazy-loading 'flavor' on Instance uuid f38f1e54-3e25-4107-9a2c-734823ced707 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:20:40.780172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:40.781223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.788390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.788855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.790895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.790895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.833697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61fe9508-2d19-4558-9a4c-5a1d103d7471 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059307 Dec 25 21:20:40.837496 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2176/4226] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:40 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:40.839861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-437061057", "metadata": {"image_type": "test"}}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:40.842514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.848295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.848754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.849659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.850107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.869315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. Dec 25 21:20:40.869315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:40.869315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b57702d3-88c6-460a-a471-45a0e81fb3c4 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "POST /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a/action" status: 404 len: 111 microversion: 2.1 time: 0.030756 Dec 25 21:20:40.869315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2177/4227] 10.222.0.32 () {60 vars in 1278 bytes} [Sat Dec 25 21:20:40 2021] POST /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:40.880905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96bfb2e1-1826-4500-8336-6c98d90b825d tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-755795466", "metadata": {"image_type": "test"}}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:40.882029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96bfb2e1-1826-4500-8336-6c98d90b825d tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Failed to fetch instance by id tempest-invalid-1349739228 {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:20:40.882545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-96bfb2e1-1826-4500-8336-6c98d90b825d tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance tempest-invalid-1349739228 could not be found. Dec 25 21:20:40.883227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96bfb2e1-1826-4500-8336-6c98d90b825d tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance tempest-invalid-1349739228 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:40.892830 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96bfb2e1-1826-4500-8336-6c98d90b825d tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "POST /compute/v2.1/servers/tempest-invalid-1349739228/action" status: 404 len: 101 microversion: 2.1 time: 0.015753 Dec 25 21:20:40.893358 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2178/4228] 10.222.0.32 () {60 vars in 1248 bytes} [Sat Dec 25 21:20:40 2021] POST /compute/v2.1/servers/tempest-invalid-1349739228/action => generated 101 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:40.910228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18079850-1dbc-486b-bd33-07cf0afb5d4e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-272208199"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:40.922022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18079850-1dbc-486b-bd33-07cf0afb5d4e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:20:40.924071 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-18079850-1dbc-486b-bd33-07cf0afb5d4e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Dec 25 21:20:40.925595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18079850-1dbc-486b-bd33-07cf0afb5d4e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:40.926663 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18079850-1dbc-486b-bd33-07cf0afb5d4e tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.025618 Dec 25 21:20:40.946313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2179/4229] 10.222.0.32 () {60 vars in 1274 bytes} [Sat Dec 25 21:20:40 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:40.951706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:40.952527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:40.965374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.966164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:40.967192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:40.968316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.096196 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f47ea263-bae2-42d2-9c2d-e12ba83114c5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action" status: 200 len: 32 microversion: 2.1 time: 0.363375 Dec 25 21:20:41.097092 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2051/4230] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:40 2021] POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:20:41.104332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c12d317d-ea7a-4403-9db1-a94bfbf1fd37 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1688114212"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:41.106665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c12d317d-ea7a-4403-9db1-a94bfbf1fd37 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:20:41.106665 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c12d317d-ea7a-4403-9db1-a94bfbf1fd37 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Dec 25 21:20:41.107344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c12d317d-ea7a-4403-9db1-a94bfbf1fd37 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:41.108494 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c12d317d-ea7a-4403-9db1-a94bfbf1fd37 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.009367 Dec 25 21:20:41.109299 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2052/4231] 10.222.0.32 () {60 vars in 1280 bytes} [Sat Dec 25 21:20:41 2021] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:41.119954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:41.121336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.127177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:41.129767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.135260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b193186c-c106-4692-88b2-037fa9ac713b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.195225 Dec 25 21:20:41.136457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.137566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.138397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.144869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2180/4232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:40 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:41.149932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-89486230-9fcb-48b1-8cba-b35429a5a4cc req-7613e0d8-2a02-46a2-abd1-781ac7a565a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "tag": "634d748d-c261-4855-913b-beb5992df4cb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:41.152386 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:41.152386 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:41.160129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-89486230-9fcb-48b1-8cba-b35429a5a4cc req-7613e0d8-2a02-46a2-abd1-781ac7a565a4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.160807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-89486230-9fcb-48b1-8cba-b35429a5a4cc req-7613e0d8-2a02-46a2-abd1-781ac7a565a4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.174179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-89486230-9fcb-48b1-8cba-b35429a5a4cc req-7613e0d8-2a02-46a2-abd1-781ac7a565a4 service nova] Creating event network-changed:634d748d-c261-4855-913b-beb5992df4cb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:20:41.179490 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-89486230-9fcb-48b1-8cba-b35429a5a4cc req-7613e0d8-2a02-46a2-abd1-781ac7a565a4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033175 Dec 25 21:20:41.180105 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2181/4233] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:41.228079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b20e569-6d30-4c91-8feb-92e13a6e5bba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.069732 Dec 25 21:20:41.228079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2053/4234] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:41 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:41.228264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:41.228264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.228427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:41.228427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.228575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.228575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.228575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.228575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca6e0ce2-6e9a-4c89-8ed2-7a6714bb3bc1 tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "DELETE /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 404 len: 111 microversion: 2.1 time: 0.036808 Dec 25 21:20:41.228860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2054/4235] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:41 2021] DELETE /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:41.237299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:41.238053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] [instance: eb1b09d3-5625-472f-beea-2338a1ab5b4a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.245250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.246397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.247817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.249301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.272231 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] HTTP exception thrown: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. Dec 25 21:20:41.275110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] Returning 404 to user: Instance eb1b09d3-5625-472f-beea-2338a1ab5b4a could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:41.276281 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81230274-7748-40a8-a709-2ba3eba1474c tempest-ImagesNegativeTestJSON-828474617 tempest-ImagesNegativeTestJSON-828474617-project] 10.222.0.32 "GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a" status: 404 len: 111 microversion: 2.1 time: 0.042833 Dec 25 21:20:41.278168 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2055/4236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:41 2021] GET /compute/v2.1/servers/eb1b09d3-5625-472f-beea-2338a1ab5b4a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:20:41.377867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:41.395641 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f461e06-f5a8-44ee-8622-9f12234c49c6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.212195 Dec 25 21:20:41.397905 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2182/4237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:41 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:41.715497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:41.716850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.729681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.730465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.731835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.733454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.787685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:41.790532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.808303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.812154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.812154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.813190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.877527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c7f87d5-f442-4ef9-869b-1f193a7e863f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.095849 Dec 25 21:20:41.881460 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2183/4238] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:41 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:41.891796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:41.901543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:41.924836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.927148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:41.929095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:41.933029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.014846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:42.016022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a8b5a4ae-4a17-423e-8898-2c7747723c6c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.130602 Dec 25 21:20:42.021743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2184/4239] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:41 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:42.032157 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51649d1e-a5d5-43b5-8f25-c7c3152f858e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.323926 Dec 25 21:20:42.041590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2056/4240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:41 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:42.154334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:42.155289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:42.167675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.174145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.174145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.175388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.196012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:42.197649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:42.208714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.209564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.211435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.212083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.270734 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cce0ad5f-ec7c-4907-a18b-797a2bfc9f3f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.078259 Dec 25 21:20:42.273519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2057/4241] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:42 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:42.381137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:42.390720 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b5bce5a3-23e7-498a-a9a6-905edbd65424 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.240128 Dec 25 21:20:42.391016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2185/4242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:42 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:42.418530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:42.422806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:42.430143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.431247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.433217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.434266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.598137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:42.606492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bdb58921-e183-4bc7-ae58-0f8c826e2653 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.195391 Dec 25 21:20:42.607146 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2058/4243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:42 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:42.896345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:42.897401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:42.905079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.905593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.906818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:42.907575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:42.954864 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f404ddf-b081-48cb-aa20-4f706e543571 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.062092 Dec 25 21:20:42.959064 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2186/4244] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:42 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:43.030023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:43.030973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:43.038846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.039307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.040738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.041286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.060572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:43.061515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:43.068492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.069204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.070183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.070803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.083969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62a796a8-7957-4612-9fc6-1bd40a21f109 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057496 Dec 25 21:20:43.089777 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2059/4245] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:43 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:43.235789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:43.244124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7d06681-7fb0-4455-95c1-b211915b63f6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.187593 Dec 25 21:20:43.247873 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2187/4246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:43 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:43.286895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:43.288015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:43.295179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.295634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.296699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.297169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.341522 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd24181d-86fa-4fbc-8f8e-4916ed40c360 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.058487 Dec 25 21:20:43.344892 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2060/4247] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:43 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:43.407470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:43.408080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:43.414502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.418757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.418757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.418757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.556416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:43.564360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4643f2fe-4001-4e31-9c45-99e90bef8dd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.160564 Dec 25 21:20:43.568475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2188/4248] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:43 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:43.625569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:43.626775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:43.635100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.636242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.637333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.638039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.796795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:43.804495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26c8d494-12fe-401e-a888-8d0e849f026d tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.184069 Dec 25 21:20:43.805350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2061/4249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:43 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:43.967285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:43.968269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:43.974683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.975134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.976131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:43.976571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:43.995684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-858623697", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "8ea22150-5d73-4eda-bec4-147118c897f9"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:44.017304 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fda2ee13-3441-4145-80fd-f6d57209b68c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.053875 Dec 25 21:20:44.019288 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2062/4250] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:43 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:44.052506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] validate_networks() for [('8ea22150-5d73-4eda-bec4-147118c897f9', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:44.099343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:44.100507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:44.109205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.109862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.112060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.112060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.156595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed254331-d789-4306-ac80-b441e8201e90 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062252 Dec 25 21:20:44.157591 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2063/4251] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:44 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:44.262748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:44.263208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:44.270073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.270630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.271615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.273213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.499885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:44.500354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:44.504429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:44.507905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:44.509088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:44.509520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:44.516549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-030141fa-88f2-4b11-9842-b526d6433eb0 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.258774 Dec 25 21:20:44.526676 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2064/4252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:44 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:44.526873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.526873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.526873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.526873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.527258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:44.527258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:44.532243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.532815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.533752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.534295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.548709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Getting quotas for project 4e25bb59aaf6463b813f8a47e00b807e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:44.554269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Getting quotas for user 55b39997f2f648ca8329c1d17120b62c and project 4e25bb59aaf6463b813f8a47e00b807e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:44.567771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:44.570196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:44.576390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b181684d-c354-44f7-8290-ab030c99f321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.057952 Dec 25 21:20:44.578102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2065/4253] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:44 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:44.583644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:44.586636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:44.591372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.591963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.592863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.593400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.731650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:44.738502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cffac56a-ebbf-4f54-9a1e-4a703a561f56 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.863899 Dec 25 21:20:44.739313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2189/4254] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:20:44.751125 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ebe78d4-3298-41bf-9e6e-371a0a0f6bf1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.170966 Dec 25 21:20:44.751295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41541c29-f9d9-4557-a9de-056d3658259f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:44.751804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2066/4255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:44 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:44.758950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41541c29-f9d9-4557-a9de-056d3658259f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:44.821766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:44.822346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:44.823116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-41541c29-f9d9-4557-a9de-056d3658259f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:44.829296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.831752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.831752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:44.831977 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41541c29-f9d9-4557-a9de-056d3658259f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1224 microversion: 2.1 time: 0.083936 Dec 25 21:20:44.832074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:44.832167 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2190/4256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:44 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:44.980939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:44.990480 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-288d4d45-a9ce-4e81-8ab5-4c5ee0a7335c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.172708 Dec 25 21:20:44.991061 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2067/4257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:44 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:45.030547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:45.031419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:45.037418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.037869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.038650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.039082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.079840 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e119725-5d50-429e-b39b-8af8111ac649 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.052869 Dec 25 21:20:45.080492 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2191/4258] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:45 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:45.177551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:45.179153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:45.185530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.186242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.187215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.187807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.244673 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff5ff5f8-1190-4064-9d44-f88f890c25be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.080432 Dec 25 21:20:45.245375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2068/4259] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:45 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:45.272457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1710016775", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "a99e9608-4051-427d-8a99-05dfc6653e1d"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:45.333071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] validate_networks() for [('a99e9608-4051-427d-8a99-05dfc6653e1d', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:20:45.534418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:45.535299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:45.542892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.546417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.546417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.546417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.982689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:20:45.983112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:20:45.983646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:20:45.984097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:20:45.984506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:20:45.990400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:45.993713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.994161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.995013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:45.995444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:45.998319 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4b7fc7c-7342-42a1-9e8a-bc55c2882d28 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.467963 Dec 25 21:20:45.998893 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2069/4260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:45 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:46.003800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:46.004766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.010671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.011337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.012129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.012572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.022068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Getting quotas for project 363ad00286c74e49ac9d96aa0edebda1. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:20:46.027761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Getting quotas for user 89c051b1622c403da5c3fead733e051c and project 363ad00286c74e49ac9d96aa0edebda1. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:20:46.041877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:20:46.044501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:20:46.056192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f2e2219-e50f-47e7-99db-1a459ef58498 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.055989 Dec 25 21:20:46.059629 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2070/4261] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:45 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:46.062525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:46.063256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.070671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.071663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.072466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.072942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.150247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f126c99a-4a45-41c5-944b-b6a24e25e10e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.941472 Dec 25 21:20:46.152258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2192/4262] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:20:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:20:46.156165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:46.156816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.163381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.163854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.164651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.165111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.224504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:46.232089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00d53fe7-faaa-46e7-9919-d9c315acec5d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.173719 Dec 25 21:20:46.232926 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2071/4263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:46 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:46.242906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:46.244771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:46.245490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.248032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50a3162e-d4b9-461a-ab93-ac99aa555d37 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1228 microversion: 2.1 time: 0.096084 Dec 25 21:20:46.248617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2193/4264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:46 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1228 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:46.253677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.253874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:46.254443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.255255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.255395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.255858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.266420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.267035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.267869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.268378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.314648 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13c0ebca-8108-490a-8788-1cf9c2294d60 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.064416 Dec 25 21:20:46.315412 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2194/4265] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:46 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:46.323927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-daf15472-a464-476e-b408-0018888f2f18 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:46.324686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-daf15472-a464-476e-b408-0018888f2f18 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.399704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-daf15472-a464-476e-b408-0018888f2f18 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:46.406856 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-daf15472-a464-476e-b408-0018888f2f18 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1217 microversion: 2.1 time: 0.090115 Dec 25 21:20:46.407439 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2195/4266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:46 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1217 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:46.411970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:46.412949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:46.419718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.420338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.421475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:46.422149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:46.430088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:46.439099 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2bc40b4a-7953-4380-aa98-260e009b15da tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.204942 Dec 25 21:20:46.440037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2072/4267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:46 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:46.484766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e85d4ff-3d45-4c44-94ca-cd6992247068 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.076085 Dec 25 21:20:46.488659 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2196/4268] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:46 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:47.016554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:47.016554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.021821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.022271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.023169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.023613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.068116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:47.069141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.075659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.076108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.076922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.077437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.121645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42bbce00-a7f5-49a9-89b3-174cdd9cedde tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.057977 Dec 25 21:20:47.124908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2197/4269] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:47 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:47.161938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:47.170215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-356f5e1a-407b-4a4d-9b1c-99446ba749e8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.159335 Dec 25 21:20:47.175132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2073/4270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:47 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:47.249595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:47.250284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.257536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.257989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.258761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.259195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.264000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:47.264780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.271949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.272343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.273172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.273617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.368320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:47.377097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1637d3b6-37e8-434e-bf48-590a39e7e097 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1284 microversion: 2.1 time: 0.116924 Dec 25 21:20:47.378045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2074/4271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:47 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:47.382301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:47.383256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.389427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.390644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.390644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.391078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.441258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:47.443903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06970bd4-3353-4514-aa14-5e9692cfc34f tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.064615 Dec 25 21:20:47.445028 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2075/4272] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:47 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:47.451725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:47.452564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.455986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4139a249-0bd6-432c-894c-0e17ad5c32c2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.208716 Dec 25 21:20:47.457510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2198/4273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:47 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:47.462217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:47.462836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.469972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.470419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.471417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.471567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.471963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.472201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.473906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.474364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.569780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:47.578108 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9197c009-ed07-4c20-b887-737a7d602094 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1221 microversion: 2.1 time: 0.131743 Dec 25 21:20:47.578719 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2076/4274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:47 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1221 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:47.583438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:47.584446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:47.594241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.594766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.595558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:47.596066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:47.640807 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51763356-fd94-443e-82e8-6760c239b275 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060722 Dec 25 21:20:47.644588 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2077/4275] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:47 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:47.648936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:47.657135 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-acda552f-0158-4760-a8bf-a7121aba48d7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.198561 Dec 25 21:20:47.657773 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2199/4276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:47 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:48.132344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:48.136579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.140798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.141262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.142061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.142504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.187406 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7f5ba80-afd2-4d4d-8110-ef76944850d3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.059004 Dec 25 21:20:48.190799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2078/4277] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:48 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:48.190936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:48.190936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.195710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.196172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.196995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.198351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.337225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:48.345730 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d880712f-8802-4afd-92a6-67258ec37afc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.161315 Dec 25 21:20:48.346505 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2200/4278] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:48 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:48.398097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:48.399068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.407372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.407922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.408964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.409543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.457994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:48.459335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.466219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.466808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.467704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.468408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.518275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81603c65-12e7-4e7f-8566-7b32f39e6b8e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.063606 Dec 25 21:20:48.519670 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2201/4279] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:48 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:48.527199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:48.528073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.536313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.536780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.541872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.541872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.578882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:48.588995 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d266c2a-5184-48c8-8a7d-40a2fcd5284e tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.195245 Dec 25 21:20:48.590295 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2079/4280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:48 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:48.596452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:48.597303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.604685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.605173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.605972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.606545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.702996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:48.713170 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c235cd0-68af-42da-8486-f7c13ea7214f tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1277 microversion: 2.1 time: 0.120777 Dec 25 21:20:48.714025 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2080/4281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:48 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:48.719886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:48.721033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.727813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.728389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.729617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.734690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.734972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:48.741722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e4b5644-714a-41ab-b4f7-dc54ccb081ba tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.220677 Dec 25 21:20:48.742522 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2202/4282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:48 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:48.756308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:48.756975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:48.772468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.773021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.773901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:48.774312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:48.777806 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03b0e244-d02c-405a-a237-cb542f3e0478 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.061779 Dec 25 21:20:48.779870 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2081/4283] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:48 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:48.927834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:48.937135 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f2b7779-a4f8-435b-aa88-580e47a5cd8c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.184358 Dec 25 21:20:48.937927 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2203/4284] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:48 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:49.199484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:49.200524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.208615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.209108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.209916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.210395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.261287 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58df54f1-c555-448a-b64d-860bf8582697 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.066082 Dec 25 21:20:49.261914 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2082/4285] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:49 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:49.363595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:49.364454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.372225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.372718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.373580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.374053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.533127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:49.534219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.548370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.553379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.554423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.555144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.605212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:49.609539 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77f5d1a6-3577-4abf-817c-36f4044cab19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.080720 Dec 25 21:20:49.610365 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2083/4286] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:49 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:49.615961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:49.617623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.627638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.628148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.629024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.629744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.644802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b857a9da-9cec-4f6d-92bd-6b7df18a0bc7 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.284850 Dec 25 21:20:49.652376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2204/4287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:49 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:49.734404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:49.735906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.750433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.751624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.752782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.753638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.843255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:49.857585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54a1bac3-e959-49b0-bcc4-8b02308b0c03 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.241873 Dec 25 21:20:49.858625 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2084/4288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:49 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:49.860086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:49.864402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:49.865225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.870785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6515ae81-56a7-4469-b82f-af54995b114c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1275 microversion: 2.1 time: 0.143036 Dec 25 21:20:49.872843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.873339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.874148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.874595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.881977 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2205/4289] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:49 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1275 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:49.888721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:49.889884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:49.896911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.897333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.898140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.898554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:49.957203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ffd4f0d2-241b-4ad0-8b59-1da68b20aa9a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.073572 Dec 25 21:20:49.958248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2206/4290] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:49 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:49.966487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e29c13f3-5e5b-43ab-bf14-0848eab823fa req-941f45a0-437a-4ee4-a013-1fd6d83b3249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4", "tag": "ccc1d5bd-ed23-461a-ae87-41bb69b17dca"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:49.968600 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:49.968600 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:49.983204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e29c13f3-5e5b-43ab-bf14-0848eab823fa req-941f45a0-437a-4ee4-a013-1fd6d83b3249 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:49.983619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e29c13f3-5e5b-43ab-bf14-0848eab823fa req-941f45a0-437a-4ee4-a013-1fd6d83b3249 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.011692 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e29c13f3-5e5b-43ab-bf14-0848eab823fa req-941f45a0-437a-4ee4-a013-1fd6d83b3249 service nova] Creating event network-changed:ccc1d5bd-ed23-461a-ae87-41bb69b17dca for instance 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 on nch2-master-1 Dec 25 21:20:50.019080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e29c13f3-5e5b-43ab-bf14-0848eab823fa req-941f45a0-437a-4ee4-a013-1fd6d83b3249 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058694 Dec 25 21:20:50.020044 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2207/4291] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:50.025661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:50.026543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:50.034900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.035484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.036382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.037004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.194082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:50.204448 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1ab2926-49c4-4f2b-909d-f9d03d527d03 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.344757 Dec 25 21:20:50.205078 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2085/4292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:49 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:50.279254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:50.280382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:50.287009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.287620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.288802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.289459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.331740 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0e5e067-4f9e-4277-a592-68356ec1ec97 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.061934 Dec 25 21:20:50.333660 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2086/4293] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:50 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:50.336476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:50.344866 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40946224-ff17-4dc1-a04d-5759be7f17d3 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.323698 Dec 25 21:20:50.345849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2208/4294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:50 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:50.624090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:50.626125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:50.633996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.634545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.636287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.636993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.669372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:50.670058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:50.678121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.678700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.679550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.680122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.687881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b99e9c29-329f-44a5-b2b9-f52d44b61450 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.067765 Dec 25 21:20:50.690661 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2087/4295] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:50 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:50.878252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:50.879648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:50.887791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.888403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.889374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.890219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.952837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:50.966396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2c2be9b5-ae26-471b-b1be-5edd51f04d4f tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.300239 Dec 25 21:20:50.967459 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2209/4296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:50 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:50.975345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:50.975345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:50.983175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.983930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:50.985230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:50.985821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.189639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:51.197208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b78a4a3-8b63-476c-a56e-022a0972d10d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.324931 Dec 25 21:20:51.198493 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2088/4297] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:50 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:51.203115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:51.204246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:51.210195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.210648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.211479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.211921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.259563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:51.265989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-185e4f94-f34f-42c5-9c6b-6f144fc766e2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.066237 Dec 25 21:20:51.266993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22bd1e07-9316-41a8-8bbb-85e29c47797c tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.297900 Dec 25 21:20:51.267865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2089/4298] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:51 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:51.273297 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2210/4299] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:50 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:51.274111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:51.277043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:51.287187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.287987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.288982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.289746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.342785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:51.343762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:51.349942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.350400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.351279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.351627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.394190 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d336f99b-bf01-472a-a013-6233d1599b25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 14 microversion: 2.42 time: 0.054966 Dec 25 21:20:51.395051 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2211/4300] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:51 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:51.402401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:51.403229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:51.410428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.410886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.411678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.412138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.449767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:51.458461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0cd138b4-a65e-4732-bbcd-3ee1d0abd004 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.189164 Dec 25 21:20:51.459109 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2090/4301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:51 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:51.557382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:51.567370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3f1d8939-acf7-4f0f-b1de-093359091e75 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.168742 Dec 25 21:20:51.569125 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2212/4302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:51 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:51.701350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:51.702299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:51.709211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.709670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.710466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.710938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.755362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7916d7a9-206f-4cbf-80df-98a23608fb97 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057739 Dec 25 21:20:51.755996 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2091/4303] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:51 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:51.990256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:51.990871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:51.997860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.998317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:51.999092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:51.999530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.036649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7ff23581-75a3-48dc-bc17-6e634b205215 req-d6c4842a-488c-4ebf-bccf-63952262c144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5", "tag": "a63c4532-3c2e-4893-bf9a-eef4032f9a9e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:52.038387 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:52.038387 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:52.047861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7ff23581-75a3-48dc-bc17-6e634b205215 req-d6c4842a-488c-4ebf-bccf-63952262c144 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.048408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7ff23581-75a3-48dc-bc17-6e634b205215 req-d6c4842a-488c-4ebf-bccf-63952262c144 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.059834 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7ff23581-75a3-48dc-bc17-6e634b205215 req-d6c4842a-488c-4ebf-bccf-63952262c144 service nova] Creating event network-changed:a63c4532-3c2e-4893-bf9a-eef4032f9a9e for instance 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 on nch2-master-1 Dec 25 21:20:52.064747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7ff23581-75a3-48dc-bc17-6e634b205215 req-d6c4842a-488c-4ebf-bccf-63952262c144 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032135 Dec 25 21:20:52.065396 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2092/4304] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:20:52.141535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:52.149356 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26763992-39ee-4855-9411-4870bfdb74a6 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.162811 Dec 25 21:20:52.149934 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2213/4305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:51 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:52.215448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:52.216244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.222462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.229019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.229019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.229019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.279088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:52.280021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.287408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.287896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.288698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.289166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.333255 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-829dee71-2f2c-491a-9700-aca1fc608c7f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058595 Dec 25 21:20:52.337164 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2214/4306] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:52 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:52.340291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:52.340935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.348359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.348821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.349644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.350086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.375366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:52.383945 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-753b337a-3357-4b7b-ac45-c5e624900ba0 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.173571 Dec 25 21:20:52.384581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2093/4307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:52 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:52.405862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:52.407410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.412898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.413506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.414478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.415037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.472122 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fdd09318-6578-4b37-a585-6aae1fc8e141 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 8164 microversion: 2.42 time: 0.069978 Dec 25 21:20:52.473262 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2094/4308] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:52 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 8164 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:20:52.478372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:52.479239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.486464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.487042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.487910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.488351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.491275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:52.501038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dbeba867-61c5-4315-ae8c-7f3f791225e8 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.165521 Dec 25 21:20:52.510637 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2215/4309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:52 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:52.583436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:52.584142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.591245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.591750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.592541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.593004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.635007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:52.643349 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3969718-977a-418b-8a41-f102ea913359 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.168910 Dec 25 21:20:52.644024 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2095/4310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:52 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:52.730118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:52.737574 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42111d6a-aaa1-418d-b83f-27260282676a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.157883 Dec 25 21:20:52.738146 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2216/4311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:52 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:52.766973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:52.767908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:52.776674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.777168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.777987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:52.778429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:52.819393 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac64d81d-6918-4023-ac99-f610ea42052a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.056025 Dec 25 21:20:52.820917 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2096/4312] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:52 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:53.167911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:53.168561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.178040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.178513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.179300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.179738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.312967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:53.320294 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b02d52fb-6b61-4580-b4c0-b71fc879cd52 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.156916 Dec 25 21:20:53.320859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2217/4313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:53 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:53.344728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:53.345781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.352723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.353208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.354721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.355157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.395938 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f4ccd8c-1d1a-4028-811f-709c1b2b52d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055071 Dec 25 21:20:53.397233 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2097/4314] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:53 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:53.400370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:53.401516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.407614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.408070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.408846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.409312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.484420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:53.485445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.492426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.492909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.493705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.494145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.539912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:53.547017 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-464963e5-ecd3-414e-858c-8ec094f19f22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 16357 microversion: 2.42 time: 0.066596 Dec 25 21:20:53.547845 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2098/4315] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:53 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 16357 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:20:53.548328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6038f6ed-db4c-4864-a72a-7ec64d598b0c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.151609 Dec 25 21:20:53.549080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2218/4316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:53 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:53.553540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:53.554244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.560867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.561353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.562239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.562688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.660668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:53.661231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.668239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.668688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.669522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.669963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.700043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:53.708218 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b820d98a-102b-4c96-96f6-752d7e2a6ce1 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.159225 Dec 25 21:20:53.709047 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2099/4317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:53 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:53.754295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:53.755353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.762188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.762650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.763451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.763891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.843278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:53.851180 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89c5b795-2deb-4cc3-bb88-ff1ee23c099c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.194104 Dec 25 21:20:53.851912 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2219/4318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:53 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:53.856472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:53.857958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:53.863894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.864459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.865595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:53.865939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:53.906683 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b5f45074-9286-4a44-97a1-c3e3c8a9659b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.053415 Dec 25 21:20:53.908167 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2220/4319] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:53 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:53.922361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:53.930483 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b44e2b23-6ef4-43e0-b676-c9614fbdb709 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.179978 Dec 25 21:20:53.931073 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2100/4320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:53 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:54.339092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:54.340455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.348311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.348764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.349571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.350004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.407289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:54.408274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.414800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.415256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.417361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.417361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.459151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0eb0966-8df6-4303-9fad-b21e1fe01059 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055420 Dec 25 21:20:54.462755 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2101/4321] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:54 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:54.493875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:54.498563 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d77c888-af5e-4cbe-b1bc-34531e3ab55c tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.164853 Dec 25 21:20:54.499123 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2221/4322] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:54 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:54.559526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:54.560524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.564201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:54.564821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.567693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.568149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.569241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.569684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.570809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.571267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.572054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.572494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.610712 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d90d9c8f-6d06-48d0-b18d-07a32ac88770 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 16357 microversion: 2.42 time: 0.055852 Dec 25 21:20:54.612159 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2102/4323] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:54 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 16357 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:54.705116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:54.712553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1bab23df-64a3-433f-914a-fcc869bff684 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.152036 Dec 25 21:20:54.713169 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2222/4324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:54 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:54.725367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:54.726072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.733707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.734159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.734936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.735372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.867803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:54.868408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.875089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:54.875261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.877592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.877592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.877592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.882778 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f25a8d14-3a5b-48df-b96d-5882a8092f56 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.161677 Dec 25 21:20:54.883347 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2103/4325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:54 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:54.918984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:54.920039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.926316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.926928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.927554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.927994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.970565 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51d41df5-132e-4567-9b48-9f6749a9ee14 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.055592 Dec 25 21:20:54.971573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2104/4326] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:54 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:54.978148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:54.978876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:54.987655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.988184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:54.989113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:54.989546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.019534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:55.027637 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d23d9d99-f544-4626-a45f-3ee404c3c8aa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.163531 Dec 25 21:20:55.028204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2223/4327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:54 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:55.121463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:55.129414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a617656e-4bd0-43fa-be8b-a1feb717160c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.156851 Dec 25 21:20:55.130039 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2105/4328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:54 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:55.470474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:55.471480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:55.478258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.478686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.479465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.480057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.515872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:55.516689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:55.522238 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02b897a3-75e4-4116-bad5-c3bf2162d3ae tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055349 Dec 25 21:20:55.523103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2224/4329] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:55 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:55.523509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.524040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.524932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.525469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.623898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:55.625207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:55.632999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.633446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.634734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.634734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.671587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:55.686549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a18fdbc-7a79-4944-b38d-be0912a708ce tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.172457 Dec 25 21:20:55.686549 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2106/4330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:55 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:55.689941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ccc4eac-c808-4389-a174-baa51c628ed4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 16357 microversion: 2.42 time: 0.070856 Dec 25 21:20:55.691443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2225/4331] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:55 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 16357 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:55.730917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:55.731824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:55.738836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.739290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.740089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.740531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.883248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:55.894375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48f94485-4cdd-4f67-8ed4-c1340d731db7 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.166901 Dec 25 21:20:55.894375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2107/4332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:55 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:55.902889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:55.903652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:55.910966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.911513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.912303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.912742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.983653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:55.985820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:55.994379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.995876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:55.997565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:55.998446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.048125 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26a57c52-d7d1-4237-87dd-98355fae9399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.069089 Dec 25 21:20:56.049321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2108/4333] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:55 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:56.054840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-162a4f00-04c0-4bbe-b55a-01cbd930245f req-ccd8d67e-ed07-4be8-8f57-2bdcf75aa66d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4", "name": "network-vif-plugged", "status": "completed", "tag": "ccc1d5bd-ed23-461a-ae87-41bb69b17dca"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:56.056421 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:56.056421 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:20:56.067493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-162a4f00-04c0-4bbe-b55a-01cbd930245f req-ccd8d67e-ed07-4be8-8f57-2bdcf75aa66d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.072002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-162a4f00-04c0-4bbe-b55a-01cbd930245f req-ccd8d67e-ed07-4be8-8f57-2bdcf75aa66d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.082750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-162a4f00-04c0-4bbe-b55a-01cbd930245f req-ccd8d67e-ed07-4be8-8f57-2bdcf75aa66d service nova] Creating event network-vif-plugged:ccc1d5bd-ed23-461a-ae87-41bb69b17dca for instance 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 on nch2-master-1 Dec 25 21:20:56.083024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:56.088152 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-162a4f00-04c0-4bbe-b55a-01cbd930245f req-ccd8d67e-ed07-4be8-8f57-2bdcf75aa66d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036966 Dec 25 21:20:56.089460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2109/4334] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:20:56.091429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f3e3e19-0467-4c22-8a97-15e4c80e7c57 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.192851 Dec 25 21:20:56.100698 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2226/4335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:55 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:56.100855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:56.100855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:56.102948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.103413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.104751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.105280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.146282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:56.149070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:56.156064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.156588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.157442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.157880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.332665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:56.341166 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf3c849f-b6d5-4a4d-bc87-2796e20abaed tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.250702 Dec 25 21:20:56.341752 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2110/4336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:56 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:56.369783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:56.377563 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0179e725-46a7-4345-852d-b14294387e84 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.235644 Dec 25 21:20:56.378140 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2227/4337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:56 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:56.534773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:56.535737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:56.543062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.543513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.544290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.544726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.586414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e0394e0-d6d0-4d99-b788-07dd1ef1f8b1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055409 Dec 25 21:20:56.587086 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2111/4338] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:56 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:56.703378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:56.703908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:56.704968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:56.706538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:56.710872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.711315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.719257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.719257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.719490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.719490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.720215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.720925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.773198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23d7ea8f-44ba-4f01-bb1e-b454a615df26 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 16357 microversion: 2.42 time: 0.073031 Dec 25 21:20:56.773861 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2112/4339] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:56 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 16357 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:20:56.855342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:56.863645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2610101-d264-4449-b07e-6eeb94f368bc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.164064 Dec 25 21:20:56.864261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2228/4340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:56 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:56.909999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:56.910697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:56.918210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.918663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:56.919444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:56.919885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.057795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:57.060231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:57.061214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.065864 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c04d341-af8a-4dfb-aad0-f5c1eabeb557 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1324 microversion: 2.1 time: 0.159868 Dec 25 21:20:57.066478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2113/4341] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:56 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:57.067255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.067679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.068478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.068938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.107421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:57.108039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.109254 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64f17db7-15fa-4b5a-9431-629c07aa4781 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.053185 Dec 25 21:20:57.110166 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2229/4342] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:57 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:57.114184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.114636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.115433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.115876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.249680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:57.258052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b32dacd-ad0e-4465-9c40-4f1211031461 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.154452 Dec 25 21:20:57.258696 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2114/4343] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:57 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:57.358961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:57.359654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.367021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.367466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.368252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.368707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.393387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:57.393985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.400057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.400539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.401378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.401820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.558240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:57.565689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e663f6db-ac73-452c-a31c-e5aeda1c211d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.211479 Dec 25 21:20:57.566571 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2230/4344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:57 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:57.588979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:57.597177 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e13501df-1464-47bc-88d1-8cdfb71b3293 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.207317 Dec 25 21:20:57.607205 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2115/4345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:57 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:57.607380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:57.607380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.607380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.607380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.607825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.608294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.647756 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d6e347e-ed2f-42d8-93b3-b8b135d8b862 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.053015 Dec 25 21:20:57.648592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2231/4346] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:57 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:20:57.786102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:57.787048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.794900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.795438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.796633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.797189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.840595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52f312ff-637c-436d-88c4-f1479b033c2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 16357 microversion: 2.42 time: 0.058521 Dec 25 21:20:57.841279 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2116/4347] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:57 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 16357 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:57.880959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:57.881686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:57.889094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.889544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:57.890329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:57.890763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.024412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:58.032723 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-799c9ba7-e364-46d8-99a7-5aa148ec3b78 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.155795 Dec 25 21:20:58.033332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2232/4348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:57 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:58.083515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.084230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.092339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.092795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.093746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.094136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.104392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-dfd75127-b6af-4420-ad6c-6c4d12b78b59 req-db8c4ed3-38e5-408b-af22-90241190bac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5", "name": "network-vif-plugged", "status": "completed", "tag": "a63c4532-3c2e-4893-bf9a-eef4032f9a9e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:58.107396 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:20:58.107396 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:20:58.116038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dfd75127-b6af-4420-ad6c-6c4d12b78b59 req-db8c4ed3-38e5-408b-af22-90241190bac5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.116038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dfd75127-b6af-4420-ad6c-6c4d12b78b59 req-db8c4ed3-38e5-408b-af22-90241190bac5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.127155 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-dfd75127-b6af-4420-ad6c-6c4d12b78b59 req-db8c4ed3-38e5-408b-af22-90241190bac5 service nova] Creating event network-vif-plugged:a63c4532-3c2e-4893-bf9a-eef4032f9a9e for instance 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 on nch2-master-1 Dec 25 21:20:58.132186 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-dfd75127-b6af-4420-ad6c-6c4d12b78b59 req-db8c4ed3-38e5-408b-af22-90241190bac5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 Dec 25 21:20:58.133302 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2233/4349] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:20:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:20:58.141702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:58.142773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.153876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.154415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.155267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.155760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.209039 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-014ed99f-06e9-4913-9730-a4195b7dba90 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.071297 Dec 25 21:20:58.210567 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2234/4350] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:58 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:58.249373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:58.257063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d111f2c-c34d-4f4a-8782-8f7f581689c3 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1520 microversion: 2.1 time: 0.177619 Dec 25 21:20:58.257701 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2117/4351] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:58.275488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.276308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.276805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.277087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.283787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.284284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.284413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.284737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.285118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.287263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.287405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.287494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.317760 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] HTTP exception thrown: Action 999 not found Dec 25 21:20:58.318298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Returning 404 to user: Action 999 not found {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:58.319138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-206ae2c7-829d-49ac-b5c9-a310a9c5956c tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.048021 Dec 25 21:20:58.324554 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2235/4352] 10.222.0.32 () {58 vars in 1307 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4/os-instance-actions/999 => generated 66 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:20:58.333574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00ec4abf-0659-4675-a80b-33869781aa97 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '.version_select at 0x7fa4f6917e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.339087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00ec4abf-0659-4675-a80b-33869781aa97 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2f2b4aa6-c35a-41b6-9d30-b7556a8d7843] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.345516 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-00ec4abf-0659-4675-a80b-33869781aa97 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] HTTP exception thrown: Instance 2f2b4aa6-c35a-41b6-9d30-b7556a8d7843 could not be found. Dec 25 21:20:58.346126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00ec4abf-0659-4675-a80b-33869781aa97 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Returning 404 to user: Instance 2f2b4aa6-c35a-41b6-9d30-b7556a8d7843 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:20:58.346980 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00ec4abf-0659-4675-a80b-33869781aa97 tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2f2b4aa6-c35a-41b6-9d30-b7556a8d7843/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.021406 Dec 25 21:20:58.347568 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2236/4353] 10.222.0.32 () {58 vars in 1295 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/2f2b4aa6-c35a-41b6-9d30-b7556a8d7843/os-instance-actions => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:20:58.358511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.359013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.365585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.366001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.367828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.367828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.394026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:20:58.438815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:58.446347 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0e0a3613-c081-4b5d-8a89-69c32b61dc86 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.175392 Dec 25 21:20:58.448350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2118/4354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:58.582958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.583506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.589507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.589958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.590760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.591201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.622806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c6f2bc5-ccbd-4899-9965-c62481f1c75f tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 204 len: 0 microversion: 2.1 time: 0.267849 Dec 25 21:20:58.623444 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2237/4355] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:20:58 2021] DELETE /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:20:58.628765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.629569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.636699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.637193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.637992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.638436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.767640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:58.775903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c86f0e4f-f41e-4bbb-b645-1865c5a31c06 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.197157 Dec 25 21:20:58.776633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2119/4356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:58.781055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:58.781729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.787911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.788362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.789182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.789612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.820606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:58.829348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e08fe08-250a-44fe-8fb3-506f33293fb6 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.204640 Dec 25 21:20:58.830036 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2238/4357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:58.834706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:58.835669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.841955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.848798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.848798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.848798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.886060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa27f793-ca7b-461f-a1dc-967f9c2d0ed6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054808 Dec 25 21:20:58.887088 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2239/4358] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:58 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:58.892341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:58.893436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:58.901076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.905095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.905095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:58.905095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:58.938208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:58.946291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6804890-fd3f-419d-8faf-9840d998fdca tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1526 microversion: 2.1 time: 0.168593 Dec 25 21:20:58.946869 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2120/4359] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:58 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1526 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:58.959976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-488a3b14-185a-4de0-9270-d907954b46b0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.071483 Dec 25 21:20:58.960746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2240/4360] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:20:58 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:20:59.049714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:59.050509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:59.057721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.058167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.058961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.059400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.202665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:59.211584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea29206e-ec2e-463b-9678-21f8acd72737 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.165826 Dec 25 21:20:59.212450 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2121/4361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:59 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:20:59.226090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:20:59.228235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:59.236675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.237235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.238317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.238763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.295514 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-57983a39-8c1b-473e-9cb5-3b262aa5a5fb tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.073351 Dec 25 21:20:59.297384 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2241/4362] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:20:59 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:20:59.464221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:59.464756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:59.472071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.472538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.473373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.473820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.604955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:20:59.612372 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dbc2f599-e1c7-43fd-ad69-926e56b857b9 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1317 microversion: 2.1 time: 0.152691 Dec 25 21:20:59.613102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2122/4363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:59 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:20:59.794165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:59.794864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:59.802334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.802909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.803689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.804124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.846345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:20:59.846928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:20:59.853260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.853718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:20:59.854618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:20:59.855064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.217956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:00.226028 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6cad9f2c-5c4e-45a1-9998-323cb537b8f7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.436426 Dec 25 21:21:00.226711 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2242/4364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:59 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:00.231587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:00.232647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.239453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.239953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.240838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.241351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.265637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:00.273199 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75c33884-cb07-495f-8faf-6209d6832cd2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.430870 Dec 25 21:21:00.273784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2123/4365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:20:59 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:00.278358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:00.278997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.282451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc9ec164-0ad8-4923-a512-a1988bb981b0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054461 Dec 25 21:21:00.286322 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2243/4366] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:00 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:00.286559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.286559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.286559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.286830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.289682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:00.289682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.297488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.297933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.298712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.299146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.346259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d03bca8c-6015-4670-99bc-a1afadb7859c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.061551 Dec 25 21:21:00.350237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2244/4367] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:00.353200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:00.355127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.361569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.362020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.362812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.363248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.457340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:00.464558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56e7e8d7-99ed-4bb3-8e98-7fffb37e4c8a tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1526 microversion: 2.1 time: 0.189615 Dec 25 21:21:00.465154 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2124/4368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:00 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1526 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:00.474186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:00.474186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.479483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.480027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.480931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.481459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.530365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c87a1f0-7d00-4c2a-aceb-729bb7b7cb6b tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.063947 Dec 25 21:21:00.532070 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2125/4369] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:00 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:00.534940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:00.543411 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7e153c6-df43-4256-8830-9b9131f882aa tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.194788 Dec 25 21:21:00.543988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2245/4370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:00 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:00.633284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:00.633284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.642376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.642835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.643682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.644119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.802451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:00.810870 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd300e2a-52a0-4599-8693-5018dbfd7185 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1507 microversion: 2.1 time: 0.185133 Dec 25 21:21:00.811452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2126/4371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:00 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:00.828565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:00.829126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.835992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.836446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.837253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.837685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.867600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:00.868570 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a1717e9-09e7-4820-aaa7-6b9d867d623b tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5/os-instance-actions/req-f126c99a-4a45-41c5-944b-b6a24e25e10e" status: 200 len: 313 microversion: 2.1 time: 0.044002 Dec 25 21:21:00.869181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2246/4372] 10.222.0.32 () {58 vars in 1418 bytes} [Sat Dec 25 21:21:00 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5/os-instance-actions/req-f126c99a-4a45-41c5-944b-b6a24e25e10e => generated 313 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:00.881818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:00.882778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:00.889811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.890307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.891452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.891904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.972842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d207f0c1-cfaa-4c81-8db9-8d97bd6be727 req-7d3e12be-50ca-4deb-8c8a-dc052b1180d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4", "name": "network-vif-deleted", "tag": "ccc1d5bd-ed23-461a-ae87-41bb69b17dca"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:00.974513 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:00.974513 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:00.981832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d207f0c1-cfaa-4c81-8db9-8d97bd6be727 req-7d3e12be-50ca-4deb-8c8a-dc052b1180d8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:00.982282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d207f0c1-cfaa-4c81-8db9-8d97bd6be727 req-7d3e12be-50ca-4deb-8c8a-dc052b1180d8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:00.995569 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d207f0c1-cfaa-4c81-8db9-8d97bd6be727 req-7d3e12be-50ca-4deb-8c8a-dc052b1180d8 service nova] Creating event network-vif-deleted:ccc1d5bd-ed23-461a-ae87-41bb69b17dca for instance 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 on nch2-master-1 Dec 25 21:21:01.000489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d207f0c1-cfaa-4c81-8db9-8d97bd6be727 req-7d3e12be-50ca-4deb-8c8a-dc052b1180d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Dec 25 21:21:01.001047 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2247/4373] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:01.111719 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d36c5563-75fb-42a9-8e42-fd2c501a9248 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "POST /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5/action" status: 202 len: 0 microversion: 2.1 time: 0.233535 Dec 25 21:21:01.112902 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2127/4374] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:00 2021] POST /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:01.122477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:01.123476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.130683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.130919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.131690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.132127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.246314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:01.247024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.259134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.259134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.259134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.259134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.272850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:01.281550 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b703275f-9744-4426-81f4-dfb5390fa4b2 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1509 microversion: 2.1 time: 0.164418 Dec 25 21:21:01.292310 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2248/4375] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:01 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:01.292310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:01.293193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.299858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.300314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.301138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.302207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.466062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:01.474813 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-853d07f5-cd23-41d3-aa8c-09e9562c19a6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1513 microversion: 2.1 time: 0.235646 Dec 25 21:21:01.485212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2128/4376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:01 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1513 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:01.485212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:01.485212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.489303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.489511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.490427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.490953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.498953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:01.507518 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3516419b-4bcb-41be-bdd1-5077586c7802 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.221087 Dec 25 21:21:01.508307 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2249/4377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:01 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:01.512821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:01.513755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.520703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.521192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.521982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.522423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.537327 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7c5e20b-bed7-43cc-a145-841ceb6a902f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060251 Dec 25 21:21:01.538319 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2129/4378] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:01 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:01.544210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:01.545023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.555875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.556331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.557413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.557896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.571453 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d997f94-4817-4430-ad49-08ab1d3164ec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062104 Dec 25 21:21:01.572976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2250/4379] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:01 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:01.577600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:01.578583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.585704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.586157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.586940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.587425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.597104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.597653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.598195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lazy-loading 'fault' on Instance uuid 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:01.642417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55b39997f2f648ca8329c1d17120b62c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e25bb59aaf6463b813f8a47e00b807e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:01.642600 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d320962-fc02-4aa1-9674-5ec89c84b4ba tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.068755 Dec 25 21:21:01.646530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2251/4380] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:01 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:01.649165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:01.649482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:01.651843 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50dc2917-e3b0-4539-88b1-c0d63a58a70b tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 200 len: 1314 microversion: 2.1 time: 0.112120 Dec 25 21:21:01.652699 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2130/4381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:01 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 1314 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:01.657532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.657690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.658470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:01.659454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:01.800052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:01.807718 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-875feb51-a314-4e67-92b2-194d18b806ec tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.162788 Dec 25 21:21:01.808329 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2252/4382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:01 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:02.302257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:02.302947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.310138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.310600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.316067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.316067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.450909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:02.458576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7d02e8b-e874-4082-8038-f5d50b65d478 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1514 microversion: 2.1 time: 0.160106 Dec 25 21:21:02.459150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2131/4383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:02 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:02.491937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:02.492711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.499505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.499951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.500727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.501186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.524901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:02.526234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.532307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.532805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.533624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.534064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.698079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:02.707371 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22d66683-6792-4693-af06-84c4ba07c217 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1490 microversion: 2.1 time: 0.218615 Dec 25 21:21:02.707801 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2253/4384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:02 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1490 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:02.712936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:02.714565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.726449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:02.728374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.728943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.730031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.730281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.734901 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49eb3697-2d65-4c72-b871-7ee58ae6ab56 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.213814 Dec 25 21:21:02.735486 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2132/4385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:02 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:02.740809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:02.741918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.748242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.748705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.749533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.749974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.772440 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3bdf2ebd-8b73-4338-a27a-770fa4d542d6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063380 Dec 25 21:21:02.773378 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2254/4386] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:02 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:02.782586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:02.783603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.790727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.791417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.792221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.792662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.795227 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d25330ca-870b-49fa-ac0b-b09a50751611 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058192 Dec 25 21:21:02.799403 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2133/4387] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:02 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:02.801144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:02.801895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] [instance: 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.808811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.809313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.810114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.810556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.825338 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] HTTP exception thrown: Instance 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 could not be found. Dec 25 21:21:02.825941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] Returning 404 to user: Instance 2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:02.826791 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d6d66c8-1d48-44c4-a0e9-ad5721f90d6d tempest-InstanceActionsNegativeTestJSON-1067309904 tempest-InstanceActionsNegativeTestJSON-1067309904-project] 10.222.0.32 "GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4" status: 404 len: 111 microversion: 2.1 time: 0.029566 Dec 25 21:21:02.827352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2134/4388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:02 2021] GET /compute/v2.1/servers/2b3390a0-3ddd-4b99-8b26-bdd23b7e22e4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:02.832259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:02.833252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.835722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2190a308-bd89-4245-8edc-3ba956c75c66 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057292 Dec 25 21:21:02.837070 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2255/4389] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:02 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:02.841109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.841109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.841582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.841911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.842056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:02.842617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.849679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.850139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.850939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.854280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.895344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04167213-6a37-4b12-bc42-4d89b0b09790 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 200 len: 166 microversion: 2.1 time: 0.066613 Dec 25 21:21:02.896221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2135/4390] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:02 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 166 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:02.906340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:02.907047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:02.924039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.924602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:02.925557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:02.925744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.034783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:03.042664 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-696eaa25-6a77-4cd7-8b78-802fa44ee86b tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1511 microversion: 2.1 time: 0.205056 Dec 25 21:21:03.043243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2256/4391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:02 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1511 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:03.103509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:03.111092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09e8684e-aab5-423e-8b8d-333c64193f97 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.209015 Dec 25 21:21:03.112894 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2136/4392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:02 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:03.135797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:03.136384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:03.143016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:03.143475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.144620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:03.144718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.389128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:03.397244 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-350653da-e5e3-40d6-8191-9815e769d842 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.265865 Dec 25 21:21:03.397848 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2257/4393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:03 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:03.475286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:03.476543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:03.484025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:03.484658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.485506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:03.485953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.506393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-449145876", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "050fe506-29b6-4536-b03a-6d4fd9d4993c"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:03.560540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] validate_networks() for [('050fe506-29b6-4536-b03a-6d4fd9d4993c', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:03.740087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:03.749248 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-432c63d0-6292-44ce-b44e-f0cff64402bf tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1507 microversion: 2.1 time: 0.277598 Dec 25 21:21:03.750018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2137/4394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:03 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1507 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:03.755622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:03.756386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:03.762667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:03.763227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.767281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:03.767281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:03.983767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:03.991295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-742cb280-55c2-4ee8-b58c-2a45c6478ed5 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.240193 Dec 25 21:21:03.991923 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2138/4395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:03 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:03.996453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '.version_select at 0x7fa4f738d820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:03.997052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.002860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.003320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.004111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.004556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.040342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-568e66f3-c8da-456d-83ee-b426bd551114 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.047350 Dec 25 21:21:04.041696 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2139/4396] 10.222.0.32 () {58 vars in 1295 bytes} [Sat Dec 25 21:21:03 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5/os-instance-actions => generated 611 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:04.049149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:04.049900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.056316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.062994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.062994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.062994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.091010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:04.091524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:04.092167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:04.092592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:04.093028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:04.102224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.102672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.103532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.103971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.107834 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cda86654-ec17-477e-b8f7-0aad59b762ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065037 Dec 25 21:21:04.108744 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2140/4397] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:04 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:04.116540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:04.117934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.123470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:04.125907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.126749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.127719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.128384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.129161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:04.144672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:04.147088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:04.187056 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-472b954f-9416-4251-8842-4c344bc83d24 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.076358 Dec 25 21:21:04.187910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2141/4398] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:04 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:04.194835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:04.195922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.203019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.203471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.204253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.204691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.246057 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d72ffa96-b93e-4b16-8841-62fd8da85399 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057079 Dec 25 21:21:04.246709 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2142/4399] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:04 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:04.251584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:04.252157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.259092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.259544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.260845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.261306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.288462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:04.298805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1fe2c755-5b4f-4455-85d6-4a9c743f4399 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.797091 Dec 25 21:21:04.299660 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2258/4400] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:03 2021] POST /compute/v2.1/servers => generated 380 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:21:04.303924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:04.304539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.312358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.317314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.325057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.325057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.484714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:04.491249 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3596af1-ec9f-48de-9297-12caf7a8ae44 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1488 microversion: 2.1 time: 0.190766 Dec 25 21:21:04.492022 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2259/4401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:04 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1488 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:04.496914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-034ec6c6-1863-4ed9-a6a1-130cf65662b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:04.497649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-034ec6c6-1863-4ed9-a6a1-130cf65662b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.549477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-034ec6c6-1863-4ed9-a6a1-130cf65662b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:04.556446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-034ec6c6-1863-4ed9-a6a1-130cf65662b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1214 microversion: 2.1 time: 0.063662 Dec 25 21:21:04.557626 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2260/4402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:04 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:04.562021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-26162108"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:04.563286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.571083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.571540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.572989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.573501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.748761 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-412cff38-933f-469b-9c1a-c01427588422 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 204 len: 0 microversion: 2.1 time: 0.500339 Dec 25 21:21:04.749539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2143/4403] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:04 2021] DELETE /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:04.752803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5325eee6-d86f-4172-9886-93e5a16171fe tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "PUT /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1060 microversion: 2.1 time: 0.194092 Dec 25 21:21:04.753785 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2261/4404] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:21:04 2021] PUT /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1060 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:04.764450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:04.765337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.772462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:04.772647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.773109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:04.773285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.774881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.775562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.779394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.779854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.780657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:04.781123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:04.984760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:04.988947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:04.992685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-353ce0c7-24d4-455b-b5e3-9bdccdc8dbdc tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1487 microversion: 2.1 time: 0.223750 Dec 25 21:21:05.002319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2262/4405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:04 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1487 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:05.002611 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9122acac-e91b-43bd-acda-de1bc94b880e tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1513 microversion: 2.1 time: 0.243318 Dec 25 21:21:05.002611 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2144/4406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:04 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1513 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:05.009299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:05.009972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.010937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:05.011605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.016154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.016609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.017437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.017801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.017950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.018249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.019026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.019455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.221508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:05.224499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:05.230090 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-001e1b2a-3404-4237-82d3-fe89b7e49a69 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1487 microversion: 2.1 time: 0.224357 Dec 25 21:21:05.230867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2145/4407] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:05 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1487 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:05.234292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b00e8177-09a4-47f4-9997-27fa8b903bd7 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.228790 Dec 25 21:21:05.235017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2263/4408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:05 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:05.235263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:05.236292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.239634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:05.241786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.246636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.247092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.247758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.247938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.248376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.249215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.250136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.250775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.290672 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f34cb8b5-0627-4b7b-90ef-fae0b6151a0d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058727 Dec 25 21:21:05.298416 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2146/4409] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:05 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:05.298580 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae46b3a0-79ca-457b-a803-df3739503068 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.055748 Dec 25 21:21:05.298580 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2264/4410] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:05 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:05.298730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:05.298730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.298891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:05.299454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.306300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.306800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.306908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.307346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.307753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.308194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.308320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.308651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.337063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:05.358478 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a70c9261-00c2-4a76-9c5c-1107d73ff09a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.063925 Dec 25 21:21:05.359819 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2265/4411] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:05 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:05.574947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:05.575696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.583127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.583580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.584355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.584790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.647276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:05.655872 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8cdfaa9-e005-4360-9414-f81eed2c25a0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1218 microversion: 2.1 time: 0.085842 Dec 25 21:21:05.656435 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2266/4412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:05 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:05.691109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b501779-c1b7-471f-87fa-9daa1cebfdf8 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 204 len: 0 microversion: 2.1 time: 0.397401 Dec 25 21:21:05.691888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2147/4413] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:05 2021] DELETE /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:05.700619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:05.701268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:05.707407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.707863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.708679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:05.709148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:05.861847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:05.870780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79d31a3a-ecb2-4277-8eee-030ef1056813 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1493 microversion: 2.1 time: 0.174419 Dec 25 21:21:05.871554 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2267/4414] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:05 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1493 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:06.015718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:06.016339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.023507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.023961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.024768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.025238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.168293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:06.180209 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03143891-51ed-4637-a12d-f43407cd2684 tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1513 microversion: 2.1 time: 0.168248 Dec 25 21:21:06.182111 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2148/4415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:06 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:06.251231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:06.251844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.258400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.258854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.260276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.260832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.302750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:06.304003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.320225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.320683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.321507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.322155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.404340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:06.411731 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9638ed4-332c-487d-bad5-096a7b2ef3ed tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.112571 Dec 25 21:21:06.412764 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2149/4416] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:06 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:06.413007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b6e89b73-d329-48a4-bc81-9837af8eef62 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.165622 Dec 25 21:21:06.413591 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2268/4417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:06 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:06.418799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:06.419264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:06.419708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.420683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.426122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.426580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.427376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.427840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.428655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.429146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.429951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.430564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.476133 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baae05f6-503a-477b-8f99-51e962a66435 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.061304 Dec 25 21:21:06.477499 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2150/4418] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:06 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:06.485804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-219e8948-00cf-468b-867d-490c2a7d1585 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.070869 Dec 25 21:21:06.490023 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2269/4419] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:06 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:06.675282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:06.676252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.685268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.686013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.686814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.687492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.767137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:06.776103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5522869b-5dd1-4967-bd43-4f38a93888e1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1274 microversion: 2.1 time: 0.106100 Dec 25 21:21:06.777101 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2151/4420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:06 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1274 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:06.889001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:06.890604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:06.903979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.904438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:06.905284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:06.905921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.175252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:07.184859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe508b70-d72e-4f2c-aa89-c204b2305429 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1493 microversion: 2.1 time: 0.299893 Dec 25 21:21:07.197848 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2270/4421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:06 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1493 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:07.199104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:07.199757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:07.206731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.211152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.211152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.211152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.424375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:07.425369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:07.434013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.437959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.437959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.437959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.480444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:07.483680 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-57c2209f-2003-4b05-b7cf-14e603019151 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063323 Dec 25 21:21:07.488257 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2271/4422] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:07 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:07.493378 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebd23b67-8939-476c-bdaf-0e07cf73f4ab tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1513 microversion: 2.1 time: 0.298994 Dec 25 21:21:07.495091 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2152/4423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:07 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:07.497855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:07.499824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:07.500765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:07.502955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:07.512665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.513896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.514161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.514367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.517972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.520829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.521903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.522445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.586640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4adf049-4b68-4d8d-96b7-ebb7d3675dd4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.090055 Dec 25 21:21:07.589245 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2153/4424] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:07 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:07.592758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:07.593784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:07.602573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.603037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.603912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.604326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.682368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c3a87c8-c576-4229-b899-774b0e7923e5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.092806 Dec 25 21:21:07.686370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2154/4425] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:07 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:07.696060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b74cde6f-0c68-42fd-85b5-152c5c1d75af req-93b2bde5-5033-4c67-8c83-55fb6dfe55e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5", "name": "network-vif-deleted", "tag": "a63c4532-3c2e-4893-bf9a-eef4032f9a9e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:07.701939 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:07.701939 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:07.719120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b74cde6f-0c68-42fd-85b5-152c5c1d75af req-93b2bde5-5033-4c67-8c83-55fb6dfe55e6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.719588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b74cde6f-0c68-42fd-85b5-152c5c1d75af req-93b2bde5-5033-4c67-8c83-55fb6dfe55e6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.749771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b74cde6f-0c68-42fd-85b5-152c5c1d75af req-93b2bde5-5033-4c67-8c83-55fb6dfe55e6 service nova] Creating event network-vif-deleted:a63c4532-3c2e-4893-bf9a-eef4032f9a9e for instance 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 on nch2-master-1 Dec 25 21:21:07.761186 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b74cde6f-0c68-42fd-85b5-152c5c1d75af req-93b2bde5-5033-4c67-8c83-55fb6dfe55e6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072097 Dec 25 21:21:07.761821 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2155/4426] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:07.853753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:07.864038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15a8838d-48dd-4c2c-90f7-864962c7f9ce tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.377306 Dec 25 21:21:07.864648 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2272/4427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:07 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:07.880800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:07.881477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:07.890151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.891351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.892566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:07.893269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:07.999824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1314040921", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "8a2bf814-627c-42b9-8fa2-c3b29a2cdee7"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:08.037900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:08.047800 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad93a12a-cfc6-4b3c-b7eb-ef3f03327010 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1272 microversion: 2.1 time: 0.171932 Dec 25 21:21:08.048669 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2273/4428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:07 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1272 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:08.053240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a06acfb8-e07e-4b3c-b601-1f87ba3d2dc5 req-92f7794a-9398-49aa-b35f-4cb332170de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89ed46e1-4b7a-40ec-a9f8-923852705e90", "name": "network-vif-deleted", "tag": "50029fbf-b328-4b5f-80c2-bcc4da3c4b96"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:08.062071 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:08.062071 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:08.064600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] validate_networks() for [('8a2bf814-627c-42b9-8fa2-c3b29a2cdee7', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:08.071234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a06acfb8-e07e-4b3c-b601-1f87ba3d2dc5 req-92f7794a-9398-49aa-b35f-4cb332170de2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.071690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a06acfb8-e07e-4b3c-b601-1f87ba3d2dc5 req-92f7794a-9398-49aa-b35f-4cb332170de2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.084024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a06acfb8-e07e-4b3c-b601-1f87ba3d2dc5 req-92f7794a-9398-49aa-b35f-4cb332170de2 service nova] Creating event network-vif-deleted:50029fbf-b328-4b5f-80c2-bcc4da3c4b96 for instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 on nch1-master-1 Dec 25 21:21:08.089602 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a06acfb8-e07e-4b3c-b601-1f87ba3d2dc5 req-92f7794a-9398-49aa-b35f-4cb332170de2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039727 Dec 25 21:21:08.090376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2274/4429] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:08.209569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:08.211331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.217997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.218710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.219692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.220295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.304313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:08.322951 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a9f0613-68cd-4551-8980-7edc1d0df559 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 200 len: 1451 microversion: 2.1 time: 0.119949 Dec 25 21:21:08.323556 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2275/4430] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:08 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 1451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:08.496154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:08.497120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.504433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.504802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.505823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.506665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.522128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:08.527242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:08.527242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:08.527242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:08.527242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:08.537107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.537913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.539102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.539840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.553663 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80f27b9f-7375-427a-9ace-11289883937a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060675 Dec 25 21:21:08.554471 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2276/4431] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:08 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:08.561475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:08.562203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.563804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Getting quotas for project e372a1fc5a7e45c39e9ebee6a776c081. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:08.569973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Getting quotas for user a1bd5080663a4db4bc90d3ef605f721f and project e372a1fc5a7e45c39e9ebee6a776c081. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:08.574369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.574369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.574369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.574369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.583790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:08.586463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:08.608418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.608868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.609350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lazy-loading 'fault' on Instance uuid 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:08.652619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89c051b1622c403da5c3fead733e051c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '363ad00286c74e49ac9d96aa0edebda1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:08.660162 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-11ee1e6a-69d0-41e3-8d7a-d419977acc8a tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 200 len: 1307 microversion: 2.1 time: 0.103978 Dec 25 21:21:08.669007 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2277/4432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:08 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:08.669007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:08.669007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.673722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.674183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.674981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.675430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.718470 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8667392a-7a63-4522-9c89-3899bf1bba7a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056143 Dec 25 21:21:08.722622 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2278/4433] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:08 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:08.725820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:08.726876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.734571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.735019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.735800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.736227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.780726 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2d6aebd7-7b4f-4ac3-aa65-be2a5bd7114f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995229 Dec 25 21:21:08.781733 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2156/4434] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:21:08.790200 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-619b5636-564b-4397-b866-90e445df1a29 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.069560 Dec 25 21:21:08.795935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2279/4435] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:08 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:08.796087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f4835a6-c7dd-4a58-aa5c-7ecf709275eb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:08.796087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f4835a6-c7dd-4a58-aa5c-7ecf709275eb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.859841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f4835a6-c7dd-4a58-aa5c-7ecf709275eb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:08.866991 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f4835a6-c7dd-4a58-aa5c-7ecf709275eb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1216 microversion: 2.1 time: 0.078432 Dec 25 21:21:08.867583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2157/4436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:08 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:08.882479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:08.883186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:08.890866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.891450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:08.892138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:08.892573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.048099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:09.057103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23d21f3b-cffe-4a4c-b667-143c6cf85d9c tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.178890 Dec 25 21:21:09.058246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2280/4437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:08 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:09.069007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.069991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.080521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.080521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.080521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.080521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.241656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:09.253000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2784399f-5f7a-47c4-9786-be25198f433e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.186898 Dec 25 21:21:09.253000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2158/4438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:09.339485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.340272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.351041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.351041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.351041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.351041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.364348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 could not be found. Dec 25 21:21:09.364997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.366159 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa875055-24e2-412c-b8e9-e38c7e5a6b71 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 404 len: 111 microversion: 2.1 time: 0.030174 Dec 25 21:21:09.373940 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2281/4439] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.382048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.383537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.391860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.397574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.404207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.404207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.417696 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 could not be found. Dec 25 21:21:09.418302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.419143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10820154-5abe-4bf5-b868-af704b45c160 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 404 len: 111 microversion: 2.1 time: 0.041501 Dec 25 21:21:09.424985 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2159/4440] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.428478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.429175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 89ed46e1-4b7a-40ec-a9f8-923852705e90] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.436057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.436576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.437447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.437894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.453270 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 could not be found. Dec 25 21:21:09.454513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 89ed46e1-4b7a-40ec-a9f8-923852705e90 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.455377 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a6a437f-30b0-4b57-b1c9-183fdce9cc4d tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90" status: 404 len: 111 microversion: 2.1 time: 0.030835 Dec 25 21:21:09.459286 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2282/4441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/89ed46e1-4b7a-40ec-a9f8-923852705e90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.465335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.470328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.472152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.472605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.473448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.473885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.493256 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 could not be found. Dec 25 21:21:09.493256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.493256 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f694c71-abbb-4b0f-b56f-0c2281028b39 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 404 len: 111 microversion: 2.1 time: 0.029312 Dec 25 21:21:09.493256 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2160/4442] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.500627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.501463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 714d5f5c-ef35-4c4a-8bb3-05dec010fd61] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.507656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.508118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.508956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.509438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.524356 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 could not be found. Dec 25 21:21:09.524995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 714d5f5c-ef35-4c4a-8bb3-05dec010fd61 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.525865 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ef3408c-30e2-4cd9-b78b-5c487a3a483e tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61" status: 404 len: 111 microversion: 2.1 time: 0.029516 Dec 25 21:21:09.526613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2283/4443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/714d5f5c-ef35-4c4a-8bb3-05dec010fd61 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.534745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.545457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.545457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.545457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.545457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.545457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.559520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca could not be found. Dec 25 21:21:09.560126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.561013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75093f3b-4cd1-4414-98a0-f0a185093583 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 404 len: 111 microversion: 2.1 time: 0.030276 Dec 25 21:21:09.564426 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2161/4444] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.568550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:09.568550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.569549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.570185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1dcb2aa4-3186-4c62-a704-70ced44d42ca] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.575051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.575500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.576294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.576727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.577603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.578279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.579189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.579804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.595922 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca could not be found. Dec 25 21:21:09.596606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 1dcb2aa4-3186-4c62-a704-70ced44d42ca could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.597526 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d9ec467-f429-436d-995f-96946916d005 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca" status: 404 len: 111 microversion: 2.1 time: 0.031993 Dec 25 21:21:09.598413 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2162/4445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/1dcb2aa4-3186-4c62-a704-70ced44d42ca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.608016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.608898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.615867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.616336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.617192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.617639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.632553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc420bf5-dab6-4ebb-a3a0-48f0027533ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.070432 Dec 25 21:21:09.632802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 1246c4c7-a769-4e4e-9a42-2138119611b8 could not be found. Dec 25 21:21:09.633435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 1246c4c7-a769-4e4e-9a42-2138119611b8 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.633582 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2284/4446] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:09 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:09.634616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a21244f4-5370-4dee-804f-763dfbce78db tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 404 len: 111 microversion: 2.1 time: 0.030353 Dec 25 21:21:09.635328 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2163/4447] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.657715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.658332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 1246c4c7-a769-4e4e-9a42-2138119611b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.665601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.666694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.674782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.674782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.680379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.681167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] [instance: 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.688344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.688949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.690013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.690874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.693426 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 1246c4c7-a769-4e4e-9a42-2138119611b8 could not be found. Dec 25 21:21:09.694181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 1246c4c7-a769-4e4e-9a42-2138119611b8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.695037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac020a44-e63a-4e73-bde5-52dbaaed9081 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8" status: 404 len: 111 microversion: 2.1 time: 0.041594 Dec 25 21:21:09.698730 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2285/4448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/1246c4c7-a769-4e4e-9a42-2138119611b8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.704657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.705271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.713094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.713882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.714201 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] HTTP exception thrown: Instance 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 could not be found. Dec 25 21:21:09.714932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.715223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] Returning 404 to user: Instance 7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.715501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.716493 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a665a59-0431-4bca-8435-5b9a502931ae tempest-InstanceActionsTestJSON-876378512 tempest-InstanceActionsTestJSON-876378512-project] 10.222.0.32 "GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5" status: 404 len: 111 microversion: 2.1 time: 0.043318 Dec 25 21:21:09.721221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2164/4449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/7d1e8a07-d1e2-418d-abfa-e9a0bfff6cd5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:21:09.733093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:09.734814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.735632 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 48b8a5b8-636e-4965-bb02-a799fdf8524f could not be found. Dec 25 21:21:09.736630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 48b8a5b8-636e-4965-bb02-a799fdf8524f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.738226 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0720bc0a-f625-4a8e-ad2d-74e7e47a28c4 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 404 len: 111 microversion: 2.1 time: 0.037290 Dec 25 21:21:09.738606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2286/4450] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.747454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.747924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.748743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.749222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.749691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.750670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: 48b8a5b8-636e-4965-bb02-a799fdf8524f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.758308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.759074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.760188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.761060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.779711 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance 48b8a5b8-636e-4965-bb02-a799fdf8524f could not be found. Dec 25 21:21:09.780384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance 48b8a5b8-636e-4965-bb02-a799fdf8524f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.781475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d19a23f3-b45a-4255-9701-83f849adca01 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f" status: 404 len: 111 microversion: 2.1 time: 0.039093 Dec 25 21:21:09.782341 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2287/4451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/48b8a5b8-636e-4965-bb02-a799fdf8524f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.789757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-91a1190a-5423-4ada-8139-2e814c5a9f83 req-575fa3d5-aec7-4873-bf6f-fcc8ccc6226f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a61c5de8-d812-47f0-b612-27005b61919f", "tag": "d39bd2f0-4d3d-4db5-8928-d5a1bd22462e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:09.792768 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:09.792768 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:09.805317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-91a1190a-5423-4ada-8139-2e814c5a9f83 req-575fa3d5-aec7-4873-bf6f-fcc8ccc6226f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.805769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-91a1190a-5423-4ada-8139-2e814c5a9f83 req-575fa3d5-aec7-4873-bf6f-fcc8ccc6226f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.828537 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-91a1190a-5423-4ada-8139-2e814c5a9f83 req-575fa3d5-aec7-4873-bf6f-fcc8ccc6226f service nova] Creating event network-changed:d39bd2f0-4d3d-4db5-8928-d5a1bd22462e for instance a61c5de8-d812-47f0-b612-27005b61919f on nch1-master-1 Dec 25 21:21:09.828640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c7ea5cf-22a3-498d-897c-63c8505da54d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.098924 Dec 25 21:21:09.828640 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2165/4452] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:09 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:09.834420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.835014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.837329 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-91a1190a-5423-4ada-8139-2e814c5a9f83 req-575fa3d5-aec7-4873-bf6f-fcc8ccc6226f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052947 Dec 25 21:21:09.838613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2288/4453] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:09.843910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:09.845085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.853074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.853756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.853871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.853964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.853964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.853964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.855178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.856229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.886252 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance b5ed595e-9d45-49c6-a45b-2e014b11f9db could not be found. Dec 25 21:21:09.886949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance b5ed595e-9d45-49c6-a45b-2e014b11f9db could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.888445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd436595-8660-43eb-9194-05619e07f2f2 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 404 len: 111 microversion: 2.1 time: 0.059061 Dec 25 21:21:09.889251 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2166/4454] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.896716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfdd0481-0473-4d05-94b7-8875c8bcd1ae tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.902922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a674330d-3a67-492f-bda2-db6dc4689301 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057579 Dec 25 21:21:09.903405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bfdd0481-0473-4d05-94b7-8875c8bcd1ae tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.903511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2289/4455] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:09 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:09.906884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.907548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: b5ed595e-9d45-49c6-a45b-2e014b11f9db] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.917551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.918507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.919913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.919913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.936121 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance b5ed595e-9d45-49c6-a45b-2e014b11f9db could not be found. Dec 25 21:21:09.936742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance b5ed595e-9d45-49c6-a45b-2e014b11f9db could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.937755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6ee311eb-6018-44a6-bb27-0b4ebdd58f61 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db" status: 404 len: 111 microversion: 2.1 time: 0.037953 Dec 25 21:21:09.941845 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2290/4456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/b5ed595e-9d45-49c6-a45b-2e014b11f9db => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.946469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b0b7f6c-1bd2-42bd-998b-fa08e5db4293 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.947041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b0b7f6c-1bd2-42bd-998b-fa08e5db4293 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.954225 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4b0b7f6c-1bd2-42bd-998b-fa08e5db4293 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance c4b19818-baf7-4e92-923d-58a8a34b2b44 could not be found. Dec 25 21:21:09.954974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b0b7f6c-1bd2-42bd-998b-fa08e5db4293 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance c4b19818-baf7-4e92-923d-58a8a34b2b44 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.956109 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b0b7f6c-1bd2-42bd-998b-fa08e5db4293 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44" status: 404 len: 111 microversion: 2.1 time: 0.013165 Dec 25 21:21:09.959694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2291/4457] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.965102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dee41887-ba2f-45db-bf69-728fdd86a783 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.965837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dee41887-ba2f-45db-bf69-728fdd86a783 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: c4b19818-baf7-4e92-923d-58a8a34b2b44] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.973077 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-dee41887-ba2f-45db-bf69-728fdd86a783 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance c4b19818-baf7-4e92-923d-58a8a34b2b44 could not be found. Dec 25 21:21:09.973769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dee41887-ba2f-45db-bf69-728fdd86a783 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance c4b19818-baf7-4e92-923d-58a8a34b2b44 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:09.974685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dee41887-ba2f-45db-bf69-728fdd86a783 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44" status: 404 len: 111 microversion: 2.1 time: 0.013990 Dec 25 21:21:09.975504 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2292/4458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/c4b19818-baf7-4e92-923d-58a8a34b2b44 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:09.984416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:09.985062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:09.986600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfdd0481-0473-4d05-94b7-8875c8bcd1ae tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:09.992657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.993229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.994130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:09.994629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:09.995395 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfdd0481-0473-4d05-94b7-8875c8bcd1ae tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1216 microversion: 2.1 time: 0.104876 Dec 25 21:21:09.996254 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2167/4459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:09 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:10.021700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:10.075194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:10.075904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:10.084658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.085489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.086463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.087030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.272513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:10.281613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce5f0614-c2e1-47fc-9917-43e752375d6e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.211212 Dec 25 21:21:10.282281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2168/4460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:10 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:10.287164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:10.287918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:10.294263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.294974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.296424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.297172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.408010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-14cbde06-8c21-4028-8210-ed30c3f401ac tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 204 len: 0 microversion: 2.1 time: 0.427354 Dec 25 21:21:10.409750 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2293/4461] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:09 2021] DELETE /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:21:10.419145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:10.419876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:10.427752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.429882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.429882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.430234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.452770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:10.458830 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2a26a58-e121-43cc-b0ed-cfcf622230bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.175280 Dec 25 21:21:10.459448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2169/4462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:10 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:10.585514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:10.600985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db4acaf1-ea66-40a5-9317-c6ecac112b12 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1480 microversion: 2.1 time: 0.185230 Dec 25 21:21:10.601672 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2294/4463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:10 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1480 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:10.644075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:10.646104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:10.653860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.654612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.655688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.656476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.701404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11d6e343-cd6c-492d-9c9f-d846df13e1c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060984 Dec 25 21:21:10.705161 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2170/4464] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:10 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:10.838531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:10.839561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:10.857097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.857665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.858527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.858969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.903124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6454a12d-084a-402c-8650-6120d089f259 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.068250 Dec 25 21:21:10.904166 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2295/4465] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:10 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:21:10.910516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:10.914358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:10.919463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.919919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.921000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:10.921621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:10.964302 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e194206-a5a2-4058-bff4-1ffcdd0be405 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057951 Dec 25 21:21:10.965063 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2171/4466] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:10 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:11.012129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:11.012863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.020428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.020905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.021712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.022148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.086169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:11.094447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f447585e-a1e2-4d43-98ff-74ca133e59bb tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1268 microversion: 2.1 time: 0.086627 Dec 25 21:21:11.095025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2296/4467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:11 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1268 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:11.299432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:11.300176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.307245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.307705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.308490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.308961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.480653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:11.481929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.490690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.491009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.491824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.492073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:11.492303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.500377 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ccad3cb-426d-410a-9a82-c816e712ab7b tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.205229 Dec 25 21:21:11.510734 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2172/4468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:11 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:11.618939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:11.619638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.626582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.627063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.627857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.628301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.636564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:11.651887 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bebdcaf6-731d-4eea-a75e-04925f3f210a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.180088 Dec 25 21:21:11.652477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2297/4469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:11 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:11.713178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:11.714114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.720035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.720481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.721283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.721726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.769120 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e202adf2-01f0-4635-b57e-7ab0ad983b97 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059627 Dec 25 21:21:11.769787 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2298/4470] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:11 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:11.781441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:11.788995 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e83acd00-04fc-4bf5-ace3-963791c997fb tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1480 microversion: 2.1 time: 0.173863 Dec 25 21:21:11.789566 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2173/4471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:11 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1480 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:11.921868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:11.923570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.931077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.932260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.933752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.934403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.977459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:11.978451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:11.985342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8293dbf2-2ade-4a5f-a52f-c7deba161a90 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.073179 Dec 25 21:21:11.985743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.986392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:11.986531 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2299/4472] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:11 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:11.987594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:11.988046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.041259 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43c07aa0-9458-45ab-9a14-a9a13f71f2c5 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.067671 Dec 25 21:21:12.042992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2174/4473] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:11 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:12.111934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:12.113539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:12.121173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.121625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.122410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.122841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.193525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:12.201924 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e588a6ad-638e-4a94-a5c9-23fc938cd361 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1274 microversion: 2.1 time: 0.093971 Dec 25 21:21:12.202584 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2300/4474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:12 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:12.517486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:12.518202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:12.525460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.525957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.526766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.527213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.680487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5c02a404-2feb-4a65-b791-f0e024aae3cb req-f7fbacfe-f067-42de-b9b5-a1a1d9b04710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6a1be38-1673-434a-ac87-a3a12f8760ce", "name": "network-vif-deleted", "tag": "b548a516-5b40-4749-9286-e686f9b3d3be"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:12.682739 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:12.682739 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:12.692731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5c02a404-2feb-4a65-b791-f0e024aae3cb req-f7fbacfe-f067-42de-b9b5-a1a1d9b04710 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.693338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5c02a404-2feb-4a65-b791-f0e024aae3cb req-f7fbacfe-f067-42de-b9b5-a1a1d9b04710 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.709805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5c02a404-2feb-4a65-b791-f0e024aae3cb req-f7fbacfe-f067-42de-b9b5-a1a1d9b04710 service nova] Creating event network-vif-deleted:b548a516-5b40-4749-9286-e686f9b3d3be for instance e6a1be38-1673-434a-ac87-a3a12f8760ce on nch1-master-1 Dec 25 21:21:12.719831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5c02a404-2feb-4a65-b791-f0e024aae3cb req-f7fbacfe-f067-42de-b9b5-a1a1d9b04710 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049443 Dec 25 21:21:12.720530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2301/4475] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:12.730362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:12.731159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:12.738300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.739279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.741051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.741660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.742704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:12.761082 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1345211-e0b9-4abe-ab06-2dd288d88ad2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.238744 Dec 25 21:21:12.761082 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2175/4476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:12 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:12.780697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:12.792781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:12.800099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.809642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.811524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.812358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.872464 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32d95dbe-2c81-4572-bd03-c1a5e850d7c6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.092015 Dec 25 21:21:12.872464 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2176/4477] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:12 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:12.876163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:12.877118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:12.886431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.887221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.888254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:12.889452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:12.971514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:12.980129 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8f85cde-42be-4706-a998-35a485730aad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.258241 Dec 25 21:21:12.980715 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2302/4478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:12 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:12.988667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d23db9414d34853ae04f7f032694f12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38d7cbaffc1340f59e994569e8e33e1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:12.996400 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c79c48e3-181e-46ca-879a-aa7bc6ff2290 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 200 len: 1278 microversion: 2.1 time: 0.124688 Dec 25 21:21:12.997595 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2177/4479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:12 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:12.997725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:12.998587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:13.005304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.006645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.007631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.008770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.054715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:13.056573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:13.057634 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1ba1ece-29eb-460d-8e9f-473c81f77178 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064026 Dec 25 21:21:13.058873 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2303/4480] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:12 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:13.064847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.065439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.066417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.066861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.108341 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31098dde-3d44-4082-ad62-44f3636ff73c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.058285 Dec 25 21:21:13.109641 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2178/4481] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:13 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:13.220966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:13.221827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:13.231153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.231744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.232645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.233251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.672575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:13.682196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-14421c9f-f1cd-46f7-9719-4f19832f0c3e tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1316 microversion: 2.1 time: 0.465274 Dec 25 21:21:13.684964 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2304/4482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:13 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1316 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:13.768279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:13.772036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:13.776844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.777325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.778177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.778747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.879554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:13.880928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:13.901436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.906343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.907450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:13.907935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:13.927915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:13.936628 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bed16c24-0941-46c6-bc41-e3d97d3f7910 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1524 microversion: 2.1 time: 0.172515 Dec 25 21:21:13.938782 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2179/4483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:13 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1524 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:13.953178 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f5524f7-6866-47a1-a87e-a9ec5cfb8bc3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.077186 Dec 25 21:21:13.953888 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2305/4484] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:13 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:13.998225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:13.998979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.013102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.013476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.014473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.015070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.016372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:14.017232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] [instance: e6a1be38-1673-434a-ac87-a3a12f8760ce] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.029986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.030616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.032744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.033250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.052527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] HTTP exception thrown: Instance e6a1be38-1673-434a-ac87-a3a12f8760ce could not be found. Dec 25 21:21:14.053428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] Returning 404 to user: Instance e6a1be38-1673-434a-ac87-a3a12f8760ce could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:14.054561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a88a7598-94b5-42d9-9109-f617d3de78b5 tempest-ServersTestJSON-814366795 tempest-ServersTestJSON-814366795-project] 10.222.0.32 "GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce" status: 404 len: 111 microversion: 2.1 time: 0.043607 Dec 25 21:21:14.055511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2306/4485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:14 2021] GET /compute/v2.1/servers/e6a1be38-1673-434a-ac87-a3a12f8760ce => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:14.077046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:14.078658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.090056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.090855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.092478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.093317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.156539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-606c5242-9c2f-48ce-bddb-e1a1cd228c27 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.086460 Dec 25 21:21:14.157649 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2307/4486] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:14 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:14.165200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:14.167354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.176127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.178663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.178663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.178663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.228833 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80cd1b00-6da2-48de-b95e-78dbad921687 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.069030 Dec 25 21:21:14.234084 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2308/4487] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:14 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:14.265627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:14.273628 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1286e2e2-d81e-4bba-a239-93c11ad6489b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.280968 Dec 25 21:21:14.275541 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2180/4488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:13 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:14.699768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:14.700579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.707708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.708251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.709138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.709644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.740393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-78c0d37a-1f4c-44d5-8e4b-9fadc9266904 req-e342e296-34f3-411d-9a21-8ef4e7f0200e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a747d3f-891a-44f7-93c1-17ac8d8cafb8", "tag": "9c0aa314-9c2e-48d1-9808-f65926f1cc94"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:14.742242 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:14.742242 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:14.752211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-78c0d37a-1f4c-44d5-8e4b-9fadc9266904 req-e342e296-34f3-411d-9a21-8ef4e7f0200e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.752661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-78c0d37a-1f4c-44d5-8e4b-9fadc9266904 req-e342e296-34f3-411d-9a21-8ef4e7f0200e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.767032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-78c0d37a-1f4c-44d5-8e4b-9fadc9266904 req-e342e296-34f3-411d-9a21-8ef4e7f0200e service nova] Creating event network-changed:9c0aa314-9c2e-48d1-9808-f65926f1cc94 for instance 3a747d3f-891a-44f7-93c1-17ac8d8cafb8 on nch2-master-1 Dec 25 21:21:14.772540 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-78c0d37a-1f4c-44d5-8e4b-9fadc9266904 req-e342e296-34f3-411d-9a21-8ef4e7f0200e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036809 Dec 25 21:21:14.773179 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2181/4489] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:14.941099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:14.955045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:14.955943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.965996 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fcbf9d0-1357-4eaf-9780-1c42f71f2247 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1316 microversion: 2.1 time: 0.265721 Dec 25 21:21:14.981236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2309/4490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:14 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1316 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:14.981535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.981535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.981535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.981535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.982134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:14.982134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:14.988375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.988984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:14.989871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:14.990383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.049967 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-69ff57fc-bd71-490e-ae3b-eb4178c6bb0e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.080860 Dec 25 21:21:15.051466 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2310/4491] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:14 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:15.173348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:15.174634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:15.187600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.188401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.189427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.190225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.209478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:15.218895 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1504 microversion: 2.1 time: 0.268615 Dec 25 21:21:15.220370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2182/4492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:14 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:15.221670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:15.222733 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c564a0e-e63f-4ca7-b4e1-594ccec8df03 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001252 Dec 25 21:21:15.223214 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2183/4493] 10.222.0.32 () {56 vars in 885 bytes} [Sat Dec 25 21:21:15 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 25 21:21:15.237052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6c9ea8f-2a1f-4422-bde3-175727c3e70f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'create', calling method: .version_select at 0x7fa4f7335a60>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1193278862", "description": "tempest-description-499070886"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:15.254502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb2d3346-2a33-40d4-af94-a50134f7585a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.090140 Dec 25 21:21:15.255854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2311/4494] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:15 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:21:15.261661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:15.263032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:15.270664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.271770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.272797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.273963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.327242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20f5c04d-7420-4b27-b650-e31b77b9cc91 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.069745 Dec 25 21:21:15.328627 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2312/4495] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:15 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:15.334476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:15.335343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:15.343866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.348426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.348426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.348426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.578501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:15.587228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00fd946b-587c-438a-9490-bd8492df05c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.256918 Dec 25 21:21:15.596766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2313/4496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:15 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:15.596766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-df870f70-1f18-4077-a0a6-bfebf5bd2547 req-cc2abc36-5208-48b9-991f-e312867b2088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61c5de8-d812-47f0-b612-27005b61919f", "name": "network-vif-plugged", "status": "completed", "tag": "d39bd2f0-4d3d-4db5-8928-d5a1bd22462e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:15.596766 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:15.596766 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:15.602231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-df870f70-1f18-4077-a0a6-bfebf5bd2547 req-cc2abc36-5208-48b9-991f-e312867b2088 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.602699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-df870f70-1f18-4077-a0a6-bfebf5bd2547 req-cc2abc36-5208-48b9-991f-e312867b2088 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.615134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-df870f70-1f18-4077-a0a6-bfebf5bd2547 req-cc2abc36-5208-48b9-991f-e312867b2088 service nova] Creating event network-vif-plugged:d39bd2f0-4d3d-4db5-8928-d5a1bd22462e for instance a61c5de8-d812-47f0-b612-27005b61919f on nch1-master-1 Dec 25 21:21:15.620555 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-df870f70-1f18-4077-a0a6-bfebf5bd2547 req-cc2abc36-5208-48b9-991f-e312867b2088 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030676 Dec 25 21:21:15.623352 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2314/4497] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:15.987611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:15.987611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:15.993199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.993887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:15.994668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:15.995080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.038338 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6c9ea8f-2a1f-4422-bde3-175727c3e70f tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.805667 Dec 25 21:21:16.039833 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2184/4498] 10.222.0.32 () {60 vars in 1179 bytes} [Sat Dec 25 21:21:15 2021] POST /compute/v2.1/os-security-groups => generated 250 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:16.053004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1193278862"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:16.053756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:16.061298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.061824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.062838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.063342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.205915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:16.214440 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bd1e1b6-0325-410a-bfdc-60028d83aa1b tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1316 microversion: 2.1 time: 0.233889 Dec 25 21:21:16.224032 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2315/4499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:15 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:16.229418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:16.230506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:16.240677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.241551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.242799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.243317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.269105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Adding security group 777664ad-5e56-438f-b294-88e17ba798c0 to port 8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e Dec 25 21:21:16.288959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8fd9371-0083-4f55-ad72-e74d2256a444 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062999 Dec 25 21:21:16.292924 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2316/4500] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:16 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:16.296743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:16.297765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:16.304467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.304786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.305598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.306031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.352980 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86f02afb-098a-4e8d-9237-46b864e0d624 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060764 Dec 25 21:21:16.353919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2317/4501] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:16 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:16.359831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:16.360826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:16.367921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.368385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.369451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.370048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.412742 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-984e257d-44fb-4ecc-b7b3-31e3226db2b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057220 Dec 25 21:21:16.417081 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2318/4502] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:16 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:16.604195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:16.605021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:16.612185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.612636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.613487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.613952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.752994 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9cadf6e-d343-434a-b621-af3318f89e81 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action" status: 202 len: 0 microversion: 2.1 time: 0.705280 Dec 25 21:21:16.754027 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2185/4503] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:16 2021] POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:16.764156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1193278862"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:16.764156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:16.772778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.773596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.774890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:16.775540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:16.957056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:16.974885 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-14e2a1b4-03ae-4468-8930-c6cae2fc1023 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1314 microversion: 2.1 time: 0.372954 Dec 25 21:21:16.975539 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2319/4504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:16 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:16.990162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c2bcbffa-25f6-41f4-90fc-d182f768d732 req-2218bdf6-2861-4bd0-ad19-1d23c411a3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:16.996808 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:16.996808 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:17.009223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c2bcbffa-25f6-41f4-90fc-d182f768d732 req-2218bdf6-2861-4bd0-ad19-1d23c411a3c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.019537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c2bcbffa-25f6-41f4-90fc-d182f768d732 req-2218bdf6-2861-4bd0-ad19-1d23c411a3c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.026902 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c2bcbffa-25f6-41f4-90fc-d182f768d732 req-2218bdf6-2861-4bd0-ad19-1d23c411a3c7 service nova] Creating event network-changed:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:21:17.032037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c2bcbffa-25f6-41f4-90fc-d182f768d732 req-2218bdf6-2861-4bd0-ad19-1d23c411a3c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052443 Dec 25 21:21:17.032863 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2320/4505] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:17.037871 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Removing security group 777664ad-5e56-438f-b294-88e17ba798c0 from port 8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e Dec 25 21:21:17.234499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:17.235212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:17.256589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.270162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.274489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.275687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.510775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:17.523753 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f86fe28-0cf4-490f-8a97-f7526cb0dfe0 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1316 microversion: 2.1 time: 0.296696 Dec 25 21:21:17.525732 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2321/4506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:17 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:17.530555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:17.531645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:17.539397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.541236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.551568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.551568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.593558 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa06aee2-e36d-4bee-8813-a72bfbb864de tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.066060 Dec 25 21:21:17.600806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2322/4507] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:17 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:17.607584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:17.608997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:17.616676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.617384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.618355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.619102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.653654 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65fc8ca4-aa34-4391-bf69-e3d5dd08375e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action" status: 202 len: 0 microversion: 2.1 time: 0.895009 Dec 25 21:21:17.658988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2186/4508] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:16 2021] POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action => generated 0 bytes in 896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:17.658988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:17.659761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:17.676641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.678571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.682252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:17.682252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:17.719934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b59f8cef-21eb-49f2-921f-d9a59c21ddb9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.116896 Dec 25 21:21:17.720741 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2323/4509] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:17 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:17.726856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-417e5b43-a6a4-41b4-ad7b-1ae060624ad8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'create', calling method: .version_select at 0x7fa4f6324ee0>, body: {"pool": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:17.760634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6bb2b43-794b-4086-96f3-60f137cfa86e tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.103800 Dec 25 21:21:17.762245 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2187/4510] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:17 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:17.998161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:17.999923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:18.013873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:18.015311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:18.017282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:18.021497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:18.287547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:18.315944 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-97348bc9-af19-498d-8050-0d967275783c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1501 microversion: 2.1 time: 0.327506 Dec 25 21:21:18.318037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2188/4511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:17 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1501 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:18.338622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:18.340354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:18.350895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:18.351836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:18.353706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:18.356825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:18.401689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f88d034-a2e8-4134-9028-b1c5968121bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.070043 Dec 25 21:21:18.405226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2189/4512] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:18 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:21:18.543504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:18.544617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:18.552181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:18.553089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:18.554290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:18.555054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.172707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:19.181075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f68e81e-f071-4be2-a71d-1b234a986de4 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1316 microversion: 2.1 time: 0.642605 Dec 25 21:21:19.181960 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2190/4513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:18 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:19.196196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:19.197854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:19.207406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.208602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.209679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.210370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.252419 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dafeae1b-2cea-4153-82ac-5dbd0645335b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059856 Dec 25 21:21:19.253131 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2191/4514] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:19 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:19.258691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:19.260270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:19.276393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.276393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.276393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.276393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.323541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-832dd842-e461-40c1-bf06-c2b9a9a3e45a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.068651 Dec 25 21:21:19.324400 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2192/4515] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:19 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:19.332040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:19.333281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:19.341345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.341807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.343446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.343913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.392519 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd758f65-d4c4-4663-8ccd-e1f0e8970b72 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.066492 Dec 25 21:21:19.396631 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2193/4516] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:19 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:19.399371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-72bccfb1-48ed-4d6f-8815-91865f67a628 req-f3193fb7-8250-4d1c-aac5-a8b357dac65c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:19.401853 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:19.401853 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:19.410673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-72bccfb1-48ed-4d6f-8815-91865f67a628 req-f3193fb7-8250-4d1c-aac5-a8b357dac65c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.413968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-72bccfb1-48ed-4d6f-8815-91865f67a628 req-f3193fb7-8250-4d1c-aac5-a8b357dac65c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.424749 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-72bccfb1-48ed-4d6f-8815-91865f67a628 req-f3193fb7-8250-4d1c-aac5-a8b357dac65c service nova] Creating event network-changed:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:21:19.430134 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-72bccfb1-48ed-4d6f-8815-91865f67a628 req-f3193fb7-8250-4d1c-aac5-a8b357dac65c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035256 Dec 25 21:21:19.432201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2194/4517] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:19.438777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:19.440008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:19.447552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.448014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.448823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:19.449300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:19.487402 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70886abd-2fc3-447e-9c02-f6f6c4da9101 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.053583 Dec 25 21:21:19.488055 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2195/4518] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:19 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:20.088719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8653f932-43e9-4258-8664-8d2e2252d56e req-afd231b9-e196-40ec-98cd-6342c7f9ca43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a747d3f-891a-44f7-93c1-17ac8d8cafb8", "name": "network-vif-plugged", "status": "completed", "tag": "9c0aa314-9c2e-48d1-9808-f65926f1cc94"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.090999 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:20.090999 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:20.100569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8653f932-43e9-4258-8664-8d2e2252d56e req-afd231b9-e196-40ec-98cd-6342c7f9ca43 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.101061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8653f932-43e9-4258-8664-8d2e2252d56e req-afd231b9-e196-40ec-98cd-6342c7f9ca43 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.113112 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8653f932-43e9-4258-8664-8d2e2252d56e req-afd231b9-e196-40ec-98cd-6342c7f9ca43 service nova] Creating event network-vif-plugged:9c0aa314-9c2e-48d1-9808-f65926f1cc94 for instance 3a747d3f-891a-44f7-93c1-17ac8d8cafb8 on nch2-master-1 Dec 25 21:21:20.118026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8653f932-43e9-4258-8664-8d2e2252d56e req-afd231b9-e196-40ec-98cd-6342c7f9ca43 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034569 Dec 25 21:21:20.119206 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2196/4519] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:20.198787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:20.199498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:20.207142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.208658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.208658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.209553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.526246 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-417e5b43-a6a4-41b4-ad7b-1ae060624ad8 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.803940 Dec 25 21:21:20.527495 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2324/4520] 10.222.0.32 () {60 vars in 1169 bytes} [Sat Dec 25 21:21:17 2021] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2806 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:20.539634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.542675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:20.552963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.553631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.555274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.556036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.575627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:20.588065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af6ec3f2-3ff6-46ee-958b-e2b301c97986 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1316 microversion: 2.1 time: 0.393409 Dec 25 21:21:20.588943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2197/4521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:20 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1316 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:20.594333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.595234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:20.601514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.602217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.602752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09e4d7d0-8d13-4564-a746-1e566cfac5b9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.073417 Dec 25 21:21:20.603230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.603669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.605080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2325/4522] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:20.610689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.611727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:20.618648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.619248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.620060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.620505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.655567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a8abf9c-7a35-483c-aa7d-17629293a209 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.065198 Dec 25 21:21:20.656234 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2198/4523] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:20.664416 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40091c38-12b2-4086-b999-8eea853062ed tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 32646 microversion: 2.1 time: 0.057894 Dec 25 21:21:20.665372 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2326/4524] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:20.670969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.671961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:20.679213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.679664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.680456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.680962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.717809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4b98549-4d79-41d0-824b-1b9b483ef87b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.051077 Dec 25 21:21:20.718571 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2327/4525] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:20.723292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.3.225"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.724426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:20.731026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.733973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.733973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:20.733973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:20.761752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Acquired lock "refresh_cache-f38f1e54-3e25-4107-9a2c-734823ced707" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:21:20.774025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-37238621", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:20.827384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] validate_networks() for [('2173080e-712c-4030-840a-d911c5ceb839', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:21.516629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:21.517227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:21.517747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:21.518231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:21.518719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:21.528021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:21.528553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:21.529419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:21.529862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:21.548414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Getting quotas for project 66319858228140b3841ef6c7c8cd5c14. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:21.554495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Getting quotas for user 257eeccacdc24f00a418cbb27204cf4f and project 66319858228140b3841ef6c7c8cd5c14. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:21.568779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:21.571410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:21.652792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-418e382c-3482-4e0a-9610-d88f322d2dbd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.995102 Dec 25 21:21:21.653634 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2199/4526] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:21:21.715421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-342862121", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "df7f119b-f1bb-462c-b2dc-ce3acd2a89d9"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:21.769315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] validate_networks() for [('df7f119b-f1bb-462c-b2dc-ce3acd2a89d9', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:22.628437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:22.629076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:22.629381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:22.629786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:22.630205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:22.640331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:22.640808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:22.641656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:22.642194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:22.660050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:22.665001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for user d7df5c79b8ea4c6ea7cf84b381b29765 and project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:22.678382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:22.681231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:22.769082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Building network info cache for instance {{(pid=136548) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:21:22.806891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f7ba98b-e9df-4145-8cce-175a75d156c2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.152360 Dec 25 21:21:22.812790 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2200/4527] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:21:22.812790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:22.813175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:22.822951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:22.824184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:22.824184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:22.824625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.134463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:23.146411 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a019c68-7f88-4a87-aa29-9830cda798cf tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1504 microversion: 2.1 time: 0.337775 Dec 25 21:21:23.148120 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2201/4528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:22 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:23.175423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:23.175423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.175423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.175423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.175423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.175423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.215192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0d767f1-51f9-4297-8632-f81fcc5141e3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065645 Dec 25 21:21:23.216019 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2202/4529] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:23 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:23.222407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:23.223202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.230495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.230957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.231760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.232197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.331365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:23.341848 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b33408f-16c5-4bb2-9264-09fba843cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1211 microversion: 2.1 time: 0.124509 Dec 25 21:21:23.351905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2203/4530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:23 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1211 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:23.359856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:23.360623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.367401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.367863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.368706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.369181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.411957 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11577e56-b96d-4044-8d48-d43b41836dfb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058523 Dec 25 21:21:23.412854 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2204/4531] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:23 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:23.418677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:23.419998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.427240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.427405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.428169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.429643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.473201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Updating instance_info_cache with network_info: [{"id": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e", "address": "fa:16:3e:80:74:5a", "network": {"id": "5e3e14c1-fa4f-4065-b9e3-19dd5f8f11c3", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1998990851-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.3.225", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd1b67368c34701bcdc20105e48ad41", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8b0e5751-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:21:23.483279 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c2375dca-411e-460d-a788-b2485218c750 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action" status: 200 len: 40801 microversion: 2.1 time: 0.069165 Dec 25 21:21:23.487063 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2205/4532] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:23 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/action => generated 40801 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:23.493375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:23.494627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.501655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.502107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.502906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.503553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.543264 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2289d17-58bc-47cb-be34-6e19af189350 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.057872 Dec 25 21:21:23.546567 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2206/4533] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:23 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:23.549985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2be6ba9d-e517-4f6e-8514-dc4ef478b85f req-6b83261c-8793-4e0c-84a3-ac2a31fb69db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:23.551565 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:23.551565 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:23.559808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2be6ba9d-e517-4f6e-8514-dc4ef478b85f req-6b83261c-8793-4e0c-84a3-ac2a31fb69db service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.560276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2be6ba9d-e517-4f6e-8514-dc4ef478b85f req-6b83261c-8793-4e0c-84a3-ac2a31fb69db service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.572530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2be6ba9d-e517-4f6e-8514-dc4ef478b85f req-6b83261c-8793-4e0c-84a3-ac2a31fb69db service nova] Creating event network-changed:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:21:23.578739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2be6ba9d-e517-4f6e-8514-dc4ef478b85f req-6b83261c-8793-4e0c-84a3-ac2a31fb69db service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033135 Dec 25 21:21:23.585040 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2207/4534] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:23.585040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61f57411-7088-4f00-b763-fc159618e281 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:23.585712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61f57411-7088-4f00-b763-fc159618e281 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.604573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Releasing lock "refresh_cache-f38f1e54-3e25-4107-9a2c-734823ced707" {{(pid=136548) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:21:23.610664 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-019b2f7b-0fa9-4213-a384-5bce83f6f7f1 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action" status: 202 len: 0 microversion: 2.1 time: 2.886327 Dec 25 21:21:23.610664 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2328/4535] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:20 2021] POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action => generated 0 bytes in 2887 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:21:23.614394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:23.614990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.622299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.622858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.623876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.625495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.680110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-61f57411-7088-4f00-b763-fc159618e281 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:23.689630 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61f57411-7088-4f00-b763-fc159618e281 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1217 microversion: 2.1 time: 0.108964 Dec 25 21:21:23.690225 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2208/4536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:23 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:23.695016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:23.695747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.707497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.708209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.709061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.709511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.734400 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-326aff7b-42c5-49d4-a500-271c8bf535ca tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/ips" status: 200 len: 145 microversion: 2.1 time: 0.042860 Dec 25 21:21:23.741070 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2209/4537] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:21:23 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:23.741070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.3.225"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:23.833490 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eae9fbf7-bc66-456c-89b5-fec01b7bf22f tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.222954 Dec 25 21:21:23.836247 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2329/4538] 10.222.0.32 () {58 vars in 1295 bytes} [Sat Dec 25 21:21:23 2021] DELETE /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8/os-server-password => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:23.848398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:23.849934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.867971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.875890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.879590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.879590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.933651 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7c9614d-0423-45b3-a7a8-5fb3984cfd34 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.090161 Dec 25 21:21:23.951040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2330/4539] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:21:23 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8/os-server-password => generated 16 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:23.956222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:23.957401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.967308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.968784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.969793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.970653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.983937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:23.992351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.993907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:23.994963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:23.995795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.018129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:24.332387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Acquired lock "refresh_cache-f38f1e54-3e25-4107-9a2c-734823ced707" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Dec 25 21:21:24.344932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a23e9da-5860-49bc-885a-744abaa0be60 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 204 len: 0 microversion: 2.1 time: 0.391977 Dec 25 21:21:24.345746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2331/4540] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:23 2021] DELETE /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:24.366082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:24.373545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:24.389880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.399501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.402050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.402356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.461197 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e92b792e-2ae0-46a6-84f5-f00cc997b3ff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.114167 Dec 25 21:21:24.463596 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2332/4541] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:24 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:24.472662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:24.473401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:24.481310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.481760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.482563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.482983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.773481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:24.781519 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a68fd98b-7fce-4863-a509-49396001d0ab tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1510 microversion: 2.1 time: 0.315891 Dec 25 21:21:24.782101 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2333/4542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:24 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1510 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:24.786361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:24.786968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:24.793356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.793815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.794888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.795333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.862756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:24.871635 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c249c83-ba3c-418d-9fc5-f91175fbbf54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1273 microversion: 2.1 time: 0.088521 Dec 25 21:21:24.881020 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2334/4543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:24.881020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:24.881020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:24.885379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.886574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.886872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.887259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.936798 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff6be2f6-c58e-4473-8dbc-8af0476d16d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062455 Dec 25 21:21:24.941390 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2335/4544] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:24 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:24.967642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:24.970565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:24.981072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.982833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:24.984467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:24.986049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.036656 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50566844-3238-4ccc-9fcc-04b465f9de7a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.096537 Dec 25 21:21:25.037434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2336/4545] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:24 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:25.044042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:25.045028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:25.052921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.053616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.054415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.054846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.404162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:25.413366 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0554b06c-c588-4e80-b406-31b37fe65945 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1213 microversion: 2.1 time: 0.374389 Dec 25 21:21:25.420183 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2337/4546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:25 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1213 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:25.459863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Building network info cache for instance {{(pid=136547) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1883}} Dec 25 21:21:25.475192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:25.475890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:25.488262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.490873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.497580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.497580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.590940 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bb34e38-95be-41fc-984d-e0f8a0b3b932 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.121030 Dec 25 21:21:25.592550 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2338/4547] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:25 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:25.610232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-51cc0de1-4f04-430e-bd28-312920d42386 req-8b98bb5a-f6f9-4ba7-9541-1cc5e3a54b75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:25.615638 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:25.615638 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:25.627946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-51cc0de1-4f04-430e-bd28-312920d42386 req-8b98bb5a-f6f9-4ba7-9541-1cc5e3a54b75 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.628664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-51cc0de1-4f04-430e-bd28-312920d42386 req-8b98bb5a-f6f9-4ba7-9541-1cc5e3a54b75 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.644698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-51cc0de1-4f04-430e-bd28-312920d42386 req-8b98bb5a-f6f9-4ba7-9541-1cc5e3a54b75 service nova] Creating event network-changed:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:21:25.652831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-51cc0de1-4f04-430e-bd28-312920d42386 req-8b98bb5a-f6f9-4ba7-9541-1cc5e3a54b75 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045954 Dec 25 21:21:25.654225 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2339/4548] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:25.803934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:25.804708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:25.817514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.818124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:25.819014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:25.822817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:26.676984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:26.684392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b34d47a0-eef5-4842-9e2a-8a46f9552bc2 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1510 microversion: 2.1 time: 0.888541 Dec 25 21:21:26.685965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2340/4549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:25 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1510 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:26.692847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:26.694467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:26.717241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:26.717761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:26.718737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:26.719332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:26.985426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Updating instance_info_cache with network_info: [{"id": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e", "address": "fa:16:3e:80:74:5a", "network": {"id": "5e3e14c1-fa4f-4065-b9e3-19dd5f8f11c3", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1998990851-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "bfd1b67368c34701bcdc20105e48ad41", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false}, "devname": "tap8b0e5751-7b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=136547) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:21:26.997557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Releasing lock "refresh_cache-f38f1e54-3e25-4107-9a2c-734823ced707" {{(pid=136547) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Dec 25 21:21:26.998945 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d193b79-dd13-452d-8e27-f7eb95ab05c0 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action" status: 202 len: 0 microversion: 2.1 time: 3.262810 Dec 25 21:21:27.001788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2210/4550] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:23 2021] POST /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707/action => generated 0 bytes in 3266 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Dec 25 21:21:27.008107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:27.010207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:27.023123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.024107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.027382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.027855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.075887 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46695934-4e72-4d42-9afe-9220e9978fa6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.072263 Dec 25 21:21:27.077542 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2211/4551] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:27 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:27.084229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:27.086085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:27.095198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.095959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.097056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.098013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.126252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:27.140831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-684a9fe6-83da-4077-81a5-ee645bb95e5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.449437 Dec 25 21:21:27.141505 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2341/4552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:26 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:27.154531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:27.157783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:27.166684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.167148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.168146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.168780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.173393 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-590daa68-4dac-4eea-81f2-363fcfbafe99 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.093774 Dec 25 21:21:27.175067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2212/4553] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:27 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:27.182283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4de2a9cd-6d5d-47b9-895c-cd2b5909bc97"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:27.184689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:27.197914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.199529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.201205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.202141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.333318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:27.340861 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1584321-ff95-4e22-9dc3-4cd1136b8011 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1275 microversion: 2.1 time: 0.196450 Dec 25 21:21:27.341461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2342/4554] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:27 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1275 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:27.346119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:27.347047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:27.353926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.354378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.355161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.355593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.405004 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-129a77ab-3dbd-4dea-b2dd-95cc35235d2c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062032 Dec 25 21:21:27.408780 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2343/4555] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:27 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:27.410583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-09da9417-41ad-4fee-a0f0-350ed1aaf4b4 req-b6728001-c0ce-401a-928a-8d72e16a0422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "336c6856-ca33-4291-b38f-03e7f7a5db93", "tag": "6dcde4f1-b084-49e9-9b96-ae184bf1c495"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:27.412047 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:27.412047 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:27.420934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-09da9417-41ad-4fee-a0f0-350ed1aaf4b4 req-b6728001-c0ce-401a-928a-8d72e16a0422 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:27.424720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-09da9417-41ad-4fee-a0f0-350ed1aaf4b4 req-b6728001-c0ce-401a-928a-8d72e16a0422 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:27.434259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-09da9417-41ad-4fee-a0f0-350ed1aaf4b4 req-b6728001-c0ce-401a-928a-8d72e16a0422 service nova] Creating event network-changed:6dcde4f1-b084-49e9-9b96-ae184bf1c495 for instance 336c6856-ca33-4291-b38f-03e7f7a5db93 on nch1-master-1 Dec 25 21:21:27.439194 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-09da9417-41ad-4fee-a0f0-350ed1aaf4b4 req-b6728001-c0ce-401a-928a-8d72e16a0422 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032223 Dec 25 21:21:27.447864 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2344/4556] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:27.447864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0dc965c8-98aa-4ef2-b4af-e21e91b52ced tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '.version_select at 0x7fa4f638c1f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:28.095122 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ebfb391-8ebf-4637-ba7c-7587316a5d87 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.918297 Dec 25 21:21:28.096168 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2213/4557] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:21:27 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments => generated 194 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:28.102199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3fb81276-824a-4475-9c28-a3830e23fd90 req-0d4044d8-55b8-4c9f-b24f-f653aaa91853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a747d3f-891a-44f7-93c1-17ac8d8cafb8", "name": "network-vif-deleted", "tag": "9c0aa314-9c2e-48d1-9808-f65926f1cc94"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:28.105191 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:28.105191 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:28.115657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3fb81276-824a-4475-9c28-a3830e23fd90 req-0d4044d8-55b8-4c9f-b24f-f653aaa91853 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.116253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3fb81276-824a-4475-9c28-a3830e23fd90 req-0d4044d8-55b8-4c9f-b24f-f653aaa91853 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.134847 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3fb81276-824a-4475-9c28-a3830e23fd90 req-0d4044d8-55b8-4c9f-b24f-f653aaa91853 service nova] Creating event network-vif-deleted:9c0aa314-9c2e-48d1-9808-f65926f1cc94 for instance 3a747d3f-891a-44f7-93c1-17ac8d8cafb8 on nch2-master-1 Dec 25 21:21:28.140631 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3fb81276-824a-4475-9c28-a3830e23fd90 req-0d4044d8-55b8-4c9f-b24f-f653aaa91853 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042560 Dec 25 21:21:28.141286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2214/4558] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:28.147605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:28.148487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:28.157697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.157697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.157697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.158921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.191609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.192324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.192997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lazy-loading 'fault' on Instance uuid 3a747d3f-891a-44f7-93c1-17ac8d8cafb8 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:28.255522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1bd5080663a4db4bc90d3ef605f721f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e372a1fc5a7e45c39e9ebee6a776c081', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:28.265038 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32b0fea6-f304-4918-9405-e8ee64a272e7 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 200 len: 1306 microversion: 2.1 time: 0.121907 Dec 25 21:21:28.265781 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2215/4559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:28 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 1306 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:28.275428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:28.275428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:28.279101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.279673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.280539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.281029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.334808 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5125d444-a364-4f56-9487-8a6629fd998c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.067706 Dec 25 21:21:28.336004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2216/4560] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:28 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:28.341456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:28.342176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:28.349251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.349757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.350569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.355193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.702886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:28.717525 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02efac38-e4a9-4deb-894c-3240a21850e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.380793 Dec 25 21:21:28.727438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2217/4561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:28 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:28.727438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:28.727438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:28.734857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.735696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.736155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.736600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.781706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2388d10-2b3c-4b31-b3c8-b9c7100d4bf7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 14 microversion: 2.1 time: 0.062076 Dec 25 21:21:28.785082 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2218/4562] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:28 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 14 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:28.789469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:28.790893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:28.797972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.798763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.799214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.799649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.941920 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0dc965c8-98aa-4ef2-b4af-e21e91b52ced tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "DELETE /compute/v2.1/os-floating-ips/ef7ad7c9-ea62-47ce-af69-6aa9939e96d1" status: 202 len: 0 microversion: 2.1 time: 1.497893 Dec 25 21:21:28.942828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2345/4563] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:21:27 2021] DELETE /compute/v2.1/os-floating-ips/ef7ad7c9-ea62-47ce-af69-6aa9939e96d1 => generated 0 bytes in 1499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:28.964239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:28.965363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:28.972143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.972591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:28.973609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:28.974212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.015680 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6ae84008-c88d-4e46-a48b-7e20d6e0c5af tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.071414 Dec 25 21:21:29.016540 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2346/4564] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:28 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:29.022980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53a59316-07be-4012-a801-ef77de800c04 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '.version_select at 0x7fa4f634d3a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:29.046712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:29.059203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f53eff8a-05e6-47aa-a92e-0892e1320e0a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1317 microversion: 2.1 time: 0.273907 Dec 25 21:21:29.060198 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2219/4565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:28 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:29.284369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:29.285013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] [instance: 3a747d3f-891a-44f7-93c1-17ac8d8cafb8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:29.294302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.295207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.296016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.296453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.311729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] HTTP exception thrown: Instance 3a747d3f-891a-44f7-93c1-17ac8d8cafb8 could not be found. Dec 25 21:21:29.312346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] Returning 404 to user: Instance 3a747d3f-891a-44f7-93c1-17ac8d8cafb8 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:29.313193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f45a743-d38c-4bbb-b7d9-c990ccf5e075 tempest-ServerPasswordTestJSON-711784220 tempest-ServerPasswordTestJSON-711784220-project] 10.222.0.32 "GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8" status: 404 len: 111 microversion: 2.1 time: 0.033414 Dec 25 21:21:29.313760 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2220/4566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:29 2021] GET /compute/v2.1/servers/3a747d3f-891a-44f7-93c1-17ac8d8cafb8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:21:29.348421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:29.349831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:29.361110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.361608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.362412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.362851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.454381 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c5953d9e-6abc-4460-a9da-4690139f3f83 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.110740 Dec 25 21:21:29.455109 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2221/4567] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:29 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:29.471894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53a59316-07be-4012-a801-ef77de800c04 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "DELETE /compute/v2.1/os-security-groups/777664ad-5e56-438f-b294-88e17ba798c0" status: 202 len: 0 microversion: 2.1 time: 0.452965 Dec 25 21:21:29.471894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2347/4568] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:21:29 2021] DELETE /compute/v2.1/os-security-groups/777664ad-5e56-438f-b294-88e17ba798c0 => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:29.484234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:29.484991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:29.492521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.493077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.494213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.494652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.539321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:29.736694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:29.737739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:29.746187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.747792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.748822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.749842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.902060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b19f43d1-8d82-4fc8-929f-5285749f75a2 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 204 len: 0 microversion: 2.1 time: 0.421585 Dec 25 21:21:29.906361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2222/4569] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:29 2021] DELETE /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:29.912189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:29.914442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:29.924175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.926203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.926203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.927343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:29.984452 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a13ab8d3-d1fa-4f92-8e79-d2e1045454b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action" status: 200 len: 8204 microversion: 2.1 time: 0.079065 Dec 25 21:21:29.985138 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2223/4570] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:29 2021] POST /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f/action => generated 8204 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:29.990563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:29.991476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:29.999014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:29.999430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.000241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.000850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.013882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:30.021401 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86a798b8-1415-4e5a-ad92-6f45104fee83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.290560 Dec 25 21:21:30.022250 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2348/4571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:29 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:30.026991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:30.031504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:30.034864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.040119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.042351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.042954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.312026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:30.316685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:30.320100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5aacc1f7-9734-403f-a3b2-fb55c593b613 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1510 microversion: 2.1 time: 0.333565 Dec 25 21:21:30.321122 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2224/4572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:29 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:30.325450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:30.326422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:30.331736 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9095f669-1d8c-4c68-a1f4-207a12ee4c41 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.308079 Dec 25 21:21:30.332310 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2349/4573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:30 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:30.333311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.333816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.334628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.335197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.336986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:30.337616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:30.344028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.345315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.345422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.345785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.382398 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e73e738-d57b-4cbb-938b-ee96e24acbca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060333 Dec 25 21:21:30.383335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2225/4574] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:30 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:30.391504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4e68d938-411e-480d-bab5-547e576c5507 req-84c3315c-b5a8-4fda-ae2f-7af58b01104e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64261b4d-7f44-4796-9323-e198eada5059", "tag": "e1a1ed5e-2df4-4726-86bd-bc56ff15ffb1"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:30.391504 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:30.391504 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:30.397726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4e68d938-411e-480d-bab5-547e576c5507 req-84c3315c-b5a8-4fda-ae2f-7af58b01104e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.398177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4e68d938-411e-480d-bab5-547e576c5507 req-84c3315c-b5a8-4fda-ae2f-7af58b01104e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.416447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4e68d938-411e-480d-bab5-547e576c5507 req-84c3315c-b5a8-4fda-ae2f-7af58b01104e service nova] Creating event network-changed:e1a1ed5e-2df4-4726-86bd-bc56ff15ffb1 for instance 64261b4d-7f44-4796-9323-e198eada5059 on nch1-master-1 Dec 25 21:21:30.422073 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4e68d938-411e-480d-bab5-547e576c5507 req-84c3315c-b5a8-4fda-ae2f-7af58b01104e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037712 Dec 25 21:21:30.422834 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2226/4575] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:30.427752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:30.428451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:30.446237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.451029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.451029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.451029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.547073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:30.557159 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22c91495-eff2-4241-a06c-4c61c11ff9cd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1317 microversion: 2.1 time: 0.223414 Dec 25 21:21:30.557742 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2350/4576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:30 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:30.562772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:30.563819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:30.570571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.571066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.572038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.572956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.622540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53ef5d34-be73-4086-88ec-f1898e7af6ea tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.063332 Dec 25 21:21:30.623515 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2351/4577] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:30 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:30.941802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:30.954040 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06763afa-ea87-4134-bcb1-d225d3f4bfdd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.530077 Dec 25 21:21:30.954845 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2227/4578] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:30 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:30.972856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:30.974273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:30.982106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.982563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:30.983364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:30.983824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.038382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:31.039623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.047838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.048421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.049598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.050314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.175980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Locking {{(pid=136548) lock /opt/stack/nova/nova/compute/api.py:4624}} Dec 25 21:21:31.326426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:31.336969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9fe13c69-3a9c-414b-8766-1aef9e7819d9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.302515 Dec 25 21:21:31.349341 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2228/4579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:31 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:31.359940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:31.360565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.367482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.368783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.369652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.370176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.382694 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a11584dc-55e9-40bb-9301-35073f3e9cae tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.414057 Dec 25 21:21:31.383575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2352/4580] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:30 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:31.395858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:31.396563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.404194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.405033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.406196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.406355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.571638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:31.579541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4dd77704-0777-44af-8a4d-4ad4666ca2ef tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1510 microversion: 2.1 time: 0.229035 Dec 25 21:21:31.585169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2229/4581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:31 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1510 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:31.589946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:31.591151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.598191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.598912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.599998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.600597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.631929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:31.640047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ece18582-269b-4936-8b3b-b58f13386c35 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.250862 Dec 25 21:21:31.640636 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2353/4582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:31 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:31.645259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:31.645912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.648071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd8f88f7-8f44-4b45-b99f-3754e55128e0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.066278 Dec 25 21:21:31.649522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2230/4583] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:31 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:31.653398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.653945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.654806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.660358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.660578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:31.660578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.671184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.671759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.672938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.673073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.717342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4715fbd-13de-4a01-9e80-70df985b26a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066562 Dec 25 21:21:31.718214 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2231/4584] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:31 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:31.726406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a5e865d-16f9-4eaa-b713-c809bc9a7e45 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:31.734228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a5e865d-16f9-4eaa-b713-c809bc9a7e45 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.734665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a5e865d-16f9-4eaa-b713-c809bc9a7e45 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.761322 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-5a5e865d-16f9-4eaa-b713-c809bc9a7e45 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] HTTP exception thrown: Instance 161df36a-2258-4f32-a7b0-2f7c793d4390 is locked Dec 25 21:21:31.762447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a5e865d-16f9-4eaa-b713-c809bc9a7e45 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Returning 409 to user: Instance 161df36a-2258-4f32-a7b0-2f7c793d4390 is locked {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:31.767089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a5e865d-16f9-4eaa-b713-c809bc9a7e45 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 409 len: 107 microversion: 2.1 time: 0.041077 Dec 25 21:21:31.767089 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2232/4585] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:31 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 107 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:21:31.772589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:31.773669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:31.781089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.781555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.782357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:31.783432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:31.805707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:31.813527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-499131f0-8cad-4c84-8836-7c040a737563 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1317 microversion: 2.1 time: 0.171713 Dec 25 21:21:31.814096 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2354/4586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:31 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:32.020224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Unlocking {{(pid=136547) unlock /opt/stack/nova/nova/compute/api.py:4653}} Dec 25 21:21:32.272169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e43cc293-a30e-4d5d-b367-135aa35cfe92 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.503231 Dec 25 21:21:32.272843 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2233/4587] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:31 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:21:32.280886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-553516e3-50b2-44e7-8bae-0199bc707bc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:32.287417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-553516e3-50b2-44e7-8bae-0199bc707bc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.287826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-553516e3-50b2-44e7-8bae-0199bc707bc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.311167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-553516e3-50b2-44e7-8bae-0199bc707bc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:21:32.365784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:32.366539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:32.388578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.391734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.391734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.391734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.619766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-553516e3-50b2-44e7-8bae-0199bc707bc8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.342499 Dec 25 21:21:32.620559 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2355/4588] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:32 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:32.628485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:32.629792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:32.636938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.637862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.639724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:32.639860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.639860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.648605 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-738ddbfe-ff24-4efa-944e-7c986f6e8cad tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.287512 Dec 25 21:21:32.649251 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2234/4589] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:32 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:32.660978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:32.661829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:32.668762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.669684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.670641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.671237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.680817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23e7d3ec-b60d-4868-ac91-bbe6037e1522 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057944 Dec 25 21:21:32.681845 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2356/4590] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:21:32 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:32.686523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:32.687289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:32.694428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.694876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:32.695928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:32.696372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.055986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:33.067808 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe94a3a8-6eda-4eb2-9962-7252699ce668 tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1510 microversion: 2.1 time: 0.416348 Dec 25 21:21:33.077897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:33.080573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2235/4591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:32 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1510 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:33.084121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:33.085206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:33.090212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f0aae50-3d4a-40fc-836a-e69371bd2ff7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.406237 Dec 25 21:21:33.091963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2357/4592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:32 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:33.102892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.103766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.104814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.111207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.111345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:33.111345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:33.119067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.119521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.120377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.120820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.151847 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b390e81-69d4-4cfa-b97d-cf64938b6e9c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.071213 Dec 25 21:21:33.153385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2236/4593] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:33 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:33.160551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:33.162623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:33.174949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.175818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.177090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.177705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.194901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-59529c0b-fad5-47d8-a3d5-6a49e63a4ab6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/4de2a9cd-6d5d-47b9-895c-cd2b5909bc97" status: 200 len: 194 microversion: 2.1 time: 0.101477 Dec 25 21:21:33.196852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2358/4594] 10.222.0.32 () {58 vars in 1412 bytes} [Sat Dec 25 21:21:33 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/4de2a9cd-6d5d-47b9-895c-cd2b5909bc97 => generated 194 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:33.202396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:33.203091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:33.210401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.211031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.213173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.214943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.239611 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec962a9a-7da3-4e10-90f1-636448506cfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.083824 Dec 25 21:21:33.240518 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2237/4595] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:33 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:33.279728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-bd50c22f-1fdd-4886-9c23-dbc4c9ce9421 req-b0d00b4a-4bef-49fc-929a-92254b314b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336c6856-ca33-4291-b38f-03e7f7a5db93", "name": "network-vif-plugged", "status": "completed", "tag": "6dcde4f1-b084-49e9-9b96-ae184bf1c495"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:33.281443 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:33.281443 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:33.290385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-bd50c22f-1fdd-4886-9c23-dbc4c9ce9421 req-b0d00b4a-4bef-49fc-929a-92254b314b8a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.290905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-bd50c22f-1fdd-4886-9c23-dbc4c9ce9421 req-b0d00b4a-4bef-49fc-929a-92254b314b8a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.303150 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-bd50c22f-1fdd-4886-9c23-dbc4c9ce9421 req-b0d00b4a-4bef-49fc-929a-92254b314b8a service nova] Creating event network-vif-plugged:6dcde4f1-b084-49e9-9b96-ae184bf1c495 for instance 336c6856-ca33-4291-b38f-03e7f7a5db93 on nch1-master-1 Dec 25 21:21:33.308205 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-bd50c22f-1fdd-4886-9c23-dbc4c9ce9421 req-b0d00b4a-4bef-49fc-929a-92254b314b8a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037343 Dec 25 21:21:33.309022 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2238/4596] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:33.514754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-86f8592b-7609-4d52-b81c-e2866e8d72f3 req-5877b872-c27d-4d0f-aefd-1df34bc976c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f38f1e54-3e25-4107-9a2c-734823ced707", "name": "network-vif-deleted", "tag": "8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:33.518623 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:33.518623 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:33.531924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-86f8592b-7609-4d52-b81c-e2866e8d72f3 req-5877b872-c27d-4d0f-aefd-1df34bc976c6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.532537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-86f8592b-7609-4d52-b81c-e2866e8d72f3 req-5877b872-c27d-4d0f-aefd-1df34bc976c6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.545881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-86f8592b-7609-4d52-b81c-e2866e8d72f3 req-5877b872-c27d-4d0f-aefd-1df34bc976c6 service nova] Creating event network-vif-deleted:8b0e5751-7b56-4a37-85e7-4ab3bbe3ac3e for instance f38f1e54-3e25-4107-9a2c-734823ced707 on nch2-master-1 Dec 25 21:21:33.550817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-86f8592b-7609-4d52-b81c-e2866e8d72f3 req-5877b872-c27d-4d0f-aefd-1df34bc976c6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045654 Dec 25 21:21:33.551860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2239/4597] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:33.578046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:33.588844 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-845121ce-8059-49ee-b2f9-743bf1c7e6c1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1317 microversion: 2.1 time: 0.390573 Dec 25 21:21:33.589549 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2359/4598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:33 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1317 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:33.668054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:33.668987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:33.675352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.675805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.676599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:33.677066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:33.825600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:33.829305 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89a24f78-fdc3-4d0f-8e3c-286e1e5076e0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.166413 Dec 25 21:21:33.829909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2240/4599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:33 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:34.086173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:34.087463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:34.093398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.094190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.095112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.095586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.108251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:34.109061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:34.115432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.127797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.128991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.130171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.130621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.130739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.131075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lazy-loading 'fault' on Instance uuid f38f1e54-3e25-4107-9a2c-734823ced707 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:34.187677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ec911a0e281430f98062b734b3d4de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfd1b67368c34701bcdc20105e48ad41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:34.196018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e3afb8c-4711-4224-8738-cf92ab0eac5a tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 200 len: 1312 microversion: 2.1 time: 0.114254 Dec 25 21:21:34.197530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2360/4600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:34 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:34.202416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:34.203507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:34.214705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.215160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.215957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.217438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.261033 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bcd85eb-96d2-4b3e-9d4c-fd503a03ce4d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062213 Dec 25 21:21:34.264745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2361/4601] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:34 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:34.266816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:34.270583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:34.274933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.275390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.276229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.276657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.312659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:34.322768 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c03d820e-fad6-4665-b219-641889254243 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.218480 Dec 25 21:21:34.323404 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2241/4602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:34 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:34.336744 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94f2aef9-c2e4-49c2-957d-730f98ab9ec7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.073551 Dec 25 21:21:34.337478 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2362/4603] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:34 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:34.606216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:34.606809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:34.613778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.614676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.615721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.616172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.767739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:34.775733 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f5c952d-2373-4fd5-a06f-4e45013e910f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1317 microversion: 2.1 time: 0.174088 Dec 25 21:21:34.776294 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2242/4604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:34 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:34.846593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:34.847327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:34.854927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.855246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:34.856030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:34.856523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.008919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:35.017306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ecb4ce9-4d0f-4c6f-aadd-d9963c4c2497 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1315 microversion: 2.1 time: 0.174784 Dec 25 21:21:35.018191 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2363/4605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:34 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:35.212608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:35.213295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] [instance: f38f1e54-3e25-4107-9a2c-734823ced707] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:35.219268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.219728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.220510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.220975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.237184 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] HTTP exception thrown: Instance f38f1e54-3e25-4107-9a2c-734823ced707 could not be found. Dec 25 21:21:35.237781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] Returning 404 to user: Instance f38f1e54-3e25-4107-9a2c-734823ced707 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:35.238620 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a223c47-bb65-4b42-adb3-bf0bb92cf90e tempest-ServerRescueTestJSONUnderV235-1351702928 tempest-ServerRescueTestJSONUnderV235-1351702928-project] 10.222.0.32 "GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707" status: 404 len: 111 microversion: 2.1 time: 0.030060 Dec 25 21:21:35.239174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2243/4606] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:35 2021] GET /compute/v2.1/servers/f38f1e54-3e25-4107-9a2c-734823ced707 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:35.273078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:35.274578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:35.283846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.284307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.285141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.285578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.332687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-52830df0-9bc9-4976-8896-7869e2f30f3e req-2b0bcb45-95f7-4ab0-a808-c452286d13f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64261b4d-7f44-4796-9323-e198eada5059", "name": "network-vif-plugged", "status": "completed", "tag": "e1a1ed5e-2df4-4726-86bd-bc56ff15ffb1"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:35.333594 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-16ecf506-81e4-4524-b3da-5939825b8be2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064872 Dec 25 21:21:35.337470 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2364/4607] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:35 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:35.337625 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:35.337625 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:35.341804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:35.342529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:35.350380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.352621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.352621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.352821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-52830df0-9bc9-4976-8896-7869e2f30f3e req-2b0bcb45-95f7-4ab0-a808-c452286d13f1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.352966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.353077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-52830df0-9bc9-4976-8896-7869e2f30f3e req-2b0bcb45-95f7-4ab0-a808-c452286d13f1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.381983 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-52830df0-9bc9-4976-8896-7869e2f30f3e req-2b0bcb45-95f7-4ab0-a808-c452286d13f1 service nova] Creating event network-vif-plugged:e1a1ed5e-2df4-4726-86bd-bc56ff15ffb1 for instance 64261b4d-7f44-4796-9323-e198eada5059 on nch1-master-1 Dec 25 21:21:35.389625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-52830df0-9bc9-4976-8896-7869e2f30f3e req-2b0bcb45-95f7-4ab0-a808-c452286d13f1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061697 Dec 25 21:21:35.390828 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2244/4608] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:35.399120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:35.400480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:35.408088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.408808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.410021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.410471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.456993 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c56db1ec-fa2f-4c12-909f-51304d4f6ce5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064291 Dec 25 21:21:35.460864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2245/4609] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:35 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:35.684939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:35.692541 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2841a88c-d4d4-4d9a-8e87-01db71921579 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.355746 Dec 25 21:21:35.693187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2365/4610] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:35 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:35.792639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:35.794657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:35.806007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.807135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:35.807538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:35.808047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.036223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:36.037601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:36.043010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:36.048082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.049094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.050137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.050790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.053662 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32d3b31d-b14d-46bc-b9d1-90459041e529 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1317 microversion: 2.1 time: 0.264745 Dec 25 21:21:36.060371 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2246/4611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:35 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1317 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:36.203644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ff193c5-1a26-432e-be9f-a6ab5fa96be0"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:36.205058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:36.213487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.213931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.214759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.215206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.561898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:36.572805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a7d27e5-a0b7-4cde-9dd3-3de130cd4500 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.541756 Dec 25 21:21:36.579574 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2366/4612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:36 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:36.605715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:36.606933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:36.622144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.624603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.625938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.629852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.688137 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5d1b40f5-b983-4bbf-bac9-c9c2562b7045 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.113461 Dec 25 21:21:36.689306 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2367/4613] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:36 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:36.695091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:36.698023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:36.714273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.714957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.715945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.716398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.771386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15dc4471-a3bd-4724-8ae4-7ccb5bbbd023 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.080451 Dec 25 21:21:36.772918 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2368/4614] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:36 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:36.778547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:36.779555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:36.802502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.802739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:36.803552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:36.804001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.056023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:37.067994 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63101425-123b-4d71-babf-6a4419d7a566 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.293413 Dec 25 21:21:37.068584 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2369/4615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:36 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:37.075315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1725569215", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:37.139998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] validate_networks() for [('2173080e-712c-4030-840a-d911c5ceb839', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:37.230208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1100f1e4-49aa-494d-89ed-122fe539f2e3 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.029816 Dec 25 21:21:37.238951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2247/4616] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:21:36 2021] POST /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:37.249143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:37.251948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:37.262040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:37.262758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.264185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:37.264837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.665176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:37.715974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b9f639e-83e0-4273-847e-1e70a72ad6fe tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1506 microversion: 2.1 time: 0.435753 Dec 25 21:21:37.715974 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2248/4617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:37 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:37.715974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:37.715974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:37.723757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:37.728276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.730197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:37.733487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.799942 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e658d265-897a-4259-afd0-5d45eda94dff tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.101987 Dec 25 21:21:37.801766 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2249/4618] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:37 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:21:37.810824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:37.817130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:37.837564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:37.840162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.841070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:37.841581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:37.945116 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-019570d0-48fe-44b2-bec8-ee9ee7744863 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.141435 Dec 25 21:21:37.949824 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2250/4619] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:37 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:38.086885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:38.087916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:38.098943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.100861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.106785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.109435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.124897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:38.125895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:38.126611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:38.127578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:38.128378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:38.149749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.150221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.151645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.153574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.203855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Getting quotas for project 66319858228140b3841ef6c7c8cd5c14. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:38.217702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Getting quotas for user 257eeccacdc24f00a418cbb27204cf4f and project 66319858228140b3841ef6c7c8cd5c14. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:38.235219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:38.238162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:38.455529 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe2362cd-c2e7-4291-92dd-4bcfe7e29418 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384051 Dec 25 21:21:38.460526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2370/4620] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:21:38.462987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:38.530105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-127e8aaf-ed4b-459e-bbf8-0a17a1bf38b9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:38.536142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d73991e7-23d6-46be-a61a-31cdde276a6b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.450264 Dec 25 21:21:38.537167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-127e8aaf-ed4b-459e-bbf8-0a17a1bf38b9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:38.551460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2251/4621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:38 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:38.675746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-127e8aaf-ed4b-459e-bbf8-0a17a1bf38b9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:38.689712 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-127e8aaf-ed4b-459e-bbf8-0a17a1bf38b9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1217 microversion: 2.1 time: 0.207726 Dec 25 21:21:38.691421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2371/4622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:38 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1217 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:38.815132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:38.817128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:38.839106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.841493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.841493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.841493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.915811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5caac398-08d4-4dee-9011-c4ffd65dfb36 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.102527 Dec 25 21:21:38.917314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2252/4623] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:38 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:38.958910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:38.960281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:38.970314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.971285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:38.972310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:38.972929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:39.029095 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86b62705-be4b-414b-a2a8-2f1563f54ed9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.073203 Dec 25 21:21:39.034870 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2372/4624] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:38 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:39.559130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:39.559922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:39.567187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:39.567649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:39.568464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:39.568929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:39.711677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:39.712376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:39.722580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:39.723392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:39.724413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:39.725091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:39.736414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:39.755224 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc7dcca5-4f09-4f8f-a258-535be82a7f17 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.201045 Dec 25 21:21:39.759381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2253/4625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:39 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:39.803391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:39.813431 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a97487b-2f2d-4639-a72e-5bf2be98aaab tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1221 microversion: 2.1 time: 0.110147 Dec 25 21:21:39.816358 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2373/4626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:39 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:39.927624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:39.928838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:39.936584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:39.937119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:39.938863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:39.939506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:40.001179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-24b4d069-2cf6-42bd-8e89-7ab7ea9de03e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.077053 Dec 25 21:21:40.002616 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2254/4627] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:39 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:40.042848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:40.044295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:40.065868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:40.066331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:40.067198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:40.067647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:40.121930 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24cc46cc-5751-4bc6-a5ad-c04f1a879c59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.079411 Dec 25 21:21:40.121930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2374/4628] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:40 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:40.470065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1692506826", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6d0f08d-96b7-4228-b50e-9f6262725ca6"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:40.529667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] validate_networks() for [('c6d0f08d-96b7-4228-b50e-9f6262725ca6', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:40.973152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:40.973865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:40.981860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:40.987706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:40.987706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:40.987706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.031112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:41.031611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:41.032019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:41.032439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:41.032865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:41.046243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.050907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.050907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.050907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.075964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Getting quotas for project af127d2683f84f0682595fe8297db6b1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:41.082836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Getting quotas for user 97abfab761214f10bb25fbf8ba958822 and project af127d2683f84f0682595fe8297db6b1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:41.099293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:41.102960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:41.173822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:41.184083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8cb2f8f2-ab35-4158-9a46-c9f8fb23972a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.414839 Dec 25 21:21:41.184679 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2375/4629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:40 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:41.191429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:41.196956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:41.204375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.205358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.206493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.207074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.299733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:41.308445 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22b93fdd-94be-4bf4-8bdf-db6f28f00255 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1269 microversion: 2.1 time: 0.119325 Dec 25 21:21:41.318988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2376/4630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:41 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:41.324198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa359d7e-7889-4e7a-9d7d-20b3a5bd215b"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:41.335430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:41.342270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4f1c042-b95d-43f5-a65d-64bda57980cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.029129 Dec 25 21:21:41.345565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.347695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.349164 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2255/4631] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:40 2021] POST /compute/v2.1/servers => generated 383 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:21:41.351076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.352338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.359728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:41.381845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:41.404977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.405430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.406244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.406679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.527908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-747783db-39bf-413d-8643-9e8a03476164 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.175488 Dec 25 21:21:41.528317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2256/4632] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:41 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:41.539907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:41.540829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:41.551884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.551884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.551884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:41.552149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:41.697135 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6dfa7e8-6a4a-4cd8-b390-f4a0f891a762 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.162374 Dec 25 21:21:41.698507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2257/4633] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:41 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:41.703692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc6d3ec3-97d0-4353-b337-d8b1161a6e62 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:41.704385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fc6d3ec3-97d0-4353-b337-d8b1161a6e62 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:41.795589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc6d3ec3-97d0-4353-b337-d8b1161a6e62 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:41.809102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc6d3ec3-97d0-4353-b337-d8b1161a6e62 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1222 microversion: 2.1 time: 0.109132 Dec 25 21:21:41.809897 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2258/4634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:41 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1222 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:41.870599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-454780197", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6d0f08d-96b7-4228-b50e-9f6262725ca6"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:41.925343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] validate_networks() for [('c6d0f08d-96b7-4228-b50e-9f6262725ca6', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:42.535706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e975190-a5f1-447a-a8e9-19e3d4b822e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.215112 Dec 25 21:21:42.537202 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2377/4635] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:21:41 2021] POST /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments => generated 194 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:42.553154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:42.570129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:42.581997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:42.582668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:42.583484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:42.583939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:42.644222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4a70021-fac5-44e6-bdb2-097e5616bc4c tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.104783 Dec 25 21:21:42.650664 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2378/4636] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:21:42 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments => generated 371 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:42.652018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:42.652709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:42.680086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:42.683574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:42.685714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:42.686186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.128240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:43.128719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:43.129171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:43.129781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:43.130363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:43.150142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.150142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.150142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.154716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.188657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Getting quotas for project af127d2683f84f0682595fe8297db6b1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:43.194145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Getting quotas for user 97abfab761214f10bb25fbf8ba958822 and project af127d2683f84f0682595fe8297db6b1. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:43.225084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:43.225084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:43.373743 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b81c728-720c-4f86-a129-8934ab4f964d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.502230 Dec 25 21:21:43.379960 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2259/4637] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:21:43.388846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:43.393873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:43.420336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.427394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.429479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.430699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.465881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:43.476302 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20773114-deb7-4ecc-b54d-0f006d833d90 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.828006 Dec 25 21:21:43.477544 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2379/4638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:42 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:43.502789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:43.511898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:43.519395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.522446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.524098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.525510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.557625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:43.575980 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3904f7ec-f478-44e7-bead-d5a259b3ba75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1275 microversion: 2.1 time: 0.198843 Dec 25 21:21:43.575980 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2260/4639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:43 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:43.594227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:43.595539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:43.627760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.628803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.630075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.636736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.652797 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54212ea4-68e1-48c2-b6ed-034ea0d1ce5b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.161478 Dec 25 21:21:43.655379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2380/4640] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:43 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:43.674058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:43.674657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:43.699217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.699688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.700499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.700992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.730432 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-388b7134-46d2-4e00-bde6-0dd545f75189 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.153698 Dec 25 21:21:43.732652 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2261/4641] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:43 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:43.762373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6fa2c4f0-ddb8-41fd-b02e-2927fdf7d48e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:43.763992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6fa2c4f0-ddb8-41fd-b02e-2927fdf7d48e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:43.826568 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37f90d6c-041d-42d0-884f-4a06acb85913 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/4de2a9cd-6d5d-47b9-895c-cd2b5909bc97" status: 200 len: 194 microversion: 2.1 time: 0.167745 Dec 25 21:21:43.832108 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2381/4642] 10.222.0.32 () {58 vars in 1412 bytes} [Sat Dec 25 21:21:43 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/4de2a9cd-6d5d-47b9-895c-cd2b5909bc97 => generated 194 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:43.842182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:43.842182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:43.847265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.847968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.849018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:43.849614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:43.990351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lazy-loading 'services' on Instance uuid f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:44.006744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6fa2c4f0-ddb8-41fd-b02e-2927fdf7d48e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:44.019192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6fa2c4f0-ddb8-41fd-b02e-2927fdf7d48e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1221 microversion: 2.1 time: 0.283193 Dec 25 21:21:44.023360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2262/4643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:43 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1221 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:44.315348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-daa27059-9ddd-4119-9ffd-36f151405ef0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/4de2a9cd-6d5d-47b9-895c-cd2b5909bc97" status: 202 len: 0 microversion: 2.1 time: 0.480931 Dec 25 21:21:44.315973 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2382/4644] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:21:43 2021] DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/4de2a9cd-6d5d-47b9-895c-cd2b5909bc97 => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:44.501939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:44.502562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:44.513443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:44.513779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:44.514730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:44.515171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:44.667317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1750777233", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": "none"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:44.728679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:44.729336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:44.729808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:44.730220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:44.730882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:44.742079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:44.742576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:44.743397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:44.744158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:44.778220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Getting quotas for project 8448b25167bd4f0facbde22bc77a818d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:44.794067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Getting quotas for user 4f35acdc849b446f8564ce2666f2e17c and project 8448b25167bd4f0facbde22bc77a818d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:44.808054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:44.811665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:44.815881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:44.823974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-97c16f58-7063-4142-936e-bbff89196131 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.325713 Dec 25 21:21:44.838037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2263/4645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:44 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:44.847798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:44.848500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:44.859344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:44.859798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:44.860779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:44.861284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:44.989965 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9c8f1aa7-258d-435f-9bd0-0bfb473fce8d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.480279 Dec 25 21:21:44.991340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2383/4646] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:21:44 2021] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Dec 25 21:21:44.998051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:44.999855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.007565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.008698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.009989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.010595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.068282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a630e94e-baa9-4824-ae72-866c046e3c71 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.074924 Dec 25 21:21:45.072556 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2384/4647] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:44 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:45.076844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:45.077943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.091999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.092796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.094030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.095337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.112412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:45.123497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa5b999d-1e70-4e8b-b33f-f5e822365fe7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.286154 Dec 25 21:21:45.136821 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2264/4648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:44 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:45.150436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9897b7dd-b9e0-49e3-8813-f755e36e9b9c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:45.151208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9897b7dd-b9e0-49e3-8813-f755e36e9b9c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.158086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-73281b74-d05e-4f5d-af62-1dffdc3c2e6a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.085383 Dec 25 21:21:45.162414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2385/4649] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:45 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:45.164731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:45.165467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.175088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.175748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.176706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.178191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.317695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:45.335487 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0957bd04-6f07-4485-b4bc-5bdc1b2a40f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1225 microversion: 2.1 time: 0.165077 Dec 25 21:21:45.336527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2386/4650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:45 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:45.363477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9897b7dd-b9e0-49e3-8813-f755e36e9b9c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:45.376535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9897b7dd-b9e0-49e3-8813-f755e36e9b9c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:45.378117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9897b7dd-b9e0-49e3-8813-f755e36e9b9c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:45.379280 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9897b7dd-b9e0-49e3-8813-f755e36e9b9c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c" status: 200 len: 1278 microversion: 2.47 time: 0.241020 Dec 25 21:21:45.379844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2265/4651] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:45 2021] GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c => generated 1278 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:45.450796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-783297195", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": "none"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:45.517419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:45.517841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:45.518361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:45.518769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:45.522034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:45.544324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.544778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.548962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.548962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.549196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:45.549196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.573826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.577381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Getting quotas for project 8448b25167bd4f0facbde22bc77a818d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:45.577984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.582143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.584934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Getting quotas for user 4f35acdc849b446f8564ce2666f2e17c and project 8448b25167bd4f0facbde22bc77a818d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:45.586033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.611479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:45.616437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:45.662181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c48c6a9f-509f-4c54-aa35-e1ab64e5d760 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/2ff193c5-1a26-432e-be9f-a6ab5fa96be0" status: 200 len: 194 microversion: 2.1 time: 0.123594 Dec 25 21:21:45.662936 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2266/4652] 10.222.0.32 () {58 vars in 1412 bytes} [Sat Dec 25 21:21:45 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/2ff193c5-1a26-432e-be9f-a6ab5fa96be0 => generated 194 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:45.674740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:45.675310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.685124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.685711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.686634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.687084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.765239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lazy-loading 'services' on Instance uuid f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:45.901756 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a8fbd94a-e9fd-487a-a0b0-1dbbc9e09a29 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.455721 Dec 25 21:21:45.902902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2387/4653] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:21:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 457 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:21:45.923988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f8b7513f-023b-45e4-94c2-5329f303d5f7 req-574478a9-ad64-4af2-9e38-0fb78de5a95c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "942e6548-a2f0-42a7-9cb7-ca574fef9231", "tag": "e4c36e02-8789-45df-a1e7-5c05d3d9f049"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:45.927094 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:45.927094 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:45.938332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f8b7513f-023b-45e4-94c2-5329f303d5f7 req-574478a9-ad64-4af2-9e38-0fb78de5a95c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.938332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f8b7513f-023b-45e4-94c2-5329f303d5f7 req-574478a9-ad64-4af2-9e38-0fb78de5a95c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.950582 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f8b7513f-023b-45e4-94c2-5329f303d5f7 req-574478a9-ad64-4af2-9e38-0fb78de5a95c service nova] Creating event network-changed:e4c36e02-8789-45df-a1e7-5c05d3d9f049 for instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 on nch2-master-1 Dec 25 21:21:45.962627 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f8b7513f-023b-45e4-94c2-5329f303d5f7 req-574478a9-ad64-4af2-9e38-0fb78de5a95c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058201 Dec 25 21:21:45.969640 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2388/4654] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:45.970625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e4ef324-a8ad-446e-8cfb-cedc89ab5f49 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/2ff193c5-1a26-432e-be9f-a6ab5fa96be0" status: 202 len: 0 microversion: 2.1 time: 0.295121 Dec 25 21:21:45.970625 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2267/4655] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:21:45 2021] DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments/2ff193c5-1a26-432e-be9f-a6ab5fa96be0 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:21:45.970835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:45.970835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.973924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ccd3141-4756-4991-8ce5-e482352b8789 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:45.976026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ccd3141-4756-4991-8ce5-e482352b8789 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:45.996309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.998348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:45.999772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:45.999772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.040543 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ccd3141-4756-4991-8ce5-e482352b8789 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "PUT /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 991 microversion: 2.47 time: 0.072172 Dec 25 21:21:46.053351 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2268/4656] 10.222.0.32 () {62 vars in 1296 bytes} [Sat Dec 25 21:21:45 2021] PUT /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:46.067081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b98bf20-3e9a-4eb4-9ed2-73a2ac727a3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:46.067837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b98bf20-3e9a-4eb4-9ed2-73a2ac727a3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:46.189096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b98bf20-3e9a-4eb4-9ed2-73a2ac727a3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:46.202452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b98bf20-3e9a-4eb4-9ed2-73a2ac727a3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:46.204198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b98bf20-3e9a-4eb4-9ed2-73a2ac727a3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:46.205588 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b98bf20-3e9a-4eb4-9ed2-73a2ac727a3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1277 microversion: 2.47 time: 0.147156 Dec 25 21:21:46.213747 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2269/4657] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:46 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:21:46.227998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:46.229162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:46.235458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.235939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.236851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.237323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.281241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5dc3e8a4-a0d6-4115-a3e9-b6ede620b3f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065840 Dec 25 21:21:46.282047 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2270/4658] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:46 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:46.287726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:46.288423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:46.296478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.297150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.297956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.299101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.364456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:46.372057 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-341e05f4-e581-4176-b2bb-d6413aaf162c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.407621 Dec 25 21:21:46.372651 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2389/4659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:45 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:46.377949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:46.379065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:46.385799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.386472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.387443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.388048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.434971 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1503783-50a1-4fcd-a4ca-3acc5d556734 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060656 Dec 25 21:21:46.435933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2390/4660] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:46 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:46.442466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:46.443478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:46.453531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.454291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.455589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:46.456032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:46.603489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:46.609813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:46.626954 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0dab628-8228-420f-ae7c-8b9c69a0f06a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1281 microversion: 2.1 time: 0.189641 Dec 25 21:21:46.629523 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2391/4661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:46 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1281 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:46.631053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe89c78f-f91c-45a1-9271-c030928f54fc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.347523 Dec 25 21:21:46.635654 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2271/4662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:46 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:47.225755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.228529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.235473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.236360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.237398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.238013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.256229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.257264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.267654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.268106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.278160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.278627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.322879 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a225bd6-cddd-4a4e-970d-6cc08e1aee35 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070400 Dec 25 21:21:47.323721 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2272/4663] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:21:47 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:47.328519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:47.330821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.343080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.343816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.344784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.345409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.372443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:47.395889 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88a7258c-19ba-47c3-95fd-2f0b8b2d2f87 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.070627 Dec 25 21:21:47.400265 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2273/4664] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:47 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:47.405410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.405892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:47.406106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.408266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:47.409697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba398079-cddb-4b77-a3f9-2cf716e21b62 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1281 microversion: 2.47 time: 0.188673 Dec 25 21:21:47.422603 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2392/4665] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:47 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1281 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:47.427838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.433119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.433119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.433119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.449669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:47.450894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.458521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.459212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.460260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.461421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.514686 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e05c566e-70a1-4f0a-80f3-013ef09037f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070647 Dec 25 21:21:47.516023 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2393/4666] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:47 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:47.521331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.522534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.531029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.531751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.532732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.533343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.570635 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24048c72-9f0a-4499-9036-0199f11a5053 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052582 Dec 25 21:21:47.571486 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2394/4667] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:21:47 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:21:47.645097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.645930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.653598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.654057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.657036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.657036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.671058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:47.678641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dfdb00b6-6ac4-4b0b-9dc5-a3a3ad5e10c3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.277081 Dec 25 21:21:47.679227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2274/4668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:47 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:47.684123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.684630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.691560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.692234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.693107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.693723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.730252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:47.731718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:47.739459 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4abf1aad-5a8c-4088-9e09-200f4efd8e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1279 microversion: 2.1 time: 0.098130 Dec 25 21:21:47.740045 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2395/4669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:47 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1279 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:47.752605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:47.753534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:47.768054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.768516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.769360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.769800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:47.933692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:47.952342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5c69bb6-503b-42a4-9a31-a2e062da3668 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.201583 Dec 25 21:21:47.954085 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2396/4670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:47 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:47.965478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-dcd7b5e4-7b5e-4ea7-bb74-165d70d77457 req-2d5a11cb-102f-45d7-874b-3e3056c7bd3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477", "tag": "e763608c-e444-4936-aae2-43161cd57a85"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:47.969399 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:47.969399 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:47.982243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dcd7b5e4-7b5e-4ea7-bb74-165d70d77457 req-2d5a11cb-102f-45d7-874b-3e3056c7bd3c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:47.983203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dcd7b5e4-7b5e-4ea7-bb74-165d70d77457 req-2d5a11cb-102f-45d7-874b-3e3056c7bd3c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.008277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-dcd7b5e4-7b5e-4ea7-bb74-165d70d77457 req-2d5a11cb-102f-45d7-874b-3e3056c7bd3c service nova] Creating event network-changed:e763608c-e444-4936-aae2-43161cd57a85 for instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 on nch2-master-1 Dec 25 21:21:48.013626 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-dcd7b5e4-7b5e-4ea7-bb74-165d70d77457 req-2d5a11cb-102f-45d7-874b-3e3056c7bd3c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058286 Dec 25 21:21:48.014297 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2397/4671] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:48.166839 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b1bb5d6-a601-4810-bd89-ac422cc2acf9 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 204 len: 0 microversion: 2.1 time: 0.486255 Dec 25 21:21:48.167735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2275/4672] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:47 2021] DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:48.169614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1115202843", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "df7f119b-f1bb-462c-b2dc-ce3acd2a89d9"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:48.180267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:48.182685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:48.190781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.193864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.196219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.196977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.230553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] validate_networks() for [('df7f119b-f1bb-462c-b2dc-ce3acd2a89d9', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:21:48.493917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:48.504570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6a7fc06-98ec-4fa9-ace1-56ef2e34decc tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1674 microversion: 2.1 time: 0.329108 Dec 25 21:21:48.505330 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2276/4673] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:48 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:48.526580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:48.529408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:48.548345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.548850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.550738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.552170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.607319 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfad611c-ce9a-466b-bc40-e57e7c9ee386 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.100498 Dec 25 21:21:48.608779 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2277/4674] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:48 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:48.614655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:48.615601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:48.628065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.630888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.631782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.632271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.748067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:48.757818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:48.759088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:48.760308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-486a936e-1c89-45f2-9e0b-adcf6be51806 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1329 microversion: 2.47 time: 0.149937 Dec 25 21:21:48.771427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2278/4675] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:48 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1329 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:48.777737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:48.780910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:48.787879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.788328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.789868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.797738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.798003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:48.798003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:48.798391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:48.798809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:48.799214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:48.808552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.809200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.810015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.810453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.832299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:21:48.837417 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eaaf940e-29c6-4613-94d8-05edbb74d85b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.074444 Dec 25 21:21:48.841336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for user d7df5c79b8ea4c6ea7cf84b381b29765 and project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:21:48.841484 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2279/4676] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:48 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:48.845647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:48.849107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:48.855548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.856037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.857000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:48.857641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:48.859781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:21:48.862441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:21:49.031853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.041394 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd24a6c6-2fdb-4399-9c81-c84b51cf7638 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1655 microversion: 2.1 time: 0.201014 Dec 25 21:21:49.042134 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2280/4677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:48 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1655 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:49.045862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bc5c1b1-58cb-4b3f-8ae9-00e1829efd0d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884968 Dec 25 21:21:49.046750 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2398/4678] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:21:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:21:49.047890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:49.048731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.053926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:49.056020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.062426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.063009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.063844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.064339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.066100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.066776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.067742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.068333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.320487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.330359 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d9bb729-a23d-4576-9a4f-371632a72c10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.282406 Dec 25 21:21:49.330958 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2399/4679] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:49 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:49.332239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.343668 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e7400f0-61d6-4144-a2ee-2c2b44ede520 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.300196 Dec 25 21:21:49.344585 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2281/4680] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:49 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:49.350416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-79fd8be2-7ffb-4a32-9552-559f7bc88967 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:49.351036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-79fd8be2-7ffb-4a32-9552-559f7bc88967 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.363314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af28843f-e8e0-4d6d-a9ee-a2dd05933077 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:49.371346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af28843f-e8e0-4d6d-a9ee-a2dd05933077 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.372378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af28843f-e8e0-4d6d-a9ee-a2dd05933077 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.413985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af28843f-e8e0-4d6d-a9ee-a2dd05933077 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Going to try to start instance {{(pid=136548) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 21:21:49.436325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-79fd8be2-7ffb-4a32-9552-559f7bc88967 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.444232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-79fd8be2-7ffb-4a32-9552-559f7bc88967 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1218 microversion: 2.1 time: 0.098207 Dec 25 21:21:49.454932 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2282/4681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:49 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:49.521916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:49.522528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.529272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.529957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.530742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.531183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.567847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af28843f-e8e0-4d6d-a9ee-a2dd05933077 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.235065 Dec 25 21:21:49.569027 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2400/4682] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:49 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:49.579233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:49.580028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.587117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.587696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.588735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.589281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.720386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.730625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75e89de5-fffd-410c-8f4a-f6447c4e83b6 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1674 microversion: 2.1 time: 0.212177 Dec 25 21:21:49.731989 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2283/4683] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:49 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1674 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:49.737348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:49.738392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.753042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.756672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.756672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.756672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.800842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.809871 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-871262ad-e61b-46ad-aad7-c98bff7f2721 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.076144 Dec 25 21:21:49.810860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2284/4684] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:49 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:49.815265 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f853048-56d8-497d-a65d-e3bf7e6aecf8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1664 microversion: 2.1 time: 0.240463 Dec 25 21:21:49.817855 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2401/4685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:49 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1664 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:49.818576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:49.819380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.834562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.835196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.836383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.836962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.863668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:49.869810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:49.902019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.902762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.904352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:49.905374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:49.966638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.975679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.978104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:49.983383 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c5d7e210-0514-427f-a36a-b2ae3467018f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1335 microversion: 2.47 time: 0.167036 Dec 25 21:21:49.983383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2285/4686] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:49 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1335 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:50.028077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a2c8c17e-b129-4ea8-b8b2-dba4bfa8a1f6 req-6e48b934-8077-43b4-b18f-117b7ae921b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20a90e3e-c379-4f2f-9632-763f67a3a334", "tag": "5eecbec8-cd5d-45a6-9264-3971371aaf2c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:50.029513 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:50.029513 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:50.037467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2c8c17e-b129-4ea8-b8b2-dba4bfa8a1f6 req-6e48b934-8077-43b4-b18f-117b7ae921b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:50.037913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2c8c17e-b129-4ea8-b8b2-dba4bfa8a1f6 req-6e48b934-8077-43b4-b18f-117b7ae921b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:50.050598 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a2c8c17e-b129-4ea8-b8b2-dba4bfa8a1f6 req-6e48b934-8077-43b4-b18f-117b7ae921b5 service nova] Creating event network-changed:5eecbec8-cd5d-45a6-9264-3971371aaf2c for instance 20a90e3e-c379-4f2f-9632-763f67a3a334 on nch2-master-1 Dec 25 21:21:50.056606 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a2c8c17e-b129-4ea8-b8b2-dba4bfa8a1f6 req-6e48b934-8077-43b4-b18f-117b7ae921b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032792 Dec 25 21:21:50.061988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2286/4687] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:50.141711 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e51323a8-44d5-42fe-b72f-435e9f51a76b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.288692 Dec 25 21:21:50.142910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2402/4688] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:49 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:50.349056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:50.350515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:50.363440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:50.365133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:50.381521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:50.382288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:50.384418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:50.384529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:50.385695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:50.387093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:50.387794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:50.388481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.161312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.175404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1c0f4f82-af9f-4945-9984-13b48b0af62a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.831298 Dec 25 21:21:51.176004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2287/4689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:50 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:51.188250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.190185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:51.190819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:51.204506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.204924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.205729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.206529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.212915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-983e2b0e-9d4a-45df-a029-65a4bd5c280d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.853093 Dec 25 21:21:51.213997 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2403/4690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:50 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:51.231823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:51.232689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:51.245820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.246669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.249338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.249989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.337606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.347068 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-786b74b6-b8da-4edf-81ca-a6aa9c7f0804 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1270 microversion: 2.1 time: 0.169237 Dec 25 21:21:51.348460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2288/4691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:51 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:51.354027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:51.355198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.355363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:51.366527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.367967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.369219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.369348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f362da0-bd4d-435a-88d0-88a2a6ea5899 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1606 microversion: 2.1 time: 0.153116 Dec 25 21:21:51.370284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.370442 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2404/4692] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:51 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1606 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:51.375343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:51.376226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:51.385250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.387192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.388029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.388493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.426026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71bd6df3-3d92-4f6e-9d0b-128559f4c9fe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065049 Dec 25 21:21:51.427582 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2289/4693] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:51 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:51.436639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:51.437399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:51.446428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.447235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.448653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.449601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.636665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.648750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.650327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:51.651561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e948d0f0-37c6-4ec7-810b-55b6a57046c4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1335 microversion: 2.47 time: 0.222618 Dec 25 21:21:51.662528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2290/4694] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:51 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1335 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:51.662528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:51.671509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:51.690019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.695228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.696210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:51.696676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:51.783985 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0442880c-5c91-4157-9913-887e1eb304e0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.130560 Dec 25 21:21:51.785141 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2291/4695] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:51 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:52.054760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:52.063875 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a8b796c2-3567-4711-8a1f-f2de466bc07b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1664 microversion: 2.1 time: 0.691390 Dec 25 21:21:52.064753 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2405/4696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:51 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1664 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:52.080223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fd5d9651-98d7-4a04-a86d-ddd1a0dbfc33 req-f58f00f8-3ed8-400f-b8f5-e114642c215c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f8bfda-0dfb-4159-89b2-bf30653ddcb2", "name": "network-vif-deleted", "tag": "468e4b8e-2b46-4578-81eb-d2bfd34de1bb"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:52.084407 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:52.084407 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:52.095662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fd5d9651-98d7-4a04-a86d-ddd1a0dbfc33 req-f58f00f8-3ed8-400f-b8f5-e114642c215c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.095662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fd5d9651-98d7-4a04-a86d-ddd1a0dbfc33 req-f58f00f8-3ed8-400f-b8f5-e114642c215c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.111308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fd5d9651-98d7-4a04-a86d-ddd1a0dbfc33 req-f58f00f8-3ed8-400f-b8f5-e114642c215c service nova] Creating event network-vif-deleted:468e4b8e-2b46-4578-81eb-d2bfd34de1bb for instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 on nch2-master-1 Dec 25 21:21:52.119549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fd5d9651-98d7-4a04-a86d-ddd1a0dbfc33 req-f58f00f8-3ed8-400f-b8f5-e114642c215c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048964 Dec 25 21:21:52.121647 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2292/4697] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:21:52.193400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:52.194098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:52.201872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.202530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.203471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.204258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.234284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:52.235791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:52.247566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.248389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.249564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.250150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.675033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:52.684357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-221de127-fe68-4717-a49d-068d077f7fd7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.495626 Dec 25 21:21:52.684965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2406/4698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:52 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:52.712716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:52.712716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:52.717153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.718520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.719643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.720490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.721774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:52.761257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f158cac-8252-4318-ae1c-b6ca721b8f37 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.530041 Dec 25 21:21:52.763434 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2293/4699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:52 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:52.772682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:52.776051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:52.797550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.797550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.798036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.802693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.827048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:52.849049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.849506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.850062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lazy-loading 'fault' on Instance uuid f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:21:52.851785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-10e0cec2-9124-4315-b52b-f005a1242c98 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1276 microversion: 2.1 time: 0.150139 Dec 25 21:21:52.855861 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2407/4700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:52 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1276 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:52.869255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:52.870699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:52.879905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.880497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.881196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.882043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.928637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0383b7f61484347ba9875a2636e1057', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ed80be6e633499b9d1dc61c05014afc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:52.939298 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21eaa56a-171e-4756-b71c-241405015bd0 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 200 len: 1328 microversion: 2.1 time: 0.173681 Dec 25 21:21:52.942308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f874c617-32e3-4748-87da-ea6ae49217c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.083854 Dec 25 21:21:52.949430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2408/4701] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:52 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:52.966056 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2294/4702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:52 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:52.972258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:52.974722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:52.978720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-56135ffb-d315-4300-a7bb-6302cdbdc9c3 req-3f465a29-141b-4939-9e50-276aa26aa1fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e6548-a2f0-42a7-9cb7-ca574fef9231", "name": "network-vif-plugged", "status": "completed", "tag": "e4c36e02-8789-45df-a1e7-5c05d3d9f049"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:52.984242 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:52.984242 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:52.986508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.987811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:52.991501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:52.994652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.000072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-56135ffb-d315-4300-a7bb-6302cdbdc9c3 req-3f465a29-141b-4939-9e50-276aa26aa1fb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.000461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-56135ffb-d315-4300-a7bb-6302cdbdc9c3 req-3f465a29-141b-4939-9e50-276aa26aa1fb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.022186 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-56135ffb-d315-4300-a7bb-6302cdbdc9c3 req-3f465a29-141b-4939-9e50-276aa26aa1fb service nova] Creating event network-vif-plugged:e4c36e02-8789-45df-a1e7-5c05d3d9f049 for instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 on nch2-master-1 Dec 25 21:21:53.027883 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-56135ffb-d315-4300-a7bb-6302cdbdc9c3 req-3f465a29-141b-4939-9e50-276aa26aa1fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060455 Dec 25 21:21:53.029381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2295/4703] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:53.044010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:53.044010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:53.044252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.044535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.045361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.045877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.140098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a6dd22c-0ed3-4682-852c-0612ada36e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.108698 Dec 25 21:21:53.140766 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2296/4704] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:53 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:53.149259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:53.149968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:53.156925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.157385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.158181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.158620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.200856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:53.217743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:53.219428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:53.221195 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fd2a7c4-58d9-4791-b761-36d2b31425d4 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1356 microversion: 2.47 time: 0.269677 Dec 25 21:21:53.234376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2409/4705] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:52 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1356 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:53.239574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:53.250461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:53.250461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.250461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.250461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.250461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.341361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:21:53.342959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:21:53.342959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:21:53.342959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:21:53.343219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:21:53.571616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:53.585257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.585749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.586563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.587003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.619389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:53.631346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40399b0c-a22f-4081-b4f6-a52014f4cb17 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "POST /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9/action" status: 202 len: 1078 microversion: 2.47 time: 0.392784 Dec 25 21:21:53.631346 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2410/4706] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:53 2021] POST /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9/action => generated 1078 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 25 21:21:53.636500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e082b4ab-1466-4a73-b2a8-3d64c190cdc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.487472 Dec 25 21:21:53.637448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2297/4707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:53 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:53.645410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:53.646308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:53.653416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:53.654139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:53.659209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.659735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.664398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.664759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.664856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.664973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:53.665063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:53.665063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.080049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.090116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.091738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.093869 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b68e3f0-ef84-41db-a4bd-58155d989325 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.452959 Dec 25 21:21:54.103731 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2411/4708] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:53 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:54.103731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:54.103731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:54.113212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.114237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.115420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.116117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.364464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.376389 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1991de09-6788-41d4-b8ee-d45768ed7354 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.726866 Dec 25 21:21:54.389051 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2298/4709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:53 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:54.394791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:54.395639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:54.402689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.403145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.403994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.405363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.553191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.561217 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c79e0b6-233a-4442-9d2f-88d6d1969edc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1317 microversion: 2.1 time: 0.465171 Dec 25 21:21:54.561833 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2412/4710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:54 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1317 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:54.566377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:54.567033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:54.573481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.574100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.574715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.575150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.863321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.871651 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8aa8c17e-af92-4fc4-8ab6-faeb1332347f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.481048 Dec 25 21:21:54.872389 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2299/4711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:54 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:54.877221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:54.878158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:54.885399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.885858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.887411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.887411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.926402 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa1c84f7-f035-4ed7-971e-195f880bb09c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052394 Dec 25 21:21:54.927058 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2300/4712] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:54 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:54.932688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:54.933444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:54.940503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.940980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.941769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.942214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.957695 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] HTTP exception thrown: Instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 could not be found. Dec 25 21:21:54.958308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Returning 404 to user: Instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:21:54.959221 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ebb56fe-f604-4876-a37c-ff9333fe3c19 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 404 len: 111 microversion: 2.1 time: 0.031034 Dec 25 21:21:54.959980 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2301/4713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:54 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:21:54.968445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:54.969393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:54.969924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:54.976246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.976698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.977644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:54.978079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:54.981116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df368c4d-1c35-4d26-80ca-2d71af8f28e4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.417061 Dec 25 21:21:54.981116 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2413/4714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:54 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:54.999709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:55.000257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:55.010759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.011220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.012042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.012634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.022934 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cd1e92a-a48b-4e58-af84-580710e2af4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058048 Dec 25 21:21:55.027123 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2302/4715] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:54 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:55.029787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c5547c52-37b9-4769-8cb1-b5370b77cfb8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '.version_select at 0x7fa4f705f430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:55.164234 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c5547c52-37b9-4769-8cb1-b5370b77cfb8 tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007250198" status: 202 len: 0 microversion: 2.1 time: 0.138676 Dec 25 21:21:55.165087 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2303/4716] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:21:55 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2007250198 => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:55.173606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-31200a41-2acf-4aa2-b3b0-72c04351fcf8 req-da7de9d2-17f3-4aca-8145-dd1317069f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477", "name": "network-vif-plugged", "status": "completed", "tag": "e763608c-e444-4936-aae2-43161cd57a85"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:55.179886 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:55.179886 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:55.186974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-31200a41-2acf-4aa2-b3b0-72c04351fcf8 req-da7de9d2-17f3-4aca-8145-dd1317069f77 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.187823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-31200a41-2acf-4aa2-b3b0-72c04351fcf8 req-da7de9d2-17f3-4aca-8145-dd1317069f77 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.221706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-31200a41-2acf-4aa2-b3b0-72c04351fcf8 req-da7de9d2-17f3-4aca-8145-dd1317069f77 service nova] Creating event network-vif-plugged:e763608c-e444-4936-aae2-43161cd57a85 for instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 on nch2-master-1 Dec 25 21:21:55.227938 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-31200a41-2acf-4aa2-b3b0-72c04351fcf8 req-da7de9d2-17f3-4aca-8145-dd1317069f77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061511 Dec 25 21:21:55.232445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Unlocking {{(pid=136548) unlock /opt/stack/nova/nova/compute/api.py:4653}} Dec 25 21:21:55.238174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2304/4717] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:55.249466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:55.255054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:55.269302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.273399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.274389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.279977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.406828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:55.416690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:55.418560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:55.419754 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc5e4021-4f54-42ce-9a08-c7d7ca8a8b32 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.180165 Dec 25 21:21:55.420543 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2305/4718] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:55 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:55.505991 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c12b99a2-1a95-4332-9de3-7b4f67dad146 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.523019 Dec 25 21:21:55.507253 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2414/4719] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:54 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:55.536364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:55.537197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:55.548068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.548601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.549776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.550488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.579255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:55.580131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:55.588501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.589327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:55.590467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:55.591117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.033012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:56.045257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75daa31c-33e6-4716-b019-61a07fcb32b0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.529721 Dec 25 21:21:56.052227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2306/4720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:55 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:56.064239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:56.064921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:56.077159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:56.082551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.083012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.083821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.084266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.095640 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3df82d52-bd91-42c3-aa99-955fa238cc60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1506 microversion: 2.1 time: 0.520119 Dec 25 21:21:56.096572 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2415/4721] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:55 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:56.101820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:56.104816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:56.112079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.113819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.114659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.115699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.189512 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-214f7760-e656-4038-93ff-88aeda0e84e9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.091394 Dec 25 21:21:56.193378 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2416/4722] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:56 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:56.200097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:56.201640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:56.209689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.210277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.211175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.211627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.972328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:56.980834 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7cee0f3-2321-4416-bb61-4cba87654e2d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.927140 Dec 25 21:21:56.981573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2307/4723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:56 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:56.987172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:56.988245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:56.994821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.995214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:56.996025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:56.996535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.014251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:57.024066 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33bf493f-c71f-43ca-9539-95ba401b88b3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.829379 Dec 25 21:21:57.024643 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2417/4724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:56 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:57.042310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:57.042846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:57.051149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.052048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.053140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.053601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.053816 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-263cf86a-ccb6-4b5f-806e-875bb0b3de74 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070901 Dec 25 21:21:57.058023 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2308/4725] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:56 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:57.063195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:57.063782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:57.071278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.073905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.073905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.073905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.100691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:21:57.468836 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51f5adbd-7756-4fa0-bd29-a7fddfaa311d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.430643 Dec 25 21:21:57.469918 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2418/4726] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:57 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:57.487258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3a19ad48-205a-4df9-b5d0-e294a73dc450 req-b0b8b885-9333-4481-aa8e-96dac44118c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec22e12b-a34c-4787-8d08-5dbf9b6556d1", "tag": "745d590e-2b18-462d-a55e-1423ff663b30"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:57.492410 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:57.492410 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:21:57.497773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3a19ad48-205a-4df9-b5d0-e294a73dc450 req-b0b8b885-9333-4481-aa8e-96dac44118c3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.498587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3a19ad48-205a-4df9-b5d0-e294a73dc450 req-b0b8b885-9333-4481-aa8e-96dac44118c3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.510649 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3a19ad48-205a-4df9-b5d0-e294a73dc450 req-b0b8b885-9333-4481-aa8e-96dac44118c3 service nova] Creating event network-changed:745d590e-2b18-462d-a55e-1423ff663b30 for instance ec22e12b-a34c-4787-8d08-5dbf9b6556d1 on nch1-master-1 Dec 25 21:21:57.515393 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3a19ad48-205a-4df9-b5d0-e294a73dc450 req-b0b8b885-9333-4481-aa8e-96dac44118c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043877 Dec 25 21:21:57.521120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2419/4727] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:57.521120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:57.522011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:57.528248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.528703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.529518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.529950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.571254 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9807640-a412-43ad-942d-16ff045b1d20 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "DELETE /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 204 len: 0 microversion: 2.1 time: 0.511509 Dec 25 21:21:57.571862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2309/4728] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:21:57 2021] DELETE /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:21:57.577817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:57.579128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:57.595892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.596347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.597231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.597671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.636937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:57.641875 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7762e4c-6baf-4105-9ab3-12807fbc65bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.068597 Dec 25 21:21:57.645784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2310/4729] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:57 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:57.649466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5f0e2c68-5671-46d3-8e8e-108afe41c8a7 req-36b6b038-e3b4-43c3-8631-96f59709ff52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a90e3e-c379-4f2f-9632-763f67a3a334", "name": "network-vif-plugged", "status": "completed", "tag": "5eecbec8-cd5d-45a6-9264-3971371aaf2c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:57.651308 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:21:57.651308 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:21:57.655321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:57.656838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:57.660912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5f0e2c68-5671-46d3-8e8e-108afe41c8a7 req-36b6b038-e3b4-43c3-8631-96f59709ff52 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.669022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5f0e2c68-5671-46d3-8e8e-108afe41c8a7 req-36b6b038-e3b4-43c3-8631-96f59709ff52 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.669156 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e42d9e45-179b-41d9-aa5f-9e4f6774f3b8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.140866 Dec 25 21:21:57.669156 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2420/4730] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:57 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:21:57.674305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:57.674888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:57.684517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.685019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.685819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.686255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.689687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5f0e2c68-5671-46d3-8e8e-108afe41c8a7 req-36b6b038-e3b4-43c3-8631-96f59709ff52 service nova] Creating event network-vif-plugged:5eecbec8-cd5d-45a6-9264-3971371aaf2c for instance 20a90e3e-c379-4f2f-9632-763f67a3a334 on nch2-master-1 Dec 25 21:21:57.697127 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5f0e2c68-5671-46d3-8e8e-108afe41c8a7 req-36b6b038-e3b4-43c3-8631-96f59709ff52 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052202 Dec 25 21:21:57.698948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2311/4731] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:21:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:21:57.713324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:57.714029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:57.724810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.728072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:57.728072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:57.728072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.057316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.065264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e45266b-2542-4904-a05f-86f5bdbe6f64 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1673 microversion: 2.1 time: 0.397321 Dec 25 21:21:58.075765 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2421/4732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:57 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1673 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:58.075765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:58.075765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:58.083866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.083866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.083866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.083866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.088036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.095758 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5772dcd1-abf2-42bc-ae12-a8e90af47e6c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1512 microversion: 2.1 time: 0.395796 Dec 25 21:21:58.096350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2312/4733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:57 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:58.101451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:58.102279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:58.109053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.110398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.111241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.111834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.416483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.424301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1993c25-4c8c-43e2-aea1-6968888407fa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.357453 Dec 25 21:21:58.424902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2422/4734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:58 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:58.429965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:58.430933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:58.436682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.437165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.437952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.438396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.463559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.473804 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e80d2dc-18df-43b8-99cb-d742e9384c8e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.376033 Dec 25 21:21:58.483754 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2313/4735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:58 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:58.487315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d22af91b-fb0f-4dd3-93ef-4711fcd3509c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.061173 Dec 25 21:21:58.488502 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2423/4736] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:58 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:58.653405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:58.654293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:58.660497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.661025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.661819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.662274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.686644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:58.687339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:58.694431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.695523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.696305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:58.696741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:58.702464 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a6f70d9-b391-4d0a-b253-e589de008e3f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052809 Dec 25 21:21:58.703325 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2314/4737] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:58 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:58.763149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.771475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.773064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:58.774229 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bc13bdcb-cd03-496c-a65d-b6e1e6976ca7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.091778 Dec 25 21:21:58.774782 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2424/4738] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:58 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:21:59.083475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:59.084173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.091183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.091756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.092407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.092851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.112662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:59.113315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.121936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.122663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.123529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.124145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.292305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:59.300813 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-204788ff-5d99-4c4f-89cb-3c1d0e576e0d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1653 microversion: 2.1 time: 0.221369 Dec 25 21:21:59.301516 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2315/4739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:59 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1653 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:59.317521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:59.318165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.318631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:59.324186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.324648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.325475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.325923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.326318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9f5fb86-bc88-4f1a-99fa-9bc8461fe9d2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1512 microversion: 2.1 time: 0.217436 Dec 25 21:21:59.326991 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2425/4740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:59 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:59.441595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:59.442480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.449333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.449788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.450582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.451021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.511648 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:21:59.511862 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:21:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 (ip 10.222.0.32) !!! Dec 25 21:21:59.533537 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-404bab03-154a-4198-9362-b93eae246d26 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.219564 Dec 25 21:21:59.544949 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2316/4741] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:59 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:59.544949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:59.544949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.548919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.549531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.550435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.550979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.723650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:59.731766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90723ac9-121c-4a2a-809a-800af32ebe6b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1321 microversion: 2.1 time: 0.293900 Dec 25 21:21:59.732611 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2426/4742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:59 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:21:59.750005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:59.751000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.757962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.758420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.759209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.759923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.806458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-876141fc-4d8f-4fd0-b23f-9f54c54e7691 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060184 Dec 25 21:21:59.807814 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2427/4743] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:21:59 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:21:59.814020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:59.816428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.823470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.823928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.824726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.825190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.825724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:21:59.834306 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d7a8c64-d961-40ba-a8a8-0fb0ce9abade tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.298553 Dec 25 21:21:59.836782 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2317/4744] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:59 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:21:59.853238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:21:59.854323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.862096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.862727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.863610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.864158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.918494 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcb04ad8-8872-4c52-b97c-9e044b5eb00a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.070619 Dec 25 21:21:59.919376 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2318/4745] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:21:59 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:21:59.925008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:21:59.925711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:21:59.933510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.933969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:21:59.934760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:21:59.935188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.047098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:00.055604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:00.057157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:00.058328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c6abfa7b-039a-428c-96c9-019b8c49342b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.137892 Dec 25 21:22:00.058883 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2319/4746] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:21:59 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:00.093142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:00.101908 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0950cee7-41b6-4a4e-961a-22eb3c43a086 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1660 microversion: 2.1 time: 0.293453 Dec 25 21:22:00.103273 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2428/4747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:21:59 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1660 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:00.321284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d21b4875-008e-4cc2-806e-78455cdfffcb req-732fa972-0670-47ad-8619-63243efda7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "942e6548-a2f0-42a7-9cb7-ca574fef9231", "name": "network-vif-deleted", "tag": "e4c36e02-8789-45df-a1e7-5c05d3d9f049"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:00.322977 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:00.322977 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:22:00.331029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d21b4875-008e-4cc2-806e-78455cdfffcb req-732fa972-0670-47ad-8619-63243efda7df service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.331542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d21b4875-008e-4cc2-806e-78455cdfffcb req-732fa972-0670-47ad-8619-63243efda7df service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.343187 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d21b4875-008e-4cc2-806e-78455cdfffcb req-732fa972-0670-47ad-8619-63243efda7df service nova] Creating event network-vif-deleted:e4c36e02-8789-45df-a1e7-5c05d3d9f049 for instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 on nch2-master-1 Dec 25 21:22:00.345118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:00.346239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:00.348461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d21b4875-008e-4cc2-806e-78455cdfffcb req-732fa972-0670-47ad-8619-63243efda7df service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033740 Dec 25 21:22:00.349400 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2320/4748] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:00.355991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.356559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.357414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.358026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.423857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:00.432112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1626b14-37a9-478c-b00c-c17753e0f994 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 200 len: 1470 microversion: 2.1 time: 0.091984 Dec 25 21:22:00.432683 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2429/4749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:00 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 1470 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:00.748377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:00.749114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:00.755421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.755889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.756679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.757150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.818838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:00.819828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:00.826455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.826911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.827719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.828160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.886115 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70dfdaf1-e72c-425f-8974-de780a0e278d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.071277 Dec 25 21:22:00.887209 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2430/4750] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:00.892681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:00.893412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:00.898285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:00.900746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.901221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.902032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.902474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.905939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3d6e937-e5b0-4c2c-8d96-17ae0e15fb5e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1513 microversion: 2.1 time: 0.162103 Dec 25 21:22:00.907510 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2321/4751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:00 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:00.922774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:00.923760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:00.929796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.930340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.931180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:00.931593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:00.955234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'flavor' on Instance uuid 20a90e3e-c379-4f2f-9632-763f67a3a334 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:01.045844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.053934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-068356ce-d9d2-4ee1-ba11-d754653a1f54 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.165361 Dec 25 21:22:01.055029 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2431/4752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:00 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:01.059638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:01.065348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.066459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.066913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.067695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.068137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.110950 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7c286af-b2e9-438c-9f8e-e60b5f868182 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054669 Dec 25 21:22:01.112407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2432/4753] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:01 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:01.118579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.119286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.127022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.127479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.128717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.128717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.197436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8925c7ad-04f6-4f40-9b1b-5d689fafa8ca tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334/action" status: 200 len: 32 microversion: 2.1 time: 0.278209 Dec 25 21:22:01.202514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2322/4754] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:00 2021] POST /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334/action => generated 32 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:22:01.203858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.204797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.212652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.213361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.214285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.214813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.216404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.234495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.236034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.237504 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cbc072e7-0f4d-480b-8957-2ba30f85bf98 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.124290 Dec 25 21:22:01.240928 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2433/4755] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:01.242664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.243277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.254495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.254993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.256250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.256846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.521960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.529811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf28b1e8-5a6b-4670-88d2-fec1ba81fd4d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.330480 Dec 25 21:22:01.530394 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2323/4756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:01.546649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.547917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.553417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.554327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.555113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.555547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.556350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.567101 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-47a74471-b435-4981-acb0-cbd3b3be1b14 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.327894 Dec 25 21:22:01.567682 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2434/4757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:01.573953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.580439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.580685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. Dec 25 21:22:01.580772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:01.581688 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f009149-edf4-4f0c-986e-3141c0e2bf31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 404 len: 111 microversion: 2.1 time: 0.040703 Dec 25 21:22:01.582256 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2324/4758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:01.582941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.583630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.584438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.584901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.590308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.590929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.597055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.598039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.598280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.598882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.888049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.897305 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d2f3e256-fdc4-4b86-b114-5e4174d0ce98 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.327935 Dec 25 21:22:01.908966 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2435/4759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:01.908966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:01.908966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.911235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.911235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.911544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.911917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.930559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:01.938137 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19603efa-d27c-4f88-b075-606f5e3db77a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.351368 Dec 25 21:22:01.939062 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2325/4760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:01.943466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:01.944179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:01.950165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.950722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.951617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:01.952151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:01.981898 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d2cb47f-845e-4755-bfe7-7c08fe5dab54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.082209 Dec 25 21:22:01.982962 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2436/4761] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:01 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:02.051719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b289c0fa-c41c-47a6-90ef-365b61730729 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:02.052924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b289c0fa-c41c-47a6-90ef-365b61730729 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:02.054346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b289c0fa-c41c-47a6-90ef-365b61730729 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.006116 Dec 25 21:22:02.054880 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2437/4762] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:02 2021] POST /compute/v2.1/servers => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:02.062333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:02.063398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.070969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.073997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.073997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.073997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.186228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.193771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18d01641-854f-48c7-9a50-5c726474ee93 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.253713 Dec 25 21:22:02.194348 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2326/4763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:01 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:02.204124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:02.205341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.212247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.212708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.213539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.213982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.253113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.262437 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72c41cd7-689b-4e59-8353-57245cee6146 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.203631 Dec 25 21:22:02.275502 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2438/4764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:02 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:02.275502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:02.275502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.281588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.281588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.281588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.281588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.323880 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9cae915b-b297-4e7d-b10c-9584c9b20cef tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057714 Dec 25 21:22:02.327516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2439/4765] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:02 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:02.330785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:02.331493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.339181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.339636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.340433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.340910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.358875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.366273 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09eb5991-2ac9-410f-8c30-5290eb374145 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.166462 Dec 25 21:22:02.375493 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2327/4766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:02 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:02.375493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:02.375493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.379383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.379383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.379383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.379663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.473275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.484806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.488021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.489897 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a82cf4b4-b50e-443a-96af-22f9fbed1b76 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.121938 Dec 25 21:22:02.491260 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2328/4767] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:02 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:02.496237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:02.497126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.503840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.504521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.510989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.510989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.518788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.528178 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d4a2699-fc05-48d2-bdd7-1287bae0e080 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.201680 Dec 25 21:22:02.529376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2440/4768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:02 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:02.584850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:02.586614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:02.593792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.594252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.595050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:02.595688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:02.674280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.682437 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cec18563-1e96-4225-ac66-ea6c4348a53a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.189672 Dec 25 21:22:02.683447 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2329/4769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:02 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:02.752913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:02.759079 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b8b9200f-8c00-4bce-a006-ab9a67a8df63 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.178350 Dec 25 21:22:02.759824 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2441/4770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:02 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:02.994230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:02.995203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:03.001359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.001819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.002607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.003049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.043716 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e903315d-2a8c-447c-8885-bffbb9155c92 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.053347 Dec 25 21:22:03.044359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2330/4771] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:02 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:03.325982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-de4842ba-d832-4e23-9e42-27f530b1ed23 req-4655532e-01dd-4770-b52e-b9845be0fea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22e12b-a34c-4787-8d08-5dbf9b6556d1", "name": "network-vif-plugged", "status": "completed", "tag": "745d590e-2b18-462d-a55e-1423ff663b30"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:03.327622 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:03.327622 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:22:03.337461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:03.338450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:03.346100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-de4842ba-d832-4e23-9e42-27f530b1ed23 req-4655532e-01dd-4770-b52e-b9845be0fea4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.346552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-de4842ba-d832-4e23-9e42-27f530b1ed23 req-4655532e-01dd-4770-b52e-b9845be0fea4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.353536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.354017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.354825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.355273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.358591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-de4842ba-d832-4e23-9e42-27f530b1ed23 req-4655532e-01dd-4770-b52e-b9845be0fea4 service nova] Creating event network-vif-plugged:745d590e-2b18-462d-a55e-1423ff663b30 for instance ec22e12b-a34c-4787-8d08-5dbf9b6556d1 on nch1-master-1 Dec 25 21:22:03.363966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-de4842ba-d832-4e23-9e42-27f530b1ed23 req-4655532e-01dd-4770-b52e-b9845be0fea4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041702 Dec 25 21:22:03.365178 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2442/4772] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:03.384646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:03.386310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:03.396757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.397486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.397882 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6bef815-5c9d-4595-a074-a3de3edb6622 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065450 Dec 25 21:22:03.401706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.401865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2331/4773] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:03 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:03.401963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.513635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:03.514495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:03.521597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.522048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.522859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.523294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.613984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:03.622731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:03.624322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:03.625580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d3065ec-7d4e-4aa5-a2c5-27054fe4e8d0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.116060 Dec 25 21:22:03.626142 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2332/4774] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:03 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:03.631812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:03.639946 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-21197164-ee5f-4039-906b-37268c15b8f5 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.260458 Dec 25 21:22:03.640389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2443/4775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:03 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:03.776907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:03.777517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:03.784040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.784492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.785305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:03.785784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:03.919539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:03.927869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f9acd22-9285-42ee-875e-7c5cf072896d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.154234 Dec 25 21:22:03.928022 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2333/4776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:03 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:04.055252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:04.056193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:04.062782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.063236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.064020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.064461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.114720 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bcfdaa66-b9a0-4b58-9412-9759fbc6876c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.063208 Dec 25 21:22:04.115376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2444/4777] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:04 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:04.408581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:04.409607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:04.416386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.416894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.417697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.418410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.458114 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c24c38ea-de8f-4302-b335-8d73ad1319d9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.053135 Dec 25 21:22:04.458748 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2334/4778] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:04 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:04.644178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:04.644892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:04.652669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.653138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.653927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.654362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.657116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:04.657767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:04.665042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.665504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.666306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.666753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.728022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:04.736294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:04.737830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:04.739009 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c30310b-ab3e-4051-ae53-f8969b75a7ad tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.099095 Dec 25 21:22:04.739573 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2445/4779] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:04 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:04.920155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:04.927897 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce78639d-0f15-4a01-ad2e-c222805febd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1318 microversion: 2.1 time: 0.275018 Dec 25 21:22:04.928478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2335/4780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:04 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:04.943237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:04.943868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:04.950511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.950970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:04.962092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:04.962092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.090561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:05.099654 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b8bc037-33f7-4613-9684-a791d7456712 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.160053 Dec 25 21:22:05.100278 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2446/4781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:04 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:05.125405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:05.126388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:05.132904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.133418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.134296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.134736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.178852 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0bbd379d-ecb6-4468-baf4-36bf711f83ab tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056984 Dec 25 21:22:05.179604 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2336/4782] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:05 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:05.469304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:05.470237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:05.477304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.477760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.478550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.479298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.518173 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6fa06c60-4f9a-493f-bcc2-a3484ee65db1 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052473 Dec 25 21:22:05.518867 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2447/4783] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:05 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:05.699444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f0437b7-5931-48ad-9c9e-424f466043af tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-577590057", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4fbcf4fb-0878-421e-9c0a-fee002967afc", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:05.758886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:05.759365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4f0437b7-5931-48ad-9c9e-424f466043af tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Block Device 4fbcf4fb-0878-421e-9c0a-fee002967afc is not bootable. Dec 25 21:22:05.759533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f0437b7-5931-48ad-9c9e-424f466043af tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Block Device 4fbcf4fb-0878-421e-9c0a-fee002967afc is not bootable. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:05.760380 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f0437b7-5931-48ad-9c9e-424f466043af tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.065087 Dec 25 21:22:05.760505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:05.761036 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2337/4784] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:05 2021] POST /compute/v2.1/servers => generated 110 bytes in 67 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:22:05.768112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.768942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.769082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:05.769717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:05.770256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.770983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.777744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.778218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.779029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.779468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.853331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:05.870496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:05.872093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:05.875203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e198c2f8-8047-4a31-961e-66c0cf1edf1e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.120920 Dec 25 21:22:05.875807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2448/4785] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:05 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:05.948098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:05.948724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:05.959465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.959844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.960926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:05.961501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:05.974289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:05.984439 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-509eb6de-cee2-4d64-a0e2-be18708623ed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.219075 Dec 25 21:22:05.985046 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2338/4786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:05 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:06.002521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:06.003133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.009739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.010191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.010987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.011423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.144859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:06.163247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-29f13770-fd59-4d2a-91f6-2b78831a2560 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1507 microversion: 2.1 time: 0.215189 Dec 25 21:22:06.163918 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2449/4787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:05 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:06.169236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:06.169850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.180569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.181065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.181941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.182358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.201120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:06.208791 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56c3ce72-a108-4173-b674-e33f9b736d21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.210042 Dec 25 21:22:06.218812 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2339/4788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:05 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:06.223754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa359d7e-7889-4e7a-9d7d-20b3a5bd215b"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:06.224990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.233504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.233976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.246006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.246006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.324407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:06.332580 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ee5c4bf-4bce-4c8c-9b43-fa488949b299 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.167578 Dec 25 21:22:06.333205 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2450/4789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:06 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:06.337847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:06.338903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.345269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.345730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.346519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.346959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.399204 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f3e45220-8cc3-45b6-8835-9bb48fd3e2d7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064723 Dec 25 21:22:06.399864 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2451/4790] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:06 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:06.419221 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] HTTP exception thrown: Invalid volume: volume aa359d7e-7889-4e7a-9d7d-20b3a5bd215b is already attached to instances: 64261b4d-7f44-4796-9323-e198eada5059 Dec 25 21:22:06.419221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Returning 400 to user: Invalid volume: volume aa359d7e-7889-4e7a-9d7d-20b3a5bd215b is already attached to instances: 64261b4d-7f44-4796-9323-e198eada5059 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:06.419221 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-480243f4-c115-4de6-8305-a76ba152953f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.197468 Dec 25 21:22:06.419221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2340/4791] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:22:06 2021] POST /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1/os-volume_attachments => generated 174 bytes in 199 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:22:06.493302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:06.494518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.502090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.502090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.502760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.503174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.530881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:06.530881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.536955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.537411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.538761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.539197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.581523 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-215a42bd-7fe5-4a00-b9a6-e5f92ec546f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055267 Dec 25 21:22:06.582842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2341/4792] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:06 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:06.587643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lazy-loading 'services' on Instance uuid 64261b4d-7f44-4796-9323-e198eada5059 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:06.881461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec1c77c5-0fdc-49ea-b97d-e95548098b26 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments/aa359d7e-7889-4e7a-9d7d-20b3a5bd215b" status: 202 len: 0 microversion: 2.1 time: 0.392663 Dec 25 21:22:06.882240 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2452/4793] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:22:06 2021] DELETE /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments/aa359d7e-7889-4e7a-9d7d-20b3a5bd215b => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:06.891321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:06.892387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.896508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:06.897497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:06.900598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.901092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.901904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.902354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.906023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.906832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.910404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:06.910404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:06.935738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f34fc6ae-17df-481c-8a95-70279174a5c9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048778 Dec 25 21:22:06.936764 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2342/4794] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:22:06 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:06.980188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:06.988832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:06.990407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:06.991580 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3402926e-4514-44f4-8766-62bc3c6f3069 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.100670 Dec 25 21:22:06.992524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2453/4795] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:06 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:07.349104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:07.349624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:07.356059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.356513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.357343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.357792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.411184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:07.412459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:07.419339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.419789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.420578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.421057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.466746 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1bb3776f-1225-42a9-8755-a7ad96169e8d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.059131 Dec 25 21:22:07.470839 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2454/4796] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:07 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:07.495495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:07.503065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6745ad6d-80da-4468-8fcf-97ffdc888c92 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.157767 Dec 25 21:22:07.503675 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2343/4797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:07 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:07.594102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:07.595109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:07.602277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.602674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.603459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.603895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.651069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4dc8e48f-9b3a-47e4-b929-3ab763bd837d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060927 Dec 25 21:22:07.651704 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2455/4798] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:07 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:07.947340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:07.948334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:07.955356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.955814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.956609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:07.957080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:07.987453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-383362fa-6188-4859-af85-0968d5f93934 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Dec 25 21:22:07.988010 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2344/4799] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:22:07 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:22:08.009805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:08.010535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:08.017975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.018430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.019224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.019667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.136784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:08.145090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:08.146620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:08.147833 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4fead07-38ed-4812-b149-1fa91ee9e6ab tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.142335 Dec 25 21:22:08.148950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2456/4800] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:08 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:08.478656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:08.479576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:08.486312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.486802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.487657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.488103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.519407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:08.520022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:08.527601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.528120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.529018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.529699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.565305 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7640c84c-1db5-4199-85f1-c0a3204dd7fc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.055556 Dec 25 21:22:08.565305 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2345/4801] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:08 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:08.663633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:08.664714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:08.672557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.673045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.673908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:08.674359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:08.725093 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8993dc4e-c454-43e4-b45a-55cbeefa43bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065949 Dec 25 21:22:08.725771 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2346/4802] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:08 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:08.946190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:08.954584 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aeed87da-56c3-40dc-a74e-ed95824fc703 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.438975 Dec 25 21:22:08.955329 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2457/4803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:08 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:08.999734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.000147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8857fe3-7e5d-4871-8998-f4c13bf80e81 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1178018810", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "aca914d0-5f7b-465f-a024-75efa27d7291", "destination_type": "local"}, {"source_type": "volume", "uuid": "c7f962ef-3f30-4f92-a684-1bdaf2635c0b", "destination_type": "invalid"}], "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:09.001088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.001843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8857fe3-7e5d-4871-8998-f4c13bf80e81 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:09.002652 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8857fe3-7e5d-4871-8998-f4c13bf80e81 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.006741 Dec 25 21:22:09.003194 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2347/4804] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:08 2021] POST /compute/v2.1/servers => generated 155 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:22:09.007445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.007899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.008702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.009832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.011296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.012080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.020026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.020480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.021290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.021732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.041900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da006d8e-f0d8-45a4-acf3-d5c5c3e70a90 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045991 Dec 25 21:22:09.042477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2458/4805] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:22:08 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:22:09.140641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-287947822", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "df7f119b-f1bb-462c-b2dc-ce3acd2a89d9"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:09.157132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.167588 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac36c48e-9235-4b24-82ce-117126db3eef tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.160131 Dec 25 21:22:09.168369 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2348/4806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:09.172731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.173361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.180340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.181674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.182558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.183328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.192451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] validate_networks() for [('df7f119b-f1bb-462c-b2dc-ce3acd2a89d9', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:22:09.260730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.268606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.270170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.278319 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbadfc6c-f5a0-4247-af05-5bfc70ae9226 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.102056 Dec 25 21:22:09.278319 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2349/4807] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:09.278319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.278319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.286703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.287154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.287940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.288378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.476628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.487286 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc8af52d-6563-4453-b18f-e992ef810402 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.214307 Dec 25 21:22:09.487912 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2350/4808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:09.543061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8acfb1c2-63df-4087-bd64-3d87eedcb373 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-378933387", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:09.544448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8acfb1c2-63df-4087-bd64-3d87eedcb373 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:09.545278 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8acfb1c2-63df-4087-bd64-3d87eedcb373 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.006217 Dec 25 21:22:09.545875 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2351/4809] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:09 2021] POST /compute/v2.1/servers => generated 624 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:09.553747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.554357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.561386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.561839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.562626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.563062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.680548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:22:09.681753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:22:09.682629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:22:09.683108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:22:09.683736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:22:09.693987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.694436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.695256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.695691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.713061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:22:09.718072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for user d7df5c79b8ea4c6ea7cf84b381b29765 and project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:22:09.730853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:22:09.733988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:22:09.749712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.756217 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-589d6b0f-d527-4707-9b4a-3a11d7eb8921 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.206324 Dec 25 21:22:09.756839 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2352/4810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:09.761920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:09.762819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.769275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.770313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.770735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.771181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.813102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a334d7e-860f-46fb-b918-a20f40f2bd73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.054985 Dec 25 21:22:09.813745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2353/4811] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:09 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:09.818747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:09.819712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.827194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.827644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.828426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.828938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.872735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7cd37f5c-0839-4902-a19e-d78bb4c8e73a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.735780 Dec 25 21:22:09.876605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2459/4812] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:09 2021] POST /compute/v2.1/servers => generated 380 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:22:09.876990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2cf52ec3-e752-4e85-920a-0b061d0ec417 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060225 Dec 25 21:22:09.876990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2354/4813] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:09 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:09.878008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.878628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.885689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5f25d21-c1aa-4dd0-9656-be2e498c0996 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.886245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.886897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.887026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5f25d21-c1aa-4dd0-9656-be2e498c0996 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.887495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.887956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.949949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5f25d21-c1aa-4dd0-9656-be2e498c0996 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:09.958957 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5f25d21-c1aa-4dd0-9656-be2e498c0996 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1217 microversion: 2.1 time: 0.076581 Dec 25 21:22:09.958957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2355/4814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:09.971059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:09.971673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:09.979832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.980284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:09.981289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:09.981832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.093446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.099577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26d98ef4-a0ae-40fc-ba23-01609357d3e1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.224746 Dec 25 21:22:10.100107 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2460/4815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:10.156686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.159361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bca20fee-3d70-461f-8ba2-2d0d4c4f961a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:10.161938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bca20fee-3d70-461f-8ba2-2d0d4c4f961a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:10.161938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bca20fee-3d70-461f-8ba2-2d0d4c4f961a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006016 Dec 25 21:22:10.165144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0106a6be-2b3a-4a38-a172-45ab7ed7094f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.197646 Dec 25 21:22:10.165860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2461/4816] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:10 2021] POST /compute/v2.1/servers => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:10.166297 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2356/4817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:09 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:10.170593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.171254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.178377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.178833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.179615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.180044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.289490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.293114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.297413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.297910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.298688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.299299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.315073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.325692 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30e306d8-1f42-4a36-97f7-00f8d2ea06fe tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.158903 Dec 25 21:22:10.326743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2462/4818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:10.343981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.344737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.351569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.352545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.353949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.354481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.371513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.380221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.381779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.385053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18e3dbe8-ad2c-4b33-911f-d72abda02f07 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.097324 Dec 25 21:22:10.385053 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2357/4819] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:10.489775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.497352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06fb0256-1eb6-4f34-a79b-d6412792cd8b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.157247 Dec 25 21:22:10.497894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2463/4820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:10.551341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebed1061-a173-4e7d-9cbd-a1aa8a00980e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-961858290", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": -1, "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:10.562561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ebed1061-a173-4e7d-9cbd-a1aa8a00980e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Flavor -1 could not be found. Dec 25 21:22:10.568822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebed1061-a173-4e7d-9cbd-a1aa8a00980e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:10.568822 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebed1061-a173-4e7d-9cbd-a1aa8a00980e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.016608 Dec 25 21:22:10.568822 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2358/4821] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:10 2021] POST /compute/v2.1/servers => generated 73 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:10.579589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.579718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.586243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.592316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.592316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.592316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.726633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.734174 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a96b7e19-9116-4d49-b460-795a26fe87c9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.162444 Dec 25 21:22:10.738451 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2464/4822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:10.751731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.752293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.760729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.761216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.762021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.762464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.824308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:10.825424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.831392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.831853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.832659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.833165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.877348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-782d8022-f827-43b3-90c7-200b6bac8fb5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.057164 Dec 25 21:22:10.878585 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2465/4823] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:10 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:10.887684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:10.888687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.895679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.896132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.896954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.897399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.901418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:10.908962 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25843ca4-d9a0-4532-8b53-43991723be47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.161042 Dec 25 21:22:10.911084 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2359/4824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:10.940501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7c47d98c-f5a8-4434-a56b-f767579c400d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057211 Dec 25 21:22:10.944139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2466/4825] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:10 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:10.971464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7241b5b7-53a4-4a01-bf27-f5cd1044d018 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1595335079", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:10.971464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7241b5b7-53a4-4a01-bf27-f5cd1044d018 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:10.971464 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7241b5b7-53a4-4a01-bf27-f5cd1044d018 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.006715 Dec 25 21:22:10.971464 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2360/4826] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:10 2021] POST /compute/v2.1/servers => generated 145 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:22:10.977479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.978432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.979919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:10.980968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:10.985746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.986199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.986988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.987424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.987734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.988190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:10.989042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:10.994424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.061626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.068956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f109c53-5e5c-4a78-919a-b53b6fe4dfff tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1221 microversion: 2.1 time: 0.095656 Dec 25 21:22:11.069590 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2467/4827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:11.147563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.157032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-756bb490-539b-4653-96b6-c92b766242c0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.180678 Dec 25 21:22:11.159749 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2361/4828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:10 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:11.174339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:11.174953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.181998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.182451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.182796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:11.183238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.183543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.183693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.189640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.190106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.190909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.191352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.386685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.402163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.402332 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e22b12b3-25d2-487b-b584-b62cfc3484cd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.229373 Dec 25 21:22:11.402332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2468/4829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:11 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:11.407126 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5644ab00-bc69-4fc7-97c7-4e597a3deb9d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.228541 Dec 25 21:22:11.408214 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2362/4830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:11 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:11.425121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:11.425121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.427500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.427966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.428789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.429296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.455435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52769939-4177-4ee3-bd0f-0beef567023a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-543452259", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:11.458676 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-52769939-4177-4ee3-bd0f-0beef567023a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Dec 25 21:22:11.459456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52769939-4177-4ee3-bd0f-0beef567023a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:11.460413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52769939-4177-4ee3-bd0f-0beef567023a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.009043 Dec 25 21:22:11.461116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2363/4831] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:11 2021] POST /compute/v2.1/servers => generated 123 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:11.468680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:11.469659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.477553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.478557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.479399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.479844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.496920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.504989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.509447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.509447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f86f21c6-f1f5-4227-9b9a-1618c4afc82d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.091441 Dec 25 21:22:11.509447 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2469/4832] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:11 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:11.611600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.619747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1afa25e-63e8-444a-92a1-6b047435a90e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.154357 Dec 25 21:22:11.620301 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2364/4833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:11 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:11.636556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:11.637202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.643693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.644150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.647399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.647399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.781233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:11.788770 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f53ee79c-4cce-48b4-9dbd-2f66fe75f344 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.156006 Dec 25 21:22:11.791229 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2470/4834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:11 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:11.843111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40176762-03b8-457a-a054-b4df3cf46254 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-318375281", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "key_name": "tempest-key-787672839", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:11.888752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:11.889699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.893982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-40176762-03b8-457a-a054-b4df3cf46254 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] validate_networks() for [('2173080e-712c-4030-840a-d911c5ceb839', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:22:11.895779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.896232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.897113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.897555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.946054 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03fdcca7-7368-4f9f-8997-9bbf1ef638e9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060817 Dec 25 21:22:11.946823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2471/4835] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:11 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:11.952571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:11.953622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:11.961171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.961631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:11.965712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:11.965712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.026140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a4f9db1-9eb7-4d28-8425-4a71951be8be tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.077911 Dec 25 21:22:12.026801 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2472/4836] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:11 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:12.087006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:12.088221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.095230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.095757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.096610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.097187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.188587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.207554 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eddbd04c-16b2-40bd-a0b9-b9c362f644a3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1277 microversion: 2.1 time: 0.124700 Dec 25 21:22:12.208150 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2473/4837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:12 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1277 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:12.219958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-40176762-03b8-457a-a054-b4df3cf46254 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Invalid key_name provided. Dec 25 21:22:12.219958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40176762-03b8-457a-a054-b4df3cf46254 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid key_name provided. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:12.219958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40176762-03b8-457a-a054-b4df3cf46254 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.374858 Dec 25 21:22:12.219958 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2365/4838] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:11 2021] POST /compute/v2.1/servers => generated 70 bytes in 376 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:22:12.225981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:12.226624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.232541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.233027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.233816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.234252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.419115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.426675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:12.431459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.431586 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f336b16-99ac-40c3-a54a-3c3be47cd043 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.205451 Dec 25 21:22:12.431586 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2474/4839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:12 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:12.433787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.434244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.435037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.435469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.445090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:12.445930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.452600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.453094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.454018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.455415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.744589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.752698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.754446 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-64907fae-caa6-41b1-b342-8df6e193db3f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.333234 Dec 25 21:22:12.755521 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2366/4840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:12 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:12.761944 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-720e5f57-091f-403b-8909-aba9b2ba3e32 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.320518 Dec 25 21:22:12.762354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:12.763707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2475/4841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:12 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:12.765100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.771411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.771923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.772717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.773187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.871909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.879746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.881359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:12.882586 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-febb9fe2-f876-4dac-ad61-71c5d4d37d3d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.125914 Dec 25 21:22:12.883299 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2367/4842] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:12 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:12.886371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fffe6d9-ff94-4f59-8d74-9bb5014be292 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1256679578", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:12.960074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:12.961274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.967495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.970892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.970892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.970892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.971279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.security_group_api [None req-2fffe6d9-ff94-4f59-8d74-9bb5014be292 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Neutron security group does_not_exist not found {{(pid=136548) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Dec 25 21:22:12.971279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2fffe6d9-ff94-4f59-8d74-9bb5014be292 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Dec 25 21:22:12.972161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fffe6d9-ff94-4f59-8d74-9bb5014be292 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:12.973094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fffe6d9-ff94-4f59-8d74-9bb5014be292 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.091283 Dec 25 21:22:12.973690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2476/4843] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:12 2021] POST /compute/v2.1/servers => generated 106 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:12.983299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:12.983913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:12.989841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.990295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:12.991081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:12.991519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.015426 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f820d6d7-b715-4145-95c1-cb25e08cec9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.059614 Dec 25 21:22:13.016283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2368/4844] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:12 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:13.038086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:13.039213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.047631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.056477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.056477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.056477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.094005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d772f72f-3d55-43ca-b1aa-01925fd31a04 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059893 Dec 25 21:22:13.094726 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2369/4845] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:13 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:13.226522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:13.227239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.228546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:13.238956 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f81d976d-6324-4ded-996a-b8c6f0664d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.260267 Dec 25 21:22:13.239721 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2477/4846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:12 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:13.240013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.240479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.241321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.241768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.257866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:13.258599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.265078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.265537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.266328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.266771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.526224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:13.533649 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f49682e-13b8-4014-98e9-982aed5c27e7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.311457 Dec 25 21:22:13.534230 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2370/4847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:13 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:13.560977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:13.572603 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f26fa05f-4cf5-46f0-bb42-9d9ff5085958 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.318583 Dec 25 21:22:13.573456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2478/4848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:13 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:13.589117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43ed0ec1-fb30-401f-bf1a-0ffb6c0ebb53 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:13.590047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43ed0ec1-fb30-401f-bf1a-0ffb6c0ebb53 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 14ff6269-1046-4abe-b737-dfa824dca02f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.595845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-43ed0ec1-fb30-401f-bf1a-0ffb6c0ebb53 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 14ff6269-1046-4abe-b737-dfa824dca02f could not be found. Dec 25 21:22:13.600413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43ed0ec1-fb30-401f-bf1a-0ffb6c0ebb53 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 14ff6269-1046-4abe-b737-dfa824dca02f could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:13.600413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43ed0ec1-fb30-401f-bf1a-0ffb6c0ebb53 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "DELETE /compute/v2.1/servers/14ff6269-1046-4abe-b737-dfa824dca02f" status: 404 len: 111 microversion: 2.1 time: 0.012500 Dec 25 21:22:13.600413 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2371/4849] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:22:13 2021] DELETE /compute/v2.1/servers/14ff6269-1046-4abe-b737-dfa824dca02f => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:13.607758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:13.608407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.614529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.614988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.615773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.616213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.772399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:13.777021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.781009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.781591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.782490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.783001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.892115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:13.900579 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e857f1b-c7e9-4cd9-9227-7d1c38dca90b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.295804 Dec 25 21:22:13.901017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2479/4850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:13 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:13.905538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:13.906631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:13.913112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.913577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.914377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:13.914820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:13.996451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.004562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.006166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.007361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f83bfba2-78e5-4823-b978-62736dee4d10 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.105417 Dec 25 21:22:14.007932 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2480/4851] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:13 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:14.012788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.013435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.013692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.019534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.022418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.022418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.022418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.022674 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f73455c2-029d-47b9-a4f3-cccbf8bc82b1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.253786 Dec 25 21:22:14.022674 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2372/4852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:13 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:14.027633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:14.028540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.037327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.037989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.039192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.039860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.098592 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e5f25fc-bac6-4c27-9538-14f3aac4ea98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.075118 Dec 25 21:22:14.099602 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2373/4853] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:14 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:14.106995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:14.108056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.115174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.121007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.121007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.121007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.164664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-047aafa5-a94b-4bd9-9cfc-751715db635c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062764 Dec 25 21:22:14.165421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2374/4854] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:14 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:14.278045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.285547 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33662e74-143d-46aa-8b8f-94f7f702cd34 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.276628 Dec 25 21:22:14.286130 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2481/4855] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:14 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:14.302273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a0b8145-28b5-4ceb-8caa-8e1d8cff6c06 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.302847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a0b8145-28b5-4ceb-8caa-8e1d8cff6c06 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Failed to fetch instance by id 9223372036854775808 {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:22:14.303440 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-5a0b8145-28b5-4ceb-8caa-8e1d8cff6c06 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Dec 25 21:22:14.304086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a0b8145-28b5-4ceb-8caa-8e1d8cff6c06 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:14.305005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a0b8145-28b5-4ceb-8caa-8e1d8cff6c06 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.006937 Dec 25 21:22:14.305600 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2375/4856] 10.222.0.32 () {58 vars in 1187 bytes} [Sat Dec 25 21:22:14 2021] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:22:14.313845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.314496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.320362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.320814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.322222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.322660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.487573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-02fed2d6-af3d-4f6a-abf8-7d98ab1f6e2f req-7e887014-095d-424c-80c1-14a43ae1e688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18053b3a-726d-42b5-8e54-89f3deee10cb", "tag": "866836b0-b932-4ad3-b858-1d09b2903533"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:14.489343 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:14.489343 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:22:14.498942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-02fed2d6-af3d-4f6a-abf8-7d98ab1f6e2f req-7e887014-095d-424c-80c1-14a43ae1e688 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.499371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-02fed2d6-af3d-4f6a-abf8-7d98ab1f6e2f req-7e887014-095d-424c-80c1-14a43ae1e688 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.511835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-02fed2d6-af3d-4f6a-abf8-7d98ab1f6e2f req-7e887014-095d-424c-80c1-14a43ae1e688 service nova] Creating event network-changed:866836b0-b932-4ad3-b858-1d09b2903533 for instance 18053b3a-726d-42b5-8e54-89f3deee10cb on nch1-master-1 Dec 25 21:22:14.517058 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-02fed2d6-af3d-4f6a-abf8-7d98ab1f6e2f req-7e887014-095d-424c-80c1-14a43ae1e688 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033672 Dec 25 21:22:14.518078 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2376/4857] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:22:14.527491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.535699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-089c1fd9-2cf0-4986-a08e-e88418df0670 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.225461 Dec 25 21:22:14.536295 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2482/4858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:14 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:14.553105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.553841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.554112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.554847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.561531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.561952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.562087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.562413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.562759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.563197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.563326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.563643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.869495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.874313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:14.877396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-65cff42e-5d73-4157-8523-1da666e53151 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.327080 Dec 25 21:22:14.878264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2483/4859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:14 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:14.882678 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-645299b4-59a1-450a-8ccd-7684ae55d4fd tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.335626 Dec 25 21:22:14.883408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2377/4860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:14 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:14.901660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e9d27ed-f55e-4ace-881e-39fd4d33d8d4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.902153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e9d27ed-f55e-4ace-881e-39fd4d33d8d4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Failed to fetch instance by id -1 {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:22:14.902706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5e9d27ed-f55e-4ace-881e-39fd4d33d8d4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance -1 could not be found. Dec 25 21:22:14.903293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e9d27ed-f55e-4ace-881e-39fd4d33d8d4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance -1 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:14.904188 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e9d27ed-f55e-4ace-881e-39fd4d33d8d4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.006842 Dec 25 21:22:14.904705 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2484/4861] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:22:14 2021] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:22:14.912463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:14.913265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:14.920250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.920710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:14.921529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:14.921966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.027856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:15.028476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.034928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.035389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.036221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.036661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.143980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:15.147392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:15.155807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:15.156424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8eeded3-e850-4f51-bdac-156989eab383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.247401 Dec 25 21:22:15.157505 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2378/4862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:14 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:15.157678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:15.171414 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03ad982c-192c-4eb7-9422-65f1dcf2d68e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.134984 Dec 25 21:22:15.171414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2485/4863] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:15 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:15.171760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:15.171760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.172400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:15.172400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.172678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.172678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.172678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.173154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.184251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.186560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.188668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.189516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.254922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eba2fb25-789b-4186-a150-41f110f10bb4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.094582 Dec 25 21:22:15.255812 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2486/4864] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:15 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:15.261727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:15.262434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.269736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.270319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.271126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.271566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.718118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:15.725966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-755bbdf0-718e-48fc-8e08-a5dce008a452 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.567425 Dec 25 21:22:15.727240 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2379/4865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:15 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:15.732748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:15.732748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.739405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.739952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.740764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.741237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.788460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f790940-69b8-4666-8d66-f408fded03a3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059743 Dec 25 21:22:15.789508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2380/4866] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:15 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:15.818366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:15.826981 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3abd5375-d69a-4217-b261-91ae3911b3dd tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.570008 Dec 25 21:22:15.827927 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2487/4867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:15 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:15.843675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9477d79-da2c-4623-a871-442a9c6815d0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:15.844438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9477d79-da2c-4623-a871-442a9c6815d0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 668f03ec-060b-4abd-a0c8-40d61c978bfa] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.851315 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b9477d79-da2c-4623-a871-442a9c6815d0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 668f03ec-060b-4abd-a0c8-40d61c978bfa could not be found. Dec 25 21:22:15.852824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9477d79-da2c-4623-a871-442a9c6815d0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 668f03ec-060b-4abd-a0c8-40d61c978bfa could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:15.853964 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9477d79-da2c-4623-a871-442a9c6815d0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/668f03ec-060b-4abd-a0c8-40d61c978bfa/action" status: 404 len: 111 microversion: 2.1 time: 0.014588 Dec 25 21:22:15.854533 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2381/4868] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:15 2021] POST /compute/v2.1/servers/668f03ec-060b-4abd-a0c8-40d61c978bfa/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:15.863436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:15.863922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.870434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.873943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.873943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.873943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.884775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:15.885273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.893154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.897135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.897135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.897135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.908649 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] HTTP exception thrown: Instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 could not be found. Dec 25 21:22:15.909356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Returning 404 to user: Instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:15.910419 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71c4e4e8-1a73-44e1-99b0-f4eb643e1b5a tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 404 len: 111 microversion: 2.1 time: 0.030075 Dec 25 21:22:15.910988 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2382/4869] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:22:15 2021] DELETE /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:22:15.915854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:15.920258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:15.923137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.923601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:15.924402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:15.924851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.049569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.057922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d5a89b5-d817-4620-bb7e-a41f870ada10 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.199028 Dec 25 21:22:16.058509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2488/4870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:15 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:16.074052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.074689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: f1f8bfda-0dfb-4159-89b2-bf30653ddcb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.080571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.081153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.081955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.082394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.094573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.096186 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] HTTP exception thrown: Instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 could not be found. Dec 25 21:22:16.096792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Returning 404 to user: Instance f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:16.097665 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9667a963-9bf8-48cb-bab5-745b3f51b7bd tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2" status: 404 len: 111 microversion: 2.1 time: 0.027261 Dec 25 21:22:16.098225 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2489/4871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/f1f8bfda-0dfb-4159-89b2-bf30653ddcb2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:16.103047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.103898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.109772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.110230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.111020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.111473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.120838 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88cbaa6c-55cf-4930-a8ea-b046cda9b143 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.202500 Dec 25 21:22:16.121468 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2383/4872] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:15 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:16.184465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.185103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.191687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.192137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.192951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.193395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.269283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.273841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.277673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.279262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.280558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1fd523eb-fece-48a9-abac-db1ac8e8d00b tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.100586 Dec 25 21:22:16.281163 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2384/4873] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:16.281494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2744977-3780-494b-aeb3-123bd355182e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.182323 Dec 25 21:22:16.282049 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2490/4874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:16.285707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:16.286759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.298218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.298218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.298218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.298218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.299161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0145f82-d15c-4d79-bfbd-b111c4483510 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:16.301115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0145f82-d15c-4d79-bfbd-b111c4483510 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: c24ffb17-9bbb-46df-bf41-e1ac431999f7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.308803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c0145f82-d15c-4d79-bfbd-b111c4483510 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance c24ffb17-9bbb-46df-bf41-e1ac431999f7 could not be found. Dec 25 21:22:16.309436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0145f82-d15c-4d79-bfbd-b111c4483510 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance c24ffb17-9bbb-46df-bf41-e1ac431999f7 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:16.310275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0145f82-d15c-4d79-bfbd-b111c4483510 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/c24ffb17-9bbb-46df-bf41-e1ac431999f7/action" status: 404 len: 111 microversion: 2.1 time: 0.014970 Dec 25 21:22:16.313045 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2491/4875] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:16 2021] POST /compute/v2.1/servers/c24ffb17-9bbb-46df-bf41-e1ac431999f7/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:22:16.320495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.321233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.328744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.329234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.330096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.330542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.349464 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fbcb8f8d-93cb-4dcc-a4e0-88b63b0e2707 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066996 Dec 25 21:22:16.354511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2385/4876] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:16 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:16.465457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.472867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd0c1afd-cc2a-45a5-aba3-f3c8697c141e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.156103 Dec 25 21:22:16.473468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2492/4877] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:16.491263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.492024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.499179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.499624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.500400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.500834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.638895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.646443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52b9abfb-3769-4ab1-9330-fec4935e6750 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.159268 Dec 25 21:22:16.647013 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2386/4878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:16.662800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a6f5948-8209-446f-a157-787d19110833 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.663478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a6f5948-8209-446f-a157-787d19110833 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 238bf76b-21a6-45bd-b7b3-96d9a54c24a3] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.670157 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5a6f5948-8209-446f-a157-787d19110833 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 238bf76b-21a6-45bd-b7b3-96d9a54c24a3 could not be found. Dec 25 21:22:16.670738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a6f5948-8209-446f-a157-787d19110833 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 238bf76b-21a6-45bd-b7b3-96d9a54c24a3 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:16.671559 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a6f5948-8209-446f-a157-787d19110833 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/238bf76b-21a6-45bd-b7b3-96d9a54c24a3" status: 404 len: 111 microversion: 2.1 time: 0.012459 Dec 25 21:22:16.672091 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2493/4879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/238bf76b-21a6-45bd-b7b3-96d9a54c24a3 => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:16.680230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.680867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.686981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.687431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.691235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.691235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.743471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.744076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.750802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.751286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.752068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.752504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.864777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.872500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29ab0681-6221-4a09-b42e-737d88e4d784 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.196082 Dec 25 21:22:16.873097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2387/4880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:16.877613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:16.878521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.885331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.893900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.893900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.893900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.928954 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-621f45df-ca92-46d7-827c-3374cad295a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054612 Dec 25 21:22:16.929703 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2388/4881] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:16 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:16.930029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:16.934635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:16.935338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:16.938226 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa152647-26a8-49e4-b959-20ed5dcb8ab4 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.198537 Dec 25 21:22:16.938799 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2494/4882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:16.942283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.942740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:16.943568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:16.946926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.079269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.087986 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca29843c-019a-4bda-9d95-f9a0f14003c5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.157245 Dec 25 21:22:17.088555 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2389/4883] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:16 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:17.140418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.140418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.145222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.145681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.146444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a0a85ed-af95-4bf8-b31e-b1c7c04be280 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1115051892", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:17.146568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.146942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.147918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a0a85ed-af95-4bf8-b31e-b1c7c04be280 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:17.148731 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a0a85ed-af95-4bf8-b31e-b1c7c04be280 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.006010 Dec 25 21:22:17.149456 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2390/4884] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:17 2021] POST /compute/v2.1/servers => generated 139 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:17.156709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.157357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.164523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.165094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.165947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.166383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.346792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.351115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.354638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7dd4887-9011-4123-b8d3-ed12da4069b7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.221095 Dec 25 21:22:17.356965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2495/4885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:17.359422 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e73e29b-dec2-47f6-9cd3-4b55b21d807b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.206090 Dec 25 21:22:17.359578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.360241 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2391/4886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:17.360374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.365382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:17.366194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.372991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.373482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.373601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.373964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.375978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.376110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.376211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.376307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.428116 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-963b0cc4-d9d7-4861-92cf-e8dcd23f052e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066156 Dec 25 21:22:17.431806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2392/4887] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:17 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:17.435257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.435937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.442714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.443449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.444724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.445400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.453063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.460918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.462499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.463943 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6002d63-6778-45ad-844b-2e5c9758e854 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.107539 Dec 25 21:22:17.464217 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2496/4888] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:17.582100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.589503 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e876a4e3-f2eb-4378-924b-ad8cce8ab470 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.159100 Dec 25 21:22:17.590075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2393/4889] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:17.643278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e975b602-7ec4-495a-9333-a8595c1b00c2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1013073357", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:17.643940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e975b602-7ec4-495a-9333-a8595c1b00c2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:17.644763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e975b602-7ec4-495a-9333-a8595c1b00c2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.006102 Dec 25 21:22:17.645301 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2497/4890] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:17 2021] POST /compute/v2.1/servers => generated 133 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:22:17.652694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.653345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.659386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.659851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.660623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.661101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.792321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.800188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30634b61-f13d-41e8-8400-ac3057092bed tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.151116 Dec 25 21:22:17.800750 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2394/4891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:17.817312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.817945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.824622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.825164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.825933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.826365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.939588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:17.940499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.946431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.946893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.947677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.948126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.956840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:17.968959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e6f41f6c-230b-4b62-9a7b-19b6f5df6a79 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.155274 Dec 25 21:22:17.969616 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2498/4892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:17.973855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:17.974462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:17.980978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.981515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.982381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:17.982825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:17.995509 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c3c5f24-d49c-402c-9ba7-a624b9948c48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059502 Dec 25 21:22:17.996535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2395/4893] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:17 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:18.002102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b51d42ce-fb52-48b8-beeb-10f49127bf7f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:18.002712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b51d42ce-fb52-48b8-beeb-10f49127bf7f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: f42245b3-e1ab-4d4a-888d-91cf2fa7fcb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.009623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b51d42ce-fb52-48b8-beeb-10f49127bf7f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance f42245b3-e1ab-4d4a-888d-91cf2fa7fcb2 could not be found. Dec 25 21:22:18.010230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b51d42ce-fb52-48b8-beeb-10f49127bf7f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance f42245b3-e1ab-4d4a-888d-91cf2fa7fcb2 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:18.011044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b51d42ce-fb52-48b8-beeb-10f49127bf7f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/f42245b3-e1ab-4d4a-888d-91cf2fa7fcb2/action" status: 404 len: 111 microversion: 2.1 time: 0.013573 Dec 25 21:22:18.011600 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2396/4894] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:17 2021] POST /compute/v2.1/servers/f42245b3-e1ab-4d4a-888d-91cf2fa7fcb2/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:18.019113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:18.019720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.027678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.036029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.036029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.036029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.152686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.161441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b356e084-754c-4b7e-ba7e-609404c28b35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.190787 Dec 25 21:22:18.162042 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2499/4895] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:17 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:18.195912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.203960 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-957ef407-f602-4898-ab55-c0651b767116 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.188240 Dec 25 21:22:18.204514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2397/4896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:18 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:18.220337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:18.225250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.227352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.228333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.229157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.229595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.363445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.371763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:18.371974 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd8b325c-f483-41e9-b4f9-a4c56de664db tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.155068 Dec 25 21:22:18.372341 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2500/4897] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:18 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:18.372451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.378795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.379264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.380045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.380491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.388389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:18.388953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.394775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.395221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.396013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.396453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.515126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.522461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19b57960-80ca-47d1-b851-eae6bbd648c7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.155041 Dec 25 21:22:18.523035 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2398/4898] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:18 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:18.527516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:18.528413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.534016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.534469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.535249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.535691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.577893 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab897f90-9a2b-4fe3-af7c-16515391658d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.053658 Dec 25 21:22:18.578519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2399/4899] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:18 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:18.583749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:18.584451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.592185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.594459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.594459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.594459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.617708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-46e2726e-7d0e-42f5-ae79-5714858f7078 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 202 len: 0 microversion: 2.1 time: 0.232677 Dec 25 21:22:18.618564 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2501/4900] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:18 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:18.630281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:18.631179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:18.637861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.638313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.639106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:18.639547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:18.661968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.672605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.674150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.675349 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6076a3cb-1708-4d0a-bd57-c54c451da672 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.095616 Dec 25 21:22:18.675942 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2400/4901] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:18 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:18.784284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:18.792752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c98142a-ac96-45bf-90c9-96ac28210424 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1508 microversion: 2.1 time: 0.166451 Dec 25 21:22:18.793344 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2502/4902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:18 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:19.015827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:19.016738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.023230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.023661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.025117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.025560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.064106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-707a3a8c-e4b0-401f-84f8-0ea56b2752c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052063 Dec 25 21:22:19.064757 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2401/4903] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:19 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:19.178440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:19.179120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.185804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.186857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.187662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.188105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.334806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:19.343531 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4780b23b-07a5-4b89-8614-da43b830b98f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.168737 Dec 25 21:22:19.344396 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2503/4904] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:19 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:19.539518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:19.540233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.547566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.548026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.548819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.549289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.589206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:19.590176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.596043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.596490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.597304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.597863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.640451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4dc971fa-e714-468b-a08a-45fbbffe70ff tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.054748 Dec 25 21:22:19.641310 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2504/4905] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:19 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:19.684597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:19.692363 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa0929e4-b3f7-4dc6-ac2b-e9705064d4b4 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.156934 Dec 25 21:22:19.693063 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2402/4906] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:19 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:19.694373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:19.695080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.703134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.703610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.704401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.704835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.774474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:19.782502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:19.784040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:19.785283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12343c5a-784d-48c4-ac37-3203794a9096 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.095085 Dec 25 21:22:19.785851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2505/4907] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:19 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:19.810328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:19.810972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.817645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.826878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.826878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.826878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.954421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:19.961903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5cc6112e-815a-4948-9593-4051835cee2d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1488 microversion: 2.1 time: 0.156148 Dec 25 21:22:19.962476 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2403/4908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:19 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1488 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:19.978677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:19.979212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:19.985689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.986133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:19.986907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:19.987338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.010505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'pause' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state paused Dec 25 21:22:20.011088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'pause' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state paused {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:20.011905 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9882c97-02c0-4c35-bab5-aaacf3c3cd47 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 143 microversion: 2.1 time: 0.037624 Dec 25 21:22:20.012444 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2506/4909] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:19 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 143 bytes in 39 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:22:20.020354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:20.021652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.026816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.027257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.028034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.028469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.074805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:20.075649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.081810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.082266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.083047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.083491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.130519 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49b1d2b5-db4d-4c71-8888-0fc830b280a4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059471 Dec 25 21:22:20.131168 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2507/4910] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:20 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:20.274861 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5af08599-c6a4-4f30-852f-1f8c2b0b2956 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 202 len: 0 microversion: 2.1 time: 0.257521 Dec 25 21:22:20.275535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2404/4911] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:20 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:20.283945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:20.284647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.293144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.293600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.294394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.294837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.374937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:20.375733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.382866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.383320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.384110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.384709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.440775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:20.449033 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b6c8ac9-b733-469f-a57a-7675b6bf8b21 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1495 microversion: 2.1 time: 0.169094 Dec 25 21:22:20.449610 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2508/4912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:20 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1495 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:20.532247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:20.540546 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1647ece8-cda3-4427-a19c-e33dbf1faa35 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.170979 Dec 25 21:22:20.541234 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2405/4913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:20 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:20.652533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:20.653423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.659852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.660306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.661125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.661567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.702131 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ddc488d5-0fc2-4896-ac3d-593a0fb803b2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.054034 Dec 25 21:22:20.702760 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2509/4914] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:20 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:20.709580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:20.714754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.718349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.718806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.719586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.720029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.805554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:20.806325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:20.813386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.813850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.815955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:20.816428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:20.854945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:20.862981 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54164f5c-3698-455b-9f69-9d2a9f027a2f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.157024 Dec 25 21:22:20.863549 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2406/4915] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:20 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:20.884323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:20.892820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:20.894376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:20.895664 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8123148c-46b2-460c-878b-fb5271397a86 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.094378 Dec 25 21:22:20.896228 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2510/4916] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:20 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:21.141934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:21.142897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.149559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.150012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.150781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.151219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.197141 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-246be69d-7875-4097-b3f5-7b3809cb5df9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058082 Dec 25 21:22:21.200795 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2407/4917] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:21 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:21.399214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d773a732-6848-4609-b8ab-d090472b4be1 req-9143e085-b842-4c7b-9cb4-24133b6ae78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18053b3a-726d-42b5-8e54-89f3deee10cb", "name": "network-vif-plugged", "status": "completed", "tag": "866836b0-b932-4ad3-b858-1d09b2903533"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:21.401492 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:21.401492 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:22:21.409672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d773a732-6848-4609-b8ab-d090472b4be1 req-9143e085-b842-4c7b-9cb4-24133b6ae78f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.410123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d773a732-6848-4609-b8ab-d090472b4be1 req-9143e085-b842-4c7b-9cb4-24133b6ae78f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.421681 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d773a732-6848-4609-b8ab-d090472b4be1 req-9143e085-b842-4c7b-9cb4-24133b6ae78f service nova] Creating event network-vif-plugged:866836b0-b932-4ad3-b858-1d09b2903533 for instance 18053b3a-726d-42b5-8e54-89f3deee10cb on nch1-master-1 Dec 25 21:22:21.426424 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d773a732-6848-4609-b8ab-d090472b4be1 req-9143e085-b842-4c7b-9cb4-24133b6ae78f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031724 Dec 25 21:22:21.427017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2511/4918] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:21.466793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:21.467856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.475064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.475456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.476336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.476781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.559261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:21.560160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.566878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.567428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.571954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.571954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.709188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:21.717241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75bd0b29-b9fd-4115-bc6f-6bd8f13792e6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.254648 Dec 25 21:22:21.717991 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2408/4919] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:21 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:21.727350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:21.727350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.737401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.737907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.738834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.739506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.774945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:21.782474 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4ddec5f-5329-45e8-af08-a781de70e2db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.228575 Dec 25 21:22:21.783115 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2512/4920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:21 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:21.787303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:21.787947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.794385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.795108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.795896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.796334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.796673 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-017a7b7e-e03b-4cc7-963b-1ba3bd7a6dfe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.077467 Dec 25 21:22:21.797594 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2409/4921] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:21 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:21.879998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:21.880899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.888120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.888805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.889624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.890094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.929476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:21.937410 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ffaf6214-6252-4e0b-aaed-b45bd90e2a5c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.153252 Dec 25 21:22:21.938001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2513/4922] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:21 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:21.942521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:21.943152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:21.949735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.950192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:21.951026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:21.951465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.027968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.035906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.037443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.039733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f593c1de-eeec-48ab-aef2-453f62ece9ac tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.099691 Dec 25 21:22:22.039733 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2514/4923] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:21 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:22.044226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:22.050742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.054124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.054582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.055389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.055833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.059456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.067101 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5372a385-f0ec-4466-a4a7-e51f395ac5b8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.191289 Dec 25 21:22:22.067746 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2410/4924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:21 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:22.069470 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. Dec 25 21:22:22.070065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:22.070890 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b625115a-a980-4bd9-a130-272b0773c4a3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231/action" status: 404 len: 111 microversion: 2.1 time: 0.030751 Dec 25 21:22:22.071985 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2515/4925] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:22 2021] POST /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:22.079719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:22.080388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.086277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.087390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.088166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.088602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.207456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:22.208374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.215140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.215593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.216383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.216815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.220262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.227708 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1c49906a-a67a-461b-9fd3-eb93dd392b2a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.151427 Dec 25 21:22:22.228313 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2411/4926] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:22 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:22.244437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:22.245014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.251089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.251541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.252359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.252803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.263895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7df6eb1d-f457-4675-909a-aa3fdde02ae4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059316 Dec 25 21:22:22.264121 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2516/4927] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:22 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:22.387771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.395348 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c761288f-7aee-4036-8264-b86afa6430df tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.154531 Dec 25 21:22:22.395916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2412/4928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:22 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:22.411986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fda9b94-a860-44bd-8890-1be180770e2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:22.413063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fda9b94-a860-44bd-8890-1be180770e2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 502435cb-75f2-47b0-a966-e8340d496235] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.419866 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7fda9b94-a860-44bd-8890-1be180770e2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 502435cb-75f2-47b0-a966-e8340d496235 could not be found. Dec 25 21:22:22.420456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fda9b94-a860-44bd-8890-1be180770e2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 502435cb-75f2-47b0-a966-e8340d496235 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:22.421314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fda9b94-a860-44bd-8890-1be180770e2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/502435cb-75f2-47b0-a966-e8340d496235/action" status: 404 len: 111 microversion: 2.1 time: 0.013674 Dec 25 21:22:22.421927 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2517/4929] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:22 2021] POST /compute/v2.1/servers/502435cb-75f2-47b0-a966-e8340d496235/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:22.429694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:22.430826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.437287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.437742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.438527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.438965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.568085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.576104 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01e800f1-8053-423a-912b-b4f851282c61 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.150055 Dec 25 21:22:22.576664 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2413/4930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:22 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:22.592799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:22.595139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.601100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.601562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.602411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.602850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.799382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:22.800014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.806335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.806478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.806788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.807571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.809717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.815927 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fbc0db5-6daa-4fe7-a57b-41c227516dbf tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.225604 Dec 25 21:22:22.824154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2518/4931] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:22 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:22.829515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:22.830438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.838246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.838451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.839102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.839536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.888257 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68e51b6c-7d77-4c68-b435-e119f7ce0072 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062294 Dec 25 21:22:22.888936 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2519/4932] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:22 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:22.894364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:22.895840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.903528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.903979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.904764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.905224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.920481 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. Dec 25 21:22:22.921111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:22.921961 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c474f718-587a-4361-9452-1f82905adf77 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231/action" status: 404 len: 111 microversion: 2.1 time: 0.031602 Dec 25 21:22:22.922539 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2520/4933] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:22 2021] POST /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:22.930475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:22.931083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:22.937559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.938013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.938799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:22.939232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:22.956936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:22.965129 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc4771f2-3ab6-4b63-83a4-0ea65cfc29db tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.169422 Dec 25 21:22:22.966090 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2414/4934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:22 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:23.057024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.057561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.063942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.064385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.065184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.065683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.077174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.084937 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-122563e2-0897-4c93-9fff-936c6bf1cd5f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.157907 Dec 25 21:22:23.085686 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2521/4935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:22 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:23.091420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.092430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.100587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.101071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.101867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.102307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.145026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.156795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.158401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.159691 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b821e44-7681-4025-bcad-0c1f86a290e2 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.106663 Dec 25 21:22:23.170253 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2415/4936] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:23.170253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.170253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.171732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.172221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.173042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.173479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.280022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.287691 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24b945bc-0a01-4429-837e-4514016dba1f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1317 microversion: 2.1 time: 0.201231 Dec 25 21:22:23.288272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2522/4937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:23.293059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:23.294034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.302265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.302738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.303528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.303967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.341337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.348663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66bd6e87-59c2-4b04-89a4-ec578677866a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.187288 Dec 25 21:22:23.352258 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2416/4938] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:23.353031 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9340dde3-3c3e-4778-9188-00a8e303ed38 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063498 Dec 25 21:22:23.356600 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2523/4939] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:23 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:23.365847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34cd7454-515d-4674-9cb9-0ce7549b3ccc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:23.367309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34cd7454-515d-4674-9cb9-0ce7549b3ccc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 897d3fbf-0767-4ebc-9059-5531471ad5fb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.373497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-34cd7454-515d-4674-9cb9-0ce7549b3ccc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 897d3fbf-0767-4ebc-9059-5531471ad5fb could not be found. Dec 25 21:22:23.374099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34cd7454-515d-4674-9cb9-0ce7549b3ccc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 897d3fbf-0767-4ebc-9059-5531471ad5fb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:23.374900 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34cd7454-515d-4674-9cb9-0ce7549b3ccc tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/897d3fbf-0767-4ebc-9059-5531471ad5fb/action" status: 404 len: 111 microversion: 2.1 time: 0.012718 Dec 25 21:22:23.375473 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2417/4940] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:23 2021] POST /compute/v2.1/servers/897d3fbf-0767-4ebc-9059-5531471ad5fb/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:23.388442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.389177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.396090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.396538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.397351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.397835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.533635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.541527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72c59e73-6121-422f-8233-7f5382c538b7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.157744 Dec 25 21:22:23.542097 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2524/4941] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:23.558980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.559590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.566315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.572829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.572829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.572829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.699566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.707005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-07df5bbf-3232-4011-b6ad-2c957b113cae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.152473 Dec 25 21:22:23.707657 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2418/4942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:23.723218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dba270cb-ffda-4f63-8657-024e3b40c8d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:23.723757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dba270cb-ffda-4f63-8657-024e3b40c8d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: e753e4da-8714-4780-b718-5f99667661c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.730215 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-dba270cb-ffda-4f63-8657-024e3b40c8d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance e753e4da-8714-4780-b718-5f99667661c2 could not be found. Dec 25 21:22:23.730792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dba270cb-ffda-4f63-8657-024e3b40c8d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance e753e4da-8714-4780-b718-5f99667661c2 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:23.731613 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dba270cb-ffda-4f63-8657-024e3b40c8d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/e753e4da-8714-4780-b718-5f99667661c2/action" status: 404 len: 111 microversion: 2.1 time: 0.012263 Dec 25 21:22:23.732138 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2525/4943] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:23 2021] POST /compute/v2.1/servers/e753e4da-8714-4780-b718-5f99667661c2/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:23.740049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.740800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.747413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.760387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.760387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.760387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.882717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:23.890144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-394f4219-fb93-410b-837a-d0f7a0dc203d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.153932 Dec 25 21:22:23.890911 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2419/4944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:23.900212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:23.902066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.908032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.908815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.909662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.910068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.912999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.913611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.920374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.920821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.921684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.922119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.952442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ca2894d-4ba7-4044-90f8-e2f6d82cd9b1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056599 Dec 25 21:22:23.953681 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2526/4945] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:23 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:23.983551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:23.984289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:23.991358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.991817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:23.992639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:23.993099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.079707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.087936 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6f24af2-40a0-497e-9d13-582d23ec490b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.178487 Dec 25 21:22:24.088620 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2420/4946] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:24.104914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:24.105458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.111596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.112321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.112863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.113310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.137514 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'restore' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active Dec 25 21:22:24.138112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'restore' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:24.138958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4582dcba-449c-47c2-8834-28f157b6af31 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 145 microversion: 2.1 time: 0.038530 Dec 25 21:22:24.139522 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2421/4947] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:24 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 145 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 25 21:22:24.147205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.147824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.150690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.154732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.155187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.155980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.156420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.158245 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0779ce17-15a2-49bb-84f4-f22340310b66 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.178941 Dec 25 21:22:24.158818 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2527/4948] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:23 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:24.178032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.178996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.185096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.185555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.186348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.186790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.253446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.262451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.264042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.265276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-10a9e00e-644f-4b6b-b677-99053ea13531 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.090940 Dec 25 21:22:24.265838 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2528/4949] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:24.304899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.305548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.311496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.311955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.312746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.313211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.318226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.326458 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fac2705b-e95f-4954-b594-2e33db8b9cc0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.182655 Dec 25 21:22:24.327114 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2422/4950] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:24.343320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.343937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.349833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.350282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.354115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.354115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.504264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.512615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4620c4ac-78f3-4519-8fc4-cb54c89f122e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1507 microversion: 2.1 time: 0.211703 Dec 25 21:22:24.513236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2529/4951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1507 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:24.518041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:24.518700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.526746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.527251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.528043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.528485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.529191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.537531 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d4625bb-1fa9-48bb-a43f-69bf92172ef1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.197701 Dec 25 21:22:24.538308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2423/4952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:24.553659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74bc905e-4da6-4628-9a9f-2eabdb16a2eb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:24.554290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-74bc905e-4da6-4628-9a9f-2eabdb16a2eb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 0d647a77-7cb9-4f6d-8820-6fc123cb604f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.559754 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-74bc905e-4da6-4628-9a9f-2eabdb16a2eb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 0d647a77-7cb9-4f6d-8820-6fc123cb604f could not be found. Dec 25 21:22:24.561090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74bc905e-4da6-4628-9a9f-2eabdb16a2eb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 0d647a77-7cb9-4f6d-8820-6fc123cb604f could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:24.562095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74bc905e-4da6-4628-9a9f-2eabdb16a2eb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/0d647a77-7cb9-4f6d-8820-6fc123cb604f/action" status: 404 len: 111 microversion: 2.1 time: 0.012147 Dec 25 21:22:24.562767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2424/4953] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:24 2021] POST /compute/v2.1/servers/0d647a77-7cb9-4f6d-8820-6fc123cb604f/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:22:24.570480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.571619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.578345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.579035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.579830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.580261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.582802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5107f67f-791f-49b5-be31-e3b8e9d04717 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.068314 Dec 25 21:22:24.583885 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2530/4954] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:24 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:24.721238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.729539 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dce1bba3-d08e-4a56-b338-70938ae61ec4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.162517 Dec 25 21:22:24.730152 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2425/4955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:24.749098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.749870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.749984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.750393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.756705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.757260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.763570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.763688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.763773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.763871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.763966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.763966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.773271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] HTTP exception thrown: Instance c169c539-29b8-4eeb-bb76-6e6eabd11098 could not be found. Dec 25 21:22:24.773911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Returning 404 to user: Instance c169c539-29b8-4eeb-bb76-6e6eabd11098 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:24.774805 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e1c7759-6eb2-4b65-b526-efe020518ead tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 404 len: 111 microversion: 2.1 time: 0.028764 Dec 25 21:22:24.777139 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2426/4956] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:22:24 2021] DELETE /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:24.783232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.788099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] [instance: c169c539-29b8-4eeb-bb76-6e6eabd11098] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.790553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.791174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.792450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.793070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.813530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] HTTP exception thrown: Instance c169c539-29b8-4eeb-bb76-6e6eabd11098 could not be found. Dec 25 21:22:24.816848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] Returning 404 to user: Instance c169c539-29b8-4eeb-bb76-6e6eabd11098 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:24.816848 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-461d69f4-befa-4bfd-bccf-0386d809a6ec tempest-AttachVolumeTestJSON-100156046 tempest-AttachVolumeTestJSON-100156046-project] 10.222.0.32 "GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098" status: 404 len: 111 microversion: 2.1 time: 0.035459 Dec 25 21:22:24.816848 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2427/4957] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/c169c539-29b8-4eeb-bb76-6e6eabd11098 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:22:24.911371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:24.920590 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53bde64a-884c-4bfb-985f-0b25de5e403e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.176032 Dec 25 21:22:24.921893 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2531/4958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:24.938346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:24.938878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.945149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.945619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.947137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.947774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.966552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:24.967653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.974270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.974814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.975597 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'resume' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active Dec 25 21:22:24.975752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.976199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'resume' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:24.976362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.977662 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db6fd174-de26-468d-9017-f00f79a41d2c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 144 microversion: 2.1 time: 0.042536 Dec 25 21:22:24.978211 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2428/4959] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:24 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 144 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:22:24.986114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:24.990836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:24.994712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.995496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:24.996451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:24.997105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.024088 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79040c72-428c-436b-bd84-49546ba3e24a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062669 Dec 25 21:22:25.028305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2532/4960] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:24 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:25.147511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.153896 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7de68b92-b1ee-4b7a-94f5-8153a3f4a085 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.171302 Dec 25 21:22:25.154459 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2429/4961] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:25.172779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:25.173767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.175715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:25.176481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.183135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.183557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.184595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.185174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.185318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.186053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.186934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.188079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.392397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.403484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f05c77d1-dd0b-45e4-94d8-2429dab029ce tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.231330 Dec 25 21:22:25.414642 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2430/4962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:25 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:25.420401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:25.421277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.423551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.429980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.431168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.432185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.432311 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-964bc2e3-1a28-4b2c-b31b-b630da0f3ce3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.264079 Dec 25 21:22:25.432929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.441423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2533/4963] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:25 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:25.497822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31fce021-3eb3-4638-9374-0dade8601718 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2173080e-712c-4030-840a-d911c5ceb839"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:25.499613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31fce021-3eb3-4638-9374-0dade8601718 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:25.500462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-31fce021-3eb3-4638-9374-0dade8601718 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.008141 Dec 25 21:22:25.503977 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2534/4964] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:25 2021] POST /compute/v2.1/servers => generated 108 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:25.505839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.511643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:25.513362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.516059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.522451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.522585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.522686 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-33c35f9a-9957-4588-a317-117a7257dd9e tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1365 microversion: 2.47 time: 0.105420 Dec 25 21:22:25.522794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.522902 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2431/4965] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:25 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:25.522992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.522992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.594626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:25.595556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.601964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.602518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.603270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.603707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.646607 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd7fc9a6-a8e3-4bfa-bac5-19177b6c2128 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055425 Dec 25 21:22:25.647464 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2432/4966] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:25 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:25.662876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.670914 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-57984d2d-e9ac-4cc2-a763-06725d963cbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.165149 Dec 25 21:22:25.671536 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2535/4967] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:25 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:25.688786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:25.689436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.697222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.697675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.700894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.700894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.840224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:25.847799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca0913b7-3022-452c-b817-62ae58b4750b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.163074 Dec 25 21:22:25.848369 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2433/4968] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:25 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:25.864942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bee7c1a2-a67d-47f3-bfac-c6bacf51dd92 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:25.865495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bee7c1a2-a67d-47f3-bfac-c6bacf51dd92 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: c0754797-0cd4-446a-a19c-ab4834401da8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.871802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-bee7c1a2-a67d-47f3-bfac-c6bacf51dd92 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance c0754797-0cd4-446a-a19c-ab4834401da8 could not be found. Dec 25 21:22:25.872379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bee7c1a2-a67d-47f3-bfac-c6bacf51dd92 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance c0754797-0cd4-446a-a19c-ab4834401da8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:25.873236 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bee7c1a2-a67d-47f3-bfac-c6bacf51dd92 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/c0754797-0cd4-446a-a19c-ab4834401da8/action" status: 404 len: 111 microversion: 2.1 time: 0.012125 Dec 25 21:22:25.873778 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2536/4969] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:25 2021] POST /compute/v2.1/servers/c0754797-0cd4-446a-a19c-ab4834401da8/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:25.881636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:25.882257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:25.888425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.889036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:25.889830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:25.890272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.032457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:26.036009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:26.037062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.042883 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7aa53afc-97b6-4e12-a9b2-74af4e334d68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.164854 Dec 25 21:22:26.044013 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2434/4970] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:25 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:26.056302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.057122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.059246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.060339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.062660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:26.063282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.075268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.075720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.076526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.076996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.121044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18428505-f5f0-4b1a-9722-3de20ee98287 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.089020 Dec 25 21:22:26.122113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2537/4971] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:26 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:26.263269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:26.274986 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12297c20-2aa9-4e39-84f1-6bbff7815d2e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.215858 Dec 25 21:22:26.275613 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2435/4972] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:26 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:26.292564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:26.293310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.300568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.301084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.301875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.302314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.326697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lazy-loading 'flavor' on Instance uuid 336c6856-ca33-4291-b38f-03e7f7a5db93 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:26.421122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:26.422348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.428345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.428840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.429647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.430085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.564957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:26.573399 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec45e7d5-9139-4dd6-96bd-0317dbd4c864 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.156142 Dec 25 21:22:26.573906 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2436/4973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:26 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:26.580223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:26.580223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.585239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.585888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.588710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.589506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.666024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:26.678204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:26.678204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:26.679461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d626b215-50ef-4eb0-b58a-cdfd67202819 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1371 microversion: 2.47 time: 0.104616 Dec 25 21:22:26.692790 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2437/4974] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:26 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:26.698502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:26.699440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.706031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.706487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.707387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.707833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.771780 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ee8c203-dd92-49c2-ba3e-d127b9b144a8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.077523 Dec 25 21:22:26.774488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2438/4975] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:26 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:26.947251 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0885c686-f93c-40a6-95c0-402d6e3e12c1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 202 len: 0 microversion: 2.1 time: 0.656403 Dec 25 21:22:26.948656 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2538/4976] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:26 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:26.958392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:26.959436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:26.968742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.969499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:26.970691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:26.971324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.133647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:27.134749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:27.141729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.142393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:27.142716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.143690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.144362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.150799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d06d5f8c-4b06-4dcf-af71-815f6c903b80 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.197384 Dec 25 21:22:27.151396 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2439/4977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:26 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:27.210791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-565094cc-ea5f-41c1-9db3-e88c29874e77 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.081091 Dec 25 21:22:27.212295 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2539/4978] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:27 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:27.308162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eac0146-d3ac-44c5-8076-4c22e019600b"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:27.311601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:27.319750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.320243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.321583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.322034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.590458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:27.591228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:27.599898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.600356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.601177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.601618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.742572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:27.750441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da54a549-ef90-43b3-adaf-630d9ed68930 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.164719 Dec 25 21:22:27.751417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2540/4979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:27 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:27.764394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:27.765174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:27.771603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.771891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.772696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.773169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.843425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:27.854317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:27.856165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:27.858895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8af42b4a-3dd4-42d2-b583-8524c3ae2be8 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1371 microversion: 2.47 time: 0.098093 Dec 25 21:22:27.860146 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2541/4980] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:27 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:27.865168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:27.866246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:27.873693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.874279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.878441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:27.878441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:27.932520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ba9de53-0430-4f91-9777-44b562f94ce5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069723 Dec 25 21:22:27.932520 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2542/4981] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:27 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:28.140324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c71c2634-6dfe-490c-a99f-099d81a743c6 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841168 Dec 25 21:22:28.142562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2440/4982] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:22:27 2021] POST /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:28.168170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:28.168909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:28.179520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.180066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.181126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.182272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.237135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:28.237135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:28.244231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.244596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.245435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.245866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.296275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa786795-674b-4ef3-bc53-c9c07acb94d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.073527 Dec 25 21:22:28.301130 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2441/4983] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:28 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:28.355786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:28.363323 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63cc8dfd-aa6e-4e76-ab91-5b8b8e4b0d08 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.199535 Dec 25 21:22:28.363894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2543/4984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:28 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:28.767962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:28.768839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:28.779672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.780544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.781526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.782179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.881599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:28.882495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:28.891482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.893989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:28.893989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:28.893989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.036827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:29.048783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:29.051448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:29.052916 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-73aeb470-efe2-4dc8-9ca3-840b359ae21d tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1371 microversion: 2.47 time: 0.178886 Dec 25 21:22:29.054667 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2544/4985] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:28 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:29.061792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:29.063007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:29.078763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:29.079118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:29.079615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.080525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:29.081145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.090608 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e2f0209-7284-4dda-af43-98d357e65951 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.326635 Dec 25 21:22:29.101506 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2442/4986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:28 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:29.139914 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e7097f8-dccc-470b-9320-1e8c38c4e578 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.082711 Dec 25 21:22:29.141604 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2545/4987] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:29 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:29.307836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:29.308749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:29.318959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:29.319768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.320767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:29.321366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.365489 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-665f56fc-6085-42a4-aed5-e7d5c6b9c172 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.061405 Dec 25 21:22:29.366167 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2443/4988] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:29 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:29.381414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:29.382134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:29.389472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:29.389938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.390740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:29.391196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:29.530552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:29.538384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cb89085b-e80d-4108-b6a4-c27fc82a5f15 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.160990 Dec 25 21:22:29.538894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2546/4989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:29 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:30.073862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:30.074476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.081647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.082102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.082885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.083323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.107748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:30.108740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.115870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.116352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.117162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.118160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.152432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.161829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.163368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.164546 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9276ba1d-9b88-4708-82be-90ce06576546 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1356 microversion: 2.47 time: 0.095659 Dec 25 21:22:30.165152 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2444/4990] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:30 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:30.170116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:30.171084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.177245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.177708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.178465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.178940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.235969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0924ae0f-f700-4c60-bcc7-6615d8c1b6f0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069561 Dec 25 21:22:30.236910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2445/4991] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:30 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:30.242373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:30.246492 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:30.246492 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:22:30.247505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.248350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Searching by: {'deleted': False, 'project_id': '8448b25167bd4f0facbde22bc77a818d'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:22:30.254593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.255042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.255945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.256385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.280968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.288340 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98154980-7901-4be6-b522-3056021885fc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.184281 Dec 25 21:22:30.299458 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2547/4992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:30 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:30.376708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:30.377868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.381857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:22:30.384572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.385088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.389800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.389800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.432642 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a8bfb2a-6628-46e8-9613-9327be0ee20b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.059425 Dec 25 21:22:30.434252 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2548/4993] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:30 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:30.467025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.473772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.474221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.485191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.486706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.521182 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c03d6371-0233-4648-a6a2-5d0909fe28de tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.282946 Dec 25 21:22:30.521772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2446/4994] 10.222.0.32 () {60 vars in 1186 bytes} [Sat Dec 25 21:22:30 2021] GET /compute/v2.1/servers/detail => generated 2706 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:30.546895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:30.547396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.554843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.555733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:30.556600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.556726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.558083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.558538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.563000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.567732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.567732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.567732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.597484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:22:30.710862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:30.724174 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-90d1551c-a7c6-4894-bf9b-9721d7479c98 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.168917 Dec 25 21:22:30.724174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2447/4995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:30 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:30.958944 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3bcf79a9-c82e-4df4-94ce-25c2a396fb16 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "DELETE /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 204 len: 0 microversion: 2.47 time: 0.414720 Dec 25 21:22:30.962122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2549/4996] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:22:30 2021] DELETE /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:22:30.975265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:30.976147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:30.983035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.983500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:30.984307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:30.984750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.087517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:31.095489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:31.097061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:31.098243 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9851e6e0-42f2-4690-a02e-0074656914b0 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1362 microversion: 2.47 time: 0.127105 Dec 25 21:22:31.105260 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2448/4997] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:30 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1362 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:31.248617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:31.249665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:31.257683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.258649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.259440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.259879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.300451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee80c6a8-1513-434f-a238-af40758413a0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055965 Dec 25 21:22:31.301392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2550/4998] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:31 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:31.305752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:31.306367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:31.312289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.312740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.313564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.314067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.446306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:31.447434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:31.455033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:31.455509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.455881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.457024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.457570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.462442 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-664fab83-a18b-4ce2-89c0-04b3b78dec20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.159638 Dec 25 21:22:31.463321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2449/4999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:31 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:31.501142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4749069d-ee98-44f7-ba0e-37dbefff6a73 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060777 Dec 25 21:22:31.501784 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2551/5000] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:31 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:31.740542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:31.741183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:31.748300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.748833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.749671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:31.750104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:31.887796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:31.895454 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55cbbf37-95e6-4cf4-b660-d716ea419b28 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.159410 Dec 25 21:22:31.896102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2450/5001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:31 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:32.116317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:32.117188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.124219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.124675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.125487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.125932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.189811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:32.198488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:32.200002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:32.201195 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-62604dfc-8e31-481b-b240-1c88f77c44ca tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1362 microversion: 2.47 time: 0.089065 Dec 25 21:22:32.202680 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2552/5002] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:32 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1362 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:32.311673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:32.312752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.319483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.319935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.320854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.321350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.363392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1c9a6393-4ae1-4af8-8e75-58fbc5749947 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055293 Dec 25 21:22:32.364157 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2451/5003] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:32 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:32.479240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:32.479852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.486639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.487091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.487866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.488301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.492363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eac0146-d3ac-44c5-8076-4c22e019600b"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:32.493591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.500663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.501215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.502003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.502444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.597472 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] HTTP exception thrown: Invalid volume: volume 0eac0146-d3ac-44c5-8076-4c22e019600b is already attached to instances: 18053b3a-726d-42b5-8e54-89f3deee10cb Dec 25 21:22:32.598077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Returning 400 to user: Invalid volume: volume 0eac0146-d3ac-44c5-8076-4c22e019600b is already attached to instances: 18053b3a-726d-42b5-8e54-89f3deee10cb {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:32.598935 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7316621-d722-429f-bf26-e2d5265b3f33 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111044 Dec 25 21:22:32.599698 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2452/5004] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:22:32 2021] POST /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments => generated 174 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:32.613281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:32.613281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.617845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.618310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.619208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.619562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.665064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:32.669727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0b05308-ace4-4fdc-ad5a-ac15e1dbadc4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064902 Dec 25 21:22:32.671647 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2453/5005] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:32 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:32.675597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:32.676192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.678469 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e302921-cff3-44ea-a9a7-1b9803e4f7e5 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.202891 Dec 25 21:22:32.679613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2553/5006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:32 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:32.684911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.685447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.686371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.686878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.765001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lazy-loading 'services' on Instance uuid 18053b3a-726d-42b5-8e54-89f3deee10cb {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:32.917045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:32.917668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:32.924504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.925001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:32.925805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:32.926244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.000619 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-15fad9de-5ac3-45a3-9a20-2aa4e4fd8454 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments/0eac0146-d3ac-44c5-8076-4c22e019600b" status: 202 len: 0 microversion: 2.1 time: 0.328850 Dec 25 21:22:33.001253 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2454/5007] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:22:32 2021] DELETE /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments/0eac0146-d3ac-44c5-8076-4c22e019600b => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:33.010407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:33.012097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:33.022035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.022629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.023323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.023786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.054521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac418e98-93fc-4696-a42d-446158b4e7b1 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048742 Dec 25 21:22:33.055738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2455/5008] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:22:33 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:22:33.064318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:33.072788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad90556b-c773-4bfa-b5e1-97474ad620b0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.163998 Dec 25 21:22:33.073389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2554/5009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:32 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:33.219480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:33.220101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:33.227392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.227916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.228743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.229214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.268016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.268556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.268949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lazy-loading 'fault' on Instance uuid 526ed898-b7b5-489a-b321-daca61b7fda9 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:33.310890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:33.318808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:33.320331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:33.321567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2628586a-ce6e-4ce0-b119-7fd921d47340 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 200 len: 1367 microversion: 2.47 time: 0.105855 Dec 25 21:22:33.322128 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2456/5010] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:33 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 1367 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:33.374400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:33.375320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:33.381415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.381862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.382632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.383059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.429274 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27fe97a0-ccc4-4de3-a2dc-dc5401b12dd0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058348 Dec 25 21:22:33.431142 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2555/5011] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:33 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:33.681799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:33.682671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:33.689176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.689770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.690467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.690909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.695934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:33.696632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:33.704282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.704735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.705543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:33.705978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:33.816209 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31f17dcd-4d70-4576-a419-593306831bec tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.138090 Dec 25 21:22:33.817809 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2457/5012] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:33 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:33.840338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:33.849470 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b9adacb-cc43-411b-adb9-701ba8774ced tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1519 microversion: 2.1 time: 0.157100 Dec 25 21:22:33.857598 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2556/5013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:33 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:33.981192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd85d214-8e82-4f3b-a8dd-fb9619137a53 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f603f3a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.030004 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd85d214-8e82-4f3b-a8dd-fb9619137a53 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7447ea85-fe46-4732-9563-e70cf2a4aa37" status: 200 len: 344 microversion: 2.1 time: 0.052809 Dec 25 21:22:34.030677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2458/5014] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:22:33 2021] GET /compute/v2.1/os-volumes/7447ea85-fe46-4732-9563-e70cf2a4aa37 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:34.066707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.067815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.075666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.076485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.077386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.077977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.090523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.091729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.099148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.099597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.100488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.101058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.112660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f157a366-2fa3-4973-b102-458c5168b116 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049810 Dec 25 21:22:34.113476 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2557/5015] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:22:34 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:34.343344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.344342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 526ed898-b7b5-489a-b321-daca61b7fda9] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.351167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.351617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.352412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.352849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.368234 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] HTTP exception thrown: Instance 526ed898-b7b5-489a-b321-daca61b7fda9 could not be found. Dec 25 21:22:34.368838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Returning 404 to user: Instance 526ed898-b7b5-489a-b321-daca61b7fda9 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:34.369831 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f85998d5-f3aa-45a3-87dd-4550165edd8c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9" status: 404 len: 111 microversion: 2.47 time: 0.030531 Dec 25 21:22:34.370401 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2558/5016] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:34 2021] GET /compute/v2.1/servers/526ed898-b7b5-489a-b321-daca61b7fda9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:22:34.378337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.378965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.386568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.387482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.388312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.389083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.415652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:22:34.517150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:34.524932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65d40282-bfc3-43e6-8277-7373ee5efff6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.438920 Dec 25 21:22:34.525509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2459/5017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:34 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:34.529847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:34.530781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.536636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.537157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.537936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.538380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.583659 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-497a7131-d5ea-4ed2-938c-24a0747e91f5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.056925 Dec 25 21:22:34.585594 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2460/5018] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:34 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:34.720724 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eefed9e6-c817-494b-974a-28dd81d4222f tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c" status: 204 len: 0 microversion: 2.47 time: 0.345844 Dec 25 21:22:34.721369 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2559/5019] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:22:34 2021] DELETE /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:22:34.730453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.731152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.738601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.739078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.739856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.740290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.829070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:34.830087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.834616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:34.841168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.842173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.842980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.843432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.844020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:34.845782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:34.847214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58301013-9e0a-4508-9255-e5296a05629c tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c" status: 200 len: 1363 microversion: 2.47 time: 0.121467 Dec 25 21:22:34.847774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2461/5020] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:34 2021] GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:34.866557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:34.868019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:34.874249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.874737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.875718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:34.876242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:34.893988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3cd25f6-b534-4328-90ab-19d4778950d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.068930 Dec 25 21:22:34.897683 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2560/5021] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:34 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:35.066613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:35.074216 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-311d5a09-25c4-4bf4-a605-389b48540888 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1499 microversion: 2.1 time: 0.211250 Dec 25 21:22:35.074982 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2462/5022] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:34 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1499 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:35.091571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:35.092259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.099293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.099747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.100559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.101030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.123599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:35.125065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.131132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.131653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.132561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.133035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.162842 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6df27ef2-41c3-4d70-892c-e10cc5916c55 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043071 Dec 25 21:22:35.163412 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2463/5023] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:22:35 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:22:35.247555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:35.252787 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c71ae44-c9b1-4a15-b9f4-e8ed476a4082 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1515 microversion: 2.1 time: 0.165329 Dec 25 21:22:35.253578 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2561/5024] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:35 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:35.272555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f46730cc-7d90-4126-9f79-d227d74b51b2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:35.275412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f46730cc-7d90-4126-9f79-d227d74b51b2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: cc3608b6-76ba-4b08-a594-dcb2de1b20d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.280045 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f46730cc-7d90-4126-9f79-d227d74b51b2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Instance cc3608b6-76ba-4b08-a594-dcb2de1b20d1 could not be found. Dec 25 21:22:35.280628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f46730cc-7d90-4126-9f79-d227d74b51b2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 404 to user: Instance cc3608b6-76ba-4b08-a594-dcb2de1b20d1 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:35.281483 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f46730cc-7d90-4126-9f79-d227d74b51b2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/cc3608b6-76ba-4b08-a594-dcb2de1b20d1/action" status: 404 len: 111 microversion: 2.1 time: 0.015712 Dec 25 21:22:35.282037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2464/5025] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:35 2021] POST /compute/v2.1/servers/cc3608b6-76ba-4b08-a594-dcb2de1b20d1/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:22:35.293021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:35.293553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.299663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.300116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.301110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.309948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.317301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-999719877", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "df7f119b-f1bb-462c-b2dc-ce3acd2a89d9"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:35.369206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] validate_networks() for [('df7f119b-f1bb-462c-b2dc-ce3acd2a89d9', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:22:35.513349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df719404-73ef-403a-bd0b-ae897eec418e tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 202 len: 0 microversion: 2.1 time: 0.225007 Dec 25 21:22:35.514037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2562/5026] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:35 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:35.522258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:35.523188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.531474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.531930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.532730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.533211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.783440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:35.792110 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06db4b3f-02c0-4ab3-b208-20b52f3dd446 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1520 microversion: 2.1 time: 0.273736 Dec 25 21:22:35.793046 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2563/5027] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:35 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:35.798063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:35.798708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.804607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.805706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.806506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.806983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.822015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:22:35.822534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:22:35.823369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:22:35.823813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:22:35.824227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:22:35.833188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.833639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.834453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.834887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.854524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:22:35.860493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Getting quotas for user d7df5c79b8ea4c6ea7cf84b381b29765 and project 8dcf2517f61849cb9650682caf0c5712. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:22:35.874156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:22:35.876491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:22:35.949584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:35.958452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f61f9331-5e26-4b4a-be10-30acbf07c2f9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.164092 Dec 25 21:22:35.959171 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2564/5028] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:35 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:35.964441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:35.966500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:35.972645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.973252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:35.974152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:35.974662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.001146 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7bf1b0a6-9be8-4c64-a13f-141747f29e9c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687441 Dec 25 21:22:36.001924 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2465/5029] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:22:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:22:36.006686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:36.007302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:36.013617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.014068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.015571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.015772 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67d57410-d99c-4e09-822f-431c556c3776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055107 Dec 25 21:22:36.016014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.016648 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2565/5030] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:35 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:36.023326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:36.024927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:36.033296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.033744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.034535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.034968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.088208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:36.089760 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0633c350-053a-4692-be66-9696d7aaa846 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066851 Dec 25 21:22:36.090493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2566/5031] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:36 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:36.097316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02f42262-95c7-4a78-9f85-4ec8ab74dc8a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:36.098113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02f42262-95c7-4a78-9f85-4ec8ab74dc8a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:36.099165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:36.101113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:36.103056 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b2df6c9-b7ec-48dd-b8aa-ab8eed3aba87 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c" status: 200 len: 1363 microversion: 2.47 time: 0.100089 Dec 25 21:22:36.105246 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2466/5032] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:36 2021] GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c => generated 1363 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:36.162024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02f42262-95c7-4a78-9f85-4ec8ab74dc8a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:36.169898 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02f42262-95c7-4a78-9f85-4ec8ab74dc8a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1217 microversion: 2.1 time: 0.077429 Dec 25 21:22:36.179884 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2567/5033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:36 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:36.716650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ebcc396-6454-41a9-b4ed-33e4302f143e tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f736edc0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:36.762075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ebcc396-6454-41a9-b4ed-33e4302f143e tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/9eaf456e-3e7a-41b0-9b13-14c25e81275e" status: 200 len: 343 microversion: 2.1 time: 0.049196 Dec 25 21:22:36.762671 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2467/5034] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:22:36 2021] GET /compute/v2.1/os-volumes/9eaf456e-3e7a-41b0-9b13-14c25e81275e => generated 343 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:36.809627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:36.810238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:36.817850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.818313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.819110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.819567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.960366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:36.968429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc0f4c6f-cd92-43fa-a7df-a80f191f068d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1500 microversion: 2.1 time: 0.162491 Dec 25 21:22:36.969035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2568/5035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:36 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1500 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:36.976067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:36.977839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:36.984908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.985371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.986100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:36.986257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.986587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.987456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:36.994227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.994674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:36.995454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:36.995887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.022799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'flavor' on Instance uuid 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:37.037376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Cannot 'rescue' instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 while it is in vm_state paused Dec 25 21:22:37.039645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 409 to user: Cannot 'rescue' instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 while it is in vm_state paused {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:37.039645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86296945-aae3-46ed-8be6-81350c946788 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 409 len: 144 microversion: 2.1 time: 0.056916 Dec 25 21:22:37.040518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2569/5036] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:36 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 144 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Dec 25 21:22:37.048793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:37.049873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.055971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.056439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.057384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.057808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.103166 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bd5fea9-8577-41db-a353-4c565a9a8d41 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057848 Dec 25 21:22:37.104022 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2570/5037] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:37 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:37.108826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:37.110292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.117572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.118028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.118827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.119267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.146476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:37.166250 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d49976e-c391-4053-acaf-62a34ebb9065 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.182871 Dec 25 21:22:37.168912 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2468/5038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:36 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:37.173621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:37.174593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.180734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.181535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.182104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.182539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.223548 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b393ec65-d490-4f8d-8253-e08a4f6ed99f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.053463 Dec 25 21:22:37.224182 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2469/5039] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:37 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:37.229342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:37.230052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.236816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.237289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.238056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.238490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.271332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.271777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.272258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lazy-loading 'fault' on Instance uuid 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:37.314322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:37.321736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:37.323250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4f35acdc849b446f8564ce2666f2e17c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8448b25167bd4f0facbde22bc77a818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:37.324434 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2736b8f7-2468-46c0-8db6-9cf7dfca00a7 tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c" status: 200 len: 1368 microversion: 2.47 time: 0.099065 Dec 25 21:22:37.325014 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2470/5040] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:37 2021] GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:37.329706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:37.330585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.337714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.338245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.339113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.339618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.409657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:37.419654 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-beda0d8e-ccfd-4239-a629-97fa70798fa8 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 202 len: 0 microversion: 2.1 time: 0.313691 Dec 25 21:22:37.420407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2571/5041] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:37 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:37.437736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee689dc3-0ee6-4f31-a807-370d8f98a20d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1213 microversion: 2.1 time: 0.096126 Dec 25 21:22:37.438409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2471/5042] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:37 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1213 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:37.443173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:37.443932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.451471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.451928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.452728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.453194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.594534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:37.596501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.602553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.602995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.603972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.604546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.614728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:37.623628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4cee3877-af0f-4748-88d9-7f82501df5c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1507 microversion: 2.1 time: 0.198753 Dec 25 21:22:37.624286 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2572/5043] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:37 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:37.861714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d9b1654-1e05-4144-b1ca-338fabdf9d82 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.270795 Dec 25 21:22:37.862403 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2472/5044] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:37 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:37.872506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:37.873091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:37.880033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.880486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:37.881297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:37.881725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.033476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:38.042309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92bdf8b4-d59c-49a9-99e8-ba7d8cf037f5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1670 microversion: 2.1 time: 0.175289 Dec 25 21:22:38.043255 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2573/5045] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:37 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:38.115105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:38.116237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:38.123275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.123804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.124734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.125263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.166026 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-232211d7-1eb2-4568-b85c-3d92efe3839f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054912 Dec 25 21:22:38.166928 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2473/5046] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:38 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:38.177516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:38.178239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:38.185291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.187630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.187630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.187630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.235749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:38.236792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:38.244457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.244934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.245792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.246259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.290443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f7687330-6849-4ffd-8998-22ab07f5faaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058609 Dec 25 21:22:38.294871 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2474/5047] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:38 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:38.346812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:38.347060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] [instance: 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:38.354835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.355300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.356102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.356551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.371805 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] HTTP exception thrown: Instance 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c could not be found. Dec 25 21:22:38.372567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] Returning 404 to user: Instance 3503245c-9c15-4ca9-8c8e-dfd5025b1c2c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:38.373575 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f41172f-fd72-4b78-8b50-6c76ea3892db tempest-ServerShowV247Test-197376765 tempest-ServerShowV247Test-197376765-project] 10.222.0.32 "GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c" status: 404 len: 111 microversion: 2.47 time: 0.031918 Dec 25 21:22:38.374283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2475/5048] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:38 2021] GET /compute/v2.1/servers/3503245c-9c15-4ca9-8c8e-dfd5025b1c2c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:22:38.455486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:38.456216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:38.463600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.464306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.465216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.465805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.600506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:38.609329 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c26ee52f-05be-444e-be22-53bf17213e66 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1277 microversion: 2.1 time: 0.157941 Dec 25 21:22:38.609908 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2476/5049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:38 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:38.615392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:38.626746 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-982106ed-308c-45ec-ba33-1551360dcc18 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.452932 Dec 25 21:22:38.630069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2574/5050] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:38 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:38.641172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:38.642196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:38.649117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.649682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.650553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:38.651831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:38.928355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:38.940285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1117286-c551-47af-92dd-cab64f702c21 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1515 microversion: 2.1 time: 0.303523 Dec 25 21:22:38.941228 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2477/5051] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:38 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1515 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:39.062542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:39.065334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:39.077886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.081164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.083294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.083874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.177255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:39.178178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:39.185419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.186065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.186892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.187492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.230820 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0eff6f39-5d00-43d9-9e61-3f5835c025d0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057119 Dec 25 21:22:39.231495 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2478/5052] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:39 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:39.306838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:39.309203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:39.330609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.332672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.334248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.335611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.340555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:39.371898 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84254b88-524a-49f3-8f66-5e6431ae42db tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1670 microversion: 2.1 time: 0.310564 Dec 25 21:22:39.374141 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2575/5053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:39 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1670 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:39.406762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-068854ac-2b2a-4994-a63f-c0e2f33e247c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.106181 Dec 25 21:22:39.410413 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2479/5054] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:39 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:39.579698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e358619e-b053-4a39-8196-c3cdd0f5722e tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4fc10fa60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:39.633628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:39.635974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:39.651476 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e358619e-b053-4a39-8196-c3cdd0f5722e tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/410a1fee-501b-4b5b-a50b-78d4eee23dec" status: 200 len: 344 microversion: 2.1 time: 0.075120 Dec 25 21:22:39.652552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2576/5055] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:22:39 2021] GET /compute/v2.1/os-volumes/410a1fee-501b-4b5b-a50b-78d4eee23dec => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:39.656015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.656717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.658477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.662781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:39.663098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.665132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:39.682642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.694709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.697479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:39.698140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:39.955017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:39.974858 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ee21861-dc73-4e4c-8d42-cafaff9dc51a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.351441 Dec 25 21:22:39.976676 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2480/5056] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:39 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:39.979159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:39.982174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-599a9e70-3b80-4e19-b686-df14d60f3d75 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f6067280>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.004701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a2c918c-9312-4829-8084-d8e51784be50 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.350423 Dec 25 21:22:40.006134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2577/5057] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:39 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:40.083739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-599a9e70-3b80-4e19-b686-df14d60f3d75 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.105804 Dec 25 21:22:40.084689 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2481/5058] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:22:39 2021] GET /compute/v2.1/os-volumes => generated 1014 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:40.100694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea01a2d6-8876-4671-9a5a-8a4b665ea1d5 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f6a76a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.185710 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea01a2d6-8876-4671-9a5a-8a4b665ea1d5 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.091603 Dec 25 21:22:40.191854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2578/5059] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 680 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:40.200737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d14d6e83-b228-46fb-aa1e-4a5e37fec5ba tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f623b310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.242100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:40.245088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:40.252088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:40.252774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:40.253592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:40.254039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:40.290642 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d14d6e83-b228-46fb-aa1e-4a5e37fec5ba tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1014 microversion: 2.1 time: 0.094906 Dec 25 21:22:40.291319 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2482/5060] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes => generated 1014 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:40.302981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c7a6b924-5370-4cf5-87c6-8d70aea910b6 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f6205820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.311648 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60793824-5b94-4b50-9bfa-1c546cc28b49 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.073015 Dec 25 21:22:40.312377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2579/5061] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:40 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:40.390837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.391674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:40.402164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:40.402681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:40.403718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:40.404361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:40.413258 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c7a6b924-5370-4cf5-87c6-8d70aea910b6 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.114107 Dec 25 21:22:40.417119 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2483/5062] 10.222.0.32 () {58 vars in 1166 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 346 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:22:40.424000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:40.425042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:40.435981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:40.436522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:40.437921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:40.438428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:40.488210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55b0eebb-d3aa-4f01-a15e-77bd62395b32 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.069518 Dec 25 21:22:40.488944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2484/5063] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:40 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:40.494577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de0168a8-6a15-4510-b985-6dd658db5581 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f6205dc0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.581073 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de0168a8-6a15-4510-b985-6dd658db5581 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 680 microversion: 2.1 time: 0.090853 Dec 25 21:22:40.581831 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2485/5064] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 680 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:40.593795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-959bc905-2b43-4c0a-9f2b-48dda58d75ef tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f67c0b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.650806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:40.664354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efc2c0ff-bb9e-44b7-a025-d3552c792192 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.277076 Dec 25 21:22:40.665563 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2580/5065] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:40.687001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-959bc905-2b43-4c0a-9f2b-48dda58d75ef tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.096956 Dec 25 21:22:40.687695 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2486/5066] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:40.705740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ddb54fa7-aae9-4963-865b-834a0b8ec223 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f719dc10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.785939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ddb54fa7-aae9-4963-865b-834a0b8ec223 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 346 microversion: 2.1 time: 0.084774 Dec 25 21:22:40.786793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2581/5067] 10.222.0.32 () {58 vars in 1187 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:40.799484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50dd568a-9b1c-4601-a669-3b1744251147 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] Calling method '.version_select at 0x7fa4f6032b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.905250 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50dd568a-9b1c-4601-a669-3b1744251147 tempest-VolumesTestJSON-2514202 tempest-VolumesTestJSON-2514202-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1014 microversion: 2.1 time: 0.109784 Dec 25 21:22:40.906083 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2487/5068] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1014 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:40.994442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:40.995075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:41.002404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.002866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.003664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.004105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.022909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:41.023917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:41.031859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.032321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.033248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.033700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.258850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:41.266673 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8e52307a-17e0-4ae9-adf7-80ae9cece351 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.278127 Dec 25 21:22:41.267252 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2582/5069] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:40 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:41.287696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:41.296636 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-caf05698-336f-43bc-8422-d732fed25ff1 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.277632 Dec 25 21:22:41.297275 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2488/5070] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:41 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:41.304233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9a4a903b-d88b-4d20-823c-e815248813dd req-4a081f9e-f9f4-4ce1-a431-44b709620718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9e9c480-9591-4be8-88a1-021df7ea5e04", "tag": "c6d03e4e-9c86-4a24-bd65-c4d2828b4a5d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:41.306232 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:41.306232 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:22:41.313686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9a4a903b-d88b-4d20-823c-e815248813dd req-4a081f9e-f9f4-4ce1-a431-44b709620718 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.314131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9a4a903b-d88b-4d20-823c-e815248813dd req-4a081f9e-f9f4-4ce1-a431-44b709620718 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.325169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9a4a903b-d88b-4d20-823c-e815248813dd req-4a081f9e-f9f4-4ce1-a431-44b709620718 service nova] Creating event network-changed:c6d03e4e-9c86-4a24-bd65-c4d2828b4a5d for instance a9e9c480-9591-4be8-88a1-021df7ea5e04 on nch2-master-1 Dec 25 21:22:41.330544 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9a4a903b-d88b-4d20-823c-e815248813dd req-4a081f9e-f9f4-4ce1-a431-44b709620718 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031822 Dec 25 21:22:41.331150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2489/5071] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:41.338554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:41.339547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:41.346739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.347524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.348317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.348749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.392851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1386847164", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": "none"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:41.395617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2a524e7-87fa-43d6-90b7-ef59e96d5d58 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062485 Dec 25 21:22:41.397889 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2490/5072] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:41 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:41.447520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:22:41.447985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:22:41.448487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:22:41.448943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:22:41.458870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:22:41.458870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.458870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.459462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.459906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.479344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Getting quotas for project ffbc622c02414a999ab1d4f3752e9693. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:22:41.484784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Getting quotas for user 4fc176dc819f44649134b4ce7dca957e and project ffbc622c02414a999ab1d4f3752e9693. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:22:41.500089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:22:41.501142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:41.502139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:41.502503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:22:41.510003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.510452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.511627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:41.512430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:41.559747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d2f67df-71cd-41c5-b178-9fdd009216b6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062508 Dec 25 21:22:41.560632 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2491/5073] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:41 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:41.667406 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae214ca4-53ce-4621-b80d-d89f182d589a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.399011 Dec 25 21:22:41.668023 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2583/5074] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:22:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 400 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:22:41.679194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23457865-e9ee-4610-9a91-d28417328983 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:41.680444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23457865-e9ee-4610-9a91-d28417328983 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:41.771725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23457865-e9ee-4610-9a91-d28417328983 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:41.780041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23457865-e9ee-4610-9a91-d28417328983 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:41.784485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23457865-e9ee-4610-9a91-d28417328983 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:41.784485 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23457865-e9ee-4610-9a91-d28417328983 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1278 microversion: 2.57 time: 0.108563 Dec 25 21:22:41.784485 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2492/5075] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:41 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:42.283925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:42.284538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:42.291227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.291930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.292741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.293205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.313631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:42.314363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:42.321782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.331050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.331050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.331050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.481700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:42.490306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c80c6813-af23-4278-91a8-bc8ffac5bf9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.210611 Dec 25 21:22:42.491005 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2584/5076] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:42 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:42.496106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:42.497636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:42.503302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.503759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.504547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.505018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.509562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:42.518418 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e3fc8ab-1c8a-4a80-86a8-7324e4ee6972 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.208598 Dec 25 21:22:42.523222 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2493/5077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:42 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:42.545264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2024ff9-1355-4a67-b561-c5df23663936 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052966 Dec 25 21:22:42.545898 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2585/5078] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:42 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:42.571896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:42.572916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:42.578891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.579338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.580108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.580581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.622502 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7443fa3e-5175-48fe-898d-335b83a2ab4b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.054468 Dec 25 21:22:42.623156 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2494/5079] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:42 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:42.801527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:42.802234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:42.809364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.809871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.810663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:42.811101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:42.875205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:42.884497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:42.890433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:42.890433 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-395641a2-cb12-43d8-8005-ff62bf085123 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1282 microversion: 2.57 time: 0.089920 Dec 25 21:22:42.890433 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2586/5080] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:42 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1282 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:43.025210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:43.026213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:43.033274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.034063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.034546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.034981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.058792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'flavor' on Instance uuid 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:22:43.383851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9eaf6ac-60d1-45b3-b337-741fd395b311 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 200 len: 32 microversion: 2.1 time: 0.362624 Dec 25 21:22:43.384500 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2495/5081] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:43 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 32 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:22:43.393265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:43.393907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:43.400839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.401423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.402220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.402662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.508777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:43.509499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:43.517692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.518162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.520415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.520863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.893452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:43.903222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7fc84ed-a295-46ea-abf4-cc145e4c768d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.513605 Dec 25 21:22:43.914367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2587/5082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:43 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:43.919786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:43.920398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:43.926442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.927220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:43.927667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:43.928103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.030064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:44.037979 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b857b88-a39e-45c4-a809-bb95fd53300e tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.533745 Dec 25 21:22:44.038551 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2496/5083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:43 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:44.043814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:44.044745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:44.051733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.052183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.053003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.053442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.092821 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0256494-d817-4add-9a69-78033fd9666e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.052554 Dec 25 21:22:44.093729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2497/5084] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:44 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:44.100843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:44.102490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:44.113871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.113871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.113871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.113871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.153458 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a35c2fed-008a-46bf-97a8-6e5570e6cd0f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058292 Dec 25 21:22:44.155197 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2498/5085] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:44 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:44.161295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:44.162538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:44.171736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.177361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.177361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.177361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.187945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:44.195350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79a4a758-e33c-4b6d-8a6e-2450067ee511 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.279575 Dec 25 21:22:44.195931 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2588/5086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:43 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:44.261601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:44.269893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:44.271405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:44.272535 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-899b5682-8b27-4cd8-9593-3d55725b1c5d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1338 microversion: 2.57 time: 0.116247 Dec 25 21:22:44.273669 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2499/5087] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:44 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1338 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:44.920035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:44.920599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:44.927008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.927438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:44.928222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:44.928652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.055897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:45.056512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:45.063514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.063969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.064773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.065243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.073887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:45.081265 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49aab8d9-21c8-4098-a7a8-a9ef0fb616f6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.165561 Dec 25 21:22:45.081850 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2589/5088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:44 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:45.103368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:45.104345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:45.110361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.110818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.111605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.112035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.152969 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bdaf391e-fc0a-4875-9508-b6957ae5db63 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.053106 Dec 25 21:22:45.156577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2590/5089] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:45 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:45.165253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:45.166615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:45.173617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.174059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.174842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.175272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.204586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:45.212359 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35439b4a-71eb-4cef-a6c1-f51db767292f tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.160759 Dec 25 21:22:45.219664 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2500/5090] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:45 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:45.219664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:45.219910 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eefa2d6b-16e4-4abb-822f-2541e428dacd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056343 Dec 25 21:22:45.220012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:45.220103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2591/5091] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:45 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:45.224623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.225107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.225883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.226829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.292899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:45.293798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:45.300783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.301281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.302048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:45.302479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:45.386025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:45.393658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:45.397560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:45.397560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:45.397560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f5ac372b-f938-4ed7-be90-c020d7ace83f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1336 microversion: 2.57 time: 0.109022 Dec 25 21:22:45.400044 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2592/5092] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:45 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1336 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:45.401815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-70a02e33-4450-4f5e-a77b-ca1560a780fb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.187838 Dec 25 21:22:45.402558 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2501/5093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:45 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:46.097571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:46.098294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:46.105278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.105744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.106584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.107024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.163756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:46.164669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:46.172025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.172505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.173338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.173778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.214869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e40dc11f-62db-480f-9863-fc2256423286 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054622 Dec 25 21:22:46.218491 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2502/5094] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:46 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:46.231222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:46.232232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:46.239389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.240220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.241249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.241694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.252173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:46.263134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef8696db-9671-4ccf-83e2-4666dea961b7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.169320 Dec 25 21:22:46.263987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2593/5095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:46 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:46.269405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:46.270364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:46.277789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.278242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.279100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.279536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.290201 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2ae8b7d-dbe3-4fac-bec5-857e1ccd597b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.065039 Dec 25 21:22:46.292254 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2503/5096] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:46 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:46.418223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:46.419498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:46.424120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:46.426170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.426624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.427421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.427857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.433392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06e78f61-983c-4b87-b85b-6c3bbe225683 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.168150 Dec 25 21:22:46.434045 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2594/5097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:46 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:46.439019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:46.445685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:46.446570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.447088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.447937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:46.448443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:46.495723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:46.504399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:46.505940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:46.507065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2022b90a-57f8-4649-80d1-edbbc8f104e7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1336 microversion: 2.57 time: 0.094974 Dec 25 21:22:46.508216 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2504/5098] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:46 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:46.598756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:46.606511 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ffbb4d79-1ba4-47ad-964f-ffb1469ea47f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.171429 Dec 25 21:22:46.607129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2595/5099] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:46 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:47.226186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:47.227098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.235993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.235993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.235993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.235993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.279989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:47.280634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.281341 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74d728fc-65ea-48e2-aecd-c50e04e8458a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059032 Dec 25 21:22:47.282178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2505/5100] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:47 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:47.287556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.288012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.288821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.289285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.306194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:47.312428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.314113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.314572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.315370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.315814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.360863 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-15aafe08-ebef-4808-ad7a-32e5966b1dfc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.059574 Dec 25 21:22:47.364789 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2506/5101] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:47 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:47.423352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:47.431349 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff96d278-2fd2-4caa-81d1-516d9067dfa6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.155122 Dec 25 21:22:47.439788 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2596/5102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:47 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:47.450835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:47.452016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.459163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.459656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.460452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.460909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.526494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:47.527131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.533462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.533983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.534771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.535208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.609179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:47.618125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:47.619582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:47.624765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9fc9831e-f6aa-49b6-a060-2b469d32a860 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1357 microversion: 2.57 time: 0.098148 Dec 25 21:22:47.624765 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2597/5103] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:47 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1357 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:47.625999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:47.626600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.631262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:47.633053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.633669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.634805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.635241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.639501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b90db2bb-e362-4ac1-949d-cf085b9dd1eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.192601 Dec 25 21:22:47.640087 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2507/5104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:47 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:47.644958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:47.646500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.652705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.653412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.654379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.655007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.737510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:22:47.737942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:22:47.738432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:22:47.738832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:22:47.739714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:22:47.772412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:47.780179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ef7983e-3d7e-47f3-848b-d689fb1a6fff tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.157786 Dec 25 21:22:47.780749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2598/5105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:47 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:47.987639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:47.993741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.994201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:47.995003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:47.995446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.022482 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a141348-6250-4919-8f53-0c552d27cca8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "POST /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2/action" status: 202 len: 1138 microversion: 2.57 time: 0.381248 Dec 25 21:22:48.023581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2508/5106] 10.222.0.32 () {62 vars in 1319 bytes} [Sat Dec 25 21:22:47 2021] POST /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2/action => generated 1138 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Dec 25 21:22:48.039393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:48.039943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:48.046371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.046827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.047602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.048037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.112210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:48.120117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:48.121652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:48.122811 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4bfdbbc9-1adc-42b6-8488-fdc2a3aa097e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.088127 Dec 25 21:22:48.123371 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2599/5107] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:48 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:48.292929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:48.293927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:48.300827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.301366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.302511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.303046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.342324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ff9807b-bce2-4dcd-b73f-b297b5ec3c4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.053422 Dec 25 21:22:48.342987 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2509/5108] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:48 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:48.384693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:48.385745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:48.396346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.397392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.397608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.398046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.443029 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-582acf3c-a01d-49b1-bb2a-2e03197f232c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.074709 Dec 25 21:22:48.447606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2600/5109] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:48 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:48.455040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:48.455040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:48.456247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.456705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.457541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.457980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.537377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-fd0daca6-5a98-4f53-9116-ea807629ab63 req-cb95f2dc-9ba1-4975-8fe1-5e126c2e34c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9c480-9591-4be8-88a1-021df7ea5e04", "name": "network-vif-plugged", "status": "completed", "tag": "c6d03e4e-9c86-4a24-bd65-c4d2828b4a5d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:48.538856 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:48.538856 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:22:48.560814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fd0daca6-5a98-4f53-9116-ea807629ab63 req-cb95f2dc-9ba1-4975-8fe1-5e126c2e34c6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.561299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-fd0daca6-5a98-4f53-9116-ea807629ab63 req-cb95f2dc-9ba1-4975-8fe1-5e126c2e34c6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.572999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-fd0daca6-5a98-4f53-9116-ea807629ab63 req-cb95f2dc-9ba1-4975-8fe1-5e126c2e34c6 service nova] Creating event network-vif-plugged:c6d03e4e-9c86-4a24-bd65-c4d2828b4a5d for instance a9e9c480-9591-4be8-88a1-021df7ea5e04 on nch2-master-1 Dec 25 21:22:48.578280 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-fd0daca6-5a98-4f53-9116-ea807629ab63 req-cb95f2dc-9ba1-4975-8fe1-5e126c2e34c6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114163 Dec 25 21:22:48.580682 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2601/5110] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:22:48.615952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:48.625253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87281ecb-a34c-4b96-a03b-7007aab78c48 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.181367 Dec 25 21:22:48.632475 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2510/5111] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:48 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:48.656761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:48.661130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:48.663873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.664326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.665168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.665609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.797845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:48.798521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:48.805224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.806182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.806974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:48.807412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:48.827153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:48.834583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-558e73fa-9e3f-410a-b659-8002d63afef7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.182548 Dec 25 21:22:48.835154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2602/5112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:48 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:48.938957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:48.946818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81cb3bce-5350-45fb-90cc-075eddb3fdc4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1530 microversion: 2.1 time: 0.152697 Dec 25 21:22:48.947387 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2511/5113] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:48 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1530 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:49.141257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:49.141795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:49.148381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.148833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.149822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.150260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.212988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:49.220969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:49.222537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:49.223701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03be9808-0ee0-48ca-9f3d-c9ae1f3dbeed tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.086372 Dec 25 21:22:49.224272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2603/5114] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:49 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:49.354573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:49.355562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:49.362288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.362767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.363540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.363971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.406210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06e169ca-ba63-4e25-8f90-0eae83ee4b18 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055759 Dec 25 21:22:49.406903 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2512/5115] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:49 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:49.455313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:49.456306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:49.462772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.463227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.464022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.464462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.515250 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c1d58d7b-d742-42ec-a196-87bf2264c723 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.063524 Dec 25 21:22:49.516027 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2604/5116] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:49 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:49.650169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:49.650819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:49.657892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.658348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.659134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.659579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.808698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:49.817055 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e4a4ef6-f868-4e20-a411-bc7c675dbc16 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.171528 Dec 25 21:22:49.817684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2513/5117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:49 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:49.851764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:49.852506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:49.867495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.867965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.868799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.869301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.964702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:49.966243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:49.972923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.973644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:49.974803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:49.975409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.006789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:50.015326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8545512-4a0d-4af7-8cf4-ad899f361b6c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1317 microversion: 2.1 time: 0.167736 Dec 25 21:22:50.015921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2605/5118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:49 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:50.120046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:50.127623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f40d6531-fd03-4ccd-a696-3f62b05bbe17 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1530 microversion: 2.1 time: 0.167333 Dec 25 21:22:50.128182 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2514/5119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:49 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1530 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:50.242869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:50.243490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:50.249926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.250363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.251194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.251629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.318987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:50.331764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:50.333440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:50.335987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-445c5083-9729-4d79-928b-e0cb3cdd5428 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.095814 Dec 25 21:22:50.335987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2606/5120] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:50 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:50.418634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:50.419676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:50.426445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.426899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.427682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.428154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.468166 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d313fce2-afd7-4c30-83a5-16e2fec3b776 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.053919 Dec 25 21:22:50.468857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2515/5121] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:50 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:50.527538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:50.528547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:50.535375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.535828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.537027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.537472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.581002 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04352197-6ce0-4371-baed-8a0b2328e562 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.057894 Dec 25 21:22:50.584901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2607/5122] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:50 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:50.835426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:50.836333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:50.843563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.844098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:50.845022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:50.845458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.039413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:51.039413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:51.047133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.047987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.048994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.049436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.051134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:51.063419 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b35290a-07a7-4d5e-9618-c1dceb988c84 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.232141 Dec 25 21:22:51.074941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2516/5123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:50 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:51.157266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:51.157266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:51.161358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.162070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.163824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.164466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.225306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:51.233384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a1e28d4-da9d-49e9-a69a-8e3cfe98294d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1506 microversion: 2.1 time: 0.205405 Dec 25 21:22:51.244836 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2608/5124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:51 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1506 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:51.355142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:51.356830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:51.358356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:51.367621 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fef04d05-ea3f-4561-ae34-3f5773b36d40 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.224529 Dec 25 21:22:51.369144 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2517/5125] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:51 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:51.372617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.373347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.375604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.376061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.479532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:51.480449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:51.496366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.497988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.497988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.498252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.527239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:51.538789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:51.542192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:51.556839 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f084961-85e7-4973-9a36-fadf1d24a094 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.198078 Dec 25 21:22:51.556839 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2609/5126] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:51 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:22:51.592487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:51.593498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:51.600416 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12e3018d-b813-43fd-bdbc-a3b3c3ad84bd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.124901 Dec 25 21:22:51.604538 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2518/5127] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:51 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:51.605868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.606435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.607337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.608005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.650334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5ca3b7e7-c52e-40a6-bee6-b1a57025c2e1 req-37b2a34f-b2f9-421f-8ba4-187a07bfa717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336c6856-ca33-4291-b38f-03e7f7a5db93", "name": "network-vif-plugged", "status": "completed", "tag": "6dcde4f1-b084-49e9-9b96-ae184bf1c495"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:51.653081 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:22:51.653081 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:22:51.663002 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2906c8cd-c774-4bf2-a178-872ecf79ecd5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.074659 Dec 25 21:22:51.664494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5ca3b7e7-c52e-40a6-bee6-b1a57025c2e1 req-37b2a34f-b2f9-421f-8ba4-187a07bfa717 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:51.665193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5ca3b7e7-c52e-40a6-bee6-b1a57025c2e1 req-37b2a34f-b2f9-421f-8ba4-187a07bfa717 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:51.667730 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2610/5128] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:51 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:51.678997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5ca3b7e7-c52e-40a6-bee6-b1a57025c2e1 req-37b2a34f-b2f9-421f-8ba4-187a07bfa717 service nova] Creating event network-vif-plugged:6dcde4f1-b084-49e9-9b96-ae184bf1c495 for instance 336c6856-ca33-4291-b38f-03e7f7a5db93 on nch1-master-1 Dec 25 21:22:51.685541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5ca3b7e7-c52e-40a6-bee6-b1a57025c2e1 req-37b2a34f-b2f9-421f-8ba4-187a07bfa717 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041419 Dec 25 21:22:51.686349 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2519/5129] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:22:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:52.082376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:52.083385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:52.091293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.091983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.093002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.093615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.286229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:52.295676 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b6f406d3-6347-4053-974d-4f376a8d5b93 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.218702 Dec 25 21:22:52.297195 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2611/5130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:52 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:52.386063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:52.387075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:52.396924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.396924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.396924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.396924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.570966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:52.572133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:52.584438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:52.597067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.606541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e84ea010-58b3-40bd-9c7e-b1d8e0349c54 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.223946 Dec 25 21:22:52.606541 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2520/5131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:52 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:52.606745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.609152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.609623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.616102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:52.617052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:52.624657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.625134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.625933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.626371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.692806 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f864087-5d55-46c7-9edf-7e1fbeef23ca tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.083786 Dec 25 21:22:52.693767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2521/5132] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:52 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:52.703333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:52.703811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:52.705157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:52.714767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.716841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.716841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:52.717197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:52.717312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:52.719494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:52.721528 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4935f53-7b36-4e6a-9f28-9f1be82bb417 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.156478 Dec 25 21:22:52.722234 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2612/5133] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:52 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:52.783818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dddd7ae8-8ab2-466e-ba75-84e8fed7e829 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.088129 Dec 25 21:22:52.787677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2522/5134] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:52 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:53.312343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:53.313096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:53.320764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.323404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.323404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.323404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.488062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:53.496597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39ccf734-15f1-4242-938a-5cac92fab2d1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.188893 Dec 25 21:22:53.509868 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2613/5135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:53 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:53.623683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:53.624384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:53.638419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.638885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.639694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.640142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.705310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:53.706238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:53.716967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.717437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.718289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.718716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.770697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a219012b-ee52-420b-979f-4f97f86b6727 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.068915 Dec 25 21:22:53.771668 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2614/5136] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:53 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:53.777053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:53.777764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:53.785493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.792099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.792099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.792099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.832547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:53.843618 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f1f383a-d43a-4fc7-91ca-7519595a44c6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.223701 Dec 25 21:22:53.844528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2523/5137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:53 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:53.849282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:53.850259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:53.857233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.857809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.858704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:53.859645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:53.891105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:53.900020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:53.901591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:53.902775 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-933073c6-1dee-4930-b8cd-59fe82866477 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.130168 Dec 25 21:22:53.903341 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2615/5138] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:53 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:53.908932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-759a9984-e3b4-404f-a985-767d9f50df2f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062976 Dec 25 21:22:53.909905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2524/5139] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:53 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:54.332529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "115961e3-4417-4431-86e4-91e13094bf9d"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:54.334289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:54.342753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.343327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.344255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.344756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.518322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:54.519410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:54.527790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.529159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.530053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.530593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.759494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:54.768307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58c5224c-7803-4da1-bd88-121c3b515aaa tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.256255 Dec 25 21:22:54.768904 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2525/5140] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:54 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:54.783779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:54.784766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:54.791865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.792385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.793244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.793667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.840207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b9f80a8-37ce-4dd3-959b-3733414064d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.060115 Dec 25 21:22:54.841582 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2526/5141] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:54 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:54.863259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:54.870173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:54.877520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.877972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:54.879030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:54.879464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.063303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:55.073247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f22a64a9-eea5-4d7f-b1b4-b83d4787038b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.213825 Dec 25 21:22:55.078916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2527/5142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:54 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:55.078916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:55.079331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:55.085844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.086312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.087695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.088141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.141105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfc795f9-b7e9-446e-9310-0f05c4df4b23 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.065929 Dec 25 21:22:55.144912 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2528/5143] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:55 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:55.147573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:55.148279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:55.156394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.156801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.157576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.158021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.173416 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-081b69f1-5e66-4195-9395-727fc4c8b467 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "POST /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844733 Dec 25 21:22:55.174030 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2616/5144] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:22:54 2021] POST /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments => generated 194 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:22:55.238653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:55.251606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:55.252370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:55.253736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b38391e-a50b-4bc4-805d-fcc0f1e7b8f6 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.110522 Dec 25 21:22:55.254680 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2529/5145] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:55 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:55.786027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:55.786556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:55.799205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.802171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.803210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.806224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.851629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:55.855276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:55.870064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.871809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.881674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:55.882148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:55.960646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8a2e208-ebb0-4e93-8728-4697f2598f81 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.112583 Dec 25 21:22:55.970252 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2530/5146] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:55 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:56.092674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:56.093589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:56.104589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.105324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.106132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.106625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.265125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:56.276318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-661662e0-3b91-492f-ae02-7adaaa666f25 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.494428 Dec 25 21:22:56.280758 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2617/5147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:55 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:56.296248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:56.296248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:56.302011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.302666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.303488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.303930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.432665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:56.441064 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-755b1ddb-2238-4684-8e1a-18124a5ffc6f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.353367 Dec 25 21:22:56.442899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2531/5148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:56 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:56.448283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:56.448923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:56.455270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.455745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.456574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.457029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.470506 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3776ec45-86a1-4bfe-b57e-af6cc959ccbb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.188418 Dec 25 21:22:56.472601 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2618/5149] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:56 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:56.535140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:56.545435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:56.548551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:56.550002 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21b1b13c-221d-44fb-a230-c398fa8312c4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.105749 Dec 25 21:22:56.551334 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2532/5150] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:56 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:56.979092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:56.984635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:56.988935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.989697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:56.990680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:56.991310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.045526 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dfa9ba3b-afa9-4f29-a46a-9bdb76ad01f2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.071452 Dec 25 21:22:57.047362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2619/5151] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:56 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:57.299009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:57.299833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:57.313994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.387260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.387260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.387260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.470756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:57.471581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:57.491330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.492419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.494169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.494943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.503686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:57.512500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6b0c573-ebaf-4a5b-a8cd-409ab5569b1a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.219245 Dec 25 21:22:57.513245 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2533/5152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:57 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:57.517765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:57.518748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:57.525299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.525757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.527998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.527998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.576646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-490d7e66-0e4e-4399-939b-5e2e6f60b8b8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062124 Dec 25 21:22:57.580545 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2534/5153] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:57 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:57.582296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:57.583002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:57.590495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.590955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.591755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:57.592202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:57.672924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:57.678874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:57.682584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:57.684168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:57.685534 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a373e148-c8d4-453a-beb8-541710273760 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.107083 Dec 25 21:22:57.686092 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2535/5154] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:57 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:57.687713 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6ec56caf-f6d2-4949-876b-b57033696228 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.228898 Dec 25 21:22:57.688283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2620/5155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:57 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:58.058400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:58.059447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.068851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.069333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.070143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.070580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.115939 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e5a6d4cd-53df-4d00-919c-0b630b5eefd2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.061826 Dec 25 21:22:58.117050 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2536/5156] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:58 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:22:58.530014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:58.530762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.538296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.538981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.540571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.541353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.592136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:58.593845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.604131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.604591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.605466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.605915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.663574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ba67e47-d7da-4cd7-bffe-1326e058f036 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.079012 Dec 25 21:22:58.665257 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2537/5157] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:58 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:22:58.707421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:58.708615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.709242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:58.716944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.717633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.718649 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e9d822f5-73cb-42d3-bf81-c21fbbe83de7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1501 microversion: 2.1 time: 0.193654 Dec 25 21:22:58.719028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.719243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2621/5158] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:58 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1501 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:58.719791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.744090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:58.744915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.752108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.756150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.756150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.756150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.827530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:58.835854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:58.838164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:58.839385 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2c60ffd6-363b-408e-9c7d-892a4a032a9c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.101420 Dec 25 21:22:58.853055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2622/5159] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:58 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:22:58.859747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc7c39fd-b000-49c4-9c3e-a1b1f848e64b"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:58.861137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.868305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.869118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.870163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.870648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.897996 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Cannot 'attach_volume' instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 while it is in vm_state rescued Dec 25 21:22:58.902441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 409 to user: Cannot 'attach_volume' instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 while it is in vm_state rescued {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:22:58.902441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24c647af-9eb5-4c1e-bbab-08892751f7a9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046324 Dec 25 21:22:58.902441 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2623/5160] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:22:58 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:22:58.910149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:58.910695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:58.918260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.918789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.919665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:58.920114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:58.920259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:58.928754 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cc462f0-ba02-4603-8364-576cbfe0f006 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.226170 Dec 25 21:22:58.941090 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2538/5161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:58 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:22:59.128695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:59.129930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:59.137305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.137761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.138617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.139069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.159353 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c14bd445-75c2-4890-b91a-aa53b6d1974c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 202 len: 0 microversion: 2.1 time: 0.252477 Dec 25 21:22:59.160450 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2624/5162] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:58 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:59.179524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:59.179524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:59.183604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.189039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.190827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.191537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.207504 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7de3b41-38d9-4a5c-8768-52a469a271a2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.082693 Dec 25 21:22:59.208834 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2539/5163] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:22:59 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:22:59.405249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:59.422985 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7006006-6991-4343-9c7d-9c2afaa0e88b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1509 microversion: 2.1 time: 0.257349 Dec 25 21:22:59.434236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2625/5164] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:59 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1509 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:22:59.676947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:22:59.678301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:59.697953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.697953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.697953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.697953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.767677 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff76a93e-bbfa-4a75-bfc4-128d0256c09b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.094651 Dec 25 21:22:59.768807 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2540/5165] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:22:59 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:22:59.862450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:59.863282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:59.872788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.875506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.877108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.880200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.959941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:59.965096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:22:59.969122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:22:59.972320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:59.977792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.978707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.983014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:22:59.986831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:22:59.989008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:22:59.993594 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f391f6dd-2217-41d6-93de-db1be822e9e8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.132301 Dec 25 21:22:59.993594 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2626/5166] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:22:59 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:00.170577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:00.178259 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da142020-eeb8-49d8-b1d2-bd505c3e2ba3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.224438 Dec 25 21:23:00.193732 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2541/5167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:22:59 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:00.219830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:00.221011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:00.230712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.231163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.231960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.232394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.291689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a42d3016-6032-406e-b611-8568a42a51c0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.075202 Dec 25 21:23:00.297358 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2627/5168] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:00 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:00.440741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:00.441774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:00.452928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.453630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.454871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.455549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.650138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:00.656442 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31a6334a-dc25-4e17-a74c-062cb0e24870 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1509 microversion: 2.1 time: 0.220424 Dec 25 21:23:00.658123 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2542/5169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:00 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:00.782422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:00.783456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:00.792627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.793049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.794785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.795262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.827098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:00.827711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:00.835108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.835570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.836530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:00.837019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:00.879164 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2738cf3-4d20-4314-81bc-062729c2827e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.100929 Dec 25 21:23:00.884213 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2628/5170] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:00.926527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lazy-loading 'services' on Instance uuid a9e9c480-9591-4be8-88a1-021df7ea5e04 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:01.011054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:01.011678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:01.018855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.019336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.020201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.020649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.097141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:01.106293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:01.107823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:01.112773 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48285690-2ead-4396-9f94-4dea251fb5b7 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.103377 Dec 25 21:23:01.112773 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2629/5171] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:01 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:23:01.200445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:01.201122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:01.207932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.210340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.210340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.210340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.298963 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a39b1a99-f0e6-4537-b901-6ae27bc26fe7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments/115961e3-4417-4431-86e4-91e13094bf9d" status: 202 len: 0 microversion: 2.1 time: 0.475760 Dec 25 21:23:01.300356 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2543/5172] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:23:00 2021] DELETE /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments/115961e3-4417-4431-86e4-91e13094bf9d => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:01.310677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:01.312037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:01.321671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.326942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.328070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.328535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.379296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:01.380037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4893c134-116f-4c93-8bd1-911f364c8b51 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.075405 Dec 25 21:23:01.381312 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2544/5173] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:01 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:01.387803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:01.388792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:01.392355 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb392656-712c-4543-ab57-b807d8241ffb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.195740 Dec 25 21:23:01.402791 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2630/5174] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:01 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:01.418064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.418511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.419318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.419751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.458461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de2b6d4c-3bd3-43f5-a53e-ebb0014a45eb tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075687 Dec 25 21:23:01.459361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2545/5175] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:23:01 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:01.695510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:01.696861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:01.712650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.713130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.713937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.714716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.893549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:01.895692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:01.905533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.906274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.907291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:01.907961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:01.919459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:01.927718 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e383e7ef-c638-4ba0-a1ba-82100618151d tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1509 microversion: 2.1 time: 0.248261 Dec 25 21:23:01.928510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2631/5176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:01 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1509 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:01.981075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-340a8201-be48-4d9e-a21f-cbc143a7f0fb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.089385 Dec 25 21:23:01.981075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2546/5177] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:01 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:02.131296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:02.132015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:02.142988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.143443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.144298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.144960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.220559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:02.229855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:02.231569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:02.232755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-656a44be-0e23-4cef-b394-76a0a26653d8 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.105552 Dec 25 21:23:02.233451 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2632/5178] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:02 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:02.392598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:02.393725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:02.401651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.402022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.402819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.403345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.410935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:02.411745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:02.421247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.421833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.423004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.423545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.456446 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-728a1fa6-a389-4a98-8adc-2e409ca5d89a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.067903 Dec 25 21:23:02.457230 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2547/5179] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:02 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:02.471086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:02.472391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:02.486439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.486439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.486439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.486439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.514044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19feab95-9dcc-4ed9-8acc-158847ef7a36 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046966 Dec 25 21:23:02.514967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2548/5180] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:23:02 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:23:02.584668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:02.593258 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8bb44d2a-550b-42df-8e13-82a4bffad557 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1525 microversion: 2.1 time: 0.186482 Dec 25 21:23:02.593885 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2633/5181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:02 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1525 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:02.946991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:02.946991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:02.955620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.956075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.957249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.957711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:02.991375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:02.992744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:02.999467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:02.999916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.000740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.001207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.047527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b5f057a-a29a-4f66-9657-2e23d797442b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060013 Dec 25 21:23:03.048312 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2634/5182] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:02 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:03.128124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:03.136389 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b554cb20-ff42-4045-a7d1-e8e261bbe621 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1515 microversion: 2.1 time: 0.195441 Dec 25 21:23:03.137054 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2549/5183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:02 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:03.252284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:03.253002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:03.260100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.260693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.261570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.262005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.344025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:03.353072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:03.354696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:03.355966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95b220cb-447a-4201-b28d-af5d3c8124a3 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.108072 Dec 25 21:23:03.356723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2635/5184] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:03 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:03.469948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:03.470895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:03.479312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.486829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.486829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.486829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.522320 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e110dba-827f-4bd7-9aef-3103aa434c25 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057507 Dec 25 21:23:03.528422 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2550/5185] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:03 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:03.610212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:03.613194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:03.617259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.618241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.619081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:03.619464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:03.757980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:03.772723 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94ddc158-7b7d-4f20-bf23-a528a61a1ec6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1507 microversion: 2.1 time: 0.161030 Dec 25 21:23:03.772723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2636/5186] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:03 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:04.059920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:04.060924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:04.067853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.068298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.069108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.069563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.116705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6fba200-a406-4932-b5c8-c292710b1414 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060666 Dec 25 21:23:04.118649 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2551/5187] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:04 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:04.374133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:04.374971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:04.381809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.382263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.383112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.383513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.449863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:04.457846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:04.462252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:04.462252 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e886f6a-7ad0-4976-9235-a9be0af6373c tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.090275 Dec 25 21:23:04.462252 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2637/5188] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:04 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:04.534926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:04.535924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:04.544260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.544755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.545572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.546016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.585457 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d57a42d3-812d-4038-9733-895d9754be45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054471 Dec 25 21:23:04.586614 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2552/5189] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:04 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:04.788251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:04.788792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:04.795178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.795627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.796412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:04.796955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:04.929588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:04.938103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4b24add-b842-4d4a-bb54-cad4c2a9b765 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1507 microversion: 2.1 time: 0.153659 Dec 25 21:23:04.938720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2638/5190] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:04 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:05.129636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:05.130554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:05.137745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.138199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.138984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.139424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.184342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb758dd5-ae16-4824-91b9-69adebbe6462 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058705 Dec 25 21:23:05.185034 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2553/5191] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:05 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:05.477843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:05.478460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:05.484840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.485331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.486117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.486560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.552745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:05.561567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:05.563187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:05.566993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf368a39-dcc8-4529-885f-452c43f9f72d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.090413 Dec 25 21:23:05.569484 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2639/5192] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:05 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:05.597665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:05.598689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:05.606573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.607030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.607819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.608260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.651093 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc1f2d45-7293-4010-938e-4cdbbcf40033 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.057560 Dec 25 21:23:05.651755 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2554/5193] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:05 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:05.811222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:05.811918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:05.817909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.818357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.819127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.819558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.956121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:05.964862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9841e95-e0f1-4cec-8402-fbc70c68d294 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1515 microversion: 2.1 time: 0.157554 Dec 25 21:23:05.966127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:05.966858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:05.968544 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2640/5194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:05 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:05.974237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.974568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.975384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.975829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.982366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "240601d5-5803-4db4-ad87-ded28e2eb84d"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:05.983484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:05.989823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.990285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:05.991081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:05.991525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.122224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:06.129880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e658a97-f5f7-4f12-865d-9c6a3f8842a9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1510 microversion: 2.1 time: 0.178107 Dec 25 21:23:06.130588 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2555/5195] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:05 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:06.146889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:06.147553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.154532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.154987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.155784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.156250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.296781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:06.304415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-91d9683c-3a1a-4d4d-b9cc-60f1c2e3d722 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1510 microversion: 2.1 time: 0.161328 Dec 25 21:23:06.317399 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2556/5196] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:06 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:06.317399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:06.317399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.318428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.318888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.319764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.320127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.369799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4e13a93-99cb-454b-8175-7ce687b66625 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062046 Dec 25 21:23:06.373783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2557/5197] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:06 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:06.375362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:06.376082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.383012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.383459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.384254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.384684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.409416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lazy-loading 'flavor' on Instance uuid 336c6856-ca33-4291-b38f-03e7f7a5db93 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:06.423858 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'shelve' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state shelved_offloaded Dec 25 21:23:06.424461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'shelve' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state shelved_offloaded {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:06.425338 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b30a32c-f586-4f97-abf4-51c402e2aaee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 155 microversion: 2.1 time: 0.053772 Dec 25 21:23:06.425911 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2558/5198] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:06 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 155 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:06.434518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:06.435080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.441027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.441477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.442257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.442697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.692470 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-96bf778d-05d9-470b-b71a-0b064c56069c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 202 len: 0 microversion: 2.1 time: 0.261281 Dec 25 21:23:06.693231 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2559/5199] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:06 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:06.698206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:06.698890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.710492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.710492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.710492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.710492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.779695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:06.787445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:06.790799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:06.790799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f34df938-b545-4edf-a75f-7d3ffd01ea47 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.095973 Dec 25 21:23:06.790994 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2560/5200] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:06 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:06.795261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:06.796222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.802123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.802581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.803378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.803823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.844050 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b840315-de7d-42a4-b32a-a55dbb15dd7a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.051871 Dec 25 21:23:06.844704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2561/5201] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:06 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:06.849520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:06.850214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:06.858133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.858592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.859938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:06.860276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:06.861386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55a62957-62b5-4b07-8d17-840b2de10ccc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.883090 Dec 25 21:23:06.864790 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2641/5202] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:23:05 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments => generated 194 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:23:07.013839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:07.022362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f48d79b-6215-4af5-8db6-8144fad87694 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1458 microversion: 2.1 time: 0.176458 Dec 25 21:23:07.028212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2562/5203] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:06 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1458 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:07.383013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:07.384658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:07.393735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.393735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.393735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.393735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.436222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-91be2b1d-c22a-41bd-b4aa-63f63ab1de08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.057720 Dec 25 21:23:07.437551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2642/5204] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:07 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:07.669482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0ad584d3-4e8b-4b5e-9fcc-7d419d1aa214 req-ba79eda2-d8fd-487b-9732-892ec73f860d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336c6856-ca33-4291-b38f-03e7f7a5db93", "name": "network-vif-unplugged", "status": "completed", "tag": "6dcde4f1-b084-49e9-9b96-ae184bf1c495"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:07.671484 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:07.671484 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:07.679377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0ad584d3-4e8b-4b5e-9fcc-7d419d1aa214 req-ba79eda2-d8fd-487b-9732-892ec73f860d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.680664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0ad584d3-4e8b-4b5e-9fcc-7d419d1aa214 req-ba79eda2-d8fd-487b-9732-892ec73f860d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.690107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.server_external_events [req-0ad584d3-4e8b-4b5e-9fcc-7d419d1aa214 req-ba79eda2-d8fd-487b-9732-892ec73f860d service nova] Unable to find a host for instance 336c6856-ca33-4291-b38f-03e7f7a5db93. Dropping event network-vif-unplugged {{(pid=136547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 21:23:07.691001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0ad584d3-4e8b-4b5e-9fcc-7d419d1aa214 req-ba79eda2-d8fd-487b-9732-892ec73f860d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026301 Dec 25 21:23:07.691568 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2563/5205] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:07 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 25 21:23:07.809675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:07.810446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:07.818028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.818490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.819291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.819733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.862306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:07.866808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:07.877978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.882031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.883173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:07.884146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:07.904790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:07.913338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:07.928989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:07.928989 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4630fbc9-475d-45a2-bfaa-d7383a258056 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.111056 Dec 25 21:23:07.928989 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2643/5206] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:07 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:07.936334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbb4a139-a2d5-4ee8-9469-d7c93a196ea4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.083957 Dec 25 21:23:07.937102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2564/5207] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:07 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:08.039891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:08.040791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:08.047384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.047838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.048631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.049110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.195550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:08.204017 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d29d016c-8894-42e1-8ef3-f0a716eb6b83 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1458 microversion: 2.1 time: 0.168351 Dec 25 21:23:08.204832 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2644/5208] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:08 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:08.448631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:08.449681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:08.456652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.457124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.457901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.458334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.502009 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39849f24-ce1b-4925-90ac-ce1cdc314127 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.057834 Dec 25 21:23:08.502940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2565/5209] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:08 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:08.936026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:08.937448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:08.945866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.947266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.948261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.948863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.949084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:08.950156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:08.958383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.959198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:08.960242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:08.960913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:09.009413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0724ba2f-5808-4114-8886-b051591646d3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064661 Dec 25 21:23:09.010221 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2566/5210] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:08 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:09.224125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:09.225202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:09.241009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:09.241460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:09.242773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:09.243107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:09.274806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:09.283276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:09.285352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:09.286697 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95a46c5a-904f-4d9f-a40a-6e9be4b82ca0 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.354479 Dec 25 21:23:09.287264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2645/5211] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:08 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:09.459508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:09.467689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ba99638-d117-491e-9698-4bc959ff56ec tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.248744 Dec 25 21:23:09.468261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2567/5212] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:09 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:09.514015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:09.515020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:09.521667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:09.522130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:09.522960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:09.523545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:09.566924 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f3e7ab8-9002-4e13-b16b-3de5a2a57369 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056752 Dec 25 21:23:09.567594 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2646/5213] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:09 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:10.141369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:10.142331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:10.149847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.149847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.149847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.150227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.200836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e84c406f-6d07-410c-be23-208856668c8e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.175415 Dec 25 21:23:10.200836 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2568/5214] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:10 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:10.306373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:10.316084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:10.316084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.316084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.316084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.316494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.389840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:10.399388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:10.401800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:10.403381 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84e982a4-e045-49a5-9491-bc12bee0243d tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.101369 Dec 25 21:23:10.404453 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2647/5215] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:10 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:10.487179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:10.488269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:10.495712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.496529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.497657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.498335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.582177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:10.583034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:10.592349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.593169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.594353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:10.595081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:10.650550 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fce96e12-748f-4300-8872-bc32f558db09 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.073646 Dec 25 21:23:10.654551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2648/5216] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:10 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:10.684051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:10.693159 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-503fbf06-cd7e-4a9f-9011-e5418d898293 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.210911 Dec 25 21:23:10.694294 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2569/5217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:10 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:11.205072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:11.206109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:11.214726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.215451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.216453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.216960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:11.217425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.217910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:11.225546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.226430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.227613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.228403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.266904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'flavor' on Instance uuid 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:11.723029 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e9186da-54e6-445e-ba61-d65fb55f58c7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 200 len: 32 microversion: 2.1 time: 0.511238 Dec 25 21:23:11.723799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2570/5218] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:11 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 32 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:23:11.732434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:11.733501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:11.740617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.741532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.742656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.743090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.815896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:11.824782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:11.826355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:11.827524 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b28577e2-3c6e-4780-84e6-5ee1a418fe04 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.100008 Dec 25 21:23:11.828447 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2571/5219] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:11 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:11.833026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:11.833994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:11.842016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.842471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.843332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.843838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.887772 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fcd30d54-6355-4556-927c-f86a335b3540 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.057811 Dec 25 21:23:11.888987 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2572/5220] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:11 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:11.893992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:11.899703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:11.903378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.903833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:11.904636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:11.905131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:12.150311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:12.162695 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8cbf3010-891b-4da7-a2c4-42310fe0ae6d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.272488 Dec 25 21:23:12.163285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2573/5221] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:11 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:12.168449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:12.169109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:12.175212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:12.175667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:12.176461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:12.176928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:12.437283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:12.449807 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1218e6e0-3916-4de1-a12d-ab8e4f07729a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.284409 Dec 25 21:23:12.458504 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2574/5222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:12 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:12.847914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:12.848616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:12.855463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:12.855907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:12.856733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:12.857182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:12.931002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:12.940255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:12.942431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:12.943760 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80e40315-c0d9-4970-8e5e-17fb7cb7d00a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.099940 Dec 25 21:23:12.955797 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2575/5223] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:12 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:12.955797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:12.955797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:12.957220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:12.957676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:12.958474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:12.958913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.010500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f4416f61-c3e3-4129-9095-df8e305f8573 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064483 Dec 25 21:23:13.011976 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2576/5224] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:12 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:13.180029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:13.180738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:13.188476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.189018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.189975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.190426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.341101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:13.346811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-524bcfff-03df-4cf9-8b14-370cb15dff75 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.170918 Dec 25 21:23:13.356492 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2577/5225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:13 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:13.360008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:13.360503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:13.366897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.367385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.368172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.368613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.396249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:23:13.695743 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9759f32e-e8d9-4632-ac56-e0cddba2d8e3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 204 len: 0 microversion: 2.1 time: 0.344412 Dec 25 21:23:13.696702 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2578/5226] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:23:13 2021] DELETE /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:23:13.702366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:13.703198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:13.711121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.728548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.728548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.728548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.858458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:13.867505 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ace90ab7-d46c-4415-b98d-7e9bc0c7bc28 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.169595 Dec 25 21:23:13.869870 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2579/5227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:13 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:13.874325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:13.874962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:13.885148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.885724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:13.886535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:13.886972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.053417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:14.060448 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0253bacb-c5be-4057-a99a-9cda348fcd7a tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1512 microversion: 2.1 time: 0.189756 Dec 25 21:23:14.061490 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2580/5228] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:13 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1512 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:14.078055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:14.078692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:14.086112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.086621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.087409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.087853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.167464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:14.175879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:14.178776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:14.180201 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fde5a788-c62e-46a9-9807-7304ac12d41b tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.107333 Dec 25 21:23:14.180971 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2581/5229] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:14 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:14.188353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:14.189704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:14.196854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.199593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.199593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.199593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.247435 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bab650b8-09f6-4499-b12b-35fe7d440133 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064956 Dec 25 21:23:14.248962 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2582/5230] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:14 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:14.367421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:14.367930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:14.379596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.379895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.380716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.381191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.541294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:14.554786 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c402b996-55e8-4eb3-be41-a5087fd5084f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.191864 Dec 25 21:23:14.555877 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2583/5231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:14 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:14.893586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:14.894272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:14.900711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.901261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:14.902599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:14.903037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.078767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:15.087503 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3739a4be-824f-4fff-9f05-94396fc031d6 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.197973 Dec 25 21:23:15.096810 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2584/5232] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:14 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:15.103172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:15.103888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:15.110929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.111479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.112347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.112993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.272194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:15.281163 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e17dd0cf-bcb1-49ff-831e-8a74261b04d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1512 microversion: 2.1 time: 0.181748 Dec 25 21:23:15.282129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2585/5233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:15 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:15.287459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:15.288388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:15.297306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.297306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.297306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.297961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.376401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:15.387445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:15.389546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:15.389981 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32e4c23c-d9d0-4563-886a-d8a0f137a31f tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.106898 Dec 25 21:23:15.390689 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2586/5234] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:15 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:15.395700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:15.396789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:15.411997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.413372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.414398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.415505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.460154 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcab1573-b3d3-4145-8374-c6c4abe4641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.068317 Dec 25 21:23:15.461472 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2587/5235] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:15 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:15.577484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:15.578207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:15.586391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.593523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.594618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.595457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.847038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:15.855555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1e1af91-0024-45fd-a49d-5154d78e6b60 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.282173 Dec 25 21:23:15.859195 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2588/5236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:15 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:15.874143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:15.879676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:15.884266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.884662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:15.885583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:15.886535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.150617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:16.159142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4324e8b6-d8ea-45b0-af47-ae8646e65ea0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.293767 Dec 25 21:23:16.159910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2589/5237] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:15 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:16.164206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:16.165832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:16.186922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.187521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.188992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.189711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.498702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:16.513907 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35b48683-5268-4435-a718-9e50aec20c08 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.349069 Dec 25 21:23:16.513907 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2590/5238] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:16 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:16.516022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:16.516631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:16.523114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.523620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.524425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.524864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.724644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:16.734715 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4cfd84d7-fb21-4911-8748-33163d88eac8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.222262 Dec 25 21:23:16.734715 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2591/5239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:16 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:16.739687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:16.740390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:16.756498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.766961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.766961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.766961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.875034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:16.884932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bea1e151-6b8a-4148-a4bc-27845542cf94 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 200 len: 1470 microversion: 2.1 time: 0.149051 Dec 25 21:23:16.886108 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2592/5240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:16 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:16.891825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:16.891825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:16.911025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.911555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:16.916147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:16.916147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:17.023886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:17.043337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:17.051524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:17.055111 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4923d8a2-dd8e-454f-b6dc-e1b95afca105 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.165746 Dec 25 21:23:17.055111 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2593/5241] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:16 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:17.072848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:17.081428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:17.093533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:17.093989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:17.094798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:17.095300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:17.153536 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-79ceeccf-6496-4a7a-b1eb-afea91ece6e7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.098807 Dec 25 21:23:17.155202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2594/5242] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:17 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:17.350900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4986a243-526a-425d-ae75-34c51f1ab6d2 req-1321fdf2-0aec-43b6-aa73-c71f0cc3df94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9e9c480-9591-4be8-88a1-021df7ea5e04", "name": "network-vif-deleted", "tag": "c6d03e4e-9c86-4a24-bd65-c4d2828b4a5d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:17.352436 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:17.352436 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:17.360359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4986a243-526a-425d-ae75-34c51f1ab6d2 req-1321fdf2-0aec-43b6-aa73-c71f0cc3df94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:17.360813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4986a243-526a-425d-ae75-34c51f1ab6d2 req-1321fdf2-0aec-43b6-aa73-c71f0cc3df94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:17.372100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4986a243-526a-425d-ae75-34c51f1ab6d2 req-1321fdf2-0aec-43b6-aa73-c71f0cc3df94 service nova] Creating event network-vif-deleted:c6d03e4e-9c86-4a24-bd65-c4d2828b4a5d for instance a9e9c480-9591-4be8-88a1-021df7ea5e04 on nch2-master-1 Dec 25 21:23:17.377301 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4986a243-526a-425d-ae75-34c51f1ab6d2 req-1321fdf2-0aec-43b6-aa73-c71f0cc3df94 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221658 Dec 25 21:23:17.377917 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2595/5243] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:17.383514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:17.384246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:17.391291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:17.391763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:17.392644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:17.393110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:17.621950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:17.621950 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6166af19-a960-47c2-a928-9f9ea79e4466 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.235982 Dec 25 21:23:17.621950 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2596/5244] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:17 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:17.621950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-173647945", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "050fe506-29b6-4536-b03a-6d4fd9d4993c"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:17.701005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] validate_networks() for [('050fe506-29b6-4536-b03a-6d4fd9d4993c', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:23:18.159007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:23:18.160246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:23:18.161023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:23:18.162328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:23:18.163088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:23:18.173772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.174245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.175268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.175867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.195473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:23:18.209591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:23:18.223687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:23:18.226341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:23:18.374042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b15cbdbe-fa0a-46df-a2ef-b3460de727de tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.757236 Dec 25 21:23:18.374826 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2597/5245] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:23:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:23:18.380337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:18.386871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:18.388534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.389099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.389978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.393817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.575695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:18.583028 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad7bbb68-7d5a-41a1-ac6f-c993652ec032 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.206533 Dec 25 21:23:18.583644 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2598/5246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:18 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:18.588347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:18.589170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: a9e9c480-9591-4be8-88a1-021df7ea5e04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:18.598898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.598898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.598898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.598898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.624713 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] HTTP exception thrown: Instance a9e9c480-9591-4be8-88a1-021df7ea5e04 could not be found. Dec 25 21:23:18.627088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Returning 404 to user: Instance a9e9c480-9591-4be8-88a1-021df7ea5e04 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:18.627941 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c479fe0b-7067-4068-9bab-b502ab8ff1a8 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04" status: 404 len: 111 microversion: 2.1 time: 0.043098 Dec 25 21:23:18.634049 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2599/5247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:18 2021] GET /compute/v2.1/servers/a9e9c480-9591-4be8-88a1-021df7ea5e04 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:18.639667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:18.641302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:18.661540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.662244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.663522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.664290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.750927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:18.759991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:18.762346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:18.766908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23a53fe5-0300-4c12-a595-e8f733ce61ac tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.129273 Dec 25 21:23:18.766908 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2600/5248] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:18 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:18.771514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:18.774319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:18.789142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.793116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.793116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.793116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.836369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58079b4e-ac75-49b2-9d9d-14e29919139a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070757 Dec 25 21:23:18.843720 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2601/5249] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:18 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:18.843720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9dd2ee5-94a8-46de-a45e-545d3e8d65a9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:18.844711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9dd2ee5-94a8-46de-a45e-545d3e8d65a9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:18.909888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d9dd2ee5-94a8-46de-a45e-545d3e8d65a9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:18.922361 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9dd2ee5-94a8-46de-a45e-545d3e8d65a9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1214 microversion: 2.1 time: 0.083240 Dec 25 21:23:18.922865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2602/5250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:18 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:18.940212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:18.940212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:18.956666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.957437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:18.958419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:18.959014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:19.204112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:19.211762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5343169-9c79-47af-a933-0c4e3ab255c4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.287734 Dec 25 21:23:19.212354 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2603/5251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:18 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:19.599540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:19.600339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:19.612713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:19.612713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:19.613107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:19.613569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:19.776471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:19.785087 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fecc2418-8c5d-4c6e-9d37-6b38a9cc9922 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.189213 Dec 25 21:23:19.791632 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2604/5252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:19 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:19.801790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:19.802593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:19.810246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:19.810839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:19.811638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:19.812069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.158399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:20.167620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:20.169186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:20.170383 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c188e4f7-271e-4a61-8bd9-66fd5f0c1960 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1366 microversion: 2.57 time: 0.377738 Dec 25 21:23:20.170921 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2605/5253] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:19 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:20.188419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:20.189448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:20.195473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:20.195937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.196741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:20.197212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.242541 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9686935-eb1a-4075-9a6e-9410e08b20cb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070107 Dec 25 21:23:20.243405 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2606/5254] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:20 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:20.250266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6a2668b-ad4d-4cef-be2e-dd1d166f117a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:20.254934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6a2668b-ad4d-4cef-be2e-dd1d166f117a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:20.315837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d6a2668b-ad4d-4cef-be2e-dd1d166f117a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:20.324296 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6a2668b-ad4d-4cef-be2e-dd1d166f117a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1214 microversion: 2.1 time: 0.079689 Dec 25 21:23:20.324887 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2607/5255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:20 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:20.331273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:20.331886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:20.340248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:20.340708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.341599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:20.347217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.539259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:20.550931 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16a05d9b-8204-48ca-b0b6-8bf024bc1e22 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.223185 Dec 25 21:23:20.551915 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2608/5256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:20 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:20.808406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:20.809057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:20.815959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:20.821860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.821860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:20.821860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:20.955298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:20.963324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d846d7d2-1276-451f-b506-8fe4aee22390 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.158584 Dec 25 21:23:20.964901 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2609/5257] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:20 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:21.196632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:21.197317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:21.204259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.204739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.205569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.206012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.236367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfe8e85b-50af-412d-b585-103f7b8766fd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 10.035429 Dec 25 21:23:21.241214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2649/5258] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:11 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 10041 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:21.259624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:21.261424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:21.268370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.269107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.269919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.270364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.274805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:21.286706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:21.290343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:21.290343 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-713e1fc8-6abf-4cb4-af21-c873a1d664fc tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1372 microversion: 2.57 time: 0.098596 Dec 25 21:23:21.296169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2610/5259] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:21 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:23:21.326890 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6be28435-65f2-4905-a004-58a31d9f30bd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.071288 Dec 25 21:23:21.327793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2650/5260] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:21 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:21.341989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:21.342803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:21.350852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.351336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.352140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.352630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.418538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:21.426380 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f366e08-92dc-47b4-9505-424b63df9be4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1218 microversion: 2.1 time: 0.089264 Dec 25 21:23:21.426944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2611/5261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:21 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:21.570701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:21.575940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:21.582134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.582589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.583385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.583995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.756409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:21.764024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63f2b218-86e5-4800-bae1-4c59b22f6d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.197987 Dec 25 21:23:21.764923 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2651/5262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:21 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:21.981178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:21.982209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:21.988559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.990838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:21.990838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:21.990838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.179946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:22.183791 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86d5b374-bd09-4983-bba8-a8c19c899ba1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.206251 Dec 25 21:23:22.193067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2612/5263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:21 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:22.248238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:22.249186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:22.256974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.259600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.259600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.259600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.298231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba8b3dc5-6c46-4e75-bd77-242b6861d9c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054211 Dec 25 21:23:22.298864 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2652/5264] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:22 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:22.308312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:22.309620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:22.315886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.316341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.317169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.317614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.339079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:22.340095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:22.346981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.347426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.348403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.349031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.395833 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40a622ed-9fea-4793-8153-4daea91d971f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060563 Dec 25 21:23:22.397417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2653/5265] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:22 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:22.404186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:22.413219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:22.415364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:22.416582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8799fb2-7841-4769-8334-92557241e229 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1372 microversion: 2.57 time: 0.111849 Dec 25 21:23:22.417168 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2613/5266] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:22 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:23:22.443928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:22.444627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:22.452421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.453158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.454137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.454570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.546927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:22.556714 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eacafadc-d219-456b-af12-0016e55adde1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1274 microversion: 2.1 time: 0.116255 Dec 25 21:23:22.559984 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2654/5267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:22 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:22.780825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:22.781486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:22.788153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.788699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:22.789607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:22.790308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.043946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:23.051689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a522295-f8f4-415f-83e2-045b89a18d2f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.274603 Dec 25 21:23:23.052347 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2614/5268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:22 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:23.211262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:23.211262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:23.211262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.211262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.211262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.211262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.309642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:23.310718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:23.316848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.317434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.318293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.318805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.360130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:23.372517 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-073e9f2b-6a11-489b-b209-d0ce6be64efd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064048 Dec 25 21:23:23.377427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2615/5269] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:23 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:23.382338 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a9446077-2bee-4b8a-91ba-49e2ad90801a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.186595 Dec 25 21:23:23.388510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2655/5270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:23 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:23.409532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:23.410861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:23.431175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.431640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.433095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.433535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.436503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:23.437532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:23.448849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.453225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.454279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.455105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.544346 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49615d80-036b-40b0-9eb8-1bcbe8bb84db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.139049 Dec 25 21:23:23.548067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2616/5271] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:23 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:23.577291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:23.577594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:23.584266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:23.585613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.586069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.586870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.587354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.602375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:23.602375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:23.602375 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-74ac4e03-8211-4578-9a02-2a0b9168db20 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1357 microversion: 2.57 time: 0.170774 Dec 25 21:23:23.614614 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2656/5272] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:23 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:23:23.632331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:23.633230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:23.642944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.644643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.645591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:23.646287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:23.686680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:23:23.903008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:23.912368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85f07ec9-ec2d-4d2b-8040-c5c2351e9a07 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.341167 Dec 25 21:23:23.914478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2617/5273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:23 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:24.070296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:24.071074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:24.079535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.084108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.084108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.084108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.106429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82ad6713-d319-4b4e-b3a6-cfee772a0429 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 204 len: 0 microversion: 2.57 time: 0.479031 Dec 25 21:23:24.108153 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2657/5274] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:23:23 2021] DELETE /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:23:24.129493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:24.131889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:24.149123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.149751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.150969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.151677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.420592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:24.434695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:24.437388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:24.439233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-73863587-b804-4db3-ac7b-8a880504d308 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1363 microversion: 2.57 time: 0.322433 Dec 25 21:23:24.440583 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2658/5275] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:24 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:23:24.448839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:24.452512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:24.457561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.458247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.459271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.460456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.527931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c46dc96d-3854-4d0a-9690-c24f02bb2547 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.085073 Dec 25 21:23:24.528613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2659/5276] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:24 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:24.534650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:24.535877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:24.548422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.550002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.553570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.555220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.585219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:24.593301 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12bdb2ec-3f03-4cea-be2d-1665da0c9eb9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.527454 Dec 25 21:23:24.603248 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2618/5277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:24 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:24.607101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:24.608035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:24.617868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.618466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.619276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.620457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.668216 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9dd4557a-7a79-4e13-9fa7-55dc16b938e4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.065566 Dec 25 21:23:24.669023 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2619/5278] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:24 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:24.819960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:24.828970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4500fa2e-cd2e-4fb5-ace1-9e7cf90b40a1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.298915 Dec 25 21:23:24.829529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2660/5279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:24 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:24.933183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:24.933183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:24.941447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.941896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:24.942704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:24.943141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.173104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:25.180743 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a325a798-4ea8-4fb5-b9c8-3f7868b8ffb3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.252977 Dec 25 21:23:25.181366 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2620/5280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:24 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:25.280665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-613492c7-3c3c-477c-bbc0-49293cc7b7e7 req-23344bb1-a04a-4ac5-8d9b-f73c46a14e3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b03831-0555-4b9e-bd9a-323002cb09e1", "tag": "eef37bbe-1508-453a-bafd-62933899b6d9"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:25.282718 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:25.282718 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:23:25.299132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-613492c7-3c3c-477c-bbc0-49293cc7b7e7 req-23344bb1-a04a-4ac5-8d9b-f73c46a14e3b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.299132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-613492c7-3c3c-477c-bbc0-49293cc7b7e7 req-23344bb1-a04a-4ac5-8d9b-f73c46a14e3b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.328553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-613492c7-3c3c-477c-bbc0-49293cc7b7e7 req-23344bb1-a04a-4ac5-8d9b-f73c46a14e3b service nova] Creating event network-changed:eef37bbe-1508-453a-bafd-62933899b6d9 for instance 36b03831-0555-4b9e-bd9a-323002cb09e1 on nch1-master-1 Dec 25 21:23:25.340037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-613492c7-3c3c-477c-bbc0-49293cc7b7e7 req-23344bb1-a04a-4ac5-8d9b-f73c46a14e3b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058356 Dec 25 21:23:25.340037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2661/5281] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:25.458731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:25.459354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:25.471834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.471834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.471834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.471834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.539216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:25.540484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:25.551926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.552746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.553192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:25.554070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.554660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.566811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:25.568358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:25.573213 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4554bac-c56e-4c7d-86c2-6dca62de6d5a tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1363 microversion: 2.57 time: 0.118722 Dec 25 21:23:25.576289 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2621/5282] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:25 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1363 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:23:25.612293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:25.613028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:25.620594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.621076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.622387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.622842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.628269 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4003290f-de15-4542-9720-0b796adb9573 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.092970 Dec 25 21:23:25.629713 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2662/5283] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:25 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:25.684771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:25.685901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:25.695516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.698438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.698697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.699392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.841338 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8da4d65-b593-4406-bf57-a3c108711fcf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.159132 Dec 25 21:23:25.842220 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2663/5284] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:25 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:25.848025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ccaee2af-cc06-4f04-bb7b-b09b2b005e21 req-b962a84e-350b-4978-af8e-722b30dd6b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336c6856-ca33-4291-b38f-03e7f7a5db93", "name": "network-vif-plugged", "status": "completed", "tag": "6dcde4f1-b084-49e9-9b96-ae184bf1c495"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:25.849698 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:25.849698 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:23:25.858843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ccaee2af-cc06-4f04-bb7b-b09b2b005e21 req-b962a84e-350b-4978-af8e-722b30dd6b55 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.861009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ccaee2af-cc06-4f04-bb7b-b09b2b005e21 req-b962a84e-350b-4978-af8e-722b30dd6b55 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.864040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:25.872589 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e6fe471-64d6-43b3-a0f8-8297ca06353d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.265391 Dec 25 21:23:25.873202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2622/5285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:25 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:25.874440 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ccaee2af-cc06-4f04-bb7b-b09b2b005e21 req-b962a84e-350b-4978-af8e-722b30dd6b55 service nova] Creating event network-vif-plugged:6dcde4f1-b084-49e9-9b96-ae184bf1c495 for instance 336c6856-ca33-4291-b38f-03e7f7a5db93 on nch1-master-1 Dec 25 21:23:25.878018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:25.878870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:25.885055 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ccaee2af-cc06-4f04-bb7b-b09b2b005e21 req-b962a84e-350b-4978-af8e-722b30dd6b55 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040609 Dec 25 21:23:25.885976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.886506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:25.886655 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2664/5286] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:25.887715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:25.888231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.146845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:26.160055 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-035bb2f0-fbe3-49d3-8a83-74688ffff9c0 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.283122 Dec 25 21:23:26.160679 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2623/5287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:25 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:26.199410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:26.200067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:26.210015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.214037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.214037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.214037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.351446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:26.359491 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82d37b84-c3a0-4f58-b082-3a4d1dc9113d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.165112 Dec 25 21:23:26.360228 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2665/5288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:26 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:26.595478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:26.596347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:26.602993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.603449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.604845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.605330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.638742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.639430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.639644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lazy-loading 'fault' on Instance uuid b159b0a7-d9d5-497e-9170-b451fe6e64d2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:26.640033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:26.641003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:26.647495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.647949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.648730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.649191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.693052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:26.696645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4404f558-daef-43c5-aa92-c89ec7d26fa2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059884 Dec 25 21:23:26.697141 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2666/5289] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:26 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:26.701696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:26.703249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4fc176dc819f44649134b4ce7dca957e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffbc622c02414a999ab1d4f3752e9693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:26.704551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1de018c4-a535-4dbf-80cb-09b1f045f81e tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 200 len: 1368 microversion: 2.57 time: 0.112892 Dec 25 21:23:26.705130 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2624/5290] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:26 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:23:26.855700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:26.856687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:26.864701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.865180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.866011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.866445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.890999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:26.892324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:26.900180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.900637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.901540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:26.901976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:26.922251 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a45c4589-c40d-47d4-8cb6-d3a5ad86188c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.071726 Dec 25 21:23:26.926329 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2667/5291] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:26 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:27.067123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:27.076388 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0731ffdb-3587-4d8a-9c99-99851bab623e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.190247 Dec 25 21:23:27.083559 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2625/5292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:26 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:27.178460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:27.179268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:27.190069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.190613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.191628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.192172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.349735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:27.359851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61b0020a-4395-4b17-b8e4-2831b2775cf1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.185660 Dec 25 21:23:27.369785 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2668/5293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:27 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:27.375370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:27.376005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:27.382687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.383174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.383951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.384394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.541742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:27.549666 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4a26f4a-e680-444b-bb5d-d8a243bd8ef0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.177761 Dec 25 21:23:27.550079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2626/5294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:27 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:27.707524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:27.708376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:27.716333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.716783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.717589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.718025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.725948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:27.726564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] [instance: b159b0a7-d9d5-497e-9170-b451fe6e64d2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:27.732455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.732935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.733721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.734156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.749215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] HTTP exception thrown: Instance b159b0a7-d9d5-497e-9170-b451fe6e64d2 could not be found. Dec 25 21:23:27.749808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] Returning 404 to user: Instance b159b0a7-d9d5-497e-9170-b451fe6e64d2 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:27.750634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6885b19-c09b-4ef8-9d37-9dc71aeb46d4 tempest-ServerShowV257Test-1437448586 tempest-ServerShowV257Test-1437448586-project] 10.222.0.32 "GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2" status: 404 len: 111 microversion: 2.57 time: 0.029719 Dec 25 21:23:27.751175 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2627/5295] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:23:27 2021] GET /compute/v2.1/servers/b159b0a7-d9d5-497e-9170-b451fe6e64d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:23:27.758210 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a6045ba0-593e-468f-a6bc-1426a737d174 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054339 Dec 25 21:23:27.759734 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2669/5296] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:27 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:27.933906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:27.935090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:27.941462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.941984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.942940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:27.943431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:27.992558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c037bbe-8377-4d45-982b-262e04483e9a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062979 Dec 25 21:23:27.993249 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2628/5297] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:27 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:28.095011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:28.102640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:28.102870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.103328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.104119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.104563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.265552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:28.273679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-474a0bbe-0b42-483e-9e96-fe3e6f7e2b01 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1516 microversion: 2.1 time: 0.182703 Dec 25 21:23:28.274589 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2670/5298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:28 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1516 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:28.378633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:28.379434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:28.387529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.387997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.388787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.389272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.528542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:28.536418 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-361a16ed-b38c-4bed-8c75-9f52dfdd17f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.161867 Dec 25 21:23:28.536997 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2629/5299] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:28 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:28.565678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:28.566436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:28.580732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.582165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.583174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.583803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.771290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:28.773044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:28.784589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.785396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.788115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:28.788115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:28.795885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:28.804231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64aa0698-8658-4b65-9b75-d33b736ecc32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.242397 Dec 25 21:23:28.805367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2671/5300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:28 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:28.844014 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee86654d-11dc-4b15-ab7a-b2f24622fea8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.077579 Dec 25 21:23:28.844779 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2630/5301] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:28 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:29.004314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:29.005704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:29.013214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.018995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.018995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.018995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.064853 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2ca66ca-4998-4e7d-8f2f-7707a97d05f0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064366 Dec 25 21:23:29.069199 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2672/5302] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:28 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:29.291761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:29.292567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:29.299771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.300319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.301137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.301584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.444473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:29.453099 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11a46ff1-1b5c-43a8-bbfa-b6796dac50e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.165712 Dec 25 21:23:29.454954 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2631/5303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:29 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:29.474725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:29.475606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:29.489779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.489779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.489779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.489779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.548730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:29.549304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:29.556357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.557365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.561692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.562362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.626529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:23:29.662931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:29.674056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01d7f7ec-f4d7-4070-a299-e917437e2bea tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.202023 Dec 25 21:23:29.681572 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2673/5304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:29 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:29.689388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:29.690138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:29.700772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.701315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.702361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.702934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.862273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:29.870283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-76606c6a-a78c-4d02-aced-968e26fcb46f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.187584 Dec 25 21:23:29.870904 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2674/5305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:29 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:29.883965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:29.884570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:29.890886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.891341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.892114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:29.892553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:29.987974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-731d60ff-04ac-45eb-8693-5799b383d095 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 204 len: 0 microversion: 2.1 time: 0.442901 Dec 25 21:23:29.988633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2632/5306] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:23:29 2021] DELETE /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:23:29.996817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:29.997842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.004704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.005195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.006016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.006459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.054671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:30.063840 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09af8b3a-1be9-49f4-b645-fac1391dfbee tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.182958 Dec 25 21:23:30.064694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2675/5307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:29 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:30.070566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:30.072059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.079212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.079966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.080826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.081299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.129911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5f33dae9-6857-4a13-9957-0e8df05c7aa9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063706 Dec 25 21:23:30.130585 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2676/5308] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:30 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:30.139340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.140124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.147283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.148284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.148687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.149153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.185037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:30.192763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc807511-8a33-4c6a-8b66-d885ce28fca1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.202922 Dec 25 21:23:30.194061 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2633/5309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:29 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:30.200267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:30.201550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.209831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.210544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.211526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.212282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.277325 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4bb2de6c-985c-4a8d-a947-0d9ca0e5c16b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.080903 Dec 25 21:23:30.282925 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2634/5310] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:30 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:30.295965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f99648a2-b65d-434c-b43e-496a6eb0bb5d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:30.310779 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f99648a2-b65d-434c-b43e-496a6eb0bb5d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance c7c08f5e-0e63-4075-b767-8cb0f5e2bdbf has no mapping to a cell. Dec 25 21:23:30.311391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f99648a2-b65d-434c-b43e-496a6eb0bb5d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance c7c08f5e-0e63-4075-b767-8cb0f5e2bdbf has no mapping to a cell. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:30.313606 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f99648a2-b65d-434c-b43e-496a6eb0bb5d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/c7c08f5e-0e63-4075-b767-8cb0f5e2bdbf/action" status: 404 len: 117 microversion: 2.1 time: 0.030051 Dec 25 21:23:30.314190 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2635/5311] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:30 2021] POST /compute/v2.1/servers/c7c08f5e-0e63-4075-b767-8cb0f5e2bdbf/action => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:30.322314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.326015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.343948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.344705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.345602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.346048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.354145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:30.364616 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1513 microversion: 2.1 time: 0.232301 Dec 25 21:23:30.364795 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2677/5312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:30.516617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:30.524190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81b904a6-4687-4dfe-9957-8426533f588a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.205564 Dec 25 21:23:30.524839 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2636/5313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:30.526107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.527172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d448882-a0e7-4497-925f-8c80cdb7ace2 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001523 Dec 25 21:23:30.527546 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2678/5314] 10.222.0.32 () {56 vars in 885 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Dec 25 21:23:30.541123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.541738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.548099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.548579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.549418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.549857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.694944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:30.703744 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-28a68a22-67f3-40f3-ae02-b94fc90d74f3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.166292 Dec 25 21:23:30.704497 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2637/5315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:30.721081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a956e680-bf24-4a7d-8308-7ac710b5503b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:30.721613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a956e680-bf24-4a7d-8308-7ac710b5503b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: cbe06867-de47-4418-b170-c395dd822663] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.727769 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a956e680-bf24-4a7d-8308-7ac710b5503b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance cbe06867-de47-4418-b170-c395dd822663 could not be found. Dec 25 21:23:30.728344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a956e680-bf24-4a7d-8308-7ac710b5503b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance cbe06867-de47-4418-b170-c395dd822663 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:30.729192 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a956e680-bf24-4a7d-8308-7ac710b5503b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/cbe06867-de47-4418-b170-c395dd822663/action" status: 404 len: 111 microversion: 2.1 time: 0.012071 Dec 25 21:23:30.729726 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2679/5316] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:30 2021] POST /compute/v2.1/servers/cbe06867-de47-4418-b170-c395dd822663/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:30.737593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.738212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.743997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.744452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.749314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.749314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.882098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:30.888177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.888807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.889893 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de7f6648-76d2-482f-ad3d-145f15b42789 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.155852 Dec 25 21:23:30.892496 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2638/5317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:30.907679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.907880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:30.908148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.908394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:30.908981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.909629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.920406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.920864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:30.921696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:30.922135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.127880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:31.139023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:31.141789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b85e143e-b009-4bdd-8010-063e30494941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.258514 Dec 25 21:23:31.147321 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd727140-705f-43e7-942a-02ffbcff7de6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.243089 Dec 25 21:23:31.147887 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2639/5318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:31.152157 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2680/5319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:30 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:31.157786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:31.157786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:31.167922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.168489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.169410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.169660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:31.170162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.170292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:31.176615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.178358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.178358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.178358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.205953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lazy-loading 'flavor' on Instance uuid 336c6856-ca33-4291-b38f-03e7f7a5db93 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:31.216375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ecf19b38-86b4-4a19-8a92-79a906d64e3e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.067011 Dec 25 21:23:31.220921 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2640/5320] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:31 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:31.227819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:31.229094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:31.237367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.237825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.253167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.253167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.412098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:31.422102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0f123958-5bc5-458e-84d3-0dec26c7b1d0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.199619 Dec 25 21:23:31.423016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2641/5321] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:31 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:31.428990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:31.430185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:31.439500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.439978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.441749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.442521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.490507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4cfecb1-3487-4b1f-82c1-6d7a97e9ccb8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066349 Dec 25 21:23:31.494346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2642/5322] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:31 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:31.496460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:31.497205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:31.499756 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-31fe19c9-0520-4553-a36f-138b8523de68 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 202 len: 0 microversion: 2.1 time: 0.333827 Dec 25 21:23:31.500658 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2681/5323] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:31 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:31.508957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:31.509787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.509934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:31.510633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.512631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.513458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.518527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.518992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.519766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.520201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.835446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:31.848151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aef7e697-f6c6-4f95-965c-4859d51d66d7 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1513 microversion: 2.1 time: 0.355255 Dec 25 21:23:31.849541 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2643/5324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:31 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1513 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:31.858325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:31.872856 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7774bd32-a453-4ff5-898e-08e6decb157b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1511 microversion: 2.1 time: 0.366553 Dec 25 21:23:31.874938 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2682/5325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:31 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:31.888157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-48a3c280-63e4-4ca7-b71c-1752cbdc81d0 req-08ca3b54-5634-45d2-b717-49c1892a768b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b03831-0555-4b9e-bd9a-323002cb09e1", "name": "network-vif-plugged", "status": "completed", "tag": "eef37bbe-1508-453a-bafd-62933899b6d9"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:31.892102 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:31.892102 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:31.903352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-48a3c280-63e4-4ca7-b71c-1752cbdc81d0 req-08ca3b54-5634-45d2-b717-49c1892a768b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:31.904038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-48a3c280-63e4-4ca7-b71c-1752cbdc81d0 req-08ca3b54-5634-45d2-b717-49c1892a768b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:31.923736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-48a3c280-63e4-4ca7-b71c-1752cbdc81d0 req-08ca3b54-5634-45d2-b717-49c1892a768b service nova] Creating event network-vif-plugged:eef37bbe-1508-453a-bafd-62933899b6d9 for instance 36b03831-0555-4b9e-bd9a-323002cb09e1 on nch1-master-1 Dec 25 21:23:31.930080 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-48a3c280-63e4-4ca7-b71c-1752cbdc81d0 req-08ca3b54-5634-45d2-b717-49c1892a768b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050674 Dec 25 21:23:31.932538 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2644/5326] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:32.159691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:32.161196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:32.168372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.168821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.169868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.170481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.230597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:32.232432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:32.239053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.239904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.240783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.241300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.317887 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a316dc0-4c22-425e-8fe8-cb94de380c62 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.092944 Dec 25 21:23:32.322847 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2645/5327] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:32 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:32.374406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:32.389284 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-11348378-7816-49ea-9167-961f951b9b0f tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.233698 Dec 25 21:23:32.390160 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2683/5328] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:32 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:32.446367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:32.447257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:32.472255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ed3155ec-b767-4e1b-b45c-523d5a8eb4f9 req-6ab247c4-8c57-4377-8f78-79edb74160b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18053b3a-726d-42b5-8e54-89f3deee10cb", "name": "network-vif-deleted", "tag": "866836b0-b932-4ad3-b858-1d09b2903533"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:32.475076 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:32.475076 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:23:32.484037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.484863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.485793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.486333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.489910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ed3155ec-b767-4e1b-b45c-523d5a8eb4f9 req-6ab247c4-8c57-4377-8f78-79edb74160b7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.490369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ed3155ec-b767-4e1b-b45c-523d5a8eb4f9 req-6ab247c4-8c57-4377-8f78-79edb74160b7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.519414 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ed3155ec-b767-4e1b-b45c-523d5a8eb4f9 req-6ab247c4-8c57-4377-8f78-79edb74160b7 service nova] Creating event network-vif-deleted:866836b0-b932-4ad3-b858-1d09b2903533 for instance 18053b3a-726d-42b5-8e54-89f3deee10cb on nch1-master-1 Dec 25 21:23:32.536511 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ed3155ec-b767-4e1b-b45c-523d5a8eb4f9 req-6ab247c4-8c57-4377-8f78-79edb74160b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068085 Dec 25 21:23:32.541515 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2684/5329] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:32.556716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:32.558611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:32.571522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.572197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.575893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.578792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.672938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00bf4760-c609-416b-b444-c91cfb17feca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.129182 Dec 25 21:23:32.680901 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2685/5330] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:32 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:32.721107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:32.728487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53d2a0a7-3877-48f0-89b6-983e0424c779 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1314 microversion: 2.1 time: 0.287937 Dec 25 21:23:32.729085 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2646/5331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:32 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:32.873623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:32.874323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:32.881751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.882205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.882990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.883475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.899416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:32.902441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:32.911067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.911523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.912481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.912942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.939102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:32.939543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:32.939999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lazy-loading 'fault' on Instance uuid 18053b3a-726d-42b5-8e54-89f3deee10cb {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:32.987520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:32.997231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af9bdf4d-aed6-4f42-972e-baec3c858096 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 200 len: 1307 microversion: 2.1 time: 0.128943 Dec 25 21:23:32.997908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2686/5332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:32 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 1307 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:33.095225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:33.103187 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-07b7a1b9-04ef-4677-86f5-c7f14c2f0383 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1494 microversion: 2.1 time: 0.207892 Dec 25 21:23:33.113505 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2647/5333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:32 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1494 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:33.121514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:33.122059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.128941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.129393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.130353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.130794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.163932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lazy-loading 'flavor' on Instance uuid 336c6856-ca33-4291-b38f-03e7f7a5db93 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:33.180441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'suspend' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state suspended Dec 25 21:23:33.181370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'suspend' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state suspended {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:33.182216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7adb73f5-88c9-4045-835c-03c9f45620ac tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 148 microversion: 2.1 time: 0.065334 Dec 25 21:23:33.189699 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2687/5334] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:33 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 148 bytes in 73 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:33.197931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:33.199386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.206429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.206884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.207672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.208274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.330050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:33.331038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.337924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.338380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.339428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.339774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.389852 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23545058-0233-4d97-a3d9-c0a98803ecf4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063355 Dec 25 21:23:33.390518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2688/5335] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:33 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:33.407437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:33.408431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.421658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.422332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.423155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.423776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.569962 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44ef1a3e-d77f-48ef-af37-74f836bdad5e tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 202 len: 0 microversion: 2.1 time: 0.375504 Dec 25 21:23:33.571414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2648/5336] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:33 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:33.581882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:33.582759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.589104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.589809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.590618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.592423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.609896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:33.619461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27444c0c-eeac-4a0e-ad89-dd4035ff3941 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.216276 Dec 25 21:23:33.625532 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2689/5337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:33 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:33.686951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:33.687880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.696055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.696826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.697985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.699275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.740672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:33.758198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8308dae8-7ffc-4a17-85d2-844ab2372ba7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1500 microversion: 2.1 time: 0.182572 Dec 25 21:23:33.763552 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2649/5338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:33 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1500 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:33.763916 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eea123f4-f4fb-4f58-ac49-0f1ed4a1516a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.080203 Dec 25 21:23:33.770125 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2690/5339] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:33 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:33.770402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:33.771377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:33.778168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.778763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:33.779565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:33.780097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.001484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:34.030247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e7bd921-770f-4863-b838-b282627892f1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1502 microversion: 2.1 time: 0.246195 Dec 25 21:23:34.030247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2650/5340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:33 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1502 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:34.030419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:34.030419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 18053b3a-726d-42b5-8e54-89f3deee10cb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.030419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.030419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.030419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.030419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.043483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] HTTP exception thrown: Instance 18053b3a-726d-42b5-8e54-89f3deee10cb could not be found. Dec 25 21:23:34.044055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:34.044212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Returning 404 to user: Instance 18053b3a-726d-42b5-8e54-89f3deee10cb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:34.044953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f858b1a-4a56-497c-a89c-85adb53f22ee tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb" status: 404 len: 111 microversion: 2.1 time: 0.034787 Dec 25 21:23:34.045265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.047156 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2691/5341] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:34 2021] GET /compute/v2.1/servers/18053b3a-726d-42b5-8e54-89f3deee10cb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:34.052024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.052732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.053883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.054555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.059234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:34.059744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.066764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.067067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.068018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.068751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.100051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:23:34.313117 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Removing security group 8da2903e-43de-461d-84b5-0c733a2bfb8c from port eef37bbe-1508-453a-bafd-62933899b6d9 Dec 25 21:23:34.468163 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e7432ef-0ef4-4020-bca0-12cc757627a9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 204 len: 0 microversion: 2.1 time: 0.412826 Dec 25 21:23:34.473789 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2692/5342] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:23:34 2021] DELETE /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:23:34.480477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:34.482111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.488380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.488976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.490195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.490872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.533870 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24e65090-8134-4857-a950-bc464eb41ac7 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058101 Dec 25 21:23:34.536287 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2693/5343] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:34 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:34.547874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:34.547874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.552797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.553297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.554097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.554542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.801968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:34.809920 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6543fc6-9f8d-41df-91aa-ec0e206b768c tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1513 microversion: 2.1 time: 0.272410 Dec 25 21:23:34.819649 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2694/5344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:34 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1513 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:34.824628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:34.825272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.831701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.835539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.835539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.835539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.955675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35510c59-db5e-444a-90cb-ce1605f460e3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1/action" status: 202 len: 0 microversion: 2.1 time: 0.917881 Dec 25 21:23:34.956638 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2651/5345] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:34 2021] POST /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:34.961834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:34.962830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:34.976504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.977007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:34.977830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:34.978267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.060064 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-17eb0793-674b-4890-b6e4-aa0e96dde481 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.101946 Dec 25 21:23:35.066619 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2652/5346] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:34 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:35.069449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:35.070852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:35.090702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.091158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.096110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.096687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.124344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:35.133037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d4110e1-404f-403a-b9c0-475ece631e3b tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.312085 Dec 25 21:23:35.133916 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2695/5347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:34 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:35.139381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:35.140435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:35.147133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.147592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.148450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.148969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.283106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:35.295971 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9f960a8-6a5d-4ff0-b8d7-117ae7ec46bc tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1460 microversion: 2.1 time: 0.160759 Dec 25 21:23:35.298091 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2696/5348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:35 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1460 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:35.303653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-20b49596-381f-4d1d-bf5a-fc5b6c088963 req-c16a6a70-b4df-470a-a97a-25e9c5e7c270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b03831-0555-4b9e-bd9a-323002cb09e1", "tag": "eef37bbe-1508-453a-bafd-62933899b6d9"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:35.305845 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:35.305845 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:23:35.324753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-20b49596-381f-4d1d-bf5a-fc5b6c088963 req-c16a6a70-b4df-470a-a97a-25e9c5e7c270 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.329026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-20b49596-381f-4d1d-bf5a-fc5b6c088963 req-c16a6a70-b4df-470a-a97a-25e9c5e7c270 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.350388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:35.354374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-20b49596-381f-4d1d-bf5a-fc5b6c088963 req-c16a6a70-b4df-470a-a97a-25e9c5e7c270 service nova] Creating event network-changed:eef37bbe-1508-453a-bafd-62933899b6d9 for instance 36b03831-0555-4b9e-bd9a-323002cb09e1 on nch1-master-1 Dec 25 21:23:35.362901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-20b49596-381f-4d1d-bf5a-fc5b6c088963 req-c16a6a70-b4df-470a-a97a-25e9c5e7c270 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062988 Dec 25 21:23:35.363154 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9c40b77-2be4-4a84-b9b4-52577330388d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1500 microversion: 2.1 time: 0.300585 Dec 25 21:23:35.364361 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2653/5349] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:35 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:35.364482 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2697/5350] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:35.375162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:35.375880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:35.391707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.392166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.393102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.393530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.556570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:35.557681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:35.564460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.564944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.565741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.566252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.622567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d891709c-ce23-4038-ac4d-1247a77c9ec6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069805 Dec 25 21:23:35.626627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2654/5351] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:35 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:35.832821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:35.834425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:35.850801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.850801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.850801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:35.850801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:35.999364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:36.010633 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-264f0f8c-4242-4917-a019-9198fd9d1e33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.640616 Dec 25 21:23:36.013886 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2698/5352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:35 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:36.031418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:36.032143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:36.043753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.044558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.045833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.046439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.182986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:36.190861 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e5a5393-7fee-445c-952c-cb0bc98c3cd9 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1513 microversion: 2.1 time: 0.363616 Dec 25 21:23:36.191434 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2655/5353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:35 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1513 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:36.196085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:36.197251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:36.206236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.206877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.208024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.209255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.276034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c7ac8c4-8339-45de-bc3e-9d823c088a9e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.082999 Dec 25 21:23:36.279184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2656/5354] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:36 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:36.290377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:36.294944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:36.301919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.302566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.304117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.304563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.307771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:36.316026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54f7c11f-2fb8-4859-b04b-d154c912feb8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.289520 Dec 25 21:23:36.334314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2699/5355] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:36 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:36.395203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:36.398671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:36.406873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.407390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.408209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.408656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.736542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:36.744730 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c6b8433-61ae-449e-8d5c-cc518d99e043 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.464162 Dec 25 21:23:36.753663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2657/5356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:36 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:36.758604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1515264940", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "050fe506-29b6-4536-b03a-6d4fd9d4993c"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:36.803587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:36.812029 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25145026-590e-47de-85d2-3b5056609226 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.425875 Dec 25 21:23:36.818691 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2700/5357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:36 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:36.825242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:36.826999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:36.830418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] validate_networks() for [('050fe506-29b6-4536-b03a-6d4fd9d4993c', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:23:36.834553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.835127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.836242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:36.837223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:36.879127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b69dcbb-68b0-4d41-a9f3-d8819358f69b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058741 Dec 25 21:23:36.879974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2701/5358] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:36 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:37.122353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-16a21f2a-a312-4e84-ae12-adda2bfae244 req-ca01e6c0-509a-448f-9a08-3f7de59c57b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec22e12b-a34c-4787-8d08-5dbf9b6556d1", "name": "network-vif-deleted", "tag": "745d590e-2b18-462d-a55e-1423ff663b30"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:37.123932 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:37.123932 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:23:37.131195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-16a21f2a-a312-4e84-ae12-adda2bfae244 req-ca01e6c0-509a-448f-9a08-3f7de59c57b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.131641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-16a21f2a-a312-4e84-ae12-adda2bfae244 req-ca01e6c0-509a-448f-9a08-3f7de59c57b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.142076 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-16a21f2a-a312-4e84-ae12-adda2bfae244 req-ca01e6c0-509a-448f-9a08-3f7de59c57b3 service nova] Creating event network-vif-deleted:745d590e-2b18-462d-a55e-1423ff663b30 for instance ec22e12b-a34c-4787-8d08-5dbf9b6556d1 on nch1-master-1 Dec 25 21:23:37.147359 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-16a21f2a-a312-4e84-ae12-adda2bfae244 req-ca01e6c0-509a-448f-9a08-3f7de59c57b3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265583 Dec 25 21:23:37.148488 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2702/5359] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:37.154268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:37.154963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.161018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.161467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.162246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.162682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.372588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:37.385766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3784c0f2-3fe1-43dd-8e52-87f899c97a90 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.236071 Dec 25 21:23:37.386600 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2703/5360] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:37 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:37.402702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:37.403578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.411581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.412201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.415804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.415804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.457104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.457559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.458015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lazy-loading 'fault' on Instance uuid ec22e12b-a34c-4787-8d08-5dbf9b6556d1 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:37.522010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:37.537596 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e6bf4f6-e2c6-45d5-b730-95b449f1df47 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 200 len: 1308 microversion: 2.1 time: 0.131020 Dec 25 21:23:37.537596 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2704/5361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:37 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 1308 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:37.537596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:37.537596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.541073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:23:37.542074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:23:37.543157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:23:37.543371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.543608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:23:37.543826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.544034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:23:37.544612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.545077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.553165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.553621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.554454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.554906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.572990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:23:37.586112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Getting quotas for user d2cc54d7a742403f896dd71d222895c2 and project 4c3545b07d0b4ccf9cd48a80c2d37521. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:23:37.591450 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a32b8936-2ba4-47bb-b791-1c0e9ca540c0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.059467 Dec 25 21:23:37.592495 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2705/5362] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:37 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:37.599326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4f43a28-0054-4235-947c-90bd8c15bab6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:37.600019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c4f43a28-0054-4235-947c-90bd8c15bab6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: e5e5965c-805d-430f-8d5f-6b62d0ac44ca] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.606909 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c4f43a28-0054-4235-947c-90bd8c15bab6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance e5e5965c-805d-430f-8d5f-6b62d0ac44ca could not be found. Dec 25 21:23:37.612456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4f43a28-0054-4235-947c-90bd8c15bab6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance e5e5965c-805d-430f-8d5f-6b62d0ac44ca could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:37.612572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:23:37.612858 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4f43a28-0054-4235-947c-90bd8c15bab6 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/e5e5965c-805d-430f-8d5f-6b62d0ac44ca/action" status: 404 len: 111 microversion: 2.1 time: 0.014673 Dec 25 21:23:37.612858 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2706/5363] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:37 2021] POST /compute/v2.1/servers/e5e5965c-805d-430f-8d5f-6b62d0ac44ca/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:37.613088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:23:37.618946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:37.619755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.628557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.629307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.635468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.635468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.771780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:37.779804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f36be934-558a-4761-bcfa-286f87ee6ec9 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.164523 Dec 25 21:23:37.780380 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2707/5364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:37 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:37.792797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:37.792797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.793068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.793420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.794236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.794677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.931788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:37.942532 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6ac4ebfe-5b63-43fa-8ffd-79b91499fbcc tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.160841 Dec 25 21:23:37.943367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2708/5365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:37 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:37.955794 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bdd981d4-9fa1-4932-b810-def1ea8515c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.200751 Dec 25 21:23:37.956120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:37.962276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2658/5366] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:23:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:23:37.966171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.969471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:37.970798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:37.972903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.973619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.974441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.974890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.985969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.986897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:37.987937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:37.988755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.078471 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ac84063-b5ea-49ed-89a8-ae4ce9bc5a6b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.120188 Dec 25 21:23:38.081185 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2659/5367] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:37 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:38.094804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7618c28d-a3da-4d0b-8e69-d57e5a3e3f1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.096521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7618c28d-a3da-4d0b-8e69-d57e5a3e3f1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.167587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:38.175216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9d561a9-8328-4043-bf95-c4f4ca02935c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.230531 Dec 25 21:23:38.176130 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2709/5368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:37 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:38.192478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:38.196194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7618c28d-a3da-4d0b-8e69-d57e5a3e3f1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:38.203595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.203706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7618c28d-a3da-4d0b-8e69-d57e5a3e3f1e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1215 microversion: 2.1 time: 0.121054 Dec 25 21:23:38.204623 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2660/5369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:38.205450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.206045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.207136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.207592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.236411 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'unpause' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active Dec 25 21:23:38.237065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'unpause' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:38.238117 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8410261-de91-4769-8bee-9a346dc4e4f0 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 145 microversion: 2.1 time: 0.050320 Dec 25 21:23:38.242187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2710/5370] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:38 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 145 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:38.249327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.250136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.258150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.260675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.260675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.260675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.394906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:38.403138 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ddeb03a-71ea-47f3-8af2-f5810d0fb8a4 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.159941 Dec 25 21:23:38.404226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2661/5371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:38.421161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.421783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.428012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.428467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.429543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.429990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.547810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.548592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: ec22e12b-a34c-4787-8d08-5dbf9b6556d1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.560303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.561055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.561802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.562344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.576978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:38.578063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] HTTP exception thrown: Instance ec22e12b-a34c-4787-8d08-5dbf9b6556d1 could not be found. Dec 25 21:23:38.579105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Returning 404 to user: Instance ec22e12b-a34c-4787-8d08-5dbf9b6556d1 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:38.580115 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44c81a31-ce11-44bb-999f-1676ca0d236b tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1" status: 404 len: 111 microversion: 2.1 time: 0.036078 Dec 25 21:23:38.580811 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2662/5372] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/ec22e12b-a34c-4787-8d08-5dbf9b6556d1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:38.588830 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af246b79-7bcd-4f6e-9d6b-93075eacf49f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.171865 Dec 25 21:23:38.590444 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2711/5373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:38.604816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:38.605989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.613268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.613890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.614917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.615236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6eca14b3-59ff-4a3e-9c26-7684574375c8 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:38.615580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.616173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6eca14b3-59ff-4a3e-9c26-7684574375c8 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 649da545-fcde-4105-bb9d-c78faee68d2e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.624976 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6eca14b3-59ff-4a3e-9c26-7684574375c8 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 649da545-fcde-4105-bb9d-c78faee68d2e could not be found. Dec 25 21:23:38.626130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6eca14b3-59ff-4a3e-9c26-7684574375c8 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 649da545-fcde-4105-bb9d-c78faee68d2e could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:38.627317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6eca14b3-59ff-4a3e-9c26-7684574375c8 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/649da545-fcde-4105-bb9d-c78faee68d2e/action" status: 404 len: 111 microversion: 2.1 time: 0.016025 Dec 25 21:23:38.628767 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2712/5374] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:38 2021] POST /compute/v2.1/servers/649da545-fcde-4105-bb9d-c78faee68d2e/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:38.638907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.639790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.647638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.648098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.648907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.649354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.666627 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c6083732-1b97-444f-a201-c622b2275991 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.067054 Dec 25 21:23:38.668774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2663/5375] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:38 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:38.802527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:38.811333 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5070736-00d5-40de-829b-7e6cbe46acf3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.178954 Dec 25 21:23:38.812231 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2713/5376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:38.829602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.830503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.837751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.838216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.839049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.839670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.960650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:38.961510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:38.969784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.970343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:38.971139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:38.971675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.068952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:39.077574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a4f4248-26a9-44d3-b2b3-681cd49108d5 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.252974 Dec 25 21:23:39.085107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2664/5377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:39.094592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:39.095605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.102199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.102664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.103801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.103998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.159776 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea6413fc-4484-4d1d-a27f-e4c730f18c4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.068944 Dec 25 21:23:39.160440 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2665/5378] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:39 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:39.166485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:39.167225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.168180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:39.174443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.177675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.177675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.177675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.178103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43058d5c-8b8d-4c9f-8f9c-71a3ccef6992 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.220843 Dec 25 21:23:39.178103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2714/5379] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:38 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:39.201155 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Cannot 'unshelve' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active Dec 25 21:23:39.201752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 409 to user: Cannot 'unshelve' instance 336c6856-ca33-4291-b38f-03e7f7a5db93 while it is in vm_state active {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:39.202585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0777f562-a12a-4d88-931b-78205e8e44a7 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action" status: 409 len: 146 microversion: 2.1 time: 0.040651 Dec 25 21:23:39.203348 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2666/5380] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:39 2021] POST /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93/action => generated 146 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:39.219977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:39.220829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.222332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:39.226054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.230729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.236444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.236444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.236444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.236765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.236765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.237665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.238262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.313887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:39.321851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e964f43-df2c-40ab-a88e-13a648eeaf4e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1219 microversion: 2.1 time: 0.105026 Dec 25 21:23:39.322700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2667/5381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:39 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:39.437292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:39.444941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2a81791-524a-4e59-ac62-de4e100a0fa2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.235382 Dec 25 21:23:39.445518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2715/5382] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:39 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:39.462729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:39.463349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.470633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.471305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.472105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.472541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.626826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:39.639756 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a60b1d9-1ec2-4421-b477-6337a6f3dc02 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.180667 Dec 25 21:23:39.640572 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2668/5383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:39 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:39.661308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96d8e604-fe7b-4211-94ea-85446cabd69a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20506336_updated"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:39.663205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96d8e604-fe7b-4211-94ea-85446cabd69a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 80617ca7-a553-48f5-87f1-85341d99414f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.674451 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-96d8e604-fe7b-4211-94ea-85446cabd69a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 80617ca7-a553-48f5-87f1-85341d99414f could not be found. Dec 25 21:23:39.675571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96d8e604-fe7b-4211-94ea-85446cabd69a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 80617ca7-a553-48f5-87f1-85341d99414f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:39.677204 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96d8e604-fe7b-4211-94ea-85446cabd69a tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "PUT /compute/v2.1/servers/80617ca7-a553-48f5-87f1-85341d99414f" status: 404 len: 111 microversion: 2.1 time: 0.023581 Dec 25 21:23:39.678036 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2716/5384] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:23:39 2021] PUT /compute/v2.1/servers/80617ca7-a553-48f5-87f1-85341d99414f => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:39.685590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:39.686420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:39.686564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.687332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.692443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.692922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.693878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.694325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.695339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.695969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.697162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.698154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.758716 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6be76de-a7b1-4f88-a228-f3a3aae43004 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.082916 Dec 25 21:23:39.759694 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2669/5385] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:39 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:39.851469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:39.858880 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8eea3364-babc-4c0b-9c8d-1bf0287d7680 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.176782 Dec 25 21:23:39.859449 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2717/5386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:39 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:39.876953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:39.877667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:39.885602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.886770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:39.887490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:39.887930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.038548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:40.047623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4259a44e-d98a-4421-bafd-174d7ef6ac7d tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.174847 Dec 25 21:23:40.048383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2670/5387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:39 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:40.064788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecd98a4d-a3b4-4603-b866-73015a9cef45 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:40.066002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecd98a4d-a3b4-4603-b866-73015a9cef45 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:40.066814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecd98a4d-a3b4-4603-b866-73015a9cef45 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "PUT /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 400 len: 619 microversion: 2.1 time: 0.006460 Dec 25 21:23:40.067525 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2718/5388] 10.222.0.32 () {60 vars in 1256 bytes} [Sat Dec 25 21:23:40 2021] PUT /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 619 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:23:40.075960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:40.076854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.084517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.085087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.086166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.086868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.172012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:40.172958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.182502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.183220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.185237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.185816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.242649 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78aef188-b355-4939-9c7e-705f6dd52fad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.074214 Dec 25 21:23:40.244226 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2719/5389] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:40 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:40.251680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:40.252935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.263151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.263894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.264868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.265642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.271656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:40.288325 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51726b85-d497-418f-84b0-c5aaf632305b tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.215694 Dec 25 21:23:40.290085 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2671/5390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:40 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:40.307124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:40.308490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.314861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.315435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.316833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.316833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.458490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:40.467608 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00745847-5f3a-4284-8996-f56957f9778c tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.221782 Dec 25 21:23:40.468427 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2720/5391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:40 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:40.473388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:40.474337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.485506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.488521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.488521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.488521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.518276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:40.528979 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25c763ed-0a80-4d18-bea9-752bcbf70d55 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.225354 Dec 25 21:23:40.540171 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2672/5392] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:40 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:40.545505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16557542-ff1d-40e8-a700-89163aa1e26f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:40.546707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16557542-ff1d-40e8-a700-89163aa1e26f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:40.547664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16557542-ff1d-40e8-a700-89163aa1e26f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "PUT /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 400 len: 108 microversion: 2.1 time: 0.006059 Dec 25 21:23:40.548425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2673/5393] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:23:40 2021] PUT /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 108 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:23:40.559422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:40.559422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.560637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:40.568001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.568451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.568790 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-56f54cb4-b3d7-4912-a1b4-e59b8e0446ac tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1267 microversion: 2.1 time: 0.098943 Dec 25 21:23:40.569276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.569528 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2721/5394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:40 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:40.569714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.775510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:40.776797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:40.783658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.784411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.785315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:40.785832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:40.835076 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9079f3b5-5d36-4735-bb13-e52145d09352 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064316 Dec 25 21:23:40.841246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2722/5395] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:40 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:40.849293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:40.858262 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78ce949e-336b-4216-96a1-f1a254a69d73 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1503 microversion: 2.1 time: 0.304377 Dec 25 21:23:40.859141 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2674/5396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:40 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1503 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:41.255858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:41.256857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:41.264790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.266262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.267628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.268242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.314289 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fcdf8447-63ae-4e2d-95eb-3fa006895df2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062403 Dec 25 21:23:41.314946 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2723/5397] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:41 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:41.485548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:41.486279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:41.493233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.493697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.494501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.494952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.607483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:41.609145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:41.618822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.619665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.621974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.622660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.681133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:41.702778 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a9c1f5c-8bef-4e10-93bd-d3b6d612fb43 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.219516 Dec 25 21:23:41.704244 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2675/5398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:41 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:41.848861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:41.849821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:41.857554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.861416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.862645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:41.865237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:41.938451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcff966f-43af-4f3f-bd30-0f8cd71914d2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.094150 Dec 25 21:23:41.939424 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2676/5399] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:41 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:41.959167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:41.971715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-819c07f7-df97-40c9-9815-89401be4992d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.387595 Dec 25 21:23:41.984506 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2724/5400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:41 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:42.326134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:42.328161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:42.334544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.335207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.336269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.336713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.380329 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a2e66759-4b14-4af0-80d7-ad6618623ad2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058559 Dec 25 21:23:42.386621 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2677/5401] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:42 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:42.721030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:42.721630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:42.729933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.730397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.731421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.731864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.890717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:42.903230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15d3e017-5433-4c81-8866-959c1a147fac tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.185852 Dec 25 21:23:42.904184 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2725/5402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:42 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:42.942988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-59931a21-f3b0-45f2-b6c9-ba81f3908486 req-724199e0-77f0-4e71-9fd5-b5fdd26594ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80ab586d-800d-4e54-9ed7-b09636cb7bd5", "tag": "8682c537-48c9-45f3-aff8-21394b858c2b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:42.946562 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:42.946562 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:42.954863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:42.954863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:42.960368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.960820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.964837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.965523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.973370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-59931a21-f3b0-45f2-b6c9-ba81f3908486 req-724199e0-77f0-4e71-9fd5-b5fdd26594ae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:42.973901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-59931a21-f3b0-45f2-b6c9-ba81f3908486 req-724199e0-77f0-4e71-9fd5-b5fdd26594ae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:42.991330 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-59931a21-f3b0-45f2-b6c9-ba81f3908486 req-724199e0-77f0-4e71-9fd5-b5fdd26594ae service nova] Creating event network-changed:8682c537-48c9-45f3-aff8-21394b858c2b for instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5 on nch2-master-1 Dec 25 21:23:42.998003 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-59931a21-f3b0-45f2-b6c9-ba81f3908486 req-724199e0-77f0-4e71-9fd5-b5fdd26594ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058933 Dec 25 21:23:42.998990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2678/5403] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:43.012348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:43.012348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:43.020343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:43.020812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:43.021748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:43.022070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:43.030230 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1b9cff9-7fc2-47b9-9928-a9e7659ae55e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.083718 Dec 25 21:23:43.030924 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2726/5404] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:42 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:43.295051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:43.302706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-beced7c1-ae4d-4945-8f55-87f18a4e13cf tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.298730 Dec 25 21:23:43.303274 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2679/5405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:43 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:43.392655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:43.394074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:43.402128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:43.402982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:43.403741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:43.404196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:43.452510 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe4c5532-1454-416e-aaf6-2aa7a137e090 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063831 Dec 25 21:23:43.456639 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2727/5406] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:43 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:43.921103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:43.921801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:43.928950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:43.929896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:43.930932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:43.931599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.043668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:44.044763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:44.053037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:44.057138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.057138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:44.057138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.142326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:44.151071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27fc207c-c88d-4722-b84e-97eae3288abb tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1567 microversion: 2.1 time: 0.235053 Dec 25 21:23:44.152243 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2680/5407] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:43 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:44.235142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8defedb3-cd55-4bc1-9c74-610984cc47a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.196452 Dec 25 21:23:44.237164 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2728/5408] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:44 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:44.319449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:44.320718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:44.330354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:44.330808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.331603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:44.332040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.467476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:44.469219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:44.480713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:44.481200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.482284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:44.482903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:44.531085 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7c6ea718-e900-4949-8a8e-213445b6215c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.070722 Dec 25 21:23:44.537051 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2729/5409] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:44 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:44.554990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:44.562918 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5716ef15-d9a9-4e6f-b253-cf69bac7a130 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.247162 Dec 25 21:23:44.563488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2681/5410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:44 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:45.169306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:45.173580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.176675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.177154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.177939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.178387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.247466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:45.248430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.254793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.255243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.256214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.256658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.306513 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-420f837c-c994-4fe2-9e17-96ba5c4d5d1b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.063091 Dec 25 21:23:45.308003 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2682/5411] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:45 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:45.331501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:45.340186 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2fad9d0-bec0-4fdf-9d81-1e9ea3603891 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1547 microversion: 2.1 time: 0.175064 Dec 25 21:23:45.340746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2730/5412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:45 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1547 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:45.357153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:45.357744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.364768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.365262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.366063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.366502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.445932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Cannot 'detach_volume' instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 while it is in vm_state rescued Dec 25 21:23:45.446535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 409 to user: Cannot 'detach_volume' instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 while it is in vm_state rescued {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:45.447705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c13f8c74-12ec-46fa-a694-3cd9f732bd6a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "DELETE /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments/240601d5-5803-4db4-ad87-ded28e2eb84d" status: 409 len: 152 microversion: 2.1 time: 0.095379 Dec 25 21:23:45.449285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2683/5413] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:23:45 2021] DELETE /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments/240601d5-5803-4db4-ad87-ded28e2eb84d => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:45.457709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:45.458304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.465319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.465778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.466567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.467006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.543945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:45.545276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.553641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.554337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.555331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.555874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.609270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-934aec52-ffbd-4632-8046-c69f98d1456f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064837 Dec 25 21:23:45.613104 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2684/5414] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:45 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:45.619287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:45.620505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.627643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.628101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.629045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.629345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.737803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5e59602-2ea9-4693-9439-c82eeb72b0ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action" status: 202 len: 0 microversion: 2.1 time: 0.283722 Dec 25 21:23:45.740157 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2731/5415] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:45 2021] POST /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:45.754380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:45.755108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:45.761731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.762323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.763224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:45.763773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:45.771074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:45.780317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86aebd92-3632-4516-92ce-4b5b3e5b4d33 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.168714 Dec 25 21:23:45.782406 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2685/5416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:45 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:45.933119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:45.941170 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58950028-c228-42cd-a553-64057ccc96d3 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1555 microversion: 2.1 time: 0.194073 Dec 25 21:23:45.951343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2732/5417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:45 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1555 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:46.320599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:46.320599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:46.338344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.339499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.340518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.340749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.389664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd4ed08b-6803-4bfe-bb15-2b44e59e25de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.072763 Dec 25 21:23:46.389664 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2686/5418] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:46 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:46.623526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:46.627288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:46.634768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.635319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.637475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.641072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.688666 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bbb1b21e-31d1-4cf3-9e12-80acc2724590 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.071245 Dec 25 21:23:46.689483 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2733/5419] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:46 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:46.798731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:46.799484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:46.806554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.807008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.807786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.808225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.968120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:46.968971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:46.976508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.977000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.977834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:46.978449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:46.985563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:46.999841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1598084e-a5ca-414b-b2f7-8ca16b3d7242 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.202976 Dec 25 21:23:46.999841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2687/5420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:46 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:47.162011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:47.171232 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5f8446d-04a1-40f6-9810-880401c2ae07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1555 microversion: 2.1 time: 0.215798 Dec 25 21:23:47.181466 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2734/5421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:46 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:47.401193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:47.402131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:47.408867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:47.409353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:47.410132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:47.410569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:47.455476 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49e5f96d-94e4-459c-af70-b32c14de3460 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058033 Dec 25 21:23:47.459592 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2688/5422] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:47 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:47.700059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:47.701033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:47.708548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:47.709090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:47.709878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:47.710323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:47.750329 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1c31c6f-e13c-4e6c-a143-4e6b6a641137 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054451 Dec 25 21:23:47.751768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2735/5423] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:47 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:48.015404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:48.016560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:48.034717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.034717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.034717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.034717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.189331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:48.189950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:48.196892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.197353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.198969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.199442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.210998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:48.218532 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2749d74b-8440-45d3-8839-12ed785e90c1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.208000 Dec 25 21:23:48.219294 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2689/5424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:48 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:48.412117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:48.422126 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6303e946-0850-4542-87ee-8454141d883a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1561 microversion: 2.1 time: 0.236884 Dec 25 21:23:48.423190 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2736/5425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:48 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:48.468325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:48.469374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:48.476017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.476597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.477427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.477864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.499994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:48.500802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:48.511903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.511903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.511903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.511903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.523682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02e30f35-e728-4f04-a62d-d685a83c4528 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.060482 Dec 25 21:23:48.528336 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2690/5426] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:48 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:48.600407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'services' on Instance uuid 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:48.764447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:48.765573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:48.779139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.779514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.780715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.780919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.822573 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a474d53-cf24-4851-8910-7094444c29f3 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064024 Dec 25 21:23:48.826819 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2691/5427] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:48 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:48.828755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0db3fe07-4352-497e-844a-25c4579c44f0 req-3137e0a2-9552-4d02-9504-d34665ca2b1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ab586d-800d-4e54-9ed7-b09636cb7bd5", "name": "network-vif-plugged", "status": "completed", "tag": "8682c537-48c9-45f3-aff8-21394b858c2b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:48.830297 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:48.830297 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:48.838160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0db3fe07-4352-497e-844a-25c4579c44f0 req-3137e0a2-9552-4d02-9504-d34665ca2b1d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.839173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0db3fe07-4352-497e-844a-25c4579c44f0 req-3137e0a2-9552-4d02-9504-d34665ca2b1d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.850387 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0db3fe07-4352-497e-844a-25c4579c44f0 req-3137e0a2-9552-4d02-9504-d34665ca2b1d service nova] Creating event network-vif-plugged:8682c537-48c9-45f3-aff8-21394b858c2b for instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5 on nch2-master-1 Dec 25 21:23:48.855212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0db3fe07-4352-497e-844a-25c4579c44f0 req-3137e0a2-9552-4d02-9504-d34665ca2b1d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030121 Dec 25 21:23:48.855784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2692/5428] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:48.875766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4c7d2b9-c0c4-4bf7-b457-3ea682539b39 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "DELETE /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments/240601d5-5803-4db4-ad87-ded28e2eb84d" status: 202 len: 0 microversion: 2.1 time: 0.378868 Dec 25 21:23:48.877898 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2737/5429] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:23:48 2021] DELETE /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments/240601d5-5803-4db4-ad87-ded28e2eb84d => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:48.898024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:48.899355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:48.909651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.910521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.911647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:48.912312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:48.954157 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ca2e3b2-bf4c-4340-9357-c5f85e07d6e9 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065788 Dec 25 21:23:48.954962 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2693/5430] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:23:48 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:49.237466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:49.238169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:49.250256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.251356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.251548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.252227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.390902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:49.398307 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5efb7d7b-1807-468d-a5bb-9eaa506d9630 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.165748 Dec 25 21:23:49.398872 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2738/5431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:49 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:49.514258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:49.515722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:49.524366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.525079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.526137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.526778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.536745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:49.537810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:49.546651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.547383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.548370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.548800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.563011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:23:49.622664 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25fc3d55-dd16-45a3-bc8d-6dde3cd0bd14 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.090629 Dec 25 21:23:49.626408 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2739/5432] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:49 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:49.835603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:49.837391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:49.846257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.846714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.847820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.848263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.891126 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94838d8f-6a1b-45bd-9837-15fa831b5b83 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059490 Dec 25 21:23:49.891834 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2740/5433] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:49 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:23:49.968333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:49.969856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:49.988103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.988565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:49.991637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:49.991637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.025258 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-668ce7d0-ab65-498c-b376-6ef91986cf04 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062765 Dec 25 21:23:50.027213 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2741/5434] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:23:49 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:23:50.121532 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-efbd3927-bec8-42e3-bfe0-e15d0caa33c3 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "DELETE /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 204 len: 0 microversion: 2.1 time: 0.610614 Dec 25 21:23:50.122219 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2694/5435] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:23:49 2021] DELETE /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:23:50.130076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:50.130700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:50.137955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.138412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.139216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.142687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.310357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:50.318261 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9791c117-1423-4f0d-84f5-9020573c5a9d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1512 microversion: 2.1 time: 0.191842 Dec 25 21:23:50.318846 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2742/5436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:50 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:50.419840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:50.421090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:50.429776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.430256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.431038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.431475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.570757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:50.578827 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d61b6a23-fec0-4387-991a-915f7047feea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1315 microversion: 2.1 time: 0.166078 Dec 25 21:23:50.579697 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2695/5437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:50 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:50.635053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:50.637441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:50.644041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.644564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.645665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.646203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.688651 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9022980e-7d75-4601-94cf-6c886f519a56 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058219 Dec 25 21:23:50.689313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2743/5438] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:50 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:50.903045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:50.903990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:50.910467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.915986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.915986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:50.915986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:50.953721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb4e83ee-4097-4449-98f3-a08ca19ff5ad tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054638 Dec 25 21:23:50.954395 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2696/5439] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:50 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:51.043062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:51.049864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.057853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.058556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.059364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.060040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.106220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a7522c8-9b1d-48fb-8e18-6b4ce31a99e2 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072131 Dec 25 21:23:51.106814 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2744/5440] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 21:23:51 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477/os-volume_attachments => generated 25 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:23:51.168274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:51.169365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.177241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.177991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.178806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.179481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.221769 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Cannot 'reboot' instance 20a90e3e-c379-4f2f-9632-763f67a3a334 while it is in vm_state rescued Dec 25 21:23:51.222387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 409 to user: Cannot 'reboot' instance 20a90e3e-c379-4f2f-9632-763f67a3a334 while it is in vm_state rescued {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:51.223235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7283482-d282-47fa-a9e7-448b6c09f17a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334/action" status: 409 len: 145 microversion: 2.1 time: 0.060260 Dec 25 21:23:51.224297 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2697/5441] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:51 2021] POST /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334/action => generated 145 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:51.233945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:51.235672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.242805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.244486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.244486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.244486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.271137 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Cannot 'rebuild' instance 20a90e3e-c379-4f2f-9632-763f67a3a334 while it is in vm_state rescued Dec 25 21:23:51.271829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 409 to user: Cannot 'rebuild' instance 20a90e3e-c379-4f2f-9632-763f67a3a334 while it is in vm_state rescued {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:51.272746 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-360c544d-e25d-4688-91fb-35a588744067 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "POST /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334/action" status: 409 len: 146 microversion: 2.1 time: 0.043464 Dec 25 21:23:51.273625 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2745/5442] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:51 2021] POST /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334/action => generated 146 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:23:51.337532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:51.338166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.345657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.346117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.346915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.347358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.503543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:51.514507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf0645f5-8244-42c3-93ad-0ac2810e0f8d tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1512 microversion: 2.1 time: 0.182411 Dec 25 21:23:51.515144 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2698/5443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:51 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:51.596414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:51.597176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.603808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.604795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.605613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.606054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.709374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:51.713061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.726505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.727246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.728765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.729738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.780183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e7477b07-5a5a-44c7-8d53-97744a3c82a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.083289 Dec 25 21:23:51.781039 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2699/5444] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:51 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:51.885930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:51.899186 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-867c3ff7-f985-40a1-af66-76d7a88c9a15 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1502 microversion: 2.1 time: 0.301463 Dec 25 21:23:51.899186 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2746/5445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:51 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1502 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:51.910210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:51.910833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.918056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.918511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.919298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.919886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.970015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:51.971111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:51.978055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.978661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:51.979715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:51.980231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.021006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f3a42cdf-fba5-412a-af9e-3600812ff930 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.055884 Dec 25 21:23:52.022753 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2747/5446] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:51 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:52.155717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53520a2e-2dc2-45f3-9253-a12205b23e4c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5/action" status: 202 len: 0 microversion: 2.1 time: 0.249369 Dec 25 21:23:52.160723 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2700/5447] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:51 2021] POST /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:52.167860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:52.168670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:52.192142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:52.192142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.192142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:52.192142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.537184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:52.538154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:52.548514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:52.549299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.550712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:52.552617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.599167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:52.608639 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1ee473fd-13da-4547-b1e9-d53cad9dd089 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1507 microversion: 2.1 time: 0.445730 Dec 25 21:23:52.616355 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2748/5448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:52 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1507 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:52.792386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:52.793450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:52.799987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:52.800484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.801384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:52.801825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:52.847200 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83b85048-281f-4378-a3da-ab278b96d24c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.058927 Dec 25 21:23:52.848056 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2749/5449] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:52 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:52.881629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:52.889876 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2737f3c1-a034-4c6f-93f3-e9cd90d820aa tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1512 microversion: 2.1 time: 0.357577 Dec 25 21:23:52.890449 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2701/5450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:52 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1512 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:53.034129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:53.037042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:53.057271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.062225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.062225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.062225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.111747 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e358d76-e96b-450d-9dc4-02515ffaaf95 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.082007 Dec 25 21:23:53.112426 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2750/5451] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:53 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:53.161081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c7c3d678-b2fa-4edf-8960-3a653a47af68 req-8f5370ff-2f68-48fe-b636-b1f04545a150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64261b4d-7f44-4796-9323-e198eada5059", "name": "network-vif-deleted", "tag": "e1a1ed5e-2df4-4726-86bd-bc56ff15ffb1"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:53.163180 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:53.163180 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:53.172587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c7c3d678-b2fa-4edf-8960-3a653a47af68 req-8f5370ff-2f68-48fe-b636-b1f04545a150 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.173123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c7c3d678-b2fa-4edf-8960-3a653a47af68 req-8f5370ff-2f68-48fe-b636-b1f04545a150 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.185798 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c7c3d678-b2fa-4edf-8960-3a653a47af68 req-8f5370ff-2f68-48fe-b636-b1f04545a150 service nova] Creating event network-vif-deleted:e1a1ed5e-2df4-4726-86bd-bc56ff15ffb1 for instance 64261b4d-7f44-4796-9323-e198eada5059 on nch1-master-1 Dec 25 21:23:53.191065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c7c3d678-b2fa-4edf-8960-3a653a47af68 req-8f5370ff-2f68-48fe-b636-b1f04545a150 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035090 Dec 25 21:23:53.191921 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2702/5452] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:53.639492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:53.639492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:53.649694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.650665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.651773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.652443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.860230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:53.861189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:53.867054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:53.868516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.869187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.870800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.871254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.876431 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa1216ce-6fc0-417a-beb1-1e76b059d9ea tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1487 microversion: 2.1 time: 0.246594 Dec 25 21:23:53.886353 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2751/5453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:53 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1487 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:53.893615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:53.894259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:53.901868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.901868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.902495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.903619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.929081 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-707d08cd-ba31-4923-96e5-086019b386f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.069926 Dec 25 21:23:53.931116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2703/5454] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:53 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:53.931772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lazy-loading 'flavor' on Instance uuid 80ab586d-800d-4e54-9ed7-b09636cb7bd5 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:53.943413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:53.943413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:53.962489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.965856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:53.965856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:53.965856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.032026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.032760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.033446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lazy-loading 'fault' on Instance uuid 64261b4d-7f44-4796-9323-e198eada5059 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:23:54.397467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7df5c79b8ea4c6ea7cf84b381b29765', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dcf2517f61849cb9650682caf0c5712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:54.408227 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d3ad5d38-c324-4b06-800e-33ecec764522 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 200 len: 1307 microversion: 2.1 time: 0.472931 Dec 25 21:23:54.410077 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2704/5455] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:53 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 1307 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:54.425979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:54.427181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:54.435929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.436854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.438808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.439574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.486848 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50be1dae-0119-4c61-bb9b-2ca9bc990ed4 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.073496 Dec 25 21:23:54.489084 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2705/5456] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:54 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:54.556588 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2403b563-edee-461e-80dc-4b9403208ea3 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5/action" status: 202 len: 0 microversion: 2.1 time: 0.666613 Dec 25 21:23:54.558524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2752/5457] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:53 2021] POST /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5/action => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:23:54.566984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:54.568183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:54.575735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.576455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.577443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.578044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.849591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:54.858068 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b1649ec-85f9-49e7-8801-dd7b3e8b5652 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1493 microversion: 2.1 time: 0.295276 Dec 25 21:23:54.858922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2706/5458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:54 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1493 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:23:54.942405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:54.949439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:54.957633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.958441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:54.959277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:54.959723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:55.010562 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b24be0cb-ac5d-4e0a-89f2-8c8421e4ce7f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.072167 Dec 25 21:23:55.015095 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2753/5459] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:54 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:55.429496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:55.430164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] [instance: 64261b4d-7f44-4796-9323-e198eada5059] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:55.437969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:55.438687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:55.439946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:55.440375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:55.457037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] HTTP exception thrown: Instance 64261b4d-7f44-4796-9323-e198eada5059 could not be found. Dec 25 21:23:55.459174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] Returning 404 to user: Instance 64261b4d-7f44-4796-9323-e198eada5059 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:23:55.460105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-35275ea9-257c-4cbf-8d32-a6777b079c27 tempest-AttachVolumeNegativeTest-2126197630 tempest-AttachVolumeNegativeTest-2126197630-project] 10.222.0.32 "GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059" status: 404 len: 111 microversion: 2.1 time: 0.034395 Dec 25 21:23:55.460980 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2707/5460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:55 2021] GET /compute/v2.1/servers/64261b4d-7f44-4796-9323-e198eada5059 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:23:55.501238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:55.505264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:55.516057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:55.516970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:55.517847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:55.518441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:55.565755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-781fe76b-ab7d-4c20-8fde-94d4a237b6b6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.070554 Dec 25 21:23:55.568619 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2754/5461] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:55 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:55.879393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:55.880031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:55.887680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:55.888382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:55.889440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:55.890193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:56.024842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:56.027402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:56.044533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:56.044533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:56.044533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:56.044533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:56.100822 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-801c70c2-590e-42be-8d98-ac7978969c48 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.080176 Dec 25 21:23:56.106098 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2755/5462] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:56 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:56.135580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:56.144495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6904fac1-a670-499c-b4e1-416e190a0441 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1514 microversion: 2.1 time: 0.272217 Dec 25 21:23:56.155093 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2708/5463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:55 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1514 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:56.580062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:56.581211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:56.592299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:56.592812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:56.593696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:56.594245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:56.640059 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-266cb47a-abba-4624-816b-3ae4eae7d823 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064722 Dec 25 21:23:56.640929 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2756/5464] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:56 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:57.113048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:57.114592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:57.124136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:57.125339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:57.126626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:57.127260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:57.162578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:57.163549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:57.177314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:57.177314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:57.177314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:57.177314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:57.230089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4dd19baa-f809-484f-9e1e-fecb2bbf5f9f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.120845 Dec 25 21:23:57.232936 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2709/5465] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:57 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:57.333402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:57.346338 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2553581c-8156-44fe-bc4a-aeadb145e836 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.188196 Dec 25 21:23:57.357318 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2757/5466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:57 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:57.652438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:57.653482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:57.660491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:57.660970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:57.661756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:57.662199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:57.707265 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c73de91-176b-4d1b-8f0c-507e1b19fcd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058601 Dec 25 21:23:57.708268 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2710/5467] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:57 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:58.243292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:58.244256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:58.261732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.269048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.269048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.269048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.336543 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7c78f7e5-b08a-493e-901a-a1022c192665 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.097941 Dec 25 21:23:58.339152 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2758/5468] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:58 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:58.363873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:58.364574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:58.376371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.377086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.378236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.378920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.668606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:58.683220 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a9a0f07-55d8-414a-8106-4d32bacecb24 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.323354 Dec 25 21:23:58.686003 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2711/5469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:58 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:23:58.728446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:58.733502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:58.746406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.746865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.747706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.748160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.798743 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a81a79e-1c3e-4f3e-8c46-ae702f3fadd9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.073083 Dec 25 21:23:58.803055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2759/5470] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:58 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:58.841993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-55bfc377-38d3-4acd-b714-0825469692d8 req-dd735a08-d4b2-4d0c-8f31-3342efa192f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ab586d-800d-4e54-9ed7-b09636cb7bd5", "name": "network-vif-plugged", "status": "completed", "tag": "8682c537-48c9-45f3-aff8-21394b858c2b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:58.844075 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:23:58.844075 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:23:58.858212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-55bfc377-38d3-4acd-b714-0825469692d8 req-dd735a08-d4b2-4d0c-8f31-3342efa192f9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:58.858807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-55bfc377-38d3-4acd-b714-0825469692d8 req-dd735a08-d4b2-4d0c-8f31-3342efa192f9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:58.877764 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-55bfc377-38d3-4acd-b714-0825469692d8 req-dd735a08-d4b2-4d0c-8f31-3342efa192f9 service nova] Creating event network-vif-plugged:8682c537-48c9-45f3-aff8-21394b858c2b for instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5 on nch2-master-1 Dec 25 21:23:58.883392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-55bfc377-38d3-4acd-b714-0825469692d8 req-dd735a08-d4b2-4d0c-8f31-3342efa192f9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045499 Dec 25 21:23:58.884235 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2712/5471] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:23:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:23:59.660727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:59.674393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:59.682274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:59.682788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:59.683615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:59.684059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:59.703396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:23:59.704122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:59.718481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:59.718984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:59.719756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:59.720361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:59.740791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-74c5cf0a-ac5c-4ceb-8293-78d63e17dd06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.393787 Dec 25 21:23:59.746845 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2760/5472] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:23:59 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:23:59.810744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:23:59.812012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:23:59.820427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:59.821124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:59.822078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:23:59.823247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:23:59.874842 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bdb60e40-63db-4c43-b9e9-004114659872 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.068369 Dec 25 21:23:59.875795 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2761/5473] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:23:59 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:23:59.943509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:23:59.953311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99b487c0-82a3-44e0-8f81-5ee8d40aa88d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.254073 Dec 25 21:23:59.954672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2713/5474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:23:59 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:00.755656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:00.756728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:00.765935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:00.766388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:00.769541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:00.769541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:00.814941 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2c90763b-3219-465f-9bb0-fb3933798b01 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.064778 Dec 25 21:24:00.818976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2762/5475] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:00.889196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:00.890203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:00.904141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:00.912993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:00.912993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:00.912993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:00.989463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:00.990263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:00.995780 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c84b071-d43a-4f19-a14e-cab6ecccdf4f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.105017 Dec 25 21:24:01.003453 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2714/5476] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:00 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:01.006560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:01.010670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:01.011612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:01.012250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:01.214166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:01.225038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6de909c5-0ff2-4ae7-8c02-dca1a35743ec tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.256908 Dec 25 21:24:01.225966 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2763/5477] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:00 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:01.827424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:01.829100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:01.842348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:01.843357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:01.844754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:01.845780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:01.903234 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9fa2e373-406d-4bd7-85d6-2ef7ff99c597 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.079751 Dec 25 21:24:01.903956 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2715/5478] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:01 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:02.014217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:02.015058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:02.022029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.022491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.023312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.023752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.069271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-071342c1-4996-4bcf-ad27-65bb23d825bf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058853 Dec 25 21:24:02.340033 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2764/5479] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:02 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:02.340694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:02.340694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:02.340694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.340694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.340694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.340694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.403893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:02.434877 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-92b1abfb-b42f-4bb5-8d47-98981ca543e0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.195100 Dec 25 21:24:02.437461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2716/5480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:02 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:02.832191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:02.832845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:02.848083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.850706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.856624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.856624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.889942 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. Dec 25 21:24:02.890562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:02.891416 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78944e22-aee9-4c89-8874-ce2f202818e3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "DELETE /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 404 len: 111 microversion: 2.1 time: 0.063576 Dec 25 21:24:02.891976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2765/5481] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:02 2021] DELETE /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:02.901953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:02.903225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 942e6548-a2f0-42a7-9cb7-ca574fef9231] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:02.915154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.916565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.917496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:02.918095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.918394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:02.918497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.945151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. Dec 25 21:24:02.945858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 942e6548-a2f0-42a7-9cb7-ca574fef9231 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:02.947074 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea49b934-718a-44ca-a316-00a4e8f5d66c tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231" status: 404 len: 111 microversion: 2.1 time: 0.050652 Dec 25 21:24:02.949101 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2717/5482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:02 2021] GET /compute/v2.1/servers/942e6548-a2f0-42a7-9cb7-ca574fef9231 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:02.950992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.951456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.954368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.956909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:02.958731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.958859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:02.975490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.976327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:02.977494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:02.981739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.015320 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35f52303-3aed-4a2c-b96a-1a2729d6cec5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.103913 Dec 25 21:24:03.017407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2766/5483] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:02 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:03.017570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:03.081707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:03.085967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:03.097809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:03.098333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.099085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:03.099536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.183735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c3e92ea-3cc6-489a-b35a-1a6e63513adf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.104801 Dec 25 21:24:03.185560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2767/5484] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:03 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:03.439664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54188378-71d9-45f3-b349-2d0e35760382 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "DELETE /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 204 len: 0 microversion: 2.1 time: 0.486447 Dec 25 21:24:03.442317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2718/5485] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:02 2021] DELETE /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:24:03.451312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:03.453460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:03.469133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:03.473206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:03.482218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:03.483121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.484144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:03.484900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.485165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:03.485627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.486428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:03.487017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:03.754999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:03.758775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:03.767198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7037be9c-865f-4c1b-a6ef-3d4c3808aa10 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.315016 Dec 25 21:24:03.769330 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2719/5486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:03 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:03.783778 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d9e8698-b618-44de-8ca0-a100e03b67b2 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.337919 Dec 25 21:24:03.785065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2768/5487] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:03 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:04.030541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:04.031851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:04.047704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.051186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.051186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.051186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.106786 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e035c833-4d6c-4d30-9939-49128859db84 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.082295 Dec 25 21:24:04.110656 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2720/5488] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:04 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:04.195892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:04.198044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:04.205491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.206026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.207051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.207690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.251264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-caf54207-9e77-47cd-993b-e5c2776dfe45 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.058864 Dec 25 21:24:04.254122 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2769/5489] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:04 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:04.796022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:04.796720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:04.804088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.804647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.805802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.806444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.807099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:04.807808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:04.822633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.824654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:04.827242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:04.827242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:05.137109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:05.151533 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac11a63a-fc1c-42ee-88cd-277aff8dca61 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.355308 Dec 25 21:24:05.152508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2721/5490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:04 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:05.158987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:05.160261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:05.187564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:05.188425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:05.191262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:05.192071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:05.229372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:05.246438 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2fe1ca4-232d-45b5-b27d-7096ac8fa0d3 tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1509 microversion: 2.1 time: 0.445484 Dec 25 21:24:05.247342 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2770/5491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:04 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1509 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:05.263162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:05.269362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:05.276450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:05.276970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:05.277984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:05.278446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:05.294499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71aa6b67-3140-49a3-9f8d-73206fa408a7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.132583 Dec 25 21:24:05.295229 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2722/5492] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:05 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:05.331897 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25440682-8c62-4b29-a716-0ccd0c8d5b4a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.072327 Dec 25 21:24:05.333521 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2771/5493] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:05 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:06.048713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8f4d3019-08d7-4542-acb9-bad71f80ee94 req-3e2fd045-9f66-4bba-a23b-1e5678afff71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336c6856-ca33-4291-b38f-03e7f7a5db93", "name": "network-vif-deleted", "tag": "6dcde4f1-b084-49e9-9b96-ae184bf1c495"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:06.050909 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:06.050909 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:24:06.069772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8f4d3019-08d7-4542-acb9-bad71f80ee94 req-3e2fd045-9f66-4bba-a23b-1e5678afff71 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.073662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8f4d3019-08d7-4542-acb9-bad71f80ee94 req-3e2fd045-9f66-4bba-a23b-1e5678afff71 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.102100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8f4d3019-08d7-4542-acb9-bad71f80ee94 req-3e2fd045-9f66-4bba-a23b-1e5678afff71 service nova] Creating event network-vif-deleted:6dcde4f1-b084-49e9-9b96-ae184bf1c495 for instance 336c6856-ca33-4291-b38f-03e7f7a5db93 on nch1-master-1 Dec 25 21:24:06.118031 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8f4d3019-08d7-4542-acb9-bad71f80ee94 req-3e2fd045-9f66-4bba-a23b-1e5678afff71 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074332 Dec 25 21:24:06.120978 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2723/5494] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:06.175032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:06.175786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:06.193303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.193777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.197861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.198320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.266324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:06.268561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:06.285966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.286624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.291883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.291883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.469154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:06.476609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:06.501446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b8d0788-4a77-4530-aa55-21c5091b3ed7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.335633 Dec 25 21:24:06.502463 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2772/5495] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:06 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:06.542098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-699527be-9cf7-4f8f-9604-ba58515e0fbb tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1300 microversion: 2.1 time: 0.250762 Dec 25 21:24:06.542098 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2724/5496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:06 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1300 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:06.542565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:06.542691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:06.542691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:06.542905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:06.542905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.542905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.542905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.542905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.549612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.555170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.557345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:06.558211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:06.618164 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9901d3e6-738d-4d1c-aea1-ce89170066f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.114197 Dec 25 21:24:06.619366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2773/5497] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:06 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:06.629384 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c22c58e0-531b-49ef-8e91-befa1df764a9 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.116201 Dec 25 21:24:06.630067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2725/5498] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:06 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:07.529668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:07.531196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:07.543033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.543986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.545009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.545684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.549634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:07.550357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:07.564064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.569716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.569716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.569716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.682989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.685206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.686642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lazy-loading 'fault' on Instance uuid 336c6856-ca33-4291-b38f-03e7f7a5db93 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:07.798994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '257eeccacdc24f00a418cbb27204cf4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66319858228140b3841ef6c7c8cd5c14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:07.813138 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-432bcfe5-a77e-454b-b531-8430fa81c0ae tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 200 len: 1305 microversion: 2.1 time: 0.266757 Dec 25 21:24:07.814376 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2726/5499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:07 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 1305 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:07.827510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:07.830149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:07.839898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.841962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.842443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.843124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.857473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:07.866444 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d7a7267-3b96-4377-a05d-a5b9ea1a3f2a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.342530 Dec 25 21:24:07.870111 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2774/5500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:07 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:07.877076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:07.881121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:07.900622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.904510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.904510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:07.904510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:07.916320 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8230b58d-c0bf-4c2c-8e0a-1cf20a2cf5f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.100353 Dec 25 21:24:07.919461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2727/5501] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:07 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:07.958639 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9f67e0b-4f3d-431c-b0d1-b8a6814c72c5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.081653 Dec 25 21:24:07.960215 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2775/5502] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:07 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:08.831853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:08.832567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] [instance: 336c6856-ca33-4291-b38f-03e7f7a5db93] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:08.840643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:08.841133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:08.842311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:08.843036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:08.862123 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] HTTP exception thrown: Instance 336c6856-ca33-4291-b38f-03e7f7a5db93 could not be found. Dec 25 21:24:08.863025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] Returning 404 to user: Instance 336c6856-ca33-4291-b38f-03e7f7a5db93 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:08.864047 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-874dcf6e-27ba-4028-9084-36af09265c8f tempest-ServersNegativeTestJSON-1875920152 tempest-ServersNegativeTestJSON-1875920152-project] 10.222.0.32 "GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93" status: 404 len: 111 microversion: 2.1 time: 0.036394 Dec 25 21:24:08.864607 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2728/5503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:08 2021] GET /compute/v2.1/servers/336c6856-ca33-4291-b38f-03e7f7a5db93 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:08.887835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:08.889269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:08.903795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:08.905614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:08.906623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:08.908381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:08.935512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:08.937486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:08.946474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:08.946474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:08.946891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:08.948038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:09.006766 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dfab33e8-b7bc-4aae-9973-dcb42a19a1bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.078628 Dec 25 21:24:09.012708 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2729/5504] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:08 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:09.018720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:09.019996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:09.027925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:09.028620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:09.029678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:09.030288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:09.097816 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78142a07-6819-4403-9338-9d4745d4e4a5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.083236 Dec 25 21:24:09.099125 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2730/5505] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:09 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:09.131680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:09.142516 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e4921fe-1c93-4eaa-a347-2ee66f6f14f2 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.259250 Dec 25 21:24:09.154263 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2776/5506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:08 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:10.023215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:10.024350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:10.033854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:10.038416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:10.041600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:10.048069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:10.120793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-432c31bd-4aa9-4081-882b-0304dbacde4f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.103344 Dec 25 21:24:10.124659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2731/5507] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:10 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:10.124821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:10.124821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:10.162128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:10.162574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:10.164778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:10.164938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:10.168230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:10.169875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:10.177958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:10.178434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:10.183512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:10.184023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:10.226659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f08a5c98-cfac-4cd7-ad5c-d0a89a16425d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.117627 Dec 25 21:24:10.227746 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2777/5508] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:10 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:10.499838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:10.514704 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4596a045-74d3-419c-bc47-998ab6c013ad tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.357257 Dec 25 21:24:10.531186 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2732/5509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:10 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:11.132623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:11.133821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:11.141781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:11.142418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:11.143232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:11.143750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:11.194452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db67b125-823d-4d5f-8faa-beb4a09bd0ba tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066096 Dec 25 21:24:11.195159 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2778/5510] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:11 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:11.238872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:11.240001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:11.248771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:11.250596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:11.250596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:11.250956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:11.296309 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89c07098-3d89-4c8b-a350-2c7d484d453a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.061396 Dec 25 21:24:11.299876 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2733/5511] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:11 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:11.548322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:11.549056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:11.556925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:11.557370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:11.558196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:11.558632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:11.794420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:11.806089 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40b0674b-26c1-4ede-be77-d5c6ec11d48e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.262005 Dec 25 21:24:11.816103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2779/5512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:11 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:12.208202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:12.209377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:12.216990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:12.218718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:12.218718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:12.218718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:12.262159 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cfbaca1f-ac7c-4819-bb71-28a1ae169c38 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.059167 Dec 25 21:24:12.263397 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2734/5513] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:12 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:12.306838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:12.310558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:12.316017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:12.316471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:12.317317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:12.317751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:12.365721 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe20ded0-1a9e-47f0-a7da-df20952f1d4c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062397 Dec 25 21:24:12.377184 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2780/5514] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:12 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:12.825203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:12.825945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:12.838608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:12.838608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:12.838608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:12.838608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:13.002363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:13.010486 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e33a4231-a515-46e9-b860-aaeda6f10966 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1509 microversion: 2.1 time: 0.190809 Dec 25 21:24:13.011268 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2735/5515] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:12 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:13.275775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:13.277917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:13.285402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:13.286241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:13.287218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:13.288088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:13.336656 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89c5cc8a-55ec-4378-ade8-e02b237c3f46 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.065571 Dec 25 21:24:13.341258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2781/5516] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:13 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:13.383987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:13.385650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:13.392539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:13.393043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:13.393859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:13.394303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:13.444067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebbae757-a3f8-4b5a-be94-72c4fb61e829 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063608 Dec 25 21:24:13.444840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2736/5517] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:13 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:14.032690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:14.038052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:14.042568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.043334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.044804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.045539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.240197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:14.248480 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6b9886a5-2f3e-444d-b9a1-92d2801b9fbd tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1506 microversion: 2.1 time: 0.224085 Dec 25 21:24:14.249376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2782/5518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:14 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:14.350486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:14.351951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:14.360214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.360832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.362112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.362759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.418524 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6669e934-91b1-4f96-98b6-8b60ebe2ba25 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066954 Dec 25 21:24:14.418524 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2737/5519] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:14 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:14.441669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:14.444480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:14.448852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.450671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.456206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:14.460193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.461006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.464503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:14.473173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.478838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.478838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:14.478838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:14.507098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:14.526226 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e6c8689-9570-408a-a614-5dcbdd232819 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.068520 Dec 25 21:24:14.526226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2738/5520] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:14 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:15.013080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-305e89cf-e829-4aea-adfe-430f433fc5da tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "DELETE /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 204 len: 0 microversion: 2.1 time: 0.575625 Dec 25 21:24:15.013602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2783/5521] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:14 2021] DELETE /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:24:15.022033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:15.022851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:15.030838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.031547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.032404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.032992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.258404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:15.270914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:15.271901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:15.281775 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2ee7a9e0-c62d-4bcd-a6ed-6e82bc2d5757 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1505 microversion: 2.1 time: 0.263846 Dec 25 21:24:15.283776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2739/5522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:15 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:15.285895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.286770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.288204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.289749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.425104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:15.426734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:15.450905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.451371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.454562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.455398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.481852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:15.494741 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-880ef5e0-cf31-4640-9e14-411b41367206 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1506 microversion: 2.1 time: 0.227307 Dec 25 21:24:15.504183 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2784/5523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:15 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1506 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:15.522168 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5507aaf-b8d5-4b76-9695-5fcea6562aaa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.100843 Dec 25 21:24:15.522831 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2740/5524] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:15 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:15.534630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:15.535689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:15.547401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.547401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.547401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:15.548397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:15.600260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6dd24f83-2012-4e08-b08f-134096263c64 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.070534 Dec 25 21:24:15.601851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2785/5525] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:15 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:16.301231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:16.302237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:16.315570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.316268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.321594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.321594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.511992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:16.512827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:16.517452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:16.525552 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bea581ab-0786-403d-bfa0-002132effebe tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1505 microversion: 2.1 time: 0.228708 Dec 25 21:24:16.526127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2741/5526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:16 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1505 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:16.527054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.527511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.528484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.529199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.535481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:16.536456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:16.544729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.545211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.559903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.559903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.592103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e018c39d-c202-4fe9-aab9-c7bba8065f8a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.061241 Dec 25 21:24:16.593164 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2742/5527] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:16 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:16.629010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:16.638678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:16.661349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.661813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.663393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:16.663840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:16.717677 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed46539a-bf26-4255-ac79-21bbb1777b07 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.107258 Dec 25 21:24:16.718974 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2743/5528] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:16 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:16.739409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:16.747660 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a65e7edb-c051-4b72-8837-395f4a17d96d tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1506 microversion: 2.1 time: 0.239688 Dec 25 21:24:16.748251 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2786/5529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:16 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:17.547419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:17.548251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:17.562179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.562767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.564666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.565289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.618148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:17.619654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:17.627502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.627958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.628793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.632036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.680147 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-517477c4-16e6-40c2-942b-354fcbb64721 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.079941 Dec 25 21:24:17.680861 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2787/5530] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:17 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:17.730500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:17.733272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:17.738458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.738906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.747005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.747458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.795380 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b8726cf-3878-4806-912d-7335c8117e48 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069354 Dec 25 21:24:17.796862 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2788/5531] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:17 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:17.807036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:17.809592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:17.817830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.818487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.819925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:17.820558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:17.846718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:17.861088 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7cf0c6d9-977e-4963-98f4-efe45c9b96ab tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1505 microversion: 2.1 time: 0.319977 Dec 25 21:24:17.869154 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2744/5532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:17 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:18.052388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:18.064038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e8ce9db-7f77-47c1-9b98-36c4801c1296 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 200 len: 1449 microversion: 2.1 time: 0.264448 Dec 25 21:24:18.067793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2789/5533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:17 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 1449 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:18.081108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:18.082079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:18.102938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.102938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.102938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.102938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.147943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d9d574f9-6fa5-41e8-9a93-563e2bae9a28 req-aec2076b-95db-41aa-9f09-88e08d079668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20a90e3e-c379-4f2f-9632-763f67a3a334", "name": "network-vif-deleted", "tag": "5eecbec8-cd5d-45a6-9264-3971371aaf2c"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:18.150931 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:18.150931 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:18.161510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d9d574f9-6fa5-41e8-9a93-563e2bae9a28 req-aec2076b-95db-41aa-9f09-88e08d079668 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.162076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d9d574f9-6fa5-41e8-9a93-563e2bae9a28 req-aec2076b-95db-41aa-9f09-88e08d079668 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.180418 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d9d574f9-6fa5-41e8-9a93-563e2bae9a28 req-aec2076b-95db-41aa-9f09-88e08d079668 service nova] Creating event network-vif-deleted:5eecbec8-cd5d-45a6-9264-3971371aaf2c for instance 20a90e3e-c379-4f2f-9632-763f67a3a334 on nch2-master-1 Dec 25 21:24:18.186475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d9d574f9-6fa5-41e8-9a93-563e2bae9a28 req-aec2076b-95db-41aa-9f09-88e08d079668 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043749 Dec 25 21:24:18.187303 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2790/5534] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:18.291980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:18.300169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e3c2b87-8109-4eea-a19b-b69b0af0e5bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.223022 Dec 25 21:24:18.300754 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2745/5535] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:18 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:18.327761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:18.328478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:18.335353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.336168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.336921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.338116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.516983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:18.526643 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4076704a-4ece-447f-9a3b-0ae43d6261f8 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.206983 Dec 25 21:24:18.527993 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2791/5536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:18 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:18.543680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-edc04f0b-9f9f-4fba-836b-4997389018d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:18.549981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edc04f0b-9f9f-4fba-836b-4997389018d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.550607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edc04f0b-9f9f-4fba-836b-4997389018d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.576139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-edc04f0b-9f9f-4fba-836b-4997389018d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Going to try to stop instance {{(pid=136547) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:24:18.697883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:18.699855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:18.706453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.707151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.708101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.708855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.765747 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-511efd6c-f3ba-4818-98c3-83f7651fdda6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.075966 Dec 25 21:24:18.767715 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2792/5537] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:18 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:18.781182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-196e5a82-2584-4e42-8719-d922ac14b4b1 req-cb48b611-a7ac-49ce-9ee9-681b84f82572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ab586d-800d-4e54-9ed7-b09636cb7bd5", "name": "network-vif-unplugged", "status": "completed", "tag": "8682c537-48c9-45f3-aff8-21394b858c2b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:18.782700 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:18.782700 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:18.793040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-196e5a82-2584-4e42-8719-d922ac14b4b1 req-cb48b611-a7ac-49ce-9ee9-681b84f82572 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.793557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-196e5a82-2584-4e42-8719-d922ac14b4b1 req-cb48b611-a7ac-49ce-9ee9-681b84f82572 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.818341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_external_events [req-196e5a82-2584-4e42-8719-d922ac14b4b1 req-cb48b611-a7ac-49ce-9ee9-681b84f82572 service nova] Unable to find a host for instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5. Dropping event network-vif-unplugged {{(pid=136548) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 21:24:18.820751 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-196e5a82-2584-4e42-8719-d922ac14b4b1 req-cb48b611-a7ac-49ce-9ee9-681b84f82572 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.043846 Dec 25 21:24:18.822828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2793/5538] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:18 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 25 21:24:18.829916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:18.831235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:18.839838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.840612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.841886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.842679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.844977 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-edc04f0b-9f9f-4fba-836b-4997389018d1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.304770 Dec 25 21:24:18.846360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2746/5539] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:18 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:18.870876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:18.871864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:18.890468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.893165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.893165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.893165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.937647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9d4ff78-e6e5-4988-aba1-ffdc3bc5981c tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.112829 Dec 25 21:24:18.942038 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2794/5540] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:18 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:18.948764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:18.949827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:18.962760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.963220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:18.964037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:18.964481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:19.007720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:19.008149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:19.008819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'fault' on Instance uuid 20a90e3e-c379-4f2f-9632-763f67a3a334 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:19.079206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:19.089882 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd117578-be80-42d7-b9fa-0def5f04ed07 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 200 len: 1311 microversion: 2.1 time: 0.145541 Dec 25 21:24:19.090623 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2795/5541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:18 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 1311 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:19.193734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:19.203975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29c108a5-041b-495b-949b-2567be112a0f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.352889 Dec 25 21:24:19.204482 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2747/5542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:18 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:19.778507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:19.779441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:19.785870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:19.786329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:19.787311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:19.788022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:19.831012 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36acf89f-1b7a-437d-ab23-33dd2ba98387 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056855 Dec 25 21:24:19.835229 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2796/5543] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:19 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:19.949760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:19.950866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:19.957944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:19.958616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:19.959576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:19.960283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.022057 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae0a9e30-de3a-4d14-a46c-2586d2ea8f52 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.064590 Dec 25 21:24:20.022057 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2748/5544] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:19 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:20.108363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:20.109946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 20a90e3e-c379-4f2f-9632-763f67a3a334] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:20.118002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.119146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.119979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.120489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.136444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Instance 20a90e3e-c379-4f2f-9632-763f67a3a334 could not be found. Dec 25 21:24:20.137075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 404 to user: Instance 20a90e3e-c379-4f2f-9632-763f67a3a334 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:20.137983 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bad3ad75-d7d3-4081-9a5e-43ffe5ea4f86 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334" status: 404 len: 111 microversion: 2.1 time: 0.033781 Dec 25 21:24:20.138721 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2749/5545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:20 2021] GET /compute/v2.1/servers/20a90e3e-c379-4f2f-9632-763f67a3a334 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:20.147157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:20.148216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:20.157073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.157927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.158959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.159642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.194741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:20.260764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-443561352", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "3702c917-fb7e-4ec7-8fa9-22efe456a3e6"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:20.329607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] validate_networks() for [('3702c917-fb7e-4ec7-8fa9-22efe456a3e6', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:24:20.536408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d013bc14-5ac8-4914-86dc-88abea5b3127 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "DELETE /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 204 len: 0 microversion: 2.1 time: 0.393438 Dec 25 21:24:20.537042 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2750/5546] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:20 2021] DELETE /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:24:20.542586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:20.547816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:20.549704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.550158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.550945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.551380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.691127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:20.699195 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-55366052-0124-4ad0-a056-2ef17afd9fb5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.160664 Dec 25 21:24:20.699774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2751/5547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:20 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:20.704085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:20.704734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:20.711066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.711528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.713002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.717820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.859996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:20.869137 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4fdc9669-13b0-44a1-b621-93aed35ed2ef tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.168292 Dec 25 21:24:20.870659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2752/5548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:20 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:20.876051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:20.877431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:20.886992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.887444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.888240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:20.888676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:20.943905 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-861af6d8-bfed-4024-bbf1-93708ca06f4a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.071615 Dec 25 21:24:20.944697 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2753/5549] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:20 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:21.032333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:21.033381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:21.044797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.045284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.046106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.046556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.080004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:24:21.080495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:24:21.080940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:24:21.081362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:24:21.081775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:24:21.091560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.092013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.093064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.093507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.096352 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac57acae-ff56-46f5-9958-3ecbcfcfe8b8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.067835 Dec 25 21:24:21.098356 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2754/5550] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:21 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:21.113880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Getting quotas for project e78183302ecf4f92a3eab85b3f567d9e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:24:21.119733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Getting quotas for user 8a9aca0cfb134140a880e9ef5ecde9ea and project e78183302ecf4f92a3eab85b3f567d9e. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:24:21.132109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:24:21.135458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:24:21.298560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec3e0a25-38a0-44da-8b3a-03ea126f43d3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.324751 Dec 25 21:24:21.299218 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2797/5551] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:24:19 2021] POST /compute/v2.1/servers => generated 380 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:24:21.311411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cefa136e-71a1-4851-9381-0f275e03c5c5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:21.312433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cefa136e-71a1-4851-9381-0f275e03c5c5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:21.376198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cefa136e-71a1-4851-9381-0f275e03c5c5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:21.384867 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cefa136e-71a1-4851-9381-0f275e03c5c5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1227 microversion: 2.1 time: 0.078810 Dec 25 21:24:21.386069 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2755/5552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:21 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1227 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:21.720610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:21.722032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:21.733513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.733977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.736146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.736426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.886102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:21.887282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:21.887920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:21.895006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-56b4aae6-7abd-46ae-9967-e9377e7f5313 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.179848 Dec 25 21:24:21.895606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2798/5553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:21 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:21.902104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.902756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.904062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.904062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.969814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:21.970820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:21.977883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.978584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:21.979738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:21.980358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:22.032779 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c876480a-ff29-4ab6-b7d0-dfe875582dc5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.078720 Dec 25 21:24:22.033803 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2799/5554] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:21 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:22.086184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:22.095528 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a06d8ffd-56eb-4710-9105-c429261e61cd tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.212440 Dec 25 21:24:22.097771 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2756/5555] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:21 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:22.108573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:22.109694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:22.116903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:22.120834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:22.120834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:22.120834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:22.159421 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5876bbc7-a18a-42d3-a097-855530a8e740 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.054755 Dec 25 21:24:22.160295 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2800/5556] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:22 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:22.402650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c7deaba-a759-4bbd-b031-3c59480e82e5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:22.403327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4c7deaba-a759-4bbd-b031-3c59480e82e5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:22.459535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4c7deaba-a759-4bbd-b031-3c59480e82e5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:22.466327 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c7deaba-a759-4bbd-b031-3c59480e82e5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1227 microversion: 2.1 time: 0.067771 Dec 25 21:24:22.466900 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2757/5557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:22 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1227 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:22.915654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:22.916349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:22.924736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:22.925461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:22.926260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:22.926699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.045752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:23.046890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:23.059639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.066366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.067355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.071519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.117340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:23.125324 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bc5965c3-496b-4d11-949a-2034930bf2a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.214540 Dec 25 21:24:23.125829 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2801/5558] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:22 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:23.130631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:23.131415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:23.137872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.138332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.139172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.139702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.139877 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c912ad79-f8f5-4341-86a5-a2df2df04922 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.097836 Dec 25 21:24:23.141357 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2758/5559] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:23 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:23.172740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:23.174371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:23.183845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.184510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.185341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.185946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.230184 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8f6ed35-357f-4520-8998-8248363ad376 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.061462 Dec 25 21:24:23.231206 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2759/5560] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:23 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:23.287603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:23.296487 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58b9a56b-11d8-4714-945e-f661df1293f1 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.169411 Dec 25 21:24:23.297007 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2802/5561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:23 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:23.484644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:23.485377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:23.492786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.493937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.494748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:23.495190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:23.561540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:23.576052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ba7f391c-c7d7-45ae-9698-b8955ae198e3 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1279 microversion: 2.1 time: 0.095538 Dec 25 21:24:23.576723 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2760/5562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:23 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:24.142385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:24.143625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:24.152051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:24.153262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:24.167455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.169945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.170130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.171312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.171928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.172858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.174017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.175857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.226000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-740ff7ff-3c15-4215-bcde-7ad92ab530f4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.077998 Dec 25 21:24:24.227132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2761/5563] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:24 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:24.242384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:24.243987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:24.251081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.251538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.252333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.253001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.301683 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f86ab746-0049-4ce7-8a15-dafb20f49efe tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063265 Dec 25 21:24:24.303214 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2762/5564] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:24 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:24.321646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:24.323248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:24.337570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.338464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.339470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.340109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.474945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:24.482501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e972414-fdac-462c-9c63-ebde0f57f24c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.343824 Dec 25 21:24:24.483399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2803/5565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:24 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:24.546092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:24.553731 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f309fb6a-3cc0-432f-9950-ae216804c9ed tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.243376 Dec 25 21:24:24.566440 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2763/5566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:24 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:24.597949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:24.599334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:24.606492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.607076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.607955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:24.608899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:24.679622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:24.689111 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e25f70b-ac61-489e-aa2b-c353cca47cb9 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1285 microversion: 2.1 time: 0.097059 Dec 25 21:24:24.689685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2804/5567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:24 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:25.238923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:25.243781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:25.252396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.254309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.258659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.262403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.309258 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfa53d43-74a3-412f-b2a1-9bc6cc9803a8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.073966 Dec 25 21:24:25.310310 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2764/5568] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:25 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:25.315148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:25.316086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:25.323170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.324140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.325209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.325650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.392359 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eaaa521e-83c2-46f8-b6d9-ba17f8afaf7e tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.081405 Dec 25 21:24:25.394286 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2805/5569] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:25 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:25.501245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:25.502223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:25.512093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.512547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.513764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.514484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.576917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:25.577611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:25.593286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.593749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.594555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.594997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.865573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:25.893966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-785d605a-0700-4c64-a2a4-307a6d37943f tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.397464 Dec 25 21:24:25.895013 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2765/5570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:25 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:25.906586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:25.909850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:25.917448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.921356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.921356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:25.921589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:25.921706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:25.930325 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-238ce956-23b5-4654-9a7f-6a58da1cef88 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.354791 Dec 25 21:24:25.931512 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2806/5571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:25 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:26.284572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:26.300290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e67ad2d6-86d9-42e7-bf57-399f6ce89c90 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.400663 Dec 25 21:24:26.311343 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2766/5572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:25 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:26.325793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:26.326904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:26.335626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.336213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.337736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.338182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.407235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:26.408040 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7045bd6-4bae-4063-b8b7-31ca76743cf5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.090415 Dec 25 21:24:26.408509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:26.409570 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2807/5573] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:26 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:26.429593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.429593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.429593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.429593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.489242 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b264ac15-eb01-4fd5-a0a1-44dc0313121b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.088246 Dec 25 21:24:26.491452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2767/5574] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:26 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:26.595632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a5c3d02b-de58-479d-97ae-7711aa4fad96 req-e97cd83a-8cf6-47a6-bc46-9e97ac1874b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65ff2690-4de7-43ad-b526-a4a9371782e5", "tag": "b1017787-1b53-4a43-97f6-3de90818e068"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:26.598857 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:26.598857 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:26.612962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a5c3d02b-de58-479d-97ae-7711aa4fad96 req-e97cd83a-8cf6-47a6-bc46-9e97ac1874b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.613411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a5c3d02b-de58-479d-97ae-7711aa4fad96 req-e97cd83a-8cf6-47a6-bc46-9e97ac1874b3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.627138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a5c3d02b-de58-479d-97ae-7711aa4fad96 req-e97cd83a-8cf6-47a6-bc46-9e97ac1874b3 service nova] Creating event network-changed:b1017787-1b53-4a43-97f6-3de90818e068 for instance 65ff2690-4de7-43ad-b526-a4a9371782e5 on nch2-master-1 Dec 25 21:24:26.634042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a5c3d02b-de58-479d-97ae-7711aa4fad96 req-e97cd83a-8cf6-47a6-bc46-9e97ac1874b3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044769 Dec 25 21:24:26.635076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2808/5575] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:26.914462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:26.915275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:26.932060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.933726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.936430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.937685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.949459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:26.950471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:26.962812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.966807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:26.975431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:26.975431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.310718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:27.323193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3dd04648-a736-4eb7-bad4-cc58feddd053 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.413475 Dec 25 21:24:27.324304 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2768/5576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:26 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:27.350412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:27.359143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:27.365146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:27.365915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.367689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:27.368933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.409170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:27.426472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a2c9c3e4-41c3-4002-8c8a-33f386451a20 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1521 microversion: 2.1 time: 0.480574 Dec 25 21:24:27.428721 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2809/5577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:26 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1521 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:27.437513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:27.438739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:27.449625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:27.449625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.449625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:27.449625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.504398 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42b423a5-1582-4af4-9f63-8e9d4cdda27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.071838 Dec 25 21:24:27.505261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2810/5578] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:27 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:27.517947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:27.519344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:27.538291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:27.538873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.540388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:27.541101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:27.628913 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68b853cf-6c2b-4284-ae32-4cc72f36dbc8 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.121850 Dec 25 21:24:27.635557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2811/5579] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:27 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:27.657586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:27.666212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-812234e1-349a-4eaf-8323-0c8d709d1a54 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.340592 Dec 25 21:24:27.667829 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2769/5580] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:27 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:28.340583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:28.341394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:28.348907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.349361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.350155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.350758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.445034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:28.446376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:28.457021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.458071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.458870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.459763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.502417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.503220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.504303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lazy-loading 'fault' on Instance uuid 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:28.595478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97abfab761214f10bb25fbf8ba958822', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af127d2683f84f0682595fe8297db6b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:28.605678 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-05c631d0-2e6e-4f8b-a01e-15d5948fbcf7 tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 200 len: 1312 microversion: 2.1 time: 0.164333 Dec 25 21:24:28.607661 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2770/5581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:28 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:28.613975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:28.623787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:28.632078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.632575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.634102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.634677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.687121 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ff3d101-d950-4d85-9ae3-bca9bff6a03a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.076550 Dec 25 21:24:28.691018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2771/5582] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:28 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:28.696730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:28.697776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:28.707087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.707546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.710794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.710794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.762051 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3463173-f222-497e-a8a0-fa77ef08be3d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.069503 Dec 25 21:24:28.762857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2772/5583] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:28 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:28.769963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:28.770976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:28.778092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.778546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.779521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:28.780157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:28.791535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:28.802817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49761296-fb2c-4ce4-adcf-456de6b93b0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1678 microversion: 2.1 time: 0.466781 Dec 25 21:24:28.818165 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2812/5584] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:28 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1678 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:29.020543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:29.040495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1ee343a-2ced-4efe-b50c-cef2748a75a0 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.275796 Dec 25 21:24:29.042501 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2773/5585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:28 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:29.050930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ad322c08-b466-4934-9648-bc4699c0eb5f req-ee46c5c9-df05-4b6f-b555-d4b7392823d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477", "name": "network-vif-deleted", "tag": "e763608c-e444-4936-aae2-43161cd57a85"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:29.053096 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:29.053096 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:29.068153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ad322c08-b466-4934-9648-bc4699c0eb5f req-ee46c5c9-df05-4b6f-b555-d4b7392823d6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.071440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ad322c08-b466-4934-9648-bc4699c0eb5f req-ee46c5c9-df05-4b6f-b555-d4b7392823d6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.092615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ad322c08-b466-4934-9648-bc4699c0eb5f req-ee46c5c9-df05-4b6f-b555-d4b7392823d6 service nova] Creating event network-vif-deleted:e763608c-e444-4936-aae2-43161cd57a85 for instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 on nch2-master-1 Dec 25 21:24:29.098141 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ad322c08-b466-4934-9648-bc4699c0eb5f req-ee46c5c9-df05-4b6f-b555-d4b7392823d6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052575 Dec 25 21:24:29.098768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2813/5586] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:29.624292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:29.625688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] [instance: 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:29.632528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.636357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.637268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.637718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.653551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] HTTP exception thrown: Instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 could not be found. Dec 25 21:24:29.654107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] Returning 404 to user: Instance 441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:29.656409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8509ca43-0cf0-4080-917a-2745bd50120a tempest-ServerRescueNegativeTestJSON-1185237855 tempest-ServerRescueNegativeTestJSON-1185237855-project] 10.222.0.32 "GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477" status: 404 len: 111 microversion: 2.1 time: 0.036053 Dec 25 21:24:29.657004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2774/5587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:29 2021] GET /compute/v2.1/servers/441fa3cf-7f7d-4f84-b4aa-cc9b9d70e477 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:29.703783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:29.705126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:29.751143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.751793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.754079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.754675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.778121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:29.779712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:29.799042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.799775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.800791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.801841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.833327 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09a55dde-b412-48b0-a374-68809ee30a02 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.137718 Dec 25 21:24:29.840300 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2814/5588] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:29 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:29.856349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:29.858020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:29.882041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.885501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.887043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:29.888248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:29.900741 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09bfac5a-506a-4642-afc6-a4c2cefdb662 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.129834 Dec 25 21:24:29.912427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2775/5589] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:29 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:30.060488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:30.063866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:30.078831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.079310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.080148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.084066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.545656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:30.553653 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-633c3551-d9a8-4f22-8c05-deafb8cc010b tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1655 microversion: 2.1 time: 0.711446 Dec 25 21:24:30.554260 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2815/5590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:29 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1655 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:30.581920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95b07744-6f2e-4549-8ff2-0a0f0344e975 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:30.589673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95b07744-6f2e-4549-8ff2-0a0f0344e975 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.589935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95b07744-6f2e-4549-8ff2-0a0f0344e975 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.648281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95b07744-6f2e-4549-8ff2-0a0f0344e975 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Going to try to start instance {{(pid=136548) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 21:24:30.715374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:30.728563 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d187d2f0-3fa7-4c1d-a028-d1dd1b91f619 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.671798 Dec 25 21:24:30.729989 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2776/5591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:30 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:30.848620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:30.850009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:30.866878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.867098 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95b07744-6f2e-4549-8ff2-0a0f0344e975 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.288540 Dec 25 21:24:30.868836 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2816/5592] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:30 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:30.869458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.877636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:30.878531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:30.885583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.886787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.897644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.898100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.900356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.901782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.948745 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c1ac9c4-9264-4141-ab6b-80afef3401ca tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.106151 Dec 25 21:24:30.951736 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2777/5593] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:30 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:30.958325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:30.959895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:30.972910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.978231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:30.981409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:30.985847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:31.129438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83313f90-1d46-43ff-9813-315d54a20bba tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.174586 Dec 25 21:24:31.135079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2778/5594] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:30 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:31.175939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:31.184365 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4df0b7e6-fca3-4ca3-84e3-1bae481b4db9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1664 microversion: 2.1 time: 0.311137 Dec 25 21:24:31.189499 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2817/5595] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:30 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1664 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:31.772041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:31.775603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:31.803069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:31.806036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:31.816285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:31.819130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:31.972285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:31.973372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:31.981493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:31.982374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:31.987018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:31.987759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:32.085430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-957ef4d1-5f8e-4a7f-a86b-44b4f0510679 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.128065 Dec 25 21:24:32.087401 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2818/5596] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:31 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:32.146838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:32.149239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:32.189034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:32.190422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:32.191953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:32.192565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:32.277392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e194c69-2c88-4000-882e-6e9326d6bc8a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.135225 Dec 25 21:24:32.278967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2819/5597] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:32 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:32.287239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:32.289260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:32.309684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:32.316444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:32.317693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:32.318239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:32.774702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:32.790815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-df3c03e0-9246-47c3-b35b-d64e37a952a4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 1.047545 Dec 25 21:24:32.800340 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2779/5598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:31 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:33.100650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:33.101976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:33.120180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:33.122286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:33.128435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:33.128923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:33.220396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:33.228162 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d82aa87d-5698-41d1-9211-956e52f633eb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1664 microversion: 2.1 time: 0.947547 Dec 25 21:24:33.228755 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2820/5599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:32 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1664 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:33.239521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7945ab9a-88ab-4d3b-8d60-9bea37006d71 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.144012 Dec 25 21:24:33.242274 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2780/5600] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:33 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:33.289647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:33.290579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:33.310859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:33.311577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:33.312185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:33.312584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:33.373456 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15129888-8e22-4aaa-abd9-2e26940f5fdd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.087615 Dec 25 21:24:33.374894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2821/5601] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:33 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:33.810936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:33.812642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:33.828804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:33.829920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:33.831293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:33.832929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.247010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:34.249179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:34.261087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.266645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.267818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.268451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.395850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:34.419212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee564080-98f3-42d4-9a98-9db463ce7a5a tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.614504 Dec 25 21:24:34.421129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2781/5602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:33 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:34.427130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:34.428264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:34.437979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.438434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.439264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.440075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.492818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-237477d1-6ffb-4008-bfcb-482162f56cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.069064 Dec 25 21:24:34.493788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2782/5603] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:34 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:34.499731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:34.501313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:34.510265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.511314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.512762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.513889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.566778 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-886fcef3-9d9b-4764-9bbe-8d480fdf3bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.071034 Dec 25 21:24:34.567564 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2783/5604] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:34 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:34.617110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:34.626973 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-250b9205-010e-40a3-b934-c33364199c32 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.385269 Dec 25 21:24:34.627565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2822/5605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:34 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:34.647892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:34.652657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:34.660935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.682085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:34.683048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:34.683581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.255341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-044ba974-c88e-46c6-b01e-7b0bac2b444e req-9415819b-7dc2-49b0-89c7-c1d97a23b98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ff2690-4de7-43ad-b526-a4a9371782e5", "name": "network-vif-plugged", "status": "completed", "tag": "b1017787-1b53-4a43-97f6-3de90818e068"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:35.257696 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:35.257696 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:35.280253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-044ba974-c88e-46c6-b01e-7b0bac2b444e req-9415819b-7dc2-49b0-89c7-c1d97a23b98d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.281610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-044ba974-c88e-46c6-b01e-7b0bac2b444e req-9415819b-7dc2-49b0-89c7-c1d97a23b98d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.297068 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-044ba974-c88e-46c6-b01e-7b0bac2b444e req-9415819b-7dc2-49b0-89c7-c1d97a23b98d service nova] Creating event network-vif-plugged:b1017787-1b53-4a43-97f6-3de90818e068 for instance 65ff2690-4de7-43ad-b526-a4a9371782e5 on nch2-master-1 Dec 25 21:24:35.302810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-044ba974-c88e-46c6-b01e-7b0bac2b444e req-9415819b-7dc2-49b0-89c7-c1d97a23b98d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051039 Dec 25 21:24:35.307912 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2823/5606] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:35.408083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:35.422636 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d1eb42c-96a7-480d-876f-26704942ca8e tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.778731 Dec 25 21:24:35.423233 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2784/5607] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:34 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:35.444374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:35.445400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:35.446537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:35.447160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:35.457766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.458956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.459104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.459517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.460390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.460750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.462110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.462255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.858624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:35.868032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e326671-ebf0-40d3-8dcc-38bcd5110861 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.426822 Dec 25 21:24:35.868745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2785/5608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:35 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:35.883210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:35.884260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:35.890314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.890845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.891711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.892250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.896145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:35.908362 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da463964-69c9-4ef6-aa8c-dd944ecb8bfb tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.465684 Dec 25 21:24:35.911396 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2824/5609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:35 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:35.917510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:35.918809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:35.925878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.926650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.927797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.928457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.976139 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95f314e7-1c9a-4403-827f-987b3734d694 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.062882 Dec 25 21:24:35.977071 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2825/5610] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:35 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:35.981886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:35.982735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:35.990520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.990966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:35.991912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:35.993128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:36.021149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lazy-loading 'flavor' on Instance uuid 161df36a-2258-4f32-a7b0-2f7c793d4390 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:36.045368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8dcee45e-1052-4d64-b5c7-e27b46c3bc40 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.173287 Dec 25 21:24:36.045368 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2786/5611] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:35 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:36.338627 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f907def-4d60-48ae-bde8-4cea927b65bb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.360045 Dec 25 21:24:36.350296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:36.351315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:36.353683 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2826/5612] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:35 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:36.360339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:36.360824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:36.362148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:36.362592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:36.508761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:36.516260 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b00d62c7-4658-4804-993d-07cb272505ce tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1676 microversion: 2.1 time: 0.171426 Dec 25 21:24:36.516830 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2787/5613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:36 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1676 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:36.929235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:36.931510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:36.940277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:36.941176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:36.942883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:36.943507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:36.988159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:36.989145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:37.002372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.003227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.004632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.005417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.067979 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f09d415-7b67-452d-ba5e-4491f9c3c5d2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.083909 Dec 25 21:24:37.070618 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2788/5614] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:36 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:37.080447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:37.080759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:37.088903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.090058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.090862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.091303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.142747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d33b4c7-6964-4617-8664-df951c8eeb06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070295 Dec 25 21:24:37.143898 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2789/5615] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:37 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:37.251139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:37.258683 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5104747b-df88-4b73-a8bd-0f4f7c1aa743 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1327 microversion: 2.1 time: 0.334002 Dec 25 21:24:37.259424 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2827/5616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:36 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1327 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:37.541467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:37.542208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:37.557578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.558067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.558901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.559365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.916353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:37.925375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cf0a1775-8676-419d-a3cf-265ba51d9551 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1659 microversion: 2.1 time: 0.394828 Dec 25 21:24:37.926778 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2790/5617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:37 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1659 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:37.944269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:37.944855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:37.952062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.952523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:37.957041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:37.957706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.079996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:38.081028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:38.110147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.110973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.112087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.112762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.183967 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6fe88b1-8c88-4756-9c33-605c59889861 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.107964 Dec 25 21:24:38.186466 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2791/5618] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:38 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:38.202888 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b26ad1cb-73f4-4ae4-a753-a2c0b162551c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action" status: 202 len: 0 microversion: 2.1 time: 0.261806 Dec 25 21:24:38.203910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:38.204823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2828/5619] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:37 2021] POST /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:38.206050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:38.223298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.225070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.227042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.227905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:38.228994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:38.230406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.238707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.239978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.241187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.242890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.316606 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd2a810a-b9d5-4999-9ab9-d554ada68dd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.127884 Dec 25 21:24:38.318149 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2792/5620] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:38 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:38.326632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:38.328288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:38.342809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.343859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.346773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.347431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.664051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:38.681351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dec7725c-82f7-4483-907c-71f75f1e86b6 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1665 microversion: 2.1 time: 0.462826 Dec 25 21:24:38.682204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2829/5621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:38 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1665 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:38.707750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:38.717856 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9286c0a-cab7-4809-8c6f-cf1035b77ed4 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1528 microversion: 2.1 time: 0.398118 Dec 25 21:24:38.718712 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2793/5622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:38 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1528 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:38.738553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:38.739184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:38.749414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.749789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:38.750803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:38.751417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.057405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:39.074849 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6d251c22-b3f9-4a09-8378-513777add234 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1528 microversion: 2.1 time: 0.341015 Dec 25 21:24:39.076866 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2830/5623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:38 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1528 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:39.207113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48ec0bab-faae-4788-9a04-2d0000a497f3 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Action: 'create', calling method: .version_select at 0x7fa4f6ffc160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-225946996", "metadata": {"Type": "work"}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:39.346153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:39.346153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:39.354354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.354811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.355616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.356065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.394867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] HTTP exception thrown: Instance 65ff2690-4de7-43ad-b526-a4a9371782e5 could not be found. Dec 25 21:24:39.395390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Returning 404 to user: Instance 65ff2690-4de7-43ad-b526-a4a9371782e5 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:39.396295 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4dbb0838-dd82-4591-9a81-6228c37bbd85 tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] 10.222.0.32 "DELETE /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 404 len: 111 microversion: 2.1 time: 0.307698 Dec 25 21:24:39.396848 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2831/5624] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:39 2021] DELETE /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 111 bytes in 309 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:24:39.406792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:39.408099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:39.417041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.417506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.418487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.419691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.466888 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-71fec440-042e-4479-8db0-af778ca83e2f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.065174 Dec 25 21:24:39.467636 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2832/5625] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:39 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:39.474216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:39.475225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:39.481812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.482299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.483074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.483514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.525217 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d592ba2-66f2-45e2-8e5f-894c1a35b890 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.056125 Dec 25 21:24:39.526421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2833/5626] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:39 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:39.530556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:39.531247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:39.538575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.539061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.539886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.540329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.720651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:39.725652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-66e8890f-1901-446c-87e8-d919931d6c38 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1528 microversion: 2.1 time: 0.198649 Dec 25 21:24:39.726233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2834/5627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:39 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1528 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:39.735474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:39.742095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:39.752954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.753585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.755252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:39.755859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:39.973737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:39.997957 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a47fb32-55d0-4a6b-93ae-1fb4e4266323 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1665 microversion: 2.1 time: 0.269934 Dec 25 21:24:40.001825 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2835/5628] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:39 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1665 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:40.017456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Action: 'update', calling method: >, body: {"server": {"name": "65ff2690-4de7-43ad-b526-a4a9371782e5_new"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:40.018847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:40.028513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.030198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.031073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.031985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.048106 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] HTTP exception thrown: Instance 65ff2690-4de7-43ad-b526-a4a9371782e5 could not be found. Dec 25 21:24:40.049025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] Returning 404 to user: Instance 65ff2690-4de7-43ad-b526-a4a9371782e5 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:40.053484 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a74ec5e5-4d16-4954-a71a-2e196d8230bd tempest-ServersNegativeTestMultiTenantJSON-1592188440 tempest-ServersNegativeTestMultiTenantJSON-1592188440-project] 10.222.0.32 "PUT /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 404 len: 111 microversion: 2.1 time: 0.046982 Dec 25 21:24:40.053484 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2836/5629] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:24:40 2021] PUT /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:40.060040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:40.060930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:40.068652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.069146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.070411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.076095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.108487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:40.234715 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48ec0bab-faae-4788-9a04-2d0000a497f3 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.388065 Dec 25 21:24:40.235352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2794/5630] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:38 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 1389 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 25 21:24:40.246359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-71306545-9565-4d10-8519-6538610c9cc2 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa500761b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:40.298404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-71306545-9565-4d10-8519-6538610c9cc2 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.056231 Dec 25 21:24:40.299142 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2795/5631] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:40 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:40.480924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:40.482634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:40.490690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.491641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.493419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.494078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.497783 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ea495b2-d622-48fe-8ed2-c112a2d745a8 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "DELETE /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 204 len: 0 microversion: 2.1 time: 0.441048 Dec 25 21:24:40.498736 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2837/5632] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:40 2021] DELETE /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:24:40.508661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:40.509751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:40.524289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.525205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.540064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.544694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.594536 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0451397c-e293-47f0-b226-7d475cb726a6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.117501 Dec 25 21:24:40.602777 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2796/5633] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:40 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:40.617234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:40.620050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:40.638131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.639942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.641925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:40.642703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:40.708654 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4598f4c-821a-4160-b7bc-821dd036a330 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.103814 Dec 25 21:24:40.712629 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2797/5634] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:40 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:40.968534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:40.977425 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ed4e057-6354-4227-93c5-6a000c599ddf tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1534 microversion: 2.1 time: 0.473180 Dec 25 21:24:40.978246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2838/5635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:40 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1534 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:41.017629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:41.018336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:41.026561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.027016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.027803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.028239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.311580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49cac958-80e5-4a11-8e56-ff398f894c83 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa500521670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:41.375291 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49cac958-80e5-4a11-8e56-ff398f894c83 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.067266 Dec 25 21:24:41.376233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2839/5636] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:41 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:41.382615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:41.391836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7afa1cf2-27e0-43fb-8953-52bd213c14e9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.378206 Dec 25 21:24:41.392412 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2798/5637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:41 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:41.409406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:41.411871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:41.417930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.418378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.420367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.420367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.613262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:41.614467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:41.622921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.623438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.624305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.624751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.673219 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-482f8f41-c6ec-4627-80f3-45dc2a523885 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.063154 Dec 25 21:24:41.675431 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2799/5638] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:41 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:24:41.718850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:41.722590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:41.723901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:41.732006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-385d8e6e-c46f-4aa5-be55-5520237503fa tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1668 microversion: 2.1 time: 0.326662 Dec 25 21:24:41.733181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2840/5639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:41 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1668 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:41.745646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.750531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.751658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.752389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.756520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:41.758762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:41.767661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.768225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.769501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:41.770128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:41.803171 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d39990e-125a-4816-afc2-11238326cc59 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.085851 Dec 25 21:24:41.803470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:41.803968 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2800/5640] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:41 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:41.809760 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.compute.api [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Working on deleting snapshot 3c9790c9-e4d6-4194-949f-3dea6e7b37f7 from shelved instance... Dec 25 21:24:42.002499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:42.003768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:42.012784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:42.013696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:42.019982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:42.020764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:42.642195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:42.678747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9778c57-d885-4f35-b497-c0950cfaa1c1 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1534 microversion: 2.1 time: 0.681963 Dec 25 21:24:42.684080 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2801/5641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:41 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1534 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:42.690452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed4719c9-353b-4490-b72a-4c610f6ddad2 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f71cc940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:42.740526 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed4719c9-353b-4490-b72a-4c610f6ddad2 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 346 microversion: 2.1 time: 0.055289 Dec 25 21:24:42.741147 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2802/5642] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:42 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:42.745864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:42.747291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:42.753448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:42.753907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:42.754738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:42.755209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:42.802492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ecac205-5c0e-47f0-8e81-13f4232b758a tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.059925 Dec 25 21:24:42.803712 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2803/5643] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:42 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:42.811390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8eb6fce5-f5bb-43d3-a3ba-b058adb38582 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa50054df70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:42.865845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8eb6fce5-f5bb-43d3-a3ba-b058adb38582 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 346 microversion: 2.1 time: 0.061435 Dec 25 21:24:42.867394 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2804/5644] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:42 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:42.874333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:42.876985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:42.884452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:42.884935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:42.886324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:42.886780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:42.935061 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00b3301d-ec28-49de-b5b9-b2339db4b20f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.066738 Dec 25 21:24:42.935691 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2805/5645] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:42 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:42.943205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9b309e6-36a4-4f1f-9c41-34af28f75223 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f6d55af0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:43.292773 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9b309e6-36a4-4f1f-9c41-34af28f75223 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 202 len: 0 microversion: 2.1 time: 0.355695 Dec 25 21:24:43.293603 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2806/5646] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:24:42 2021] DELETE /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:43.306734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44ff72d5-be8d-47a1-8a52-a48538d8051d tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f5f46b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:43.360987 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44ff72d5-be8d-47a1-8a52-a48538d8051d tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.062993 Dec 25 21:24:43.361649 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2807/5647] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:43 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:43.632105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Doing local delete in cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) {{(pid=136548) _delete /opt/stack/nova/nova/compute/api.py:2439}} Dec 25 21:24:43.633534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.633977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.634425 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.compute.api [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Dec 25 21:24:43.656514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] deallocate_for_instance() {{(pid=136548) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Dec 25 21:24:43.697115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:43.697731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:43.706839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.707355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.710357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.715174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.802306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:43.811081 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ddb0704a-89a3-48c5-bd4a-1a3940764416 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1492 microversion: 2.1 time: 0.123886 Dec 25 21:24:43.811768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2808/5648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:43 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1492 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:43.825050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-973ef62d-3458-4619-b1e1-169aa031d5d2 req-c26478c8-0a4a-4b36-ae87-afab185b2440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65ff2690-4de7-43ad-b526-a4a9371782e5", "name": "network-vif-deleted", "tag": "b1017787-1b53-4a43-97f6-3de90818e068"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:43.827356 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:43.827356 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:24:43.838905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-973ef62d-3458-4619-b1e1-169aa031d5d2 req-c26478c8-0a4a-4b36-ae87-afab185b2440 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.843665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-973ef62d-3458-4619-b1e1-169aa031d5d2 req-c26478c8-0a4a-4b36-ae87-afab185b2440 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.858436 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-973ef62d-3458-4619-b1e1-169aa031d5d2 req-c26478c8-0a4a-4b36-ae87-afab185b2440 service nova] Creating event network-vif-deleted:b1017787-1b53-4a43-97f6-3de90818e068 for instance 65ff2690-4de7-43ad-b526-a4a9371782e5 on nch2-master-1 Dec 25 21:24:43.864304 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-973ef62d-3458-4619-b1e1-169aa031d5d2 req-c26478c8-0a4a-4b36-ae87-afab185b2440 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050991 Dec 25 21:24:43.865626 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2809/5649] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:43.872631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:43.874099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:43.885546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.887064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.888280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.889223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.944521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-291b5034-7167-474e-88b0-fbfc39d9facb tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.076981 Dec 25 21:24:43.945709 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2810/5650] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:43 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:43.952084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:43.953121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:43.961910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.963147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:43.964143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:43.964582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:44.013756 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f021c64-1288-4e27-b9c7-09764c6a8687 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.065819 Dec 25 21:24:44.014423 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2811/5651] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:43 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:44.377969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-07ac1694-8281-40db-b88d-84b38f6acf18 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f71e8ee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:44.524595 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-07ac1694-8281-40db-b88d-84b38f6acf18 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.150839 Dec 25 21:24:44.525178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2812/5652] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:44 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:44.571698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Updating instance_info_cache with network_info: [] {{(pid=136548) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Dec 25 21:24:44.832611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:44.834302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:44.850235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:44.852782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:44.855553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:44.857084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:44.923686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:44.928153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:44.928153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lazy-loading 'fault' on Instance uuid 65ff2690-4de7-43ad-b526-a4a9371782e5 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:45.028548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a9aca0cfb134140a880e9ef5ecde9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e78183302ecf4f92a3eab85b3f567d9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:45.041643 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81c430fc-0353-4e97-b3a7-1019cd2964a5 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 200 len: 1317 microversion: 2.1 time: 0.216391 Dec 25 21:24:45.052308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2813/5653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:44 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:45.058616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:45.059722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:45.078662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.079486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.080545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.081498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.160953 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-57b9be4d-3e95-4d99-9b39-43a83a0a4a70 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action" status: 200 len: 24571 microversion: 2.1 time: 0.106518 Dec 25 21:24:45.164411 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2814/5654] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:24:45 2021] POST /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c/action => generated 24571 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:24:45.172245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:45.176761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:45.186928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.187693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.188764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.189740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.244287 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6b7f1e2b-bea4-4da0-8f79-dfdfd8ff3dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.080747 Dec 25 21:24:45.245771 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2815/5655] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:45 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:45.252015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:45.255158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:45.259779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.260577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.261405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.261845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.542981 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89927e02-a55c-4c79-a4dc-96113254b988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "DELETE /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 204 len: 0 microversion: 2.1 time: 3.795879 Dec 25 21:24:45.546360 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2841/5656] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:41 2021] DELETE /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 0 bytes in 3800 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:24:45.555790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0166682a-ef1c-4d32-aff6-1aa2194abbb2 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa500706790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:45.614220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0166682a-ef1c-4d32-aff6-1aa2194abbb2 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.066566 Dec 25 21:24:45.614796 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2842/5657] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:45 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:45.620086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:45.620947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 80ab586d-800d-4e54-9ed7-b09636cb7bd5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:45.627572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.628830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.629243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.629836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.646242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] HTTP exception thrown: Instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5 could not be found. Dec 25 21:24:45.668485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Returning 404 to user: Instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:45.669845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b143b88-72d7-423d-bea7-7255351de105 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5" status: 404 len: 111 microversion: 2.1 time: 0.053771 Dec 25 21:24:45.671817 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2843/5658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:45 2021] GET /compute/v2.1/servers/80ab586d-800d-4e54-9ed7-b09636cb7bd5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:45.675372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:45.683478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:45.684218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:45.684367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4e94d57-09ff-4473-98d3-dc23f6b4095b tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1602 microversion: 2.1 time: 0.436969 Dec 25 21:24:45.684916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2816/5659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:45 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1602 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:45.697994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.697994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.697994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.697994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.725868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:45.901613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-85d13599-a74b-4117-8b54-f50a1dbb26a3 req-59ffb733-2caf-404f-abcc-64d7503bc4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80ab586d-800d-4e54-9ed7-b09636cb7bd5", "name": "network-vif-deleted", "tag": "8682c537-48c9-45f3-aff8-21394b858c2b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:45.903177 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:45.903177 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:24:45.916895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-85d13599-a74b-4117-8b54-f50a1dbb26a3 req-59ffb733-2caf-404f-abcc-64d7503bc4d0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:45.917357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-85d13599-a74b-4117-8b54-f50a1dbb26a3 req-59ffb733-2caf-404f-abcc-64d7503bc4d0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:45.931520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.server_external_events [req-85d13599-a74b-4117-8b54-f50a1dbb26a3 req-59ffb733-2caf-404f-abcc-64d7503bc4d0 service nova] Unable to find a host for instance 80ab586d-800d-4e54-9ed7-b09636cb7bd5. Dropping event network-vif-deleted {{(pid=136547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 21:24:45.932424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-85d13599-a74b-4117-8b54-f50a1dbb26a3 req-59ffb733-2caf-404f-abcc-64d7503bc4d0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.035708 Dec 25 21:24:45.933280 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2817/5660] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:45 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 25 21:24:46.059992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:46.060626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] [instance: 65ff2690-4de7-43ad-b526-a4a9371782e5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:46.069091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:46.069550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:46.070411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:46.082845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:46.110186 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] HTTP exception thrown: Instance 65ff2690-4de7-43ad-b526-a4a9371782e5 could not be found. Dec 25 21:24:46.112739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] Returning 404 to user: Instance 65ff2690-4de7-43ad-b526-a4a9371782e5 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:46.114429 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e635f363-090f-46da-ad49-0c60256d3485 tempest-ServersNegativeTestMultiTenantJSON-1905796865 tempest-ServersNegativeTestMultiTenantJSON-1905796865-project] 10.222.0.32 "GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5" status: 404 len: 111 microversion: 2.1 time: 0.057945 Dec 25 21:24:46.115788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2818/5661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:46 2021] GET /compute/v2.1/servers/65ff2690-4de7-43ad-b526-a4a9371782e5 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:46.232824 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d68014f8-14bf-47c0-9fd6-13fed86843f0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "DELETE /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 204 len: 0 microversion: 2.1 time: 0.550293 Dec 25 21:24:46.234473 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2844/5662] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:45 2021] DELETE /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:24:46.238561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:46.239433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:46.247650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:46.248800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:46.251733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:46.252378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:46.257177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:46.264963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:46.272197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:46.274023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:46.274859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:46.275862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:46.323809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d51cc825-464e-43ff-b710-79b28fc0f3aa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070899 Dec 25 21:24:46.324606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2845/5663] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:46 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:46.355923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:46.363835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-feccc73e-304f-4457-ba65-c00c0cc24f58 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1466 microversion: 2.1 time: 0.129548 Dec 25 21:24:46.364398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2819/5664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:46 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1466 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:46.628175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3a988e6-73b9-4bfa-813d-380b93b2feb5 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f62ec430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:46.709677 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3a988e6-73b9-4bfa-813d-380b93b2feb5 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.079861 Dec 25 21:24:46.709677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2846/5665] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:46 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:47.342651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:47.344565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:47.375891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:47.378853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:47.382274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:47.383540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:47.384598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:47.387530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:47.397545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:47.398130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:47.399625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:47.400079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:47.491155 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4be3beb-5ea7-4346-8df2-54db621259de tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.158734 Dec 25 21:24:47.492422 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2820/5666] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:47 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:47.692740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:47.702227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d314d6e4-21f9-40ec-b714-321b9ad2c780 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1466 microversion: 2.1 time: 0.324833 Dec 25 21:24:47.702803 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2847/5667] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:47 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1466 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:47.718190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebbec2c9-5839-4826-b1ee-0ce182fd484c tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f71e8af0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:47.775843 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebbec2c9-5839-4826-b1ee-0ce182fd484c tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.061618 Dec 25 21:24:47.776458 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2821/5668] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:47 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:48.503420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:48.505822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:48.512268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:48.512844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:48.513838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:48.514530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:48.575417 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-169dbe6b-9c91-4ef6-ac06-113b71faf94e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.075858 Dec 25 21:24:48.584924 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2848/5669] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:48 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:48.720684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:48.721454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:48.731713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:48.731978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:48.732593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:48.733090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:48.790719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f27b359-47cc-4653-a737-c3dcfbe32a06 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f62e8af0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:48.954814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:48.962739 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f27b359-47cc-4653-a737-c3dcfbe32a06 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.178627 Dec 25 21:24:48.965434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2849/5670] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:48 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:24:48.981726 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5662ccf2-9931-42b6-8b27-7855cefda1a5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1466 microversion: 2.1 time: 0.265990 Dec 25 21:24:48.983637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2822/5671] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:48 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1466 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:49.019801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-081ea2cc-a74f-45a2-bf39-9d570eb22943 req-f465d899-fe5e-4200-962b-49700753d5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b03831-0555-4b9e-bd9a-323002cb09e1", "name": "network-vif-deleted", "tag": "eef37bbe-1508-453a-bafd-62933899b6d9"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:49.021815 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:49.021815 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:49.036413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-081ea2cc-a74f-45a2-bf39-9d570eb22943 req-f465d899-fe5e-4200-962b-49700753d5b7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:49.037738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-081ea2cc-a74f-45a2-bf39-9d570eb22943 req-f465d899-fe5e-4200-962b-49700753d5b7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:49.051974 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-081ea2cc-a74f-45a2-bf39-9d570eb22943 req-f465d899-fe5e-4200-962b-49700753d5b7 service nova] Creating event network-vif-deleted:eef37bbe-1508-453a-bafd-62933899b6d9 for instance 36b03831-0555-4b9e-bd9a-323002cb09e1 on nch1-master-1 Dec 25 21:24:49.059049 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-081ea2cc-a74f-45a2-bf39-9d570eb22943 req-f465d899-fe5e-4200-962b-49700753d5b7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045919 Dec 25 21:24:49.061492 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2850/5672] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:49.595145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:49.596481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:49.610178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:49.611707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:49.613673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:49.615249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:49.670494 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-df559d7f-ed2f-4b10-aca7-35326a024736 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.079105 Dec 25 21:24:49.673011 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2823/5673] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:49 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:49.978126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36bbf2f0-f393-4450-8f69-5b7eba86ee52 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa5005218b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:50.014113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:50.014846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:50.034345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:50.035912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:50.041082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:50.048472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:50.091205 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36bbf2f0-f393-4450-8f69-5b7eba86ee52 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.115681 Dec 25 21:24:50.092056 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2851/5674] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:49 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:50.103949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:50.104416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:50.104921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lazy-loading 'fault' on Instance uuid 36b03831-0555-4b9e-bd9a-323002cb09e1 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:50.186956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:50.197927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-138f15e4-f7a6-4ecb-8641-57878c63dd3c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 200 len: 1304 microversion: 2.1 time: 0.192154 Dec 25 21:24:50.198525 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2824/5675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:50 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:50.690860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:50.695657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:50.706639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:50.707180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:50.708222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:50.708906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:50.761817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4de0727b-83f1-4e4f-96fa-5d6aaa7a2f1c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.080772 Dec 25 21:24:50.762691 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2852/5676] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:50 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:51.125112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4fc932a8-49ef-401d-94d4-b711bc1872b5 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f6d55700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:51.215463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:51.216180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 36b03831-0555-4b9e-bd9a-323002cb09e1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:51.223409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.223857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.232282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.236777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.238469 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4fc932a8-49ef-401d-94d4-b711bc1872b5 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.134938 Dec 25 21:24:51.239684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2825/5677] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:51 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:51.268432 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] HTTP exception thrown: Instance 36b03831-0555-4b9e-bd9a-323002cb09e1 could not be found. Dec 25 21:24:51.270054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Returning 404 to user: Instance 36b03831-0555-4b9e-bd9a-323002cb09e1 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:51.273646 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab22c462-b127-4588-8177-e90f49a69988 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1" status: 404 len: 111 microversion: 2.1 time: 0.062455 Dec 25 21:24:51.276060 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2853/5678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:51 2021] GET /compute/v2.1/servers/36b03831-0555-4b9e-bd9a-323002cb09e1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:24:51.287203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:51.287549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:51.295884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.296830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.297930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.298898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.349475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:51.775082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:51.776035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:51.787603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.788060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.789732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.791342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.811503 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e20b3b4-453d-4a25-b5b6-1f9b0ac78f0a tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 204 len: 0 microversion: 2.1 time: 0.531224 Dec 25 21:24:51.815166 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2826/5679] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:51 2021] DELETE /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:24:51.833795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:51.838011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:51.851294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.851762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.852573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:51.853062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:51.879431 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9052fbab-1fe1-42e2-9a97-c054d576b5cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.109283 Dec 25 21:24:51.884579 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2854/5680] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:51 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:52.173991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:52.183001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ea9d2e9-dc63-4325-94d0-d06d415b0134 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1507 microversion: 2.1 time: 0.364421 Dec 25 21:24:52.184332 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2827/5681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:51 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1507 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:24:52.251251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e954f891-27fb-4f77-ae30-d08f91f620e0 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa5005218b0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:52.364141 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e954f891-27fb-4f77-ae30-d08f91f620e0 tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 200 len: 345 microversion: 2.1 time: 0.116963 Dec 25 21:24:52.365179 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2855/5682] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:52 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:52.589424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b496cda-b5ee-413b-82d5-ca60075541c9 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Calling method '.version_select at 0x7fa4f7012ca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:52.666197 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b496cda-b5ee-413b-82d5-ca60075541c9 tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.264107 Dec 25 21:24:52.672395 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2828/5683] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:24:52 2021] GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f/defaults => generated 371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:52.678283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e49e256a-d2c2-4ac3-a195-7a656a88391a tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Calling method '.version_select at 0x7fa4f62e4310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:52.818240 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e49e256a-d2c2-4ac3-a195-7a656a88391a tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f" status: 200 len: 371 microversion: 2.1 time: 0.144905 Dec 25 21:24:52.831919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfed079d-7b98-4d9d-9f22-2936cf59233a tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Calling method '.version_select at 0x7fa4f71cc040>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:52.838554 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2856/5684] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:24:52 2021] GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f => generated 371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:52.893566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:52.894923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:52.913177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:52.913177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:52.922051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:52.923126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:52.939854 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfed079d-7b98-4d9d-9f22-2936cf59233a tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f/defaults" status: 200 len: 371 microversion: 2.1 time: 0.111685 Dec 25 21:24:52.949022 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2829/5685] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:24:52 2021] GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f/defaults => generated 371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:52.960199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6cce37b5-dbe5-4936-afcb-10733b414b4b tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Calling method '.version_select at 0x7fa4f72a18b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:53.045590 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3746320b-6814-46f8-af50-80879332f932 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.155024 Dec 25 21:24:53.049140 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2857/5686] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:52 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:53.211768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:53.212500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:53.234805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:53.235224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:53.236038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:53.239737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:53.302506 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6cce37b5-dbe5-4936-afcb-10733b414b4b tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f" status: 200 len: 371 microversion: 2.1 time: 0.351667 Dec 25 21:24:53.306922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2830/5687] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:24:52 2021] GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f => generated 371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:53.331869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89caf106-bb69-4925-b904-9e381f2a751a tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] Calling method '.version_select at 0x7fa4f72a1430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:53.499079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89caf106-bb69-4925-b904-9e381f2a751a tempest-QuotasTestJSON-1461143998 tempest-QuotasTestJSON-1461143998-project] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f?user_id=40de098493ad447794d22ab4fec92300" status: 200 len: 371 microversion: 2.1 time: 0.183222 Dec 25 21:24:53.500276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2831/5688] 10.222.0.32 () {58 vars in 1322 bytes} [Sat Dec 25 21:24:53 2021] GET /compute/v2.1/os-quota-sets/a5994474339c4e2d8dd50eeab0ee993f?user_id=40de098493ad447794d22ab4fec92300 => generated 371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:53.528630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad495685-0672-4aea-a661-86ae7f3d2fce tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Calling method '.version_select at 0x7fa4f72f9ee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:53.613346 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ad495685-0672-4aea-a661-86ae7f3d2fce tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] HTTP exception thrown: Volume 13b96a22-3669-467f-b804-105709b063fe could not be found. Dec 25 21:24:53.614624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad495685-0672-4aea-a661-86ae7f3d2fce tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] Returning 404 to user: Volume 13b96a22-3669-467f-b804-105709b063fe could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:53.618462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad495685-0672-4aea-a661-86ae7f3d2fce tempest-VolumesGetTestJSON-157046292 tempest-VolumesGetTestJSON-157046292-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe" status: 404 len: 109 microversion: 2.1 time: 0.116180 Dec 25 21:24:53.619281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2832/5689] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:53 2021] GET /compute/v2.1/os-volumes/13b96a22-3669-467f-b804-105709b063fe => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:53.904209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:53.914763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-16e9c869-2cf2-4e25-a46d-34cc635f530c tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1507 microversion: 2.1 time: 0.716448 Dec 25 21:24:53.915888 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2858/5690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:53 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1507 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:54.062875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:54.077176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:54.077176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:54.077176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:54.077176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:54.077176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:54.146412 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c66338cf-a750-427c-b805-b31e8121578c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.090746 Dec 25 21:24:54.147103 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2833/5691] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:54 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:54.587285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-986f3669-24bf-4ce8-97a5-fed7442be981 req-ca37154f-d071-4890-a3cb-76e5628a630a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a61c5de8-d812-47f0-b612-27005b61919f", "name": "network-vif-deleted", "tag": "d39bd2f0-4d3d-4db5-8928-d5a1bd22462e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:54.588838 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:54.588838 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:54.609710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-986f3669-24bf-4ce8-97a5-fed7442be981 req-ca37154f-d071-4890-a3cb-76e5628a630a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:54.615771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-986f3669-24bf-4ce8-97a5-fed7442be981 req-ca37154f-d071-4890-a3cb-76e5628a630a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:54.653960 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-986f3669-24bf-4ce8-97a5-fed7442be981 req-ca37154f-d071-4890-a3cb-76e5628a630a service nova] Creating event network-vif-deleted:d39bd2f0-4d3d-4db5-8928-d5a1bd22462e for instance a61c5de8-d812-47f0-b612-27005b61919f on nch1-master-1 Dec 25 21:24:54.670740 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-986f3669-24bf-4ce8-97a5-fed7442be981 req-ca37154f-d071-4890-a3cb-76e5628a630a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086195 Dec 25 21:24:54.685799 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2859/5692] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:54.936499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:54.936499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:54.971117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:54.976475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:54.976475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:54.976475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:55.034667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:55.035138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:55.035703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lazy-loading 'fault' on Instance uuid a61c5de8-d812-47f0-b612-27005b61919f {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:24:55.116506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:55.139493 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1885ea8c-a562-480a-8489-3fee122c3de7 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 200 len: 1304 microversion: 2.1 time: 0.198647 Dec 25 21:24:55.139493 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2834/5693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:54 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 1304 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:55.161148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:55.162624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:55.180187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:55.180963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:55.181986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:55.182653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:55.274726 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c466a6be-39e4-47fd-a575-0d904a6f8345 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.112678 Dec 25 21:24:55.274726 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2860/5694] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:55 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:56.150213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:56.150910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: a61c5de8-d812-47f0-b612-27005b61919f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:56.159298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.160131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.161525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.162221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.181149 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] HTTP exception thrown: Instance a61c5de8-d812-47f0-b612-27005b61919f could not be found. Dec 25 21:24:56.181952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Returning 404 to user: Instance a61c5de8-d812-47f0-b612-27005b61919f could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:56.183043 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62effc74-ebef-4b64-9194-1562b7cce5fb tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f" status: 404 len: 111 microversion: 2.1 time: 0.037370 Dec 25 21:24:56.184104 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2835/5695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:56 2021] GET /compute/v2.1/servers/a61c5de8-d812-47f0-b612-27005b61919f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:56.197417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:56.198855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:56.207031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.207496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.208298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.208746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.250695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:24:56.280158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:56.281174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:56.305431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.305431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.305431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.305431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.372542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5de2c1a1-f377-46e7-9ff6-5b3b3411f731 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.096012 Dec 25 21:24:56.374712 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2836/5696] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:56 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:56.788847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1a32089-d3a9-466d-ae85-a4170fdf2fd0 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 204 len: 0 microversion: 2.1 time: 0.599614 Dec 25 21:24:56.789635 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2861/5697] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:24:56 2021] DELETE /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:24:56.806623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:56.807475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:56.820159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.820159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:56.833029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:56.833498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:57.385116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:57.386224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:57.402756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:57.403820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:57.405967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:57.406991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:57.464382 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-699ece9f-d6ee-472d-8cfd-8292340b8ea6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.083771 Dec 25 21:24:57.466706 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2862/5698] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:57 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:24:57.582200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:57.593869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f551a030-98d7-4a09-abec-190ec1d0db25 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1496 microversion: 2.1 time: 0.793278 Dec 25 21:24:57.597639 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2837/5699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:56 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1496 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:57.851023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-165c461e-a2a1-48c5-a3ce-b18d9f5cff3a tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Action: 'create', calling method: .version_select at 0x7fa4f62b0e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1954767877", "metadata": {"Type": "work"}}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:57.853008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-165c461e-a2a1-48c5-a3ce-b18d9f5cff3a tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:57.854116 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-165c461e-a2a1-48c5-a3ce-b18d9f5cff3a tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.282828 Dec 25 21:24:57.855766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2863/5700] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:57 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 285 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:24:57.865123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae658f2d-9020-4541-a92a-e9bd0b13d975 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Action: 'create', calling method: .version_select at 0x7fa4f72a1c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1269910096", "metadata": {"Type": "work"}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:57.867196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae658f2d-9020-4541-a92a-e9bd0b13d975 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:57.868344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae658f2d-9020-4541-a92a-e9bd0b13d975 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007902 Dec 25 21:24:57.868992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2838/5701] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:57 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:24:57.879163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fec55e34-d9cf-4805-83f5-be354dc97bc2 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Action: 'create', calling method: .version_select at 0x7fa5005219d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-359225690", "metadata": {"Type": "work"}}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:57.880397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fec55e34-d9cf-4805-83f5-be354dc97bc2 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:57.881239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fec55e34-d9cf-4805-83f5-be354dc97bc2 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006952 Dec 25 21:24:57.882806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2864/5702] 10.222.0.32 () {60 vars in 1155 bytes} [Sat Dec 25 21:24:57 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:24:57.892800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-523b4fe9-c25f-4d5b-9aba-3254943a94d0 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Calling method '.version_select at 0x7fa4f617e9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:57.921718 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-523b4fe9-c25f-4d5b-9aba-3254943a94d0 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] HTTP exception thrown: Volume tempest-invalid-1432103615 could not be found. Dec 25 21:24:57.922345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-523b4fe9-c25f-4d5b-9aba-3254943a94d0 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Returning 404 to user: Volume tempest-invalid-1432103615 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:57.923371 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-523b4fe9-c25f-4d5b-9aba-3254943a94d0 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1432103615" status: 404 len: 99 microversion: 2.1 time: 0.035886 Dec 25 21:24:57.923930 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2839/5703] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:24:57 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1432103615 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:24:57.934227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2597c359-9b90-4dd8-ab34-4eff4b5c68ab tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003974 Dec 25 21:24:57.934957 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2865/5704] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Dec 25 21:24:57 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Dec 25 21:24:57.950589 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e1cc789f-dca7-49b9-899c-d204974d93c4 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009939 Dec 25 21:24:57.951429 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2840/5705] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:24:57 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Dec 25 21:24:57.971834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c7883fa-ac88-46f3-b19d-d1443a4a3b7e tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Calling method '.version_select at 0x7fa4f62a33a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:58.018396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-8c7883fa-ac88-46f3-b19d-d1443a4a3b7e tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] HTTP exception thrown: Volume cc314792-6d0a-42dc-baef-0c22b902c03c could not be found. Dec 25 21:24:58.018396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c7883fa-ac88-46f3-b19d-d1443a4a3b7e tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Returning 404 to user: Volume cc314792-6d0a-42dc-baef-0c22b902c03c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:58.018396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c7883fa-ac88-46f3-b19d-d1443a4a3b7e tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/cc314792-6d0a-42dc-baef-0c22b902c03c" status: 404 len: 109 microversion: 2.1 time: 0.054612 Dec 25 21:24:58.018396 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2866/5706] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:24:57 2021] DELETE /compute/v2.1/os-volumes/cc314792-6d0a-42dc-baef-0c22b902c03c => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:24:58.026833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d582623-727b-4d85-9878-d84208a8fcc1 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Calling method '.version_select at 0x7fa4f70de8b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:58.057447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9d582623-727b-4d85-9878-d84208a8fcc1 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] HTTP exception thrown: Volume a522ee59-6829-466e-8916-e041aabea89e could not be found. Dec 25 21:24:58.058536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d582623-727b-4d85-9878-d84208a8fcc1 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] Returning 404 to user: Volume a522ee59-6829-466e-8916-e041aabea89e could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:24:58.059597 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d582623-727b-4d85-9878-d84208a8fcc1 tempest-VolumesNegativeTest-680900592 tempest-VolumesNegativeTest-680900592-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/a522ee59-6829-466e-8916-e041aabea89e" status: 404 len: 109 microversion: 2.1 time: 0.037128 Dec 25 21:24:58.060280 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2841/5707] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:24:58 2021] GET /compute/v2.1/os-volumes/a522ee59-6829-466e-8916-e041aabea89e => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:24:58.477610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:58.478631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:58.491090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:58.491090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:58.491090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:58.491637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:58.568357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-293134ae-1379-4bd3-bb53-8e79707e31cc tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.095928 Dec 25 21:24:58.569414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2867/5708] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:58 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:24:58.615866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:24:58.620037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:58.633235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:58.633889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:58.635358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:58.637424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:59.093655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:24:59.109728 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f107b368-8765-455e-9f16-cb5dd8fc98c4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1496 microversion: 2.1 time: 0.497924 Dec 25 21:24:59.110543 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2842/5709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:24:58 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1496 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:24:59.350241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1dddc6dc-ea60-471c-acd0-6200fd9901bb req-ac7bebb9-1767-4fd1-84d6-33c826373f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c440c6c-f195-45df-bc8f-62cfb0a36698", "name": "network-vif-deleted", "tag": "815adaf6-6cd2-46df-a541-c0f11b539b22"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:59.352833 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:24:59.352833 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:24:59.361254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1dddc6dc-ea60-471c-acd0-6200fd9901bb req-ac7bebb9-1767-4fd1-84d6-33c826373f6c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:59.362129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1dddc6dc-ea60-471c-acd0-6200fd9901bb req-ac7bebb9-1767-4fd1-84d6-33c826373f6c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:59.376995 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1dddc6dc-ea60-471c-acd0-6200fd9901bb req-ac7bebb9-1767-4fd1-84d6-33c826373f6c service nova] Creating event network-vif-deleted:815adaf6-6cd2-46df-a541-c0f11b539b22 for instance 8c440c6c-f195-45df-bc8f-62cfb0a36698 on nch1-master-1 Dec 25 21:24:59.397150 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1dddc6dc-ea60-471c-acd0-6200fd9901bb req-ac7bebb9-1767-4fd1-84d6-33c826373f6c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050766 Dec 25 21:24:59.401699 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2868/5710] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:24:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:24:59.580519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:24:59.581549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:24:59.590856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:59.591535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:59.592512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:24:59.593138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:24:59.669132 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7fc27014-4589-4bd4-b981-9102b62684ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.092129 Dec 25 21:24:59.672453 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2843/5711] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:24:59 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:00.137735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:00.137735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:00.137735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:00.137735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:00.138653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:00.138653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:00.171525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:00.171983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:00.172437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lazy-loading 'fault' on Instance uuid 8c440c6c-f195-45df-bc8f-62cfb0a36698 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:25:00.235815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:00.249122 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-195a6cee-6c39-42e8-8728-ad9fba099257 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 200 len: 1305 microversion: 2.1 time: 0.124879 Dec 25 21:25:00.250851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2869/5712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:00 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:00.683882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:00.685818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:00.710751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:00.712066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:00.714120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:00.714791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:00.782626 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c5b1c904-0831-4809-bec5-1b33486aaa5e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.104083 Dec 25 21:25:00.786419 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2844/5713] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:01.269270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:01.270812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 8c440c6c-f195-45df-bc8f-62cfb0a36698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:01.298044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.304859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.305948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.306528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.323115 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] HTTP exception thrown: Instance 8c440c6c-f195-45df-bc8f-62cfb0a36698 could not be found. Dec 25 21:25:01.329612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Returning 404 to user: Instance 8c440c6c-f195-45df-bc8f-62cfb0a36698 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:25:01.331479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e0fcac9d-6022-40b3-a5e1-77ea958123b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698" status: 404 len: 111 microversion: 2.1 time: 0.068550 Dec 25 21:25:01.332503 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2870/5714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:01 2021] GET /compute/v2.1/servers/8c440c6c-f195-45df-bc8f-62cfb0a36698 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:25:01.341706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:01.342312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:01.351194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.351748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.352574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.353068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.383422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:25:01.815749 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ba799d53-766d-417c-8de4-ffb48fd726f9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "DELETE /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 204 len: 0 microversion: 2.1 time: 0.478196 Dec 25 21:25:01.829983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2845/5715] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:25:01 2021] DELETE /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:25:01.830447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:01.831964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:01.841964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:01.844358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:01.861343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.862524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.865187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.872763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.872965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.872965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.872965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:01.886181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:01.994309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-525bc919-f297-4e66-b5dc-53d91c40d10e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.200539 Dec 25 21:25:01.995258 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2871/5716] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:01 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:02.260107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:02.274932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d747420-4d84-4f2a-b180-cc53db585902 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1674 microversion: 2.1 time: 0.440512 Dec 25 21:25:02.276314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2846/5717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:01 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1674 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:03.005720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:03.007417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:03.014506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:03.014961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:03.015773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:03.016211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:03.064815 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7cd941ca-9544-40bd-a9f5-391020464d08 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.062957 Dec 25 21:25:03.066610 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2872/5718] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:03 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:25:03.297810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:03.298436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:03.307166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:03.308178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:03.310068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:03.310768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:04.082778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:04.087580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:04.105886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:04.106753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:04.108017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:04.108746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:04.174565 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9d50435-efd7-4607-867c-b6c797992d64 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.098245 Dec 25 21:25:04.180313 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2873/5719] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:04 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:04.499781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:04.511845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3474ba0-7074-40a5-a7e5-9efb077938a1 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1674 microversion: 2.1 time: 1.219136 Dec 25 21:25:04.513185 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2847/5720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:03 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1674 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:05.187515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:05.188527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:05.203755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:05.204506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:05.205791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:05.206896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:05.271733 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e9dfcd9-ba1b-4cf4-876f-157714261c57 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.088102 Dec 25 21:25:05.276271 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2874/5721] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:05 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:05.530341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:05.533971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:05.544757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:05.545307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:05.546092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:05.546546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:05.684989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:05.694587 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6b189ed4-a1e1-40a1-bdcd-acde2ca91eb9 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1607 microversion: 2.1 time: 0.167774 Dec 25 21:25:05.704337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2848/5722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:05 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1607 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:06.286085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:06.290767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:06.307741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:06.308829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:06.311583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:06.313051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:06.394747 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea15aeb1-92df-4f30-918b-74245a809333 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.114847 Dec 25 21:25:06.395417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2875/5723] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:06 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:06.530194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fc3a6129-8d2c-4182-a62e-506e483da403 req-177a5395-b33d-49fe-aa47-578813c227dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "161df36a-2258-4f32-a7b0-2f7c793d4390", "name": "network-vif-deleted", "tag": "cdd08e2a-d7d3-45dd-874c-1cadcc9203fd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:06.532604 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:06.532604 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:25:06.546121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fc3a6129-8d2c-4182-a62e-506e483da403 req-177a5395-b33d-49fe-aa47-578813c227dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:06.547380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fc3a6129-8d2c-4182-a62e-506e483da403 req-177a5395-b33d-49fe-aa47-578813c227dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:06.562617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fc3a6129-8d2c-4182-a62e-506e483da403 req-177a5395-b33d-49fe-aa47-578813c227dc service nova] Creating event network-vif-deleted:cdd08e2a-d7d3-45dd-874c-1cadcc9203fd for instance 161df36a-2258-4f32-a7b0-2f7c793d4390 on nch1-master-1 Dec 25 21:25:06.570804 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fc3a6129-8d2c-4182-a62e-506e483da403 req-177a5395-b33d-49fe-aa47-578813c227dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044145 Dec 25 21:25:06.578310 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2849/5724] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:25:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:25:06.715683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:06.716656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:06.739689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:06.739689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:06.739689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:06.739689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:06.885441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cc54d7a742403f896dd71d222895c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c3545b07d0b4ccf9cd48a80c2d37521', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:06.900260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-327262bd-d54a-49fc-bdf4-858bfff07dc4 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 200 len: 1323 microversion: 2.1 time: 0.191026 Dec 25 21:25:06.902266 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2876/5725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:06 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:07.409090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:07.411401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:07.423523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:07.427654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:07.429090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:07.429524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:07.504210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b279017-9c7c-49e1-ada8-59a19ee63d51 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.098505 Dec 25 21:25:07.509414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2850/5726] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:07 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:07.922748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:07.929233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] [instance: 161df36a-2258-4f32-a7b0-2f7c793d4390] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:07.969325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:07.969325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:07.969325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:07.969325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:07.993990 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] HTTP exception thrown: Instance 161df36a-2258-4f32-a7b0-2f7c793d4390 could not be found. Dec 25 21:25:07.995067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Returning 404 to user: Instance 161df36a-2258-4f32-a7b0-2f7c793d4390 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:25:07.996131 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1f8f782-22c8-403d-b1df-282ffbd80e39 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390" status: 404 len: 111 microversion: 2.1 time: 0.081562 Dec 25 21:25:07.997259 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2877/5727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:07 2021] GET /compute/v2.1/servers/161df36a-2258-4f32-a7b0-2f7c793d4390 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:25:08.006613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c1e3a8b-71e4-4445-af65-5f9d496641b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] Calling method '.version_select at 0x7fa500761700>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:08.161527 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c1e3a8b-71e4-4445-af65-5f9d496641b5 tempest-ServerActionsTestJSON-1512798586 tempest-ServerActionsTestJSON-1512798586-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979290507" status: 202 len: 0 microversion: 2.1 time: 0.159539 Dec 25 21:25:08.163528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2851/5728] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 21:25:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1979290507 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:08.519498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:08.536729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:08.540493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:08.541652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:08.542846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:08.543596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:08.609343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca3545e9-ad1c-4c9b-90c2-b8f552ddb07a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.094629 Dec 25 21:25:08.610394 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2878/5729] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:08 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:08.899574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Calling method '.version_select at 0x7fa5007610d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:08.900858 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:08.900858 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:25:08.904214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:08.905129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:08.959015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:08.960124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:08.986952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:08.988612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:09.014813 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2fb04fb1-2ae9-4740-a601-f65f96610f20 tempest-PortsAdminExtendedAttrsTestJSON-1921191649 tempest-PortsAdminExtendedAttrsTestJSON-1921191649-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.357268 Dec 25 21:25:09.016478 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2852/5730] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:25:08 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:25:09.622079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:09.623772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:09.635187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:09.642784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:09.642784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:09.648163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:09.705548 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22ee619a-9300-41ca-87da-5fa59a2801fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.087312 Dec 25 21:25:09.706282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2879/5731] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:09 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:10.743583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:10.744944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:10.765057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:10.765516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:10.767800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:10.767800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:10.876204 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c95d51b-9561-4ed0-bdc6-7ba818f8b5a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.159782 Dec 25 21:25:10.879390 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2853/5732] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:10 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:11.891003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:11.892011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:11.904006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:11.904461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:11.905298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:11.905789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:11.970560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cf672203-3dcb-4161-bc31-f90b1d92f07f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.083100 Dec 25 21:25:11.974425 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2880/5733] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:11 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:12.998757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:13.009453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:13.033815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:13.034246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:13.053911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:13.057948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:13.152101 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-878a78a6-7665-4f60-a6e5-822a22185b66 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.168930 Dec 25 21:25:13.155822 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2854/5734] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:12 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:14.167163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:14.168351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:14.190699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:14.190699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:14.191419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:14.192144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:14.326948 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bbfefd2-6add-404b-ba89-8ac48faa22d1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.163093 Dec 25 21:25:14.331962 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2881/5735] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:14 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:15.350359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:15.352496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:15.367772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:15.369533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:15.375497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:15.375497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:15.485535 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e49668ec-e15d-4760-ad38-bc702ab59321 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.142000 Dec 25 21:25:15.494061 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2855/5736] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:15 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:16.498260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:16.499389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:16.517007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:16.517727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:16.518948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:16.519495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:16.586036 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6cb90675-2c50-49ce-b061-d4abd5ffee50 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.084331 Dec 25 21:25:16.586036 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2882/5737] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:16 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:17.598901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:17.601619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:17.613316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:17.614087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:17.615259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:17.616534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:17.698620 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27a936e9-c123-4b38-996c-c15ded6a3e34 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.105835 Dec 25 21:25:17.701799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2856/5738] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:17 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:18.712835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:18.713889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:18.734381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:18.734845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:18.735661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:18.736102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:18.804628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-326c1329-41f1-44f2-828c-2c15e09408a0 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.096430 Dec 25 21:25:18.805297 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2883/5739] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:18 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:19.816377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:19.817418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:19.825369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:19.825830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:19.826638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:19.827083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:19.870243 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52f12248-5076-487b-96a0-99fee2e705d9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.057914 Dec 25 21:25:19.870918 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2857/5740] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:19 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:20.882608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:20.883614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:20.892582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:20.893469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:20.894350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:20.895040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:21.007982 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0c60a42-4ba9-4636-adbf-2fd28ed18151 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.117867 Dec 25 21:25:21.015021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2884/5741] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:20 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:22.022149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:22.023275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:22.035102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:22.036260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:22.040625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:22.040625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:22.086880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c92e9e6-b44a-4733-83b4-4c6db461267d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.070264 Dec 25 21:25:22.087551 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2858/5742] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:22 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:23.100910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:23.102684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:23.121608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:23.123262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:23.125416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:23.126278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:23.214287 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb0503e5-8121-4651-ae60-7167cd38e84c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.118848 Dec 25 21:25:23.215744 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2885/5743] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:23 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:24.229182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:24.230816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:24.238434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:24.239156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:24.240689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:24.241343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:24.306953 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d549bca1-a683-4014-a957-09dd8f718cfa tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.082299 Dec 25 21:25:24.308064 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2859/5744] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:24 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:25.320477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:25.321541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:25.334989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:25.335444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:25.336267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:25.336709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:25.430222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-630d4e06-c926-471c-b2b2-98cd726510a3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.113175 Dec 25 21:25:25.431073 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2886/5745] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:25 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:26.444983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:26.446333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:26.454178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:26.454653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:26.455840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:26.456397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:26.515301 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fc7e01f-f3fa-436d-9fe0-6560b3def407 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.075488 Dec 25 21:25:26.516139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2887/5746] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:26 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:26.628566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-520427205", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "d3e5445c-e82c-41fa-b43a-d819a64e08ff"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:26.701240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] validate_networks() for [('d3e5445c-e82c-41fa-b43a-d819a64e08ff', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:25:27.357114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:25:27.357624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:25:27.358199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:25:27.358738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:25:27.359162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:25:27.370224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:27.370768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:27.371526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:27.372150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:27.392297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Getting quotas for project 76f51d39e5e345dbafabc9f8d372fc34. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:25:27.402194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Getting quotas for user 925d8266445c4711bad30f8be395f458 and project 76f51d39e5e345dbafabc9f8d372fc34. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:25:27.416917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:25:27.419570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:25:27.528352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:27.530001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:27.537917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:27.538586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:27.540264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:27.540919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:27.550128 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cec63cf-6581-43d3-82a1-01bcdb28d45f tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297005 Dec 25 21:25:27.550791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2860/5747] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:25:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:25:27.570683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e92049c-cc0c-44ab-8843-b63c87b78d3e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:27.571323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e92049c-cc0c-44ab-8843-b63c87b78d3e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:27.641386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4516420c-7dbd-4645-ad53-ba73d1031df3 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.106656 Dec 25 21:25:27.649324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e92049c-cc0c-44ab-8843-b63c87b78d3e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:27.649833 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2888/5748] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:27 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:27.658497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e92049c-cc0c-44ab-8843-b63c87b78d3e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1216 microversion: 2.1 time: 0.095240 Dec 25 21:25:27.661155 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2861/5749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:27 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1216 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:28.660908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:28.663772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:28.672162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:28.673638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:28.680294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac90cff4-fa82-4582-b3af-86ddac99c89e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:28.681567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac90cff4-fa82-4582-b3af-86ddac99c89e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:28.687278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:28.688755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:28.748808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ac90cff4-fa82-4582-b3af-86ddac99c89e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:28.753357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3866ebb-e3ba-42b8-807c-f789250b78b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.103458 Dec 25 21:25:28.754025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2889/5750] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:28 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:28.756379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac90cff4-fa82-4582-b3af-86ddac99c89e tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1216 microversion: 2.1 time: 0.080897 Dec 25 21:25:28.764772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2862/5751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:28 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1216 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:25:29.773679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:29.774532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:29.776154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:29.777442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:29.797042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:29.799055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:29.799616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:29.800544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:29.801400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:29.804223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:29.806046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:29.806225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:29.888069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae55bbb2-305d-47e8-8e01-dcd1b5a20ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.125636 Dec 25 21:25:29.889710 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2890/5752] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:29 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:29.895854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:29.903331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db8054db-3328-425e-9045-f26c0f4e7830 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1268 microversion: 2.1 time: 0.134223 Dec 25 21:25:29.903910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2863/5753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:29 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1268 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:30.901963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:30.903717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:30.912294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:30.919638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:30.919638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:30.919638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:30.923998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:30.924631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:30.935224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:30.936097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:30.937279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:30.938160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:31.009003 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-531f74a7-4727-4ba6-9e2c-6a4fa416cfd9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.111200 Dec 25 21:25:31.009825 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2891/5754] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:30 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:31.218874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:31.232091 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d697811-8905-40c8-b1fa-737963e212b0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1274 microversion: 2.1 time: 0.311951 Dec 25 21:25:31.232707 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2864/5755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:30 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1274 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:25:32.025094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:32.027264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:32.043940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:32.043940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:32.043940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:32.043940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:32.100810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e546c4ac-cc17-456c-a1a2-2ddc62143dc1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.081988 Dec 25 21:25:32.104949 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2892/5756] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:32 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:32.255129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:32.255748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:32.263101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:32.264402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:32.265243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:32.265857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:32.513995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:32.521613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41675ab6-4e36-4a06-9666-d3a32b61bf82 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.270376 Dec 25 21:25:32.532279 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2865/5757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:32 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:33.112805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:33.115288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:33.125868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:33.128287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:33.134123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:33.134740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:33.168414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f3768b69-a52a-4dd7-bba2-0a7200fe92c7 req-c56bed2b-bb5e-40fa-a63b-80305d1c7e24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22ebc312-ee15-4ad5-9083-12afbc14bdf6", "tag": "41bf078c-e30c-41c9-894d-b8d92af84070"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:33.172043 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:33.172043 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:25:33.184251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f3768b69-a52a-4dd7-bba2-0a7200fe92c7 req-c56bed2b-bb5e-40fa-a63b-80305d1c7e24 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:33.184702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f3768b69-a52a-4dd7-bba2-0a7200fe92c7 req-c56bed2b-bb5e-40fa-a63b-80305d1c7e24 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:33.201803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f3768b69-a52a-4dd7-bba2-0a7200fe92c7 req-c56bed2b-bb5e-40fa-a63b-80305d1c7e24 service nova] Creating event network-changed:41bf078c-e30c-41c9-894d-b8d92af84070 for instance 22ebc312-ee15-4ad5-9083-12afbc14bdf6 on nch2-master-1 Dec 25 21:25:33.218362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f3768b69-a52a-4dd7-bba2-0a7200fe92c7 req-c56bed2b-bb5e-40fa-a63b-80305d1c7e24 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053833 Dec 25 21:25:33.219250 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2866/5758] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:25:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:25:33.219724 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8fd49e26-fc5a-477c-8da6-de204268f302 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.109788 Dec 25 21:25:33.221377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2893/5759] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:33 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:33.542108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:33.543966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:33.569559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:33.572641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:33.572641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:33.575037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:33.926159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:33.935583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-265a7864-30d9-4304-b818-7c0ecb390f33 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.400070 Dec 25 21:25:33.969365 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2867/5760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:33 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:34.232101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:34.233314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:34.247981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:34.248451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:34.249302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:34.253427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:34.316289 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ded837b9-7b92-40ef-ad20-a245a6b8d130 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 24536 microversion: 2.42 time: 0.086563 Dec 25 21:25:34.321798 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2894/5761] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:34 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 24536 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:34.953830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:34.955609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:34.963128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:34.963991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:34.965070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:34.965866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:35.279609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:35.295987 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c88c6df5-e17b-4ba3-99f2-13ee13f01db5 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.346670 Dec 25 21:25:35.296946 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2868/5762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:34 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:35.328982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:35.330856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:35.350263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:35.350787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:35.351661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:35.353311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:35.476523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d95c4b09-a809-4129-aa52-8e0d442dd631 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.149879 Dec 25 21:25:35.477865 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2895/5763] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:35 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:36.312821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:36.314187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:36.329807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:36.330682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:36.331777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:36.332537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:36.497099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:36.504426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:36.531443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:36.531770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:36.533396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:36.535777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:36.613646 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d58edbf-a2c7-44f0-a817-d1659385d7b7 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.127269 Dec 25 21:25:36.614592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2896/5764] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:36 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:36.667217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:36.674883 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5309339-b001-4c73-85aa-0abdbb5388d2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.365853 Dec 25 21:25:36.675485 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2869/5765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:36 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:25:37.628820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:37.631154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:37.640253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:37.641174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:37.642305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:37.642932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:37.691462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:37.692290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:37.706411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:37.707149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:37.709249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:37.709857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:37.740764 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-74e71d61-c606-4098-a83f-197b7915cf41 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.115684 Dec 25 21:25:37.742269 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2897/5766] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:37 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:38.071432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:38.084942 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e9074b4-3dd6-4692-be0c-4ed32866af9b tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.396953 Dec 25 21:25:38.089207 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2870/5767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:37 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:25:38.760364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:38.763216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:38.778298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:38.779640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:38.780514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:38.781245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:38.832852 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60465060-062b-48c3-a8e1-99910fd87607 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.082673 Dec 25 21:25:38.834685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2898/5768] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:38 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:25:39.101416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:39.102039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:39.115434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:39.116112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:39.117463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:39.121352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:39.808514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:39.816329 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baf1404d-d7b4-4775-a163-684be01ca028 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.718516 Dec 25 21:25:39.819623 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2871/5769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:39 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:39.858009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:39.863616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:39.882827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:39.886656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:39.886656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:39.886656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:39.999816 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1221f2fe-7869-4b7e-9c90-5333848449f1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.156262 Dec 25 21:25:40.010273 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2899/5770] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:39 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:40.834634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:40.835208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:40.845635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:40.846403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:40.847390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:40.848050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:41.023429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:41.023429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:41.039769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:41.040240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:41.043433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:41.045182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:41.146803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-570c2b26-4f71-44fa-babd-e139b3ce27a4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.129262 Dec 25 21:25:41.146803 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2900/5771] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:41 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:25:41.382175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:41.432332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9d18869-8173-4ac5-9b3f-1657a5706b30 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 0.563680 Dec 25 21:25:41.444016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2872/5772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:40 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:41.566180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ce55a827-d22b-444f-800f-255056f27e84 req-7ac2f2e4-5546-4a4e-86f3-c3a0c6bbe013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ebc312-ee15-4ad5-9083-12afbc14bdf6", "name": "network-vif-plugged", "status": "completed", "tag": "41bf078c-e30c-41c9-894d-b8d92af84070"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:41.574664 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:41.574664 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:25:41.592581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ce55a827-d22b-444f-800f-255056f27e84 req-7ac2f2e4-5546-4a4e-86f3-c3a0c6bbe013 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:41.593888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ce55a827-d22b-444f-800f-255056f27e84 req-7ac2f2e4-5546-4a4e-86f3-c3a0c6bbe013 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:41.634219 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ce55a827-d22b-444f-800f-255056f27e84 req-7ac2f2e4-5546-4a4e-86f3-c3a0c6bbe013 service nova] Creating event network-vif-plugged:41bf078c-e30c-41c9-894d-b8d92af84070 for instance 22ebc312-ee15-4ad5-9083-12afbc14bdf6 on nch2-master-1 Dec 25 21:25:41.646229 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ce55a827-d22b-444f-800f-255056f27e84 req-7ac2f2e4-5546-4a4e-86f3-c3a0c6bbe013 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090948 Dec 25 21:25:41.649001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2901/5773] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:25:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:25:42.156430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:42.158073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:42.172379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:42.172783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:42.174621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:42.175744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:42.292220 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1785c558-7bb8-4751-babd-ecf60be82796 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.139742 Dec 25 21:25:42.297444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2873/5774] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:42 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:42.452658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:42.452658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:42.465079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:42.465712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:42.466862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:42.468675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:43.308756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:43.309889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:43.327508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:43.330875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:43.331869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:43.332332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:43.434289 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e19b75b3-ff2b-4d53-89c6-a7b5f2fc840d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.132652 Dec 25 21:25:43.438408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2874/5775] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:43 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:43.713587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:43.736987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f1f6553-b190-455c-ab60-c259028f95a0 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1316 microversion: 2.1 time: 1.283678 Dec 25 21:25:43.738812 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2902/5776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:42 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1316 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:44.445932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:44.446952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:44.460852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:44.461340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:44.462170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:44.462616 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:44.567921 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99db3d66-0658-4791-abc0-f22c88c5822e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.125517 Dec 25 21:25:44.574721 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2875/5777] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:44 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:44.746516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:44.747165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:44.760626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:44.762206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:44.764995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:44.765469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.397641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:45.407446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f73bf128-e0de-43e1-b735-30e39a1927d8 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1505 microversion: 2.1 time: 0.665031 Dec 25 21:25:45.412988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2903/5778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:44 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:45.437778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:45.438834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:45.478904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.478904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.483234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.483974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.575694 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44c93760-8b5a-445f-8b28-f65bb246f922 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6/ips" status: 200 len: 109 microversion: 2.1 time: 0.143168 Dec 25 21:25:45.585672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2876/5779] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:45 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6/ips => generated 109 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:25:45.592177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:45.596572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:45.603222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:45.615419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:45.639194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.639662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.647566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.649279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.652651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.653448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.654945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.655417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.685659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec23b3cc-2213-4b33-918b-5edc2b7e868a tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6/ips" status: 200 len: 109 microversion: 2.1 time: 0.099335 Dec 25 21:25:45.694522 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2904/5780] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:25:45 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6/ips => generated 109 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:25:45.713228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:45.714977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:45.749380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.750216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.754522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.754522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.777254 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c3c4fd9-b0f1-4b92-94e0-793a450b7f2a tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.188665 Dec 25 21:25:45.784574 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2877/5781] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:45 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:45.841044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d0f56e49-2d90-441d-b13f-0f14c45c9b17 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6/ips/tempest-ServerAddressesTestJSON-618184826-network" status: 200 len: 94 microversion: 2.1 time: 0.139674 Dec 25 21:25:45.850907 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2905/5782] 10.222.0.32 () {58 vars in 1397 bytes} [Sat Dec 25 21:25:45 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6/ips/tempest-ServerAddressesTestJSON-618184826-network => generated 94 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:25:45.882113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:45.884158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:45.896561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.897533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.905340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:45.906204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:45.982378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:25:46.346946 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e530668-1727-4e12-b5b2-ab2bfc35fdf2 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "DELETE /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 204 len: 0 microversion: 2.1 time: 0.494677 Dec 25 21:25:46.352448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2878/5783] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:25:45 2021] DELETE /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:25:46.368599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:46.368599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:46.370318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:46.370800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:46.371590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:46.372571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:46.791798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:46.792839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:46.812187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:46.812861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:46.813904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:46.814522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:46.917994 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a8a57d80-5598-4378-b56c-ddcc890aa8ee tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.121701 Dec 25 21:25:46.922072 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2879/5784] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:46 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:25:47.119586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:47.137645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42b2f4b2-4b14-4127-93df-4691146aa6e1 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1511 microversion: 2.1 time: 0.780866 Dec 25 21:25:47.146075 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2906/5785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:46 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1511 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:47.932363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:47.935752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:47.997523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:47.997987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:47.998909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:48.000713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:48.102366 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da61f7b8-6ce3-493e-aece-388e4c916269 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.173323 Dec 25 21:25:48.104754 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2880/5786] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:47 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:48.162151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:48.163590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:48.181671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:48.192476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:48.193835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:48.194747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:49.125144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:49.126216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:49.144520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:49.151806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:49.152839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:49.154214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:49.258831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ec2ccc9-12de-45fb-9a99-a385671c1cf2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.144130 Dec 25 21:25:49.264751 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2881/5787] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:49 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:25:49.888910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-aad3c4ab-42e0-45eb-b9d9-400b7cad51ed req-7d62262a-1069-4bc4-9e91-3e3ab32c594e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22ebc312-ee15-4ad5-9083-12afbc14bdf6", "name": "network-vif-deleted", "tag": "41bf078c-e30c-41c9-894d-b8d92af84070"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:49.891475 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:25:49.891475 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:25:49.897809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:49.907289 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f2c7d32-fb38-43d3-a04e-6425b7ab2987 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1511 microversion: 2.1 time: 1.750851 Dec 25 21:25:49.917140 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2907/5788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:48 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1511 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:49.921936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-aad3c4ab-42e0-45eb-b9d9-400b7cad51ed req-7d62262a-1069-4bc4-9e91-3e3ab32c594e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:49.922412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-aad3c4ab-42e0-45eb-b9d9-400b7cad51ed req-7d62262a-1069-4bc4-9e91-3e3ab32c594e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:49.955913 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-aad3c4ab-42e0-45eb-b9d9-400b7cad51ed req-7d62262a-1069-4bc4-9e91-3e3ab32c594e service nova] Creating event network-vif-deleted:41bf078c-e30c-41c9-894d-b8d92af84070 for instance 22ebc312-ee15-4ad5-9083-12afbc14bdf6 on nch2-master-1 Dec 25 21:25:49.969170 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-aad3c4ab-42e0-45eb-b9d9-400b7cad51ed req-7d62262a-1069-4bc4-9e91-3e3ab32c594e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090415 Dec 25 21:25:49.969325 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2882/5789] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:25:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:25:50.286697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:50.292489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:50.335684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:50.337455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:50.340024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:50.342443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:50.481354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c369f948-cbd6-4726-abb0-3eee1e074c0d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.212250 Dec 25 21:25:50.482468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2908/5790] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:50 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:50.925600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:50.927190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:50.935121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:50.936677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:50.943446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:50.944674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:51.011825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:51.012291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:51.012767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lazy-loading 'fault' on Instance uuid 22ebc312-ee15-4ad5-9083-12afbc14bdf6 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:25:51.092819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '925d8266445c4711bad30f8be395f458', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f51d39e5e345dbafabc9f8d372fc34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:25:51.113742 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19b8e15c-15a1-411b-9a3a-c8d51a6da475 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 200 len: 1306 microversion: 2.1 time: 0.192101 Dec 25 21:25:51.124973 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2883/5791] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:50 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 1306 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:25:51.494389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:51.496797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:51.509748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:51.514802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:51.515885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:51.521230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:51.575908 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30ff7fb3-9458-4e1b-bd44-7e9e51c1f5a1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.085482 Dec 25 21:25:51.580740 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2909/5792] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:51 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:52.141210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:25:52.141884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] [instance: 22ebc312-ee15-4ad5-9083-12afbc14bdf6] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:52.150031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:52.151028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:52.151878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:52.152613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:52.167603 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] HTTP exception thrown: Instance 22ebc312-ee15-4ad5-9083-12afbc14bdf6 could not be found. Dec 25 21:25:52.168213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] Returning 404 to user: Instance 22ebc312-ee15-4ad5-9083-12afbc14bdf6 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:25:52.169098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-712b8c03-ff4d-4869-8d2d-194d5b0f3154 tempest-ServerAddressesTestJSON-1193958312 tempest-ServerAddressesTestJSON-1193958312-project] 10.222.0.32 "GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6" status: 404 len: 111 microversion: 2.1 time: 0.031883 Dec 25 21:25:52.169666 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2884/5793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:25:52 2021] GET /compute/v2.1/servers/22ebc312-ee15-4ad5-9083-12afbc14bdf6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:25:52.589809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:52.591418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:52.612619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:52.613313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:52.615280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:52.615894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:52.712251 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0d20a24-f82d-4205-9950-8ddce527a4db tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.126454 Dec 25 21:25:52.713545 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2910/5794] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:52 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:53.726632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:53.735213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:53.747224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:53.747686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:53.758487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:53.758963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:53.853269 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da081db5-5439-4d9a-8950-0c26a6cfa9e2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.132118 Dec 25 21:25:53.854338 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2885/5795] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:53 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:54.873148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:54.876720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:54.894251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:54.895562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:54.896576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:54.897239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:54.968379 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cf84ffbe-4817-43cb-ad2c-63c50e7209a9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.105037 Dec 25 21:25:54.974037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2911/5796] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:54 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:55.990617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:55.992200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:56.002082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:56.002544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:56.003548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:56.004277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:56.071709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbfdd057-0e08-4d86-bc9f-92eb793c2c76 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.087681 Dec 25 21:25:56.075962 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2886/5797] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:55 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:57.085539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:57.088651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:57.101637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:57.102450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:57.103933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:57.104558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:57.186239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-922f6d6a-5835-43d3-b2b9-ce720e46d9da tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.104113 Dec 25 21:25:57.187559 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2912/5798] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:57 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:58.209577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:58.216985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:58.250593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:58.251521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:58.253137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:58.254932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:58.352794 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c20b79a-6be1-44d3-8a0c-8a774ff288f9 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.151869 Dec 25 21:25:58.353884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2887/5799] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:58 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:25:59.367911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:25:59.369231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:25:59.414604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:59.417538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:59.419627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:25:59.422396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:25:59.567544 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d80fea2-267f-4bf1-b29d-b445aacdf92c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.205679 Dec 25 21:25:59.572461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2913/5800] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:25:59 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:00.580679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:00.581546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:00.597295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:00.602883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:00.603999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:00.604628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:00.737339 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31e5f4fb-6774-4682-be24-bf57fe04cc98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.160172 Dec 25 21:26:00.743121 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2888/5801] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:01.751760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:01.752847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:01.760538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:01.761418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:01.762570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:01.763284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:01.812540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fbf7aec5-0fca-4fd5-a20b-0d1e30314968 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.065970 Dec 25 21:26:01.817192 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2914/5802] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:01 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:02.824753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:02.825923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:02.838467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:02.841542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:02.842795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:02.845411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:02.900626 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb5da0cc-de3e-4128-9fe6-c9ea586e4e86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.079476 Dec 25 21:26:02.902307 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2915/5803] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:02 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:02.969183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2042576968", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "62035f0b-310d-441b-86b6-87cbf84c7a7f"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:03.029836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] validate_networks() for [('62035f0b-310d-441b-86b6-87cbf84c7a7f', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:26:03.918111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:03.918111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:03.935029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:03.940203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:03.942247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:03.942886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:04.047304 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07501504-da30-4410-be02-5f6de475997f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.137243 Dec 25 21:26:04.061346 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2916/5804] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:03 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:04.307329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:26:04.312842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:26:04.312842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:26:04.312842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:26:04.312842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:26:04.323880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:04.324336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:04.325184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:04.325626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:04.418459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Getting quotas for project 5a8dd053b27a426f844ddb32e4f1d6f6. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:26:04.426361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Getting quotas for user e1915a5223074263ae66c1964ca003f4 and project 5a8dd053b27a426f844ddb32e4f1d6f6. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:26:04.440046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:26:04.443206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:26:04.634990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aeeaddb2-6332-4204-9f73-9c56f2a07ebf tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.971873 Dec 25 21:26:04.641375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2889/5805] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:26:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:26:04.657750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1788002b-1854-4fb9-a146-a8f100aa9858 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:04.676555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1788002b-1854-4fb9-a146-a8f100aa9858 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:04.879205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1788002b-1854-4fb9-a146-a8f100aa9858 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:04.887765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1788002b-1854-4fb9-a146-a8f100aa9858 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1225 microversion: 2.1 time: 0.239878 Dec 25 21:26:04.888345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2917/5806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:04 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1225 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:05.068830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:05.070233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:05.084920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:05.085850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:05.087994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:05.089418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:05.170815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c6c0679c-5ace-4ef5-9145-016909e8e947 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.106308 Dec 25 21:26:05.177205 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2890/5807] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:05 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:05.907200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a644d69-5c1b-434d-a409-24a643c914d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:05.908632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a644d69-5c1b-434d-a409-24a643c914d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:06.029379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a644d69-5c1b-434d-a409-24a643c914d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:06.036667 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a644d69-5c1b-434d-a409-24a643c914d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1225 microversion: 2.1 time: 0.135067 Dec 25 21:26:06.037280 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2918/5808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:05 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:26:06.191834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:06.192863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:06.212287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:06.213991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:06.216298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:06.220232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:06.291858 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8db52a8a-54d0-4f08-9f50-f81f8e624469 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.111785 Dec 25 21:26:06.293427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2891/5809] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:06 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:07.055449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:07.056743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:07.072486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:07.073019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:07.079145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:07.079785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:07.244511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:07.257422 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35c71bca-7d1e-4ac1-8cbb-783ac9f82213 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1221 microversion: 2.1 time: 0.207114 Dec 25 21:26:07.263194 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2919/5810] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:07 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1221 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:07.304908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:07.306689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:07.319227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:07.322094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:07.326690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:07.327497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:07.393052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-45ccd1c0-57ae-4b21-a272-f33455be1990 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.092938 Dec 25 21:26:07.399050 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2892/5811] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:07 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:08.279483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:08.284032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:08.295801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:08.297362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:08.302664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:08.303124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:08.406714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:08.408629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:08.417247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:08.419529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:08.420701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:08.421944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:08.488474 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7498d348-b76b-473e-a539-7725a5baaa60 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.085091 Dec 25 21:26:08.492527 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2893/5812] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:08 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:08.630849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:08.640021 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0f0daad-9f89-4bfd-83a1-5a5bcbb45847 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1295 microversion: 2.1 time: 0.364568 Dec 25 21:26:08.640863 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2920/5813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:08 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1295 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:09.500228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:09.501454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:09.510126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:09.510859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:09.511681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:09.512302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:09.561984 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d5338818-5873-4117-858f-fe09b7564a0b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.065792 Dec 25 21:26:09.563775 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2894/5814] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:09 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:09.657097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:09.658657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:09.666630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:09.667379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:09.668418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:09.669082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:09.786426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:09.797340 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06110af4-4914-4895-ab64-2c75ac149391 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1283 microversion: 2.1 time: 0.141290 Dec 25 21:26:09.797340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2921/5815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:09 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1283 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:10.583052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:10.586705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:10.599237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:10.600317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:10.606958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:10.608322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:10.683496 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7beac604-6f4a-4dcf-adbe-656aac8dbb54 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 32448 microversion: 2.42 time: 0.105372 Dec 25 21:26:10.691154 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2895/5816] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:10 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 32448 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:10.811496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:10.812186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:10.818950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:10.819979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:10.820854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:10.821690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:11.488677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:11.496247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a623ac95-e3e8-43e5-8aac-cf82fbb9ed11 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.688352 Dec 25 21:26:11.499136 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2922/5817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:10 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:11.700256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:11.701636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:11.710931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:11.711626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:11.712978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:11.713679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:11.789146 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9f9cf56-fa30-442b-91dc-c180e1be0086 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.094772 Dec 25 21:26:11.790112 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2896/5818] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:11 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:12.512917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:12.513749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:12.521346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:12.522084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:12.523197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:12.523816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:12.802292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:12.803918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:12.811830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:12.812604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:12.813620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:12.814222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:12.883858 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c1cb94e-df60-4353-afe7-1a55f0ecb82e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.085817 Dec 25 21:26:12.888577 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2897/5819] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:12 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:12.934246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:12.945929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9569dbb2-20fd-4021-9997-0e2e369f35b1 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.435966 Dec 25 21:26:12.948395 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2923/5820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:12 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:13.141275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-eed86cbd-6893-4a43-9cb5-54e2717ad16f req-acda90c9-4546-455b-97e3-9ba44d4e975c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67552d4b-2d47-4a5b-ac39-6664ed0b7525", "tag": "a935ddec-3753-4cad-bfd1-a5b690147f82"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:13.143139 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:26:13.143139 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:26:13.152459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-eed86cbd-6893-4a43-9cb5-54e2717ad16f req-acda90c9-4546-455b-97e3-9ba44d4e975c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:13.153802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-eed86cbd-6893-4a43-9cb5-54e2717ad16f req-acda90c9-4546-455b-97e3-9ba44d4e975c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:13.166817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-eed86cbd-6893-4a43-9cb5-54e2717ad16f req-acda90c9-4546-455b-97e3-9ba44d4e975c service nova] Creating event network-changed:a935ddec-3753-4cad-bfd1-a5b690147f82 for instance 67552d4b-2d47-4a5b-ac39-6664ed0b7525 on nch2-master-1 Dec 25 21:26:13.179230 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-eed86cbd-6893-4a43-9cb5-54e2717ad16f req-acda90c9-4546-455b-97e3-9ba44d4e975c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Dec 25 21:26:13.179230 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2898/5821] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:26:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:26:13.898098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:13.900269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:13.920301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:13.921181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:13.926768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:13.929672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:13.966786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:13.976034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:13.981268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:13.981742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:13.982576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:13.983024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:14.012286 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5be969bf-8c33-434b-90b5-7a40ff66a0fe tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.119904 Dec 25 21:26:14.013003 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2924/5822] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:13 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:14.542549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:14.553404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a60b12f9-37d1-4da0-bb48-ab872b08ea31 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.591180 Dec 25 21:26:14.567783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2899/5823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:13 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:15.028086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:15.037535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:15.057936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:15.058398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:15.059202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:15.067626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:15.154841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6cc5a274-ae32-435d-8b74-8955fb5fdde5 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.133758 Dec 25 21:26:15.161467 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2925/5824] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:15 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:15.572933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:15.573765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:15.580560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:15.581569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:15.582342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:15.582778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:15.998376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:16.014771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30cba409-6bed-4378-b2a7-acf523b6c586 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.441094 Dec 25 21:26:16.026146 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2900/5825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:15 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:16.170384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:16.171388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:16.179137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:16.198807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:16.198807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:16.198807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:16.285387 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64cfe379-59c0-4e83-b916-59f74c19ef98 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.113346 Dec 25 21:26:16.285387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2926/5826] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:16 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:17.049316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:17.049316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:17.063122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:17.064122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:17.065174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:17.065966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:17.276023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:17.288525 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83d90abc-8799-49e2-962f-cd00f5a37ecd tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.256333 Dec 25 21:26:17.293603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:17.295834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:17.311346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2901/5827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:17 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:17.315498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:17.316230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:17.317435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:17.318511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:17.370692 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e9eed51-2699-47ed-a8de-2eb0871fb886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.082545 Dec 25 21:26:17.371713 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2927/5828] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:17 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:18.303917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:18.304548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:18.316407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:18.316861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:18.317988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:18.318147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:18.384390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:18.385474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:18.394228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:18.394947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:18.395654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:18.396104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:18.454389 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe4eae41-4d73-4a5e-be42-adcae6261316 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.074573 Dec 25 21:26:18.460676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2928/5829] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:18 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:18.479059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:18.487075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-634485db-6b2a-4c0a-8ef4-23152db632fc tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.188560 Dec 25 21:26:18.488683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2902/5830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:18 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:19.468299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:19.469360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:19.476757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:19.477923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:19.478526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:19.479142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:19.504403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:19.505118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:19.515536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:19.517240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:19.519196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:19.519850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:19.532093 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ba63cb4-e3b9-48c9-b777-28ef6f32641d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.067575 Dec 25 21:26:19.533475 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2929/5831] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:19 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:19.543260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-30c97c2c-2b32-4ce7-8647-e5832a9794ff req-23b7b9c0-550a-402f-adc1-e915e2f41a65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67552d4b-2d47-4a5b-ac39-6664ed0b7525", "name": "network-vif-plugged", "status": "completed", "tag": "a935ddec-3753-4cad-bfd1-a5b690147f82"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:19.546421 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:26:19.546421 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:26:19.554807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-30c97c2c-2b32-4ce7-8647-e5832a9794ff req-23b7b9c0-550a-402f-adc1-e915e2f41a65 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:19.555265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-30c97c2c-2b32-4ce7-8647-e5832a9794ff req-23b7b9c0-550a-402f-adc1-e915e2f41a65 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:19.568342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-30c97c2c-2b32-4ce7-8647-e5832a9794ff req-23b7b9c0-550a-402f-adc1-e915e2f41a65 service nova] Creating event network-vif-plugged:a935ddec-3753-4cad-bfd1-a5b690147f82 for instance 67552d4b-2d47-4a5b-ac39-6664ed0b7525 on nch2-master-1 Dec 25 21:26:19.575667 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-30c97c2c-2b32-4ce7-8647-e5832a9794ff req-23b7b9c0-550a-402f-adc1-e915e2f41a65 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039690 Dec 25 21:26:19.577025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2930/5832] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:26:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:26:19.816550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:19.832502 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-054af4b6-dfd6-45d6-ae0e-04ee069082eb tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.332621 Dec 25 21:26:19.834471 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2903/5833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:19 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:20.547139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:20.549462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:20.557086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:20.558407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:20.559466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:20.560145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:20.664047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-684911cb-9922-4b41-8c23-869bd124f0b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.121728 Dec 25 21:26:20.666084 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2931/5834] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:20 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:20.856203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:20.856964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:20.873755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:20.883236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:20.888345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:20.892573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:21.396534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:21.405657 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f80afff-c31c-4535-bc42-75ac6f7726d6 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1325 microversion: 2.1 time: 0.553579 Dec 25 21:26:21.411175 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2904/5835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:20 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1325 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:21.678150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:21.679378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:21.696763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:21.700468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:21.700468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:21.700468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:21.765188 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f96bf62e-458f-4638-9afd-00cb8797a36b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.091162 Dec 25 21:26:21.769888 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2932/5836] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:21 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:22.432707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:22.434078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:22.445850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:22.448184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:22.449255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:22.449903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:22.781942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:22.784656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:22.796930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:22.802029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:22.804469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:22.805182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:22.905802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ce72af5-766c-45ad-92f1-ce327c043fd1 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.128258 Dec 25 21:26:22.909827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:22.914224 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2933/5837] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:22 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:22.919074 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a1fc9e0-1c84-4e6b-8b46-e9079f235b4a tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1521 microversion: 2.1 time: 0.490175 Dec 25 21:26:22.922472 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2905/5838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:22 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:22.943464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:22.944335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:22.952021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:22.952771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:22.953852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:22.954498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:22.998171 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] HTTP exception thrown: Instance is not a member of specified network Dec 25 21:26:23.000498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Returning 404 to user: Instance is not a member of specified network {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:26:23.003108 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fa7bd371-1f36-4e64-8169-b57d19b749e5 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.065231 Dec 25 21:26:23.012004 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2934/5839] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 21:26:22 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525/ips/invalid => generated 91 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:26:23.017266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a97a27d-f280-4cfa-a7b0-1cf21f934cba tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:23.017874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a97a27d-f280-4cfa-a7b0-1cf21f934cba tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Failed to fetch instance by id 999 {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2871}} Dec 25 21:26:23.019035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-8a97a27d-f280-4cfa-a7b0-1cf21f934cba tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] HTTP exception thrown: Instance 999 could not be found. Dec 25 21:26:23.019872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a97a27d-f280-4cfa-a7b0-1cf21f934cba tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Returning 404 to user: Instance 999 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:26:23.020971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a97a27d-f280-4cfa-a7b0-1cf21f934cba tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008130 Dec 25 21:26:23.021789 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2906/5840] 10.222.0.32 () {58 vars in 1148 bytes} [Sat Dec 25 21:26:23 2021] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Dec 25 21:26:23.039447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:23.040136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:23.054262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:23.054722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:23.055536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:23.056322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:23.120916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:26:23.521078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eead8855-335e-49b6-9b78-19bb99cd0fc0 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "DELETE /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 204 len: 0 microversion: 2.1 time: 0.485391 Dec 25 21:26:23.525089 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2935/5841] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:26:23 2021] DELETE /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:26:23.530249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:23.531490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:23.547744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:23.550382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:23.553039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:23.553802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:23.923178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:23.925638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:23.933999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:23.934460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:23.936672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:23.937338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:24.104328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-206fb769-8595-4893-aa9f-4e5eb5eb97fd tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.187832 Dec 25 21:26:24.106966 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2936/5842] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:23 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:24.390152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:24.410814 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f2dae52-2a12-4c5b-b528-23fea26c36ea tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1527 microversion: 2.1 time: 0.884521 Dec 25 21:26:24.412198 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2907/5843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:23 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1527 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:25.120170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:25.121264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:25.136522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:25.140537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:25.141591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:25.142246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:25.226762 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd3f4f3d-31a8-45a3-8cac-1b419fca2ce2 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.110798 Dec 25 21:26:25.227567 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2937/5844] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:25 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:25.428599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:25.429888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:25.444345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:25.445082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:25.464440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:25.466021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:26.100289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:26.138827 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09369fdd-68cc-46e8-a163-875189ff15d3 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1527 microversion: 2.1 time: 0.709769 Dec 25 21:26:26.144137 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2908/5845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:25 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1527 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:26.240338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:26.242292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:26.255626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:26.255626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:26.255626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:26.255626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:26.326989 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ad12c0b-2e45-471c-a997-81deb6ce657f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.090928 Dec 25 21:26:26.328803 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2938/5846] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:26 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:26.749633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6b0f478d-0ccb-440d-8f24-2594e92f71ba req-5b049bdf-9f0f-41a0-bd62-019a5bb3515c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67552d4b-2d47-4a5b-ac39-6664ed0b7525", "name": "network-vif-deleted", "tag": "a935ddec-3753-4cad-bfd1-a5b690147f82"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:26.752637 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:26:26.752637 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:26:26.774508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6b0f478d-0ccb-440d-8f24-2594e92f71ba req-5b049bdf-9f0f-41a0-bd62-019a5bb3515c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:26.775223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6b0f478d-0ccb-440d-8f24-2594e92f71ba req-5b049bdf-9f0f-41a0-bd62-019a5bb3515c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:26.806797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6b0f478d-0ccb-440d-8f24-2594e92f71ba req-5b049bdf-9f0f-41a0-bd62-019a5bb3515c service nova] Creating event network-vif-deleted:a935ddec-3753-4cad-bfd1-a5b690147f82 for instance 67552d4b-2d47-4a5b-ac39-6664ed0b7525 on nch2-master-1 Dec 25 21:26:26.818065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6b0f478d-0ccb-440d-8f24-2594e92f71ba req-5b049bdf-9f0f-41a0-bd62-019a5bb3515c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072159 Dec 25 21:26:26.819441 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2909/5847] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:26:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:26:27.167782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:27.168613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:27.182474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:27.183033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:27.184129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:27.184826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:27.233144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:27.234008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:27.234729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lazy-loading 'fault' on Instance uuid 67552d4b-2d47-4a5b-ac39-6664ed0b7525 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:26:27.339991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:27.341056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:27.352778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:27.353819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:27.354693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:27.355142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:27.388279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1915a5223074263ae66c1964ca003f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8dd053b27a426f844ddb32e4f1d6f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:27.424952 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2cb31352-0573-4636-ba50-ec08af5e2742 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 200 len: 1315 microversion: 2.1 time: 0.267711 Dec 25 21:26:27.429968 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2939/5848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:27 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:26:27.458853 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8002eae6-820b-42b3-9baf-f2e5bf404886 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.120738 Dec 25 21:26:27.459626 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2910/5849] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:27 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:28.442956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:28.443494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] [instance: 67552d4b-2d47-4a5b-ac39-6664ed0b7525] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:28.472115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:28.475500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:28.488137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:28.490113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:28.496588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:28.499626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:28.514124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:28.514573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:28.515380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:28.515823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:28.593391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] HTTP exception thrown: Instance 67552d4b-2d47-4a5b-ac39-6664ed0b7525 could not be found. Dec 25 21:26:28.594223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] Returning 404 to user: Instance 67552d4b-2d47-4a5b-ac39-6664ed0b7525 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:26:28.598518 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b45d3a82-812d-4395-a36d-9596b0340309 tempest-ServerAddressesNegativeTestJSON-1659920084 tempest-ServerAddressesNegativeTestJSON-1659920084-project] 10.222.0.32 "GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525" status: 404 len: 111 microversion: 2.1 time: 0.160430 Dec 25 21:26:28.599112 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2940/5850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:26:28 2021] GET /compute/v2.1/servers/67552d4b-2d47-4a5b-ac39-6664ed0b7525 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:26:28.661119 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-59523201-2007-46f0-8bb8-df31b7c3c682 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.193671 Dec 25 21:26:28.662540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2911/5851] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:28 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:29.673488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:29.675460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:29.690579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:29.691325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:29.693077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:29.697035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:29.862867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9bf39a36-1c32-4ab6-8375-ad5d941acfd6 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.189514 Dec 25 21:26:29.866828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2941/5852] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:29 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:30.880782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:30.882102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:30.897076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:30.899359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:30.903167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:30.904928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:30.993702 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-171763e0-eeaf-46a3-9ec6-dd4a9782f5bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.119604 Dec 25 21:26:30.997916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2912/5853] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:30 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:32.006991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:32.008018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:32.021253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:32.022081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:32.024357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:32.026455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:32.117485 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92c4679d-2b59-4104-b9a3-8cabe19e6b4c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.115141 Dec 25 21:26:32.118537 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2942/5854] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:32 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:33.146017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:33.146017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:33.154120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:33.154901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:33.155794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:33.156355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:33.216155 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f40f8f6-f434-4cfc-87c5-260e830cb732 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.079520 Dec 25 21:26:33.226390 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2913/5855] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:33 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:34.240772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:34.241995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:34.250454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:34.250915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:34.251756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:34.252747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:34.298145 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db9d896d-17c8-4a8d-8f1f-48f5daba8535 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.062144 Dec 25 21:26:34.300762 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2943/5856] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:34 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:35.313929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:35.315019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:35.330007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:35.339466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:35.341387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:35.341831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:35.423825 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e84049b-0de4-498d-a7f7-803513dd677c tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.115195 Dec 25 21:26:35.428117 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2914/5857] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:35 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:36.121755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fef6464c-84c0-4116-9f2e-1539f7b24b04 tempest-ComputeTenantNetworksTest-520736126 tempest-ComputeTenantNetworksTest-520736126-project] Calling method '.version_select at 0x7fa5007229d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:36.436925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:36.438070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:36.446337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:36.446946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:36.448004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:36.448522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:36.496392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fab5de59-1728-4a1e-a7f9-dff849d79173 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.063902 Dec 25 21:26:36.498608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2915/5858] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:36 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:26:36.887917 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fef6464c-84c0-4116-9f2e-1539f7b24b04 tempest-ComputeTenantNetworksTest-520736126 tempest-ComputeTenantNetworksTest-520736126-project] 10.222.0.32 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.931209 Dec 25 21:26:36.888978 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2944/5859] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:26:35 2021] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:26:36.900030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ee265bc-7239-4b5d-b5eb-9216eb9e6150 tempest-ComputeTenantNetworksTest-520736126 tempest-ComputeTenantNetworksTest-520736126-project] Calling method '.version_select at 0x7fa4f6fe81f0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:37.106375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ee265bc-7239-4b5d-b5eb-9216eb9e6150 tempest-ComputeTenantNetworksTest-520736126 tempest-ComputeTenantNetworksTest-520736126-project] 10.222.0.32 "GET /compute/v2.1/os-tenant-networks/ace9479a-3b61-4eb5-98de-3415c3cd06ad" status: 200 len: 140 microversion: 2.1 time: 0.211574 Dec 25 21:26:37.107674 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2916/5860] 10.222.0.32 () {58 vars in 1268 bytes} [Sat Dec 25 21:26:36 2021] GET /compute/v2.1/os-tenant-networks/ace9479a-3b61-4eb5-98de-3415c3cd06ad => generated 140 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:26:37.510212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:37.511998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:37.524953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:37.527035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:37.529720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:37.535112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:37.636486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08f80a0f-649e-4913-af98-ea4a645df979 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.131167 Dec 25 21:26:37.640760 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2945/5861] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:37 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:38.652820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:38.654534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:38.667861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:38.669359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:38.673402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:38.674627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:38.744648 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-579c1d0d-ba66-4138-a531-fa9eaa56dbdb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.094759 Dec 25 21:26:38.745578 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2917/5862] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:38 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:39.757846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:39.759474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:39.774404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:39.776102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:39.777143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:39.777756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:39.834252 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac6a75e0-5aa8-4c5f-9cb1-6af608596a2b tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.080479 Dec 25 21:26:39.840068 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2946/5863] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:39 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:40.849380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:26:40.850974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:40.868518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:40.877882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:40.884967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:40.886438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:41.005156 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8df345a4-05e3-4fde-810f-41189b5b7c39 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.160434 Dec 25 21:26:41.007452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2918/5864] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:26:40 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:26:41.026064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:41.026828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:41.045948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:41.047051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:41.050553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:41.051194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:42.121449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:42.141687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:42.145984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:26:42.150512 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d78563ca-fe53-447d-ac3a-3c9f11359fae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2952 microversion: 2.42 time: 1.137450 Dec 25 21:26:42.151510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2947/5865] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:26:41 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2952 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:26:42.210128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:26:42.214402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:26:42.225015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:42.227797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:42.227797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:26:42.227797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:26:42.641633 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b060a86d-fad1-4780-811d-1a8ad6999823 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.442468 Dec 25 21:26:42.642273 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2919/5866] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Dec 25 21:26:42 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/os-interface => generated 1831 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:26:59.524082 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:26:59.529204 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:26:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:27:01.407618 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:27:01.408636 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:27:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.32) !!! Dec 25 21:27:01.437207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39a4e502-16f9-41a4-a8fe-d5813727726b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'create', calling method: .version_select at 0x7fa50074e940>, body: {"keypair": {"name": "tempest-keypair-119889696"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:01.458684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-39a4e502-16f9-41a4-a8fe-d5813727726b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:27:01.464824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-39a4e502-16f9-41a4-a8fe-d5813727726b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for user 517838d2d4a942bfa8b332c767c60904 and project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:27:01.922338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-39a4e502-16f9-41a4-a8fe-d5813727726b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:27:01.937530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-39a4e502-16f9-41a4-a8fe-d5813727726b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for user 517838d2d4a942bfa8b332c767c60904 and project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:27:01.987937 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39a4e502-16f9-41a4-a8fe-d5813727726b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.847442 Dec 25 21:27:01.997048 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2948/5867] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:27:01 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 852 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:27:08.772769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1319751174", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8199f70-d579-4a7f-8b38-5d569ea5e784"}], "security_groups": [{"name": "tempest-securitygroup--1166923283"}], "key_name": "tempest-keypair-119889696", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:09.247978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] validate_networks() for [('c8199f70-d579-4a7f-8b38-5d569ea5e784', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:27:10.257685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:27:10.258371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:27:10.260106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:27:10.260795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:27:10.262810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:27:10.288570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:10.289356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:10.290421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:10.291035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:10.322145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:27:10.333873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for user 517838d2d4a942bfa8b332c767c60904 and project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:27:10.341720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:27:10.344646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:27:10.494682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61ed22c7-7e5e-47b1-b215-f6b3bae0dbc0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.727910 Dec 25 21:27:10.495795 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2920/5868] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:27:08 2021] POST /compute/v2.1/servers => generated 402 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:27:10.506265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5129b16-f633-4365-a99e-265d95aec72c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:10.513035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5129b16-f633-4365-a99e-265d95aec72c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:11.162271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5129b16-f633-4365-a99e-265d95aec72c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:11.170128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5129b16-f633-4365-a99e-265d95aec72c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:11.175512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c5129b16-f633-4365-a99e-265d95aec72c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:11.184474 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5129b16-f633-4365-a99e-265d95aec72c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1281 microversion: 2.20 time: 0.674711 Dec 25 21:27:11.185292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2949/5869] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:10 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1281 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:12.208852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce148d6c-5056-4fbc-bc17-58d481bc382d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:12.208852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce148d6c-5056-4fbc-bc17-58d481bc382d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:12.286021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce148d6c-5056-4fbc-bc17-58d481bc382d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:12.293699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce148d6c-5056-4fbc-bc17-58d481bc382d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:12.295654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce148d6c-5056-4fbc-bc17-58d481bc382d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:12.297777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce148d6c-5056-4fbc-bc17-58d481bc382d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1281 microversion: 2.20 time: 0.098341 Dec 25 21:27:12.299383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2921/5870] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:12 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:13.316549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:13.317792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:13.325812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:13.326516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:13.327526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:13.331707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:13.448601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:13.464753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:13.466313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:13.467446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a040b2d-c711-44ad-8288-9469b1125e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1333 microversion: 2.20 time: 0.154742 Dec 25 21:27:13.468044 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2950/5871] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:13 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1333 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:14.490855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:14.493188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:14.518586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:14.525490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:14.526519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:14.529287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:14.729241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:14.742839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:14.750625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:14.763797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-912c38c1-2aba-40fb-9c99-7a4de5d94b77 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1339 microversion: 2.20 time: 0.269756 Dec 25 21:27:14.765223 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2922/5872] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:14 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1339 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:15.774443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:15.778054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:15.792673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:15.794942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:15.794942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:15.795636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:16.493216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:16.509433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:16.515079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:16.518437 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7c59b2cd-d921-48da-8cf2-86229f4d5189 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.750237 Dec 25 21:27:16.519513 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2951/5873] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:15 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:17.554736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:17.559422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:17.579040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b41b5fae-00c8-4637-822e-99075c0ea93b req-9312aef3-9875-4573-b73e-a378a8647d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:17.580764 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:27:17.580764 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:27:17.590453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:17.591967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:17.595396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:17.598702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:17.602695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b41b5fae-00c8-4637-822e-99075c0ea93b req-9312aef3-9875-4573-b73e-a378a8647d16 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:17.602695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b41b5fae-00c8-4637-822e-99075c0ea93b req-9312aef3-9875-4573-b73e-a378a8647d16 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:17.629179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b41b5fae-00c8-4637-822e-99075c0ea93b req-9312aef3-9875-4573-b73e-a378a8647d16 service nova] Creating event network-changed:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:27:17.639285 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b41b5fae-00c8-4637-822e-99075c0ea93b req-9312aef3-9875-4573-b73e-a378a8647d16 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064890 Dec 25 21:27:17.645285 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2952/5874] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:27:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:27:18.491546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:18.500264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:18.505119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:18.505119 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-992278c9-13c1-4d9c-adff-94303715e2b3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.969147 Dec 25 21:27:18.505119 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2923/5875] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:17 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:19.520703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:19.521559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:19.533212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:19.533688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:19.534518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:19.534967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:20.161425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:20.189286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:20.193338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:20.196520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82c7e179-1d9b-4a98-87fd-d1bbd4127d34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.678561 Dec 25 21:27:20.197830 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2953/5876] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:19 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:21.214407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:21.214985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:21.222495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:21.223397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:21.224387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:21.225034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:21.522622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:21.531382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:21.534517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:21.540075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a4d1d7c5-1e49-4865-a1c9-3947cdaf479f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.329673 Dec 25 21:27:21.540738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2924/5877] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:21 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:27:22.558744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:22.560663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:22.570610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:22.571065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:22.575796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:22.576259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:22.784233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:22.794358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:22.797971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:22.810705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50847f9b-05b4-475d-b83f-535ef03357f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.245526 Dec 25 21:27:22.813100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2954/5878] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:22 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:23.184217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:23.189548 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:27:23.189548 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:27:23.191626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:23.192611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Searching by: {'deleted': False, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:27:23.201592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.202486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.203638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.205508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.243310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:27:23.275326 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c25fc1eb-c5dd-4475-bdd8-0c04dc18abe6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.094691 Dec 25 21:27:23.283414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2925/5879] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:27:23 2021] GET /compute/v2.1/servers => generated 343 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:27:23.288612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:23.292098 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:27:23.292098 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:27:23.294077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:23.295306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Searching by: {'deleted': False, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:27:23.301857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.302390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.303314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.303985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.337993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:27:23.391575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:23.399805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.400349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.595074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a77a30a-0d56-421e-901e-4ecc7aa5d70f tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.309644 Dec 25 21:27:23.595749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2955/5880] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:27:23 2021] GET /compute/v2.1/servers/detail => generated 1605 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:23.613011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-673c445f-d972-4256-a796-41bace570eab tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:23.623396 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-673c445f-d972-4256-a796-41bace570eab tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014218 Dec 25 21:27:23.625713 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2926/5881] 10.222.0.32 () {58 vars in 1136 bytes} [Sat Dec 25 21:27:23 2021] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:27:23.818552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:23.819264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:23.836791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.838028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.839142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.839938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.980756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:23.981648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:23.989191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.989933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:23.991390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:23.991917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:24.033105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:24.040008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:27:24.056401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:24.059266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:24.060520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5cc02a0e-97fa-42fe-8c52-e09f21c70eba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.246413 Dec 25 21:27:24.061147 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2956/5882] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:23 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:24.497067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc89a77e-e533-43c4-a86a-ff1127c89bcd tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 204 len: 0 microversion: 2.1 time: 0.521935 Dec 25 21:27:24.498861 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2927/5883] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:27:23 2021] DELETE /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:27:24.506848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:24.507697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:24.515754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:24.522003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:24.529267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:24.530191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:24.713046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:24.721159 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f5357a9-8315-4702-bd27-8043fbbc08d5 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1608 microversion: 2.1 time: 0.218426 Dec 25 21:27:24.721742 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2957/5884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:27:24 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1608 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:25.081412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:25.082199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:25.089589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:25.090779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:25.091822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:25.092689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:25.505356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:25.524230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:25.526326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:25.532490 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3accfad1-13e3-4c97-9347-c1163058ae71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.455492 Dec 25 21:27:25.533788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2928/5885] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:25 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:25.737771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:25.738398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:25.745241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:25.745943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:25.746946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:25.747561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:25.809202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7b625488-9843-4dea-b053-02b0a577c78c req-94cf8302-da30-4bb2-b05f-9103f4e2fe35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "name": "network-vif-plugged", "status": "completed", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:25.812383 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:27:25.812383 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:27:25.823366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7b625488-9843-4dea-b053-02b0a577c78c req-94cf8302-da30-4bb2-b05f-9103f4e2fe35 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:25.824165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7b625488-9843-4dea-b053-02b0a577c78c req-94cf8302-da30-4bb2-b05f-9103f4e2fe35 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:25.836729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7b625488-9843-4dea-b053-02b0a577c78c req-94cf8302-da30-4bb2-b05f-9103f4e2fe35 service nova] Creating event network-vif-plugged:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:27:25.842342 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7b625488-9843-4dea-b053-02b0a577c78c req-94cf8302-da30-4bb2-b05f-9103f4e2fe35 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038509 Dec 25 21:27:25.842975 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2929/5886] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:27:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:27:26.130429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:26.143479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7de9945-af58-42bf-bd04-d162203973c2 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1608 microversion: 2.1 time: 0.409268 Dec 25 21:27:26.144545 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2958/5887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:27:25 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1608 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:26.552656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:26.553390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:26.559606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:26.560059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:26.560848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:26.562475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:27.075903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-130cbb27-af7e-4956-a4c0-7f8a33588b62 req-29a48d85-b75c-4abb-849c-205244d87969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e524c2c3-e248-42dd-82e5-49cb6b3a3b2c", "name": "network-vif-deleted", "tag": "94ab1ddd-760b-4f0c-b396-3eeca500e583"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:27.081272 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:27:27.081272 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:27:27.094407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:27.105025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:27.107658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:27.109775 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0dcf8393-0ed0-401e-8508-f58992077848 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1407 microversion: 2.20 time: 0.561420 Dec 25 21:27:27.110635 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2930/5888] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:26 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1407 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:27.124302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-130cbb27-af7e-4956-a4c0-7f8a33588b62 req-29a48d85-b75c-4abb-849c-205244d87969 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:27.127263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-130cbb27-af7e-4956-a4c0-7f8a33588b62 req-29a48d85-b75c-4abb-849c-205244d87969 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:27.151565 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-130cbb27-af7e-4956-a4c0-7f8a33588b62 req-29a48d85-b75c-4abb-849c-205244d87969 service nova] Creating event network-vif-deleted:94ab1ddd-760b-4f0c-b396-3eeca500e583 for instance e524c2c3-e248-42dd-82e5-49cb6b3a3b2c on nch1-master-1 Dec 25 21:27:27.163649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:27.164724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:27.176342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-130cbb27-af7e-4956-a4c0-7f8a33588b62 req-29a48d85-b75c-4abb-849c-205244d87969 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105620 Dec 25 21:27:27.177873 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2959/5889] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:27:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:27:27.185908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:27.188304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:27.189549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:27.191791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:27.284797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:27.295107 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10e48df5-d0b5-465f-a59d-6cd685e3c57d tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1540 microversion: 2.1 time: 0.136864 Dec 25 21:27:27.304944 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2931/5890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:27:27 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1540 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:28.129667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:28.130625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:28.138238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.142485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.144176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.145036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.312759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:28.313569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:28.322413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.323148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.324380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.378273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.381641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.382868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lazy-loading 'fault' on Instance uuid e524c2c3-e248-42dd-82e5-49cb6b3a3b2c {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:27:28.517394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81821563e0034d1e9743c4ec82245ed6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1ca2fcc2ce4d41b609fa6a753fc806', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:28.526893 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f6d6aa9-43b9-4ee5-8a84-219866be3cc0 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 200 len: 1256 microversion: 2.1 time: 0.218061 Dec 25 21:27:28.529360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2932/5891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:27:28 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 1256 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:28.583719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:28.600092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:28.604808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:27:28.607382 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8e428900-0f51-418b-97ab-4f8017992aba tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1596 microversion: 2.20 time: 0.483455 Dec 25 21:27:28.610873 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2960/5892] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:27:28 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1596 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:27:28.642906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:28.643498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:28.651045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.652683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.653573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:28.658913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:28.968929 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e28add4e-ef96-4615-ac4e-630c9ba4ab36 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.333528 Dec 25 21:27:28.970371 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2933/5893] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Dec 25 21:27:28 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-interface => generated 284 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:27:29.546924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:29.548200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] [instance: e524c2c3-e248-42dd-82e5-49cb6b3a3b2c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:29.555650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:29.556396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:29.557335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:29.560187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:29.582535 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] HTTP exception thrown: Instance e524c2c3-e248-42dd-82e5-49cb6b3a3b2c could not be found. Dec 25 21:27:29.602039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Returning 404 to user: Instance e524c2c3-e248-42dd-82e5-49cb6b3a3b2c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:27:29.603337 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef4e83cb-be22-48c3-96d6-455a999af4cf tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c" status: 404 len: 111 microversion: 2.1 time: 0.060898 Dec 25 21:27:29.606024 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2961/5894] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:27:29 2021] GET /compute/v2.1/servers/e524c2c3-e248-42dd-82e5-49cb6b3a3b2c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:27:29.620697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ffe58ed-eb67-48ee-b3f3-fcbacef331e6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] Calling method '.version_select at 0x7fa4f6227c10>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:27:29.709278 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ffe58ed-eb67-48ee-b3f3-fcbacef331e6 tempest-ServersTestBootFromVolume-822926053 tempest-ServersTestBootFromVolume-822926053-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-818043027" status: 202 len: 0 microversion: 2.1 time: 0.097754 Dec 25 21:27:29.709877 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2934/5895] 10.222.0.32 () {58 vars in 1217 bytes} [Sat Dec 25 21:27:29 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-818043027 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:31.734290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:31.735779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:31.743457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:31.744172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:31.745210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:31.745820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:31.770695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8bce1b8f-3f69-498d-8b8e-d93db9afb331 req-8624e07e-7767-46be-aebe-6c6a9983791f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:31.775267 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:27:31.775267 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:27:31.787985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8bce1b8f-3f69-498d-8b8e-d93db9afb331 req-8624e07e-7767-46be-aebe-6c6a9983791f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:31.788734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8bce1b8f-3f69-498d-8b8e-d93db9afb331 req-8624e07e-7767-46be-aebe-6c6a9983791f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:31.803301 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8bce1b8f-3f69-498d-8b8e-d93db9afb331 req-8624e07e-7767-46be-aebe-6c6a9983791f service nova] Creating event network-changed:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:27:31.808990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8bce1b8f-3f69-498d-8b8e-d93db9afb331 req-8624e07e-7767-46be-aebe-6c6a9983791f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042355 Dec 25 21:27:31.810209 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2935/5896] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:27:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:27:31.835690 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af42b8a6-987a-478d-884c-77f5be730590 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.105373 Dec 25 21:27:31.837183 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2962/5897] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:31 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:32.848366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:32.850147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:32.865277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:32.865970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:32.866957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:32.867558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:32.944795 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32666fa6-f9dd-451b-ab80-d2783dc231fb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.098566 Dec 25 21:27:32.946429 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2936/5898] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:32 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:33.956770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:33.968230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:33.980803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:33.980803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:33.980803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:33.980803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:34.047455 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecdfe66b-e0f7-4e36-9706-cb3216f29c97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.092797 Dec 25 21:27:34.047974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2963/5899] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:33 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:35.058952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:35.059882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:35.068231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:35.069130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:35.070254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:35.071128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:35.119135 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f265ced-8757-41e7-99a2-800cdab84382 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.064380 Dec 25 21:27:35.120731 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2937/5900] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:35 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:36.132313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:36.135120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:36.144519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:36.145381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:36.146482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:36.147181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:36.195585 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0feb91b-a5b3-4ceb-bbac-6eaa2a2a6b12 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.067705 Dec 25 21:27:36.197127 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2964/5901] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:36 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:37.208546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:37.213461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:37.235666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:37.237039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:37.238102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:37.238735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:37.287165 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c3c68e9-07e3-4090-a139-e1d11ac41cbd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.083296 Dec 25 21:27:37.291980 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2938/5902] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:37 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:38.303827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:38.305703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:38.316980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:38.318217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:38.319239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:38.319946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:38.399450 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13df98ea-8979-430e-8c13-7cae5cca3ceb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.097288 Dec 25 21:27:38.399450 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2965/5903] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:38 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:39.411846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:39.414120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:39.422679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:39.424145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:39.425209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:39.426004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:39.491019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a9f4aaf2-0937-45a1-ad40-16fc014f5d5b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 14 microversion: 2.20 time: 0.085580 Dec 25 21:27:39.494504 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2939/5904] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:39 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:27:40.506827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:40.508540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:40.516601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:40.521146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:40.522048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:40.522562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:40.611256 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1dddd49-22af-4135-a621-7c6e736ae02a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 8204 microversion: 2.20 time: 0.110837 Dec 25 21:27:40.612438 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2966/5905] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:40 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 8204 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:27:41.634313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:41.635871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:41.664024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:41.665198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:41.666539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:41.669492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:41.738575 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f036e38c-cdd0-434d-8347-53cf00c8b835 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 16395 microversion: 2.20 time: 0.110375 Dec 25 21:27:41.742362 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2940/5906] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:41 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 16395 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:42.767984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:42.783377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:42.798189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:42.800373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:42.801501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:42.802232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:42.854933 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ae9af18-c66b-405a-9cb8-b8baf5cf8d10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 16395 microversion: 2.20 time: 0.105966 Dec 25 21:27:42.859928 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2967/5907] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:42 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 16395 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:43.867665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:43.868632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:43.883085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:43.883531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:43.884539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:43.886116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:43.955447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-095deb09-db0c-47ab-8e90-229925aaea23 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 16395 microversion: 2.20 time: 0.091191 Dec 25 21:27:43.959396 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2941/5908] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:43 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 16395 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:44.971900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:44.973366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:44.987163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:44.988490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:44.989666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:44.990624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:45.037211 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f1ca425-0e47-458b-aa45-8b4fe55d8c38 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 16395 microversion: 2.20 time: 0.070888 Dec 25 21:27:45.038001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2968/5909] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:44 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 16395 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:46.050018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:46.051041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:46.065369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:46.065836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:46.069929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:46.069929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:46.158928 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1f1e139-450f-4b02-a318-a25ead5da894 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.113392 Dec 25 21:27:46.162783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2942/5910] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:46 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:47.174276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:47.175936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:47.186948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:47.188203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:47.190131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:47.191733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:47.254051 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dfe8bf9-6e40-468f-af66-57ae98b7ab34 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.086798 Dec 25 21:27:47.255633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2969/5911] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:47 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:48.267278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:48.268576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:48.277598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:48.278344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:48.279544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:48.280492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:48.337580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b0283440-ba05-4508-bc4d-a23ebf0d1db6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.074309 Dec 25 21:27:48.344675 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2943/5912] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:48 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:27:49.351069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:49.353423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:49.369212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:49.373586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:49.373586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:49.373586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:49.430257 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-93dd03be-2313-4bf5-860a-7fe6abe43a94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.083479 Dec 25 21:27:49.431982 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2970/5913] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:49 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:50.444916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:50.446081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:50.468058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:50.469263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:50.470999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:50.472010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:50.549999 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3dfdb84d-24e6-42c8-83e4-50fbf30ce7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.111022 Dec 25 21:27:50.551529 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2944/5914] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:50 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:51.562685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:51.563695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:51.577376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:51.579752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:51.580763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:51.585546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:51.649704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68b5d3de-c600-439d-8872-c5d64110ae70 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.090917 Dec 25 21:27:51.655813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2971/5915] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:51 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:52.672272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:52.674227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:52.691753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:52.692600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:52.694271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:52.696268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:52.772746 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea7a9cac-2528-4324-87b2-729b34487ff4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.112952 Dec 25 21:27:52.774406 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2945/5916] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:52 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:27:53.789969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:53.790660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:53.813597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:53.814169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:53.817137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:53.817609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:53.974821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7402dafe-4854-4194-aeb1-5d733fc5a9ff tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.190125 Dec 25 21:27:53.976114 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2972/5917] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:53 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:54.989994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:54.991132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:55.008785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:55.013429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:55.019961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:55.025012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:55.113126 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-555fb10c-ad50-4607-879f-5cfb5bdc8828 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.122449 Dec 25 21:27:55.123486 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2946/5918] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:54 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:56.130045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:56.131085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:56.147172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:56.153823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:56.153823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:56.154103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:56.233832 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ddc03fc-c530-401e-b0a7-48247b198272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 24564 microversion: 2.20 time: 0.108487 Dec 25 21:27:56.235712 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2973/5919] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:56 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 24564 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:57.249759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:57.250783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:57.269431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:57.270191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:57.273543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:57.274003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:57.385299 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7957d475-aed2-42b8-acd1-726fa0d3e36c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.142679 Dec 25 21:27:57.386776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2947/5920] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:57 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:58.398576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:58.401362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:58.420576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:58.421321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:58.424311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:58.424311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:58.473499 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8fb2bb7f-29cf-4c12-995a-0a4395edc9c7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.078717 Dec 25 21:27:58.475943 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2974/5921] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:58 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:27:59.488491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:27:59.489553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:27:59.504915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:59.504915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:59.508635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:27:59.509288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:27:59.575832 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad8ee2fe-d95e-4d15-8ffd-f77e643aa546 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.091747 Dec 25 21:27:59.602703 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2948/5922] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:27:59 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:00.593395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:00.596156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:00.612132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:00.612615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:00.613664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:00.614095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:00.721916 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-836ba8fa-1671-46da-b4c0-f9695a3e394d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.136951 Dec 25 21:28:00.723012 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2975/5923] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:00 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:01.736812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:01.738627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:01.752609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:01.755798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:01.756693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:01.757188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:01.831985 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43028b11-762a-46bb-b4a8-ac14902de34a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.100750 Dec 25 21:28:01.833368 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2949/5924] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:01 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:28:02.846775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:02.848576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:02.867015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:02.867754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:02.872408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:02.881270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:02.961412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd171482-3ed9-476c-8ad2-d7b2b12afa82 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.116832 Dec 25 21:28:02.962500 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2976/5925] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:02 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:03.982763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:03.989155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:04.011458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:04.015069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:04.016846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:04.018799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:04.103524 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baad224a-5e83-47f2-92f8-2dc6b6d8b450 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.131034 Dec 25 21:28:04.104519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2950/5926] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:03 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:05.116928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:05.117965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:05.128713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:05.129149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:05.129969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:05.130416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:05.233859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc2854d1-99c0-46fa-9aa5-6c1a23d4ec10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.121112 Dec 25 21:28:05.235312 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2977/5927] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:05 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:06.258678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:06.272766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:06.308455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:06.309347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:06.310578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:06.311212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:06.368314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9f019ac-9277-46a0-a94d-cba92ad74060 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.125239 Dec 25 21:28:06.369312 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2951/5928] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:06 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:07.388452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:07.389702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:07.455764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:07.460574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:07.466998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:07.468425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:07.645820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c8ea593-7123-429f-8c50-da0d24b11eaf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.268391 Dec 25 21:28:07.647191 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2978/5929] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:07 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:08.673431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:08.675186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:08.684158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:08.685545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:08.686613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:08.687254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:08.745389 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94ae7721-5163-4529-9165-d95dc4d27d94 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.076377 Dec 25 21:28:08.746714 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2952/5930] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:08 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:09.758360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:09.759926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:09.773107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:09.773864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:09.774650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:09.775089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:09.844195 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fdb662ce-346e-4ad9-8f86-2714b3e96e8f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.089432 Dec 25 21:28:09.844848 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2979/5931] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:09 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:10.858979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:10.860595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:10.879469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:10.881244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:10.882301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:10.887092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:10.989996 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e58dd87c-798e-4ef9-b9fb-234520ced1a4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.135850 Dec 25 21:28:10.991531 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2953/5932] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:10 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:12.005842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:12.007046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:12.033744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:12.033917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:12.034788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:12.035396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:12.139722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d5ba75a-da41-45bf-8685-66df3f549de5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.138373 Dec 25 21:28:12.144464 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2980/5933] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:11 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:13.152261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:13.154894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:13.162691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:13.163352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:13.164300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:13.164902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:13.227100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dea3ab96-74be-44bf-aebf-e7e0c4d59fc2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.077827 Dec 25 21:28:13.228494 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2954/5934] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:13 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:14.248297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:14.251186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:14.260616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:14.261343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:14.263083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:14.263748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:14.340197 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8daa9a18-7cd7-4ef1-8354-69870c45bf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.102468 Dec 25 21:28:14.341552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2981/5935] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:14 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:15.353607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:15.355251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:15.363976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:15.364811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:15.366109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:15.366768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:15.473913 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a793cbc-d994-445c-9687-db255c036426 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.120693 Dec 25 21:28:15.474720 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2955/5936] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:15 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:16.486870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:16.487886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:16.521449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:16.522213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:16.523028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:16.524090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:16.572335 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88a7162e-7dcc-4724-9abc-2daffa5d4a99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.089642 Dec 25 21:28:16.573020 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2982/5937] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:16 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:17.591371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:17.593235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:17.607186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:17.608173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:17.614006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:17.614496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:17.725835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1006a560-6f6b-482f-85ef-5b3fd0e738ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.141719 Dec 25 21:28:17.727430 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2956/5938] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:17 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:18.739267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:18.740280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:18.753955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:18.754423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:18.755241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:18.755688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:18.826117 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e6fcf46-631d-457c-b450-4526a4fb1c45 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.091156 Dec 25 21:28:18.830508 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2983/5939] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:18 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:19.839951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:19.846121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:19.850177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:19.850860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:19.851928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:19.852518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:19.897854 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e97c577-751d-4658-b408-6f6949ede119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.063121 Dec 25 21:28:19.899426 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2957/5940] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:19 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:20.918471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:20.920617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:20.930013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:20.930607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:20.931641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:20.932156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:20.989472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27028991-f82b-445d-af8a-182cc264f1d8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.081141 Dec 25 21:28:20.990586 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2984/5941] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:20 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:22.002452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:22.003477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:22.010896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:22.011515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:22.013001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:22.013451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:22.053604 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ef89c9c-c449-41db-9631-1ee7ee1d8fae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.055123 Dec 25 21:28:22.054282 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2958/5942] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:21 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:28:23.066283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:23.068096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:23.093767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:23.094305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:23.100963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:23.100963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:23.182331 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8d4d9108-e0a5-47fd-9a10-65a1e356bd5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.119705 Dec 25 21:28:23.188962 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2985/5943] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:23 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:24.196721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:24.198799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:24.208122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:24.208933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:24.210012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:24.210606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:24.264858 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a34de69a-87e9-498d-bca3-ee46647581dd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.072011 Dec 25 21:28:24.266917 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2959/5944] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:24 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:25.278993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:25.280836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:25.288451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:25.289305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:25.290246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:25.290880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:25.339196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e64ec47c-282d-4dd1-8986-74933ae5ff37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.066002 Dec 25 21:28:25.341044 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2986/5945] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:25 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:26.352267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:26.353965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:26.365098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:26.365825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:26.366915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:26.367482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:26.416558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b27a415-35e9-48bf-8b89-fde6112d7ece tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.068746 Dec 25 21:28:26.418229 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2960/5946] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:26 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:27.430196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:27.431474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:27.441285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:27.442151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:27.443197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:27.444079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:27.515750 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-17005076-cf22-417c-8c55-903c60c9c01d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.083528 Dec 25 21:28:27.519182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2987/5947] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:27 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:28.533824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:28.534910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:28.553896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:28.555403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:28.556490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:28.557121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:28.617553 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-210cc016-e367-44af-b95a-0023edfe877c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.090715 Dec 25 21:28:28.618581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2961/5948] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:28 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:29.632064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:29.634261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:29.643830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:29.644768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:29.645962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:29.646552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:29.690696 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b139df8e-aca1-4edd-8154-10e7c0afbd1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.062796 Dec 25 21:28:29.691297 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2988/5949] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:29 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:30.704598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:30.705980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:30.713571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:30.714648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:30.716437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:30.717241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:30.762736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c71af492-85c8-4ea2-9cdc-3e950314ad5a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.062124 Dec 25 21:28:30.763339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2962/5950] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:30 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:31.778228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:31.783497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:31.795143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:31.797813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:31.801835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:31.802372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:31.903830 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cdc4c480-1e7d-4a85-a149-c336a35653da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.124164 Dec 25 21:28:31.903830 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2989/5951] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:31 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:32.912086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:32.913168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:32.921277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:32.921737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:32.922599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:32.922971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:32.965956 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20091ae4-76de-41ee-834f-e2078dd699be tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.057191 Dec 25 21:28:32.968202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2963/5952] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:32 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:33.979240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:33.981142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:33.989276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:33.991586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:33.991586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:33.991586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:34.042505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7f77aef-4d3c-4424-bceb-3fd361980ae7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.067541 Dec 25 21:28:34.043667 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2990/5953] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:33 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:35.056375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:35.057903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:35.066202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:35.066657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:35.067449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:35.067888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:35.117909 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e136ec47-a554-445b-ae75-bb4bb4f2459a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.066126 Dec 25 21:28:35.118872 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2964/5954] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:35 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:36.133030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:36.134142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:36.143274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:36.144004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:36.145060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:36.145587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:36.202229 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44f68b7b-07b1-46e2-a014-90fad587dd10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.072037 Dec 25 21:28:36.202229 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2991/5955] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:36 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:37.214195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:37.216474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:37.232476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:37.233206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:37.234288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:37.234908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:37.282487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53f6a6b9-5a7e-4935-87c5-bf46c5dbac71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.074332 Dec 25 21:28:37.283940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2965/5956] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:37 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:38.296993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:38.300910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:38.307744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:38.309294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:38.310311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:38.310928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:38.363315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40f2b1f3-4f63-4868-9993-fb7bf9d67bdc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.071789 Dec 25 21:28:38.365121 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2992/5957] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:38 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:39.379196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:39.380712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:39.391164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:39.391972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:39.393060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:39.393763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:39.508444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c63b4aa-294a-400a-99c9-7a2b614a2552 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.074617 Dec 25 21:28:39.508444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2966/5958] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:39 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:40.515467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:40.517265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:40.526854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:40.527320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:40.532572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:40.533192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:40.622221 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6aeeac49-6d7e-4c04-8535-031fab2d22d7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.114543 Dec 25 21:28:40.626367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2993/5959] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:40 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:41.642743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:41.643756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:41.667147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:41.681450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:41.686006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:41.688512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:41.794214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58968ac1-f24b-4f96-9173-1b300efba4a9 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.162634 Dec 25 21:28:41.795108 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2967/5960] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:41 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:42.813743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:42.815237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:42.831311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:42.831765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:42.832569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:42.835511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:42.939911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd85e0df-2013-4ae6-ab11-89716aebd615 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.132083 Dec 25 21:28:42.943305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2994/5961] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:42 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:43.904236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74fcd556-3671-469f-a704-30b9ceb762de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'create', calling method: .version_select at 0x7fa4f70e68b0>, body: {"keypair": {"name": "tempest-keypair-1399369495"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:43.955417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:43.957213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-74fcd556-3671-469f-a704-30b9ceb762de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Getting quotas for project 980165331b334d7795b91adc96459725. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:28:43.957927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:43.964351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-74fcd556-3671-469f-a704-30b9ceb762de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Getting quotas for user 0d9b0c5962544b66b24db53b7e9b8333 and project 980165331b334d7795b91adc96459725. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:28:43.971026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:43.978379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:43.981070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:43.982307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:44.093227 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-332da396-4619-4b0a-af89-867176bfa1aa tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.137185 Dec 25 21:28:44.095719 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2995/5962] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:43 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:44.367246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-74fcd556-3671-469f-a704-30b9ceb762de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Getting quotas for project 980165331b334d7795b91adc96459725. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:28:44.375374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-74fcd556-3671-469f-a704-30b9ceb762de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Getting quotas for user 0d9b0c5962544b66b24db53b7e9b8333 and project 980165331b334d7795b91adc96459725. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:28:44.394001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74fcd556-3671-469f-a704-30b9ceb762de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.32 time: 0.494365 Dec 25 21:28:44.395515 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2968/5963] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:28:43 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 497 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:28:45.107805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:45.109714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:45.128240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:45.129024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:45.131743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:45.132435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:45.214893 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5d42749-af20-49da-92dd-fd5d4eec164e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.110000 Dec 25 21:28:45.223721 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2996/5964] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:45 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:46.235350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:46.244161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:46.279240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:46.282153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:46.286267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:46.287835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:46.361459 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6eea291-c3d2-4f60-a72f-80bc72779b97 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.132062 Dec 25 21:28:46.362278 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2969/5965] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:46 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:47.377070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:47.379130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:47.387897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:47.388655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:47.389698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:47.390137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:47.434767 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d04758d5-6643-4436-aca3-72fe47905c5d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.064293 Dec 25 21:28:47.436911 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2997/5966] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:47 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:48.458017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:48.458017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:48.491927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:48.493304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:48.494479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:48.495120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:48.548257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf46efe5-630f-4573-8176-74b94e7104e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.101043 Dec 25 21:28:48.550374 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2970/5967] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:48 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:49.196807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-638448845", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "36c58514-4b76-443a-8b4e-8188ecbb730f"}, {"port": "893605c1-33ba-4c92-b5eb-6207f354a521", "tag": "port-1"}, {"port": "1704d60b-466b-4afa-a1c8-2e009902991b", "tag": "port-2"}, {"uuid": "6dab2bb9-1b11-4634-becc-b5742aceff64", "tag": "net-1"}, {"uuid": "6dab2bb9-1b11-4634-becc-b5742aceff64"}, {"uuid": "1eebed42-83f0-407e-9fde-c8f3a2309436", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "1eebed42-83f0-407e-9fde-c8f3a2309436", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6c571104-d681-49c0-b0ed-045a03bd3bba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e7976291-a452-4d2e-b90b-b00735370896", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--592698459"}], "key_name": "tempest-keypair-1399369495", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:49.306022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] validate_networks() for [('36c58514-4b76-443a-8b4e-8188ecbb730f', None, None, None, None, None), (None, None, '893605c1-33ba-4c92-b5eb-6207f354a521', None, None, None), (None, None, '1704d60b-466b-4afa-a1c8-2e009902991b', None, None, None), ('6dab2bb9-1b11-4634-becc-b5742aceff64', None, None, None, None, None), ('6dab2bb9-1b11-4634-becc-b5742aceff64', None, None, None, None, None), ('1eebed42-83f0-407e-9fde-c8f3a2309436', '10.2.2.100', None, None, None, None), ('1eebed42-83f0-407e-9fde-c8f3a2309436', '10.2.2.200', None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:28:49.562649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:49.564801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:49.573591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:49.574504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:49.575753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:49.576430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:49.639365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61e4d5bb-4c2b-46ed-8cb0-3511001e2d1e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.081866 Dec 25 21:28:49.643849 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2971/5968] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:49 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:28:50.653703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:50.654716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:50.673253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:50.673779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:50.674641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:50.675126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:50.722041 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01341c11-1ecd-4406-b0db-b74dac7b7c4e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.073728 Dec 25 21:28:50.726300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2972/5969] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:50 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:28:51.499389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:28:51.499883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:28:51.500300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:28:51.500889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:28:51.501361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:28:51.510526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:51.511709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:51.512525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:51.512990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:51.530796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Getting quotas for project 980165331b334d7795b91adc96459725. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:28:51.537935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Getting quotas for user 0d9b0c5962544b66b24db53b7e9b8333 and project 980165331b334d7795b91adc96459725. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:28:51.731062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:28:51.734252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6c571104-d681-49c0-b0ed-045a03bd3bba',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e7976291-a452-4d2e-b90b-b00735370896',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84d8c368-fc65-4b1d-bfa0-8dcd9af9fee2',volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:28:51.734386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:51.735518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:51.746492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:51.746492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:51.746492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:51.746880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:51.790458 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fea489c6-7421-44cd-8057-0244c389f01f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.060297 Dec 25 21:28:51.795017 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2973/5970] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:51 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:28:52.806120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:52.807970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:52.815736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:52.816403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:52.817387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:52.818087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:52.866609 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-646fec51-591a-4637-92f8-270c2aad01cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.066536 Dec 25 21:28:52.870637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2974/5971] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:52 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:52.955820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fcf3f658-34ea-41d8-822d-0e301f82560e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 3.763398 Dec 25 21:28:52.962326 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2998/5972] 10.222.0.32 () {62 vars in 1188 bytes} [Sat Dec 25 21:28:49 2021] POST /compute/v2.1/servers => generated 405 bytes in 3771 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:28:52.968650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81060d7c-ab67-4a8d-889c-8a563bdb8e4b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:28:52.971684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81060d7c-ab67-4a8d-889c-8a563bdb8e4b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:53.032771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81060d7c-ab67-4a8d-889c-8a563bdb8e4b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:53.042879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81060d7c-ab67-4a8d-889c-8a563bdb8e4b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:53.042879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81060d7c-ab67-4a8d-889c-8a563bdb8e4b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:53.044047 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81060d7c-ab67-4a8d-889c-8a563bdb8e4b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1285 microversion: 2.32 time: 0.080980 Dec 25 21:28:53.044609 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2975/5973] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:28:52 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1285 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:28:53.881039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:53.882839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:53.904789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:53.908285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:53.909281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:53.912531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:53.975572 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b213541-d99c-401b-8fd3-82efde35f798 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.100915 Dec 25 21:28:53.977456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 2999/5974] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:53 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:54.062719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52dc5d5d-3696-47c6-8906-a77e81189ea8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:28:54.063379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52dc5d5d-3696-47c6-8906-a77e81189ea8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:54.153534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52dc5d5d-3696-47c6-8906-a77e81189ea8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:54.165565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52dc5d5d-3696-47c6-8906-a77e81189ea8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:54.168556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52dc5d5d-3696-47c6-8906-a77e81189ea8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:54.170124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52dc5d5d-3696-47c6-8906-a77e81189ea8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1285 microversion: 2.32 time: 0.111420 Dec 25 21:28:54.171599 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2976/5975] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:28:54 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:28:54.991000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:54.992292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:55.000828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:55.001312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:55.002126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:55.002569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:55.051997 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3c93432-1a0a-4269-a9c9-d75ec57f946b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.066440 Dec 25 21:28:55.056060 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3000/5976] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:54 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:55.190825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:28:55.195638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:55.209409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:55.209902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:55.210737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:55.211364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:55.345421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:55.356160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:55.357928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:55.359132 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2ac7b9d-19d9-4d62-b2bb-674b2f6cbcde tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1575 microversion: 2.32 time: 0.173870 Dec 25 21:28:55.360015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2977/5977] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:28:55 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:28:56.066535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:56.068908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:56.084338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:56.085056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:56.086440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:56.086975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:56.140388 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f403b0b-1eb3-4eb9-9ea4-564b82213779 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.078677 Dec 25 21:28:56.141827 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3001/5978] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:56 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:56.387037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:28:56.397005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:56.408337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:56.410411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:56.412121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:56.413326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:56.528296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:56.542187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:56.543635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:56.544829 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ceb26e0-38fd-413a-b992-80d066d320e8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1593 microversion: 2.32 time: 0.170469 Dec 25 21:28:56.545589 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2978/5979] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:28:56 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1593 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:28:57.153224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:57.154323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:57.162473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:57.163116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:57.164110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:57.164710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:57.253466 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06e20698-396e-49fb-a0bb-19332b281e5f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.104849 Dec 25 21:28:57.257090 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3002/5980] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:57 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:57.564446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:28:57.565096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:57.576485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:57.577308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:57.578341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:57.578993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:57.879997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:57.889738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:57.891487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:57.892845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-720a899c-f4d5-424c-8aef-05a6fce86be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1660 microversion: 2.32 time: 0.332305 Dec 25 21:28:57.904378 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2979/5981] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:28:57 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1660 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:28:58.266821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:58.267813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:58.275273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:58.276683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:58.277476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:58.277920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:58.342096 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f5d40d2d-4518-4349-9a17-6c0bb10f5759 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.079309 Dec 25 21:28:58.342950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3003/5982] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:58 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:58.930386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:28:58.934074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:58.956748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:58.957906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:58.959194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:58.960180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:59.357855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:28:59.359208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:28:59.372183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:59.372731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:59.373667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:28:59.374324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:28:59.426542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2bde8f4-7f2a-4ffa-b3e1-a0b51ee18d49 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.075270 Dec 25 21:28:59.431605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3004/5983] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:28:59 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:28:59.635155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:59.645278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:59.647036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:28:59.648254 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bfc90b3-92e6-456b-9f50-2d759d17eb22 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1706 microversion: 2.32 time: 0.737400 Dec 25 21:28:59.648844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2980/5984] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:28:58 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1706 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:00.440262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:00.445109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:00.449221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:00.449686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:00.450670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:00.451123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:00.503597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b85327d-f243-4e1e-bb64-287d9a57856f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.060661 Dec 25 21:29:00.503597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3005/5985] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:00 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:29:00.668979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:00.669626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:00.684669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:00.685183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:00.685986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:00.686550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:00.991784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:01.001654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:01.003211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:01.004405 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40964bd0-979a-4fae-a76e-e29e30e0835b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1752 microversion: 2.32 time: 0.340714 Dec 25 21:29:01.005200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2981/5986] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:00 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1752 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:01.509664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:01.510637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:01.517998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:01.518462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:01.519287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:01.519723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:01.568100 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f48f643-af19-4e85-aa4d-ed36acc7b944 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.062716 Dec 25 21:29:01.568968 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3006/5987] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:01 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:29:02.024383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:02.025238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:02.033048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:02.033809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:02.034719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:02.035378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:02.325821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:02.346348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:02.349587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:02.350223 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0bc8e1c4-715b-462a-87f8-bcf42fa5c586 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1798 microversion: 2.32 time: 0.330167 Dec 25 21:29:02.350967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2982/5988] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:02 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1798 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:02.584492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:02.584492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:02.593411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:02.593879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:02.594788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:02.595467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:02.652677 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-471fa458-7938-4746-871f-cedabe3085e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.069863 Dec 25 21:29:02.652677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3007/5989] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:02 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:29:03.370150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:03.371282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:03.384733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:03.385974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:03.386787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:03.387228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:03.663924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:03.667568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:03.687727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:03.688641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:03.691177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:03.692982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:03.758930 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6cfc0b75-69de-4f56-b086-8cf7f557a750 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.097976 Dec 25 21:29:03.760233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3008/5990] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:03 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:29:03.841572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:03.855614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:03.859152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:03.860975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-789e70b7-8718-4b6d-8006-ff82e31a23b1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1844 microversion: 2.32 time: 0.496641 Dec 25 21:29:03.865307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2983/5991] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:03 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1844 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:04.771836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:04.772968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:04.789328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:04.789795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:04.790605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:04.791052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:04.835524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba27f12d-f3e6-48a1-8a89-e740a9edf874 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 32626 microversion: 2.20 time: 0.067828 Dec 25 21:29:04.837301 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3009/5992] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:04 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 32626 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:29:04.893394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:04.897042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:04.916901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:04.921753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:04.927347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:04.927882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:05.305822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9797e862-bb48-4a9e-af2e-22295eb7c803 req-c7bcee02-abd3-46fb-9b17-7aee8a95eeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "dbad079c-9ad0-47fd-8d51-bc9c6d074098"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:05.307397 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:05.307397 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:29:05.335474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9797e862-bb48-4a9e-af2e-22295eb7c803 req-c7bcee02-abd3-46fb-9b17-7aee8a95eeb9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:05.341540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9797e862-bb48-4a9e-af2e-22295eb7c803 req-c7bcee02-abd3-46fb-9b17-7aee8a95eeb9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:05.366705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9797e862-bb48-4a9e-af2e-22295eb7c803 req-c7bcee02-abd3-46fb-9b17-7aee8a95eeb9 service nova] Creating event network-changed:dbad079c-9ad0-47fd-8d51-bc9c6d074098 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:05.383517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9797e862-bb48-4a9e-af2e-22295eb7c803 req-c7bcee02-abd3-46fb-9b17-7aee8a95eeb9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.443376 Dec 25 21:29:05.399423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3010/5993] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:05.630600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:05.663932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:05.668107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:05.673647 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25c4fd6e-15a6-4cef-a74e-72adbd5b54c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1844 microversion: 2.32 time: 0.792820 Dec 25 21:29:05.674301 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2984/5994] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:04 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1844 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:05.851297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:05.852208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:05.862131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:05.864639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:05.866361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:05.867021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:05.943174 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7375c774-ccf4-4539-9664-065ee0380983 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 200 len: 40781 microversion: 2.20 time: 0.098870 Dec 25 21:29:05.966336 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3011/5995] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:05 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 40781 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:29:05.968055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:05.968663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:05.976396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:05.976957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:05.978138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:05.979304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:06.007370 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c3320af-2ed8-42f0-8531-5cf6f5841bd0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/ips" status: 200 len: 148 microversion: 2.20 time: 0.046382 Dec 25 21:29:06.016301 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2985/5996] 10.222.0.32 () {60 vars in 1288 bytes} [Sat Dec 25 21:29:05 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/ips => generated 148 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:29:06.694164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:06.695166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:06.709641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:06.710378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:06.711453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:06.715301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:07.054484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:07.064533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:07.068019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:07.068019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c0a40d2-3270-49c1-b69e-44ac3d40b33c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1865 microversion: 2.32 time: 0.377902 Dec 25 21:29:07.068019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3012/5997] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:06 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1865 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:07.428372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-42bcc13a-b356-4f9b-b50f-a824c9b94e38 req-1596ba27-a3d0-425f-8dd0-1ee6e25eb89a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "893605c1-33ba-4c92-b5eb-6207f354a521"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:07.429990 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:07.429990 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:07.446258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-42bcc13a-b356-4f9b-b50f-a824c9b94e38 req-1596ba27-a3d0-425f-8dd0-1ee6e25eb89a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:07.446713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-42bcc13a-b356-4f9b-b50f-a824c9b94e38 req-1596ba27-a3d0-425f-8dd0-1ee6e25eb89a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:07.469835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-42bcc13a-b356-4f9b-b50f-a824c9b94e38 req-1596ba27-a3d0-425f-8dd0-1ee6e25eb89a service nova] Creating event network-changed:893605c1-33ba-4c92-b5eb-6207f354a521 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:07.478903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-42bcc13a-b356-4f9b-b50f-a824c9b94e38 req-1596ba27-a3d0-425f-8dd0-1ee6e25eb89a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053415 Dec 25 21:29:07.480051 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2986/5998] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:08.094186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:08.106259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:08.124361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:08.125195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:08.128305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:08.130613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:08.606753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:08.617038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:08.618773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:08.620662 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-21f6888e-69e1-4aaf-ab07-91f44eb8f120 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1865 microversion: 2.32 time: 0.538599 Dec 25 21:29:08.621526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3013/5999] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:08 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1865 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:09.535882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2ab783cf-ce9d-4dc3-a7d9-f6d9cc2cb35b req-b955874a-4528-4d38-9a8a-2586c9d6571b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "1704d60b-466b-4afa-a1c8-2e009902991b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:09.538310 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:09.538310 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:09.566945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2ab783cf-ce9d-4dc3-a7d9-f6d9cc2cb35b req-b955874a-4528-4d38-9a8a-2586c9d6571b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:09.567405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2ab783cf-ce9d-4dc3-a7d9-f6d9cc2cb35b req-b955874a-4528-4d38-9a8a-2586c9d6571b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:09.593144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2ab783cf-ce9d-4dc3-a7d9-f6d9cc2cb35b req-b955874a-4528-4d38-9a8a-2586c9d6571b service nova] Creating event network-changed:1704d60b-466b-4afa-a1c8-2e009902991b for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:09.601990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2ab783cf-ce9d-4dc3-a7d9-f6d9cc2cb35b req-b955874a-4528-4d38-9a8a-2586c9d6571b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070982 Dec 25 21:29:09.605573 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2987/6000] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:09.639765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:09.646907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:09.660016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:09.665753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:09.665753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:09.665753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:10.167560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:10.189244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:10.190862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:10.192080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-93706eaf-cce2-446f-a68a-204107dfd702 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.556323 Dec 25 21:29:10.192651 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3014/6001] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:09 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:10.217964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:10.219190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:10.232841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:10.234850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:10.236115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:10.236974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:10.280187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lazy-loading 'flavor' on Instance uuid 65490ad4-5baf-4c89-9877-006d581b4758 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:29:11.149210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-034ce126-8e1f-4c5d-8041-02f6c30bb0bd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 202 len: 0 microversion: 2.20 time: 0.937660 Dec 25 21:29:11.157185 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2988/6002] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:10 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 0 bytes in 948 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:29:11.164775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:11.166888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:11.173659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:11.174112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:11.175080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:11.175519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:11.215922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:11.216639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:11.240304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:11.240988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:11.241987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:11.242581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:11.601600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:11.639266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:11.641167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:11.643162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:11.647875 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30295fa6-eee3-4d28-9047-8fec2dfca7c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.487070 Dec 25 21:29:11.651114 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3015/6003] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:11 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:11.652598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:11.654638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:11.656218 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e7dc50f8-d819-4896-8196-736a15c598d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.444596 Dec 25 21:29:11.662580 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2989/6004] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:11 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:11.712115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4a2d576d-a872-429f-a715-cf300afcb2de req-4904685c-599b-4acb-9e5d-d877e8d81ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "c4a5dc77-7743-4d72-8f35-550325e4dc63"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:11.714641 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:11.714641 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:29:11.722847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4a2d576d-a872-429f-a715-cf300afcb2de req-4904685c-599b-4acb-9e5d-d877e8d81ca9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:11.723297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4a2d576d-a872-429f-a715-cf300afcb2de req-4904685c-599b-4acb-9e5d-d877e8d81ca9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:11.758704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4a2d576d-a872-429f-a715-cf300afcb2de req-4904685c-599b-4acb-9e5d-d877e8d81ca9 service nova] Creating event network-changed:c4a5dc77-7743-4d72-8f35-550325e4dc63 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:11.770912 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4a2d576d-a872-429f-a715-cf300afcb2de req-4904685c-599b-4acb-9e5d-d877e8d81ca9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060999 Dec 25 21:29:11.774163 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3016/6005] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:29:12.666217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:12.667012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:12.684173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:12.685232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:12.701915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:12.704769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:12.704769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:12.704769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:12.705208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:12.705208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:12.705208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:12.706751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:13.311644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:13.328513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:13.334976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:13.336469 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de281be6-7559-49e7-9a3a-e59029a27c4e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.656986 Dec 25 21:29:13.341172 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3017/6006] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:12 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:13.369583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:13.379353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:13.384344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:13.386460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-874d0e26-72ea-4ed2-8152-63d573d137c6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.724344 Dec 25 21:29:13.386592 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2990/6007] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:12 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:13.828968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-274a8803-e1a8-4cdf-adfa-30589247901a req-332b397a-4555-485c-a2c8-65c2cda8d0fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "bbeefdb7-89c8-4442-a2e7-858c459b3b9a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:13.831224 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:13.831224 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:29:13.845323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-274a8803-e1a8-4cdf-adfa-30589247901a req-332b397a-4555-485c-a2c8-65c2cda8d0fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:13.846286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-274a8803-e1a8-4cdf-adfa-30589247901a req-332b397a-4555-485c-a2c8-65c2cda8d0fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:13.872721 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-274a8803-e1a8-4cdf-adfa-30589247901a req-332b397a-4555-485c-a2c8-65c2cda8d0fe service nova] Creating event network-changed:bbeefdb7-89c8-4442-a2e7-858c459b3b9a for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:13.881919 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-274a8803-e1a8-4cdf-adfa-30589247901a req-332b397a-4555-485c-a2c8-65c2cda8d0fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057828 Dec 25 21:29:13.886125 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3018/6008] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:29:14.362314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:14.364350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:14.375212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:14.386861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:14.388468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:14.389113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:14.406278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:14.407241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:14.425888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:14.426840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:14.440900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:14.443285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:15.017119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:15.030793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:15.031055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:15.032200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:15.033609 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f031bccc-6532-44bb-8352-237f5424d0b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.680163 Dec 25 21:29:15.040453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:15.042815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:15.044179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c3086b2-5d69-4140-9ba3-3ff2c0e5043b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.644065 Dec 25 21:29:15.045261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2991/6009] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:14 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:15.048697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3019/6010] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:14 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:15.905338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-52a69dad-dfb0-4ff1-bdcb-fcaca19d4b18 req-475e3100-53f9-429b-b787-db9636501c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "d1b259e7-c1c4-46a5-8fa8-934e76ffd08c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:15.907892 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:15.907892 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:15.923905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-52a69dad-dfb0-4ff1-bdcb-fcaca19d4b18 req-475e3100-53f9-429b-b787-db9636501c5e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:15.924925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-52a69dad-dfb0-4ff1-bdcb-fcaca19d4b18 req-475e3100-53f9-429b-b787-db9636501c5e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:15.938095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-52a69dad-dfb0-4ff1-bdcb-fcaca19d4b18 req-475e3100-53f9-429b-b787-db9636501c5e service nova] Creating event network-changed:d1b259e7-c1c4-46a5-8fa8-934e76ffd08c for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:15.954799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-52a69dad-dfb0-4ff1-bdcb-fcaca19d4b18 req-475e3100-53f9-429b-b787-db9636501c5e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052875 Dec 25 21:29:15.955941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2992/6011] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:16.053282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:16.053737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:16.069038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:16.070007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:16.074269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:16.079860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:16.080519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:16.087222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:16.088785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:16.096298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:16.099464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:16.099934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:16.638012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:16.657441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:16.660894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:16.662141 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78cbf4b4-d5cb-4819-a1e6-2ef7cd00e75f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.598620 Dec 25 21:29:16.663032 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2993/6012] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:16 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:16.706571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:16.715459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:16.717015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:16.718189 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d1200f0-5b32-4b88-81f6-778f58204e7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.669796 Dec 25 21:29:16.718754 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3020/6013] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:16 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:17.682041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:17.683428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:17.693425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:17.694111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:17.695098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:17.696228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:17.737328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:17.738792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:17.757315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:17.758118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:17.759807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:17.760557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:18.213173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:18.229807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:18.231547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:18.235923 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88d13a83-f257-4890-bb34-683a16cbf507 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.558597 Dec 25 21:29:18.236550 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2994/6014] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:17 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:18.244956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-01cacc36-fe82-474c-b7dc-4ff494a14f1c req-401184f1-1e49-4c60-b38e-bbebf3a6fb18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "c1259bc6-d32f-4b81-b593-3660604ed03e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:18.246896 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:18.246896 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:18.267583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-01cacc36-fe82-474c-b7dc-4ff494a14f1c req-401184f1-1e49-4c60-b38e-bbebf3a6fb18 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:18.268525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-01cacc36-fe82-474c-b7dc-4ff494a14f1c req-401184f1-1e49-4c60-b38e-bbebf3a6fb18 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:18.288444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-01cacc36-fe82-474c-b7dc-4ff494a14f1c req-401184f1-1e49-4c60-b38e-bbebf3a6fb18 service nova] Creating event network-changed:c1259bc6-d32f-4b81-b593-3660604ed03e for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:18.295316 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-01cacc36-fe82-474c-b7dc-4ff494a14f1c req-401184f1-1e49-4c60-b38e-bbebf3a6fb18 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057530 Dec 25 21:29:18.296181 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2995/6015] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:18.324298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:18.339630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:18.345925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:18.349381 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9c729341-2099-47b7-aa1d-f7a69f193d5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.615881 Dec 25 21:29:18.351178 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3021/6016] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:17 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:19.254896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:19.256460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:19.265459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:19.271023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:19.272097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:19.272696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:19.370437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:19.371065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:19.389282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:19.396122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:19.400977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:19.400977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:20.101752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:20.115611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:20.117288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:20.118851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88869f93-503f-47b9-9017-a171f4159618 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.868111 Dec 25 21:29:20.119857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2996/6017] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:19 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:20.268594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:20.293618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:20.295406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:20.298622 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce588585-b87b-4d7b-96bd-51b7aaf3ed5d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.932460 Dec 25 21:29:20.299650 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3022/6018] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:19 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:21.139453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:21.140608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:21.158460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:21.165039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:21.165039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:21.165039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:21.323589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:21.324390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:21.336692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:21.341098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:21.342264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:21.342866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:21.787176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:21.796603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:21.808997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:21.810503 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3e42246-508b-45c9-8258-2bce348250e4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.676836 Dec 25 21:29:21.811569 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2997/6019] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:21 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:22.056400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:22.086763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:22.089137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:22.091213 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-659d20e5-32b9-4fad-9167-d5fca44de539 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.777121 Dec 25 21:29:22.093362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3023/6020] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:21 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:22.835346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:22.835784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:22.843496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:22.844033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:22.844853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:22.845315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:23.011642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:23.038389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:23.040910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:23.042941 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a728226-204a-4579-a225-e28d94a95e6a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1741 microversion: 2.20 time: 0.211866 Dec 25 21:29:23.043608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2998/6021] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:22 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:23.111888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:23.112518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:23.121177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:23.121650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:23.122714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:23.123285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:23.966532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:23.979017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:23.980640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:23.981908 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15d0fd28-a1ae-4170-98f1-78c56b51eb07 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.875355 Dec 25 21:29:24.015001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3024/6022] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:23 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:24.062819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:24.073791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:24.090278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:24.092596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:24.092596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:24.092596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:24.465355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:24.478485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:24.480941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:24.485118 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be7cc14d-f918-4a51-82cf-5aa1f397e91a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.426600 Dec 25 21:29:24.489329 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 2999/6023] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:24 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:25.001357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:25.001979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:25.016740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:25.017437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:25.018265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:25.018721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:25.409015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:25.426759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:25.432671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:25.447119 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-496935b7-6e49-41d4-88fc-f9d09bfc3f9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.437021 Dec 25 21:29:25.448583 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3025/6024] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:24 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:25.507553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:25.509221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:25.523029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:25.523686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:25.525480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:25.525932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:25.809335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:25.818139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:25.825679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:25.826915 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-957928b6-c9ec-440f-ae70-38e57534ec48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.325379 Dec 25 21:29:25.827498 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3000/6025] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:25 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:26.456584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:26.457336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:26.497487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:26.497487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:26.497487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:26.497487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:26.882245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b0da39d0-12eb-4899-bd96-8ec7a4f01387 req-fd40684d-fad3-48c6-b154-8f71e9eb7299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "name": "network-vif-plugged", "status": "completed", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:26.888449 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:26.888449 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:26.889152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:26.903023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b0da39d0-12eb-4899-bd96-8ec7a4f01387 req-fd40684d-fad3-48c6-b154-8f71e9eb7299 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:26.903776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b0da39d0-12eb-4899-bd96-8ec7a4f01387 req-fd40684d-fad3-48c6-b154-8f71e9eb7299 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:26.911668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:26.923833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:26.927823 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aae56cfc-a5dd-4cab-8e8b-a17277eb5be8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.474397 Dec 25 21:29:26.928491 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3026/6026] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:26 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:26.930445 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b0da39d0-12eb-4899-bd96-8ec7a4f01387 req-fd40684d-fad3-48c6-b154-8f71e9eb7299 service nova] Creating event network-vif-plugged:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:29:26.937508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:26.938051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:26.944706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b0da39d0-12eb-4899-bd96-8ec7a4f01387 req-fd40684d-fad3-48c6-b154-8f71e9eb7299 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.475551 Dec 25 21:29:26.949374 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3001/6027] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:29:26.972267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:26.974909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:26.979412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:26.980802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:27.268675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:27.281716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:27.284087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:27.285464 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-193fbdc6-123a-4944-857d-981af71edb61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.355949 Dec 25 21:29:27.286139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3027/6028] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:26 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:27.952416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:27.952416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:27.971951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:27.972482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:27.973367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:27.978807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:28.307055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:28.307687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:28.335596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:28.336756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:28.339818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:28.341079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:28.345371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:28.359530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:28.362647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:28.365833 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e2448ae-7bbc-4011-91d7-6adec3cc5a76 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.422262 Dec 25 21:29:28.370554 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3002/6029] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:27 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:28.617365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:28.626657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:28.628081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:28.641394 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a83069b-ba07-4532-87b2-93ccfce0878c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.328964 Dec 25 21:29:28.652772 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3028/6030] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:28 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:29.386869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:29.387652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:29.403661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:29.411460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:29.411460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:29.411460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:29.665110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:29.665750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:29.683446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:29.687407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:29.687407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:29.687407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:29.865271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:29.895240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:29.901744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:29.903202 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a0876c3-1750-49c3-a609-51af812ec2b0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.520398 Dec 25 21:29:29.903805 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3003/6031] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:29 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:30.141024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:30.161206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:30.162742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:30.174158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b7a3f1d-e874-41b0-86a1-1c3e3e65d119 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.507922 Dec 25 21:29:30.188454 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3029/6032] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:29 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:30.921768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:30.922386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:30.929433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:30.929898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:30.931246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:30.931768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:31.196099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:31.196099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:31.228278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:31.228744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:31.229595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:31.230044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:31.325693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:31.345190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:31.348558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:31.350095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4aa8a5f-a7fc-4302-8492-0b4d72cd02dc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.432183 Dec 25 21:29:31.363110 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3004/6033] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:30 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:31.595576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:31.608340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:31.611882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:31.613519 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8b6e243-7b46-4038-bb6c-fa470aec72b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.421865 Dec 25 21:29:31.626587 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3030/6034] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:31 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:32.374145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:32.375514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:32.390492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:32.393326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:32.393326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:32.393326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:32.632210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:32.637796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:32.664170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:32.665783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:32.668047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:32.672998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:32.938520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:32.958039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:32.964522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:32.965786 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88ae5a0f-6208-45e0-b3ba-f68e44087601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.599998 Dec 25 21:29:32.966355 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3005/6035] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:32 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:33.084122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:33.094254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:33.105882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:33.112066 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ff1453f-08fa-4e7e-a58e-61d5cf3baa6d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.483682 Dec 25 21:29:33.112602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3031/6036] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:32 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:33.984201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:33.984824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:34.014587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:34.041594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:34.048449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:34.048449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:34.146113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:34.147752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:34.163138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:34.166358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:34.170436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:34.171103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:34.866891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:34.876428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:34.880791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:34.882342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7f03538-850c-4b4e-9f52-31f3077ce29b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.744151 Dec 25 21:29:34.887771 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3032/6037] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:34 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:34.898652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:34.924336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:34.929540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:34.931805 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e68897cd-1d10-4ac9-a8fd-2c77b7b58d9e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.951126 Dec 25 21:29:34.947247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3006/6038] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:33 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:35.908474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:35.909322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:35.920090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:35.923675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:35.927393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:35.928698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:35.955913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:35.963097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:36.012171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:36.014515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:36.014515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:36.014515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:36.865609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:36.878162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:36.881249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:36.885255 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05af2331-5ecf-48e3-9363-90a4234ba238 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.981214 Dec 25 21:29:36.886516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3033/6039] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:35 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:36.928558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:36.942331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:36.949600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:36.953890 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c4b4d02-731c-4a36-8b19-566e587931c0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 1.002361 Dec 25 21:29:36.954996 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3007/6040] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:35 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:37.908953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:37.912640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:37.921355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:37.921998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:37.922957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:37.923542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:37.974760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:37.978580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:37.990380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:37.991223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:37.992316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:37.993079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:38.614738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:38.628204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:38.632544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:38.637290 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef76eced-a1ce-4e32-ae20-68cb71e285f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.738164 Dec 25 21:29:38.638221 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3034/6041] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:37 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:38.703802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:38.718029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:38.719497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:38.725098 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a6c5a13-80c2-4258-be41-9ecb4364ebaf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.755614 Dec 25 21:29:38.733797 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3008/6042] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:37 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:39.656039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:39.656661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:39.667227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:39.668826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:39.669686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:39.670134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:39.749613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:39.757323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:39.804981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:39.805709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:39.807252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:39.808298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:40.028821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:40.041455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:40.044291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:40.049275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b30951eb-5714-4b3a-b710-5455377911c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.396350 Dec 25 21:29:40.050138 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3035/6043] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:39 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:40.168862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-eaf7cba1-7a0f-49b2-aef9-c9423d75314c req-2fd7a9ca-fd4a-4378-b442-3ea46d6ea631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "d1b259e7-c1c4-46a5-8fa8-934e76ffd08c"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:40.173738 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:40.173738 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:29:40.194181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-eaf7cba1-7a0f-49b2-aef9-c9423d75314c req-2fd7a9ca-fd4a-4378-b442-3ea46d6ea631 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:40.194933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-eaf7cba1-7a0f-49b2-aef9-c9423d75314c req-2fd7a9ca-fd4a-4378-b442-3ea46d6ea631 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:40.224004 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-eaf7cba1-7a0f-49b2-aef9-c9423d75314c req-2fd7a9ca-fd4a-4378-b442-3ea46d6ea631 service nova] Creating event network-vif-plugged:d1b259e7-c1c4-46a5-8fa8-934e76ffd08c for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:40.230126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:40.245938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:40.250196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:40.251684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-eaf7cba1-7a0f-49b2-aef9-c9423d75314c req-2fd7a9ca-fd4a-4378-b442-3ea46d6ea631 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086506 Dec 25 21:29:40.254077 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3036/6044] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:29:40.254718 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b0a136e-2dc0-4f31-ad6f-6a11102a0b58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.509367 Dec 25 21:29:40.266909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3009/6045] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:39 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:41.069402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:41.070253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:41.085767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:41.087078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:41.088005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:41.088664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:41.280030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:41.283082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:41.293952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:41.294771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:41.296211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:41.297150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:41.324712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:41.335384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:41.338966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:41.340560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f136c828-ed6b-44ed-a747-3e6d8de630b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.276700 Dec 25 21:29:41.341955 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3037/6046] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:41 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:41.802087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:41.820255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:41.827519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:41.830198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f167c14-e0aa-40ea-9d80-7b222196c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.554556 Dec 25 21:29:41.831026 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3010/6047] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:41 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:42.301193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4a85e52a-eb82-47f0-8548-c7539addc46e req-05d425e3-a608-4715-b9a3-7faa3bf3c0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "dbad079c-9ad0-47fd-8d51-bc9c6d074098"}, {"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "c4a5dc77-7743-4d72-8f35-550325e4dc63"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:42.303615 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:42.303615 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:29:42.346820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4a85e52a-eb82-47f0-8548-c7539addc46e req-05d425e3-a608-4715-b9a3-7faa3bf3c0b6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:42.348274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4a85e52a-eb82-47f0-8548-c7539addc46e req-05d425e3-a608-4715-b9a3-7faa3bf3c0b6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:42.360652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:42.361827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:42.373337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:42.374093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:42.376086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:42.378774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:42.410315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4a85e52a-eb82-47f0-8548-c7539addc46e req-05d425e3-a608-4715-b9a3-7faa3bf3c0b6 service nova] Creating event network-vif-plugged:dbad079c-9ad0-47fd-8d51-bc9c6d074098 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:42.411000 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4a85e52a-eb82-47f0-8548-c7539addc46e req-05d425e3-a608-4715-b9a3-7faa3bf3c0b6 service nova] Creating event network-vif-plugged:c4a5dc77-7743-4d72-8f35-550325e4dc63 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:42.421300 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4a85e52a-eb82-47f0-8548-c7539addc46e req-05d425e3-a608-4715-b9a3-7faa3bf3c0b6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.124318 Dec 25 21:29:42.423607 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3038/6048] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:42 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:42.694470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:42.703460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:42.710953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:42.713226 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-970b8a94-bdec-48b5-a043-75677d613855 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.356656 Dec 25 21:29:42.715767 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3011/6049] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:42 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:42.850049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:42.850761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:42.864780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:42.865544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:42.867038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:42.868199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:43.287502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:43.316732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:43.316732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:43.316732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35d223b7-48be-4d99-a0b0-d8570f50ff86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.455816 Dec 25 21:29:43.316732 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3039/6050] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:42 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:43.733972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:43.736593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:43.752774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:43.757296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:43.760301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:43.760964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:44.250282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:44.265458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:44.267104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:44.274891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75aea930-62b6-41ee-97d0-b1efd71d3fa3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.544843 Dec 25 21:29:44.285846 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3012/6051] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:43 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:44.324584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:44.326430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:44.344401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:44.346065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:44.348111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:44.348863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:44.496832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-058501e3-3a06-4c70-94a4-918b42d9c893 req-a4d120bb-60f8-4b20-9e1d-598e1b3d1f98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "1704d60b-466b-4afa-a1c8-2e009902991b"}, {"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "c1259bc6-d32f-4b81-b593-3660604ed03e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:44.498626 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:44.498626 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:44.512435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-058501e3-3a06-4c70-94a4-918b42d9c893 req-a4d120bb-60f8-4b20-9e1d-598e1b3d1f98 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:44.512966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-058501e3-3a06-4c70-94a4-918b42d9c893 req-a4d120bb-60f8-4b20-9e1d-598e1b3d1f98 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:44.587616 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-058501e3-3a06-4c70-94a4-918b42d9c893 req-a4d120bb-60f8-4b20-9e1d-598e1b3d1f98 service nova] Creating event network-vif-plugged:1704d60b-466b-4afa-a1c8-2e009902991b for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:44.588400 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-058501e3-3a06-4c70-94a4-918b42d9c893 req-a4d120bb-60f8-4b20-9e1d-598e1b3d1f98 service nova] Creating event network-vif-plugged:c1259bc6-d32f-4b81-b593-3660604ed03e for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:44.603927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-058501e3-3a06-4c70-94a4-918b42d9c893 req-a4d120bb-60f8-4b20-9e1d-598e1b3d1f98 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110931 Dec 25 21:29:44.606185 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3013/6052] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:44 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:44.865400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:44.865400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:44.865400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:44.865400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b1cf40d-7605-4215-a88a-08249ee3010f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.533215 Dec 25 21:29:44.865400 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3040/6053] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:44 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:45.297491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:45.298735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:45.315125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:45.316024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:45.316841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:45.317460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:45.671211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:45.684174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:45.687106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:45.688377 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ba308176-c4c3-4e29-ad5e-63029f176a69 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.397242 Dec 25 21:29:45.710088 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3014/6054] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:45 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:45.871985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:45.873427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:45.884650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:45.886795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:45.887794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:45.888404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:46.145389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:46.161687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:46.171827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:46.171827 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d0286c4-319b-4e2f-897d-dbb5f42216ec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.303457 Dec 25 21:29:46.174511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3041/6055] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:45 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:46.624811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-cd584f4b-fd6e-438a-b8b8-9ae9aa27304c req-de188858-7a58-41a8-a5f1-b1e69a02d56c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "893605c1-33ba-4c92-b5eb-6207f354a521"}, {"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-plugged", "status": "completed", "tag": "bbeefdb7-89c8-4442-a2e7-858c459b3b9a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:46.626622 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:46.626622 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:46.635656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cd584f4b-fd6e-438a-b8b8-9ae9aa27304c req-de188858-7a58-41a8-a5f1-b1e69a02d56c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:46.636109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cd584f4b-fd6e-438a-b8b8-9ae9aa27304c req-de188858-7a58-41a8-a5f1-b1e69a02d56c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:46.648003 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-cd584f4b-fd6e-438a-b8b8-9ae9aa27304c req-de188858-7a58-41a8-a5f1-b1e69a02d56c service nova] Creating event network-vif-plugged:893605c1-33ba-4c92-b5eb-6207f354a521 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:46.649109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-cd584f4b-fd6e-438a-b8b8-9ae9aa27304c req-de188858-7a58-41a8-a5f1-b1e69a02d56c service nova] Creating event network-vif-plugged:bbeefdb7-89c8-4442-a2e7-858c459b3b9a for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:46.654687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-cd584f4b-fd6e-438a-b8b8-9ae9aa27304c req-de188858-7a58-41a8-a5f1-b1e69a02d56c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033590 Dec 25 21:29:46.656528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3015/6056] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:46 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:46.706106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:46.706798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:46.717711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:46.718447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:46.719399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:46.719995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:47.190603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:47.191577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:47.198603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:47.199348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:47.200319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:47.201008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:47.601191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:47.618991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:47.620910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:47.622361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2458418-d5cc-43bc-a744-439b9a435b44 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1736 microversion: 2.20 time: 0.919976 Dec 25 21:29:47.623035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3042/6057] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:46 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1736 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:47.894147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:47.902098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:47.903953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:47.905634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae9a5da7-ade9-46d6-9f96-d492fef73111 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.719277 Dec 25 21:29:47.907097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3016/6058] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:47 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:48.641844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:48.642383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:48.649272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:48.650004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:48.651161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:48.651629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:48.803196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:48.812184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:48.813743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:48.815241 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f49297e-7b5f-455d-9412-635beb193716 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1718 microversion: 2.20 time: 0.177393 Dec 25 21:29:48.827303 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3043/6059] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:48 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1718 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:48.924975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:48.927308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:48.933967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:48.934412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:48.935381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:48.935970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:49.177433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:49.186825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:49.188365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:49.189591 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d9e4262-f5ef-426c-9bd2-086485888e08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1874 microversion: 2.32 time: 0.268614 Dec 25 21:29:49.190157 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3017/6060] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:48 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1874 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:49.843783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:49.844687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:49.851904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:49.852447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:49.853365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:49.853899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:50.087059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:50.095743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:50.097911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:50.099168 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e8dcc82-81be-44f4-8316-99701ab70ff7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1718 microversion: 2.20 time: 0.259850 Dec 25 21:29:50.099832 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3044/6061] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:49 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1718 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:50.209161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:50.210035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:50.219929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:50.221048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:50.223514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:50.223514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:50.525163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5ba34d35-660e-4bd4-a579-492be6cd49f7 req-581d5f68-1e7a-4c01-b7f4-3b8170c8f437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "name": "network-vif-unplugged", "status": "completed", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:50.527657 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:50.527657 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:29:50.566284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5ba34d35-660e-4bd4-a579-492be6cd49f7 req-581d5f68-1e7a-4c01-b7f4-3b8170c8f437 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:50.568613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5ba34d35-660e-4bd4-a579-492be6cd49f7 req-581d5f68-1e7a-4c01-b7f4-3b8170c8f437 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:50.602938 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5ba34d35-660e-4bd4-a579-492be6cd49f7 req-581d5f68-1e7a-4c01-b7f4-3b8170c8f437 service nova] Creating event network-vif-unplugged:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:29:50.620442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5ba34d35-660e-4bd4-a579-492be6cd49f7 req-581d5f68-1e7a-4c01-b7f4-3b8170c8f437 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102299 Dec 25 21:29:50.621451 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3045/6062] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:50.857710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:50.872230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:50.875900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:50.877362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1cd3f51b-fa58-4d52-9911-7e94cc77a540 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2827 microversion: 2.32 time: 0.672518 Dec 25 21:29:50.919245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:50.919772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:50.926954 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3018/6063] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:50 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2827 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:50.935902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:50.936618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:50.937455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:50.937888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:51.117966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:51.118810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:51.129218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:51.130063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:51.131603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:51.132201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:51.179870 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fb80809-0164-4579-ab0b-2542a9786d17 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.270767 Dec 25 21:29:51.180473 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3046/6064] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Dec 25 21:29:50 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/os-interface => generated 1831 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:51.474935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:51.501557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:51.505008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:51.507353 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca23f9f3-5899-455b-b0cb-cea6902794cf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1721 microversion: 2.20 time: 0.393583 Dec 25 21:29:51.508291 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3019/6065] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:51 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:29:51.529593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "06661aab-01cf-4a95-94d1-d80c006009d6"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:51.530948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:51.545977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:51.548973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:51.550047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:51.552403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.189154 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e1c098c-a7bc-435c-9017-395ef8f34ea5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.663523 Dec 25 21:29:53.189954 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3047/6066] 10.222.0.32 () {62 vars in 1363 bytes} [Sat Dec 25 21:29:51 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments => generated 188 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:29:53.401340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:53.402711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:53.417823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:53.418305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.424465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:53.426804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.709661 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1201edc-551e-491d-acb4-ae92ecc10fc4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action" status: 202 len: 0 microversion: 2.20 time: 0.312987 Dec 25 21:29:53.714964 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3020/6067] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:53 2021] POST /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/action => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:29:53.723055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:53.724331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:53.743495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:53.744127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.745018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:53.745472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.755727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:53.756659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:53.766869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:53.770101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.771087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:53.771528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:53.828673 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-df83f8d5-0302-491f-8bb6-45a9cedc2644 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.076380 Dec 25 21:29:53.830238 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3021/6068] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:29:54.090644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-22a677ae-baad-4f56-b52a-890419817004 req-ff654337-2b39-4be4-bf62-3358436adf11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "tag": "dbad079c-9ad0-47fd-8d51-bc9c6d074098"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:54.095772 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:29:54.095772 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:29:54.128261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:54.132285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-22a677ae-baad-4f56-b52a-890419817004 req-ff654337-2b39-4be4-bf62-3358436adf11 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:54.135635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-22a677ae-baad-4f56-b52a-890419817004 req-ff654337-2b39-4be4-bf62-3358436adf11 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:54.150386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:54.153202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:54.155122 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1891f4f5-fd3d-4a21-b970-2cfdc98b454a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1747 microversion: 2.20 time: 0.436009 Dec 25 21:29:54.156426 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3048/6069] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:53 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1747 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:54.167460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-22a677ae-baad-4f56-b52a-890419817004 req-ff654337-2b39-4be4-bf62-3358436adf11 service nova] Creating event network-changed:dbad079c-9ad0-47fd-8d51-bc9c6d074098 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:29:54.174799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-22a677ae-baad-4f56-b52a-890419817004 req-ff654337-2b39-4be4-bf62-3358436adf11 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341999 Dec 25 21:29:54.176484 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3022/6070] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:29:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:29:54.841619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:54.843005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:54.860831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:54.861649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:54.862665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:54.864747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:54.910917 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-795fab3d-32a9-4f96-9465-dbd51a4c7523 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.074477 Dec 25 21:29:54.911876 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3049/6071] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:54 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:29:55.173958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:55.178025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:55.196324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:55.199878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:55.201635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:55.206631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:55.922752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:55.924435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:55.934515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:55.935643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:55.936691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:55.938079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:56.026032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eaa6101a-8f7b-484a-b2b5-486796559665 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.107241 Dec 25 21:29:56.026683 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3050/6072] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:55 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:29:56.401027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:56.415760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:56.417359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:56.422422 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfef299a-6588-4f9b-ba5e-53b184bbf277 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1747 microversion: 2.20 time: 1.252584 Dec 25 21:29:56.425350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3023/6073] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:55 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1747 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:57.040345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:57.041377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:57.061861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:57.062355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:57.063175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:57.063614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:57.159203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7cda9d87-1652-4ef4-92d0-13a5840ffb4c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.123918 Dec 25 21:29:57.160432 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3051/6074] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:57 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:29:57.444984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:57.445713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:57.466673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:57.470877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:57.471755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:57.472204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:57.857161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:57.868981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:57.870902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:57.873198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8776b397-794c-4781-9f4b-66893c792b43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1749 microversion: 2.20 time: 0.433053 Dec 25 21:29:57.874376 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3024/6075] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:57 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1749 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:29:58.171940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:58.173538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:58.182139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:58.186197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:58.186197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:58.186197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:58.236279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-56ed404f-8341-4296-8c4c-374626207f8b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.069175 Dec 25 21:29:58.237237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3052/6076] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:58 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:29:58.894086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:29:58.894711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:58.903752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:58.904213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:58.905046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:58.905490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:59.255720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:29:59.256759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:29:59.266574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:59.266939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:59.267818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:29:59.268339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:29:59.316436 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0354f35b-b320-4b21-bfa2-1d1d3efcdb2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.071237 Dec 25 21:29:59.320547 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3053/6077] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:29:59 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:29:59.443199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:59.470726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:59.481277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:29:59.481277 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4650073a-5d3b-4015-94c1-716d7e2a9a9b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.583745 Dec 25 21:29:59.481277 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3025/6078] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:29:58 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:00.331632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:00.332150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:00.343679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:00.344313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:00.345751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:00.351026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:00.395547 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53d3a940-2b3e-4a34-8dbc-f3ada6d70e50 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.070254 Dec 25 21:30:00.400113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3054/6079] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:00 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:30:00.497733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:00.499164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:00.525519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:00.528222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:00.529151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:00.529612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.287515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:01.289330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:01.325696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:01.329427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.333795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:01.335223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.431698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01505a0b-6494-48a8-97b5-95bd1cb465bf tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action" status: 200 len: 40162 microversion: 2.42 time: 0.538394 Dec 25 21:30:01.436923 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3055/6080] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:00 2021] POST /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c/action => generated 40162 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:01.448019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:01.449107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:01.462456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:01.467510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.467510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:01.467510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.521113 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-764f11f2-e497-4427-ae10-3750cbcbe1e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.080890 Dec 25 21:30:01.523505 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3056/6081] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:01 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:30:01.531212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:01.532142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:01.547501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:01.547501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.547501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:01.547967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:01.589569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:30:01.618355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:01.632783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:01.638810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:01.640343 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d3d55a3-2e28-4c58-8b7d-c22457a4c2a8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 1.152698 Dec 25 21:30:01.644021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3026/6082] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:00 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:02.230684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0bb10ca-803e-4bba-9f6f-4466098a855e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 204 len: 0 microversion: 2.42 time: 0.705249 Dec 25 21:30:02.235103 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3057/6083] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:30:01 2021] DELETE /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 0 bytes in 707 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:30:02.242142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:02.243037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:02.262865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:02.265192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:02.269564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:02.270251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:02.535338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:02.540833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:02.550606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:02.551303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:02.552500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:02.553605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:02.637046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48787482-6aff-4c9a-878e-ab25d3d6c098 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.106511 Dec 25 21:30:02.642734 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3058/6084] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:02 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:30:02.660017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:02.660733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:02.671220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:02.675407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:02.680052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:02.680741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:03.527207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:03.548454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:03.553441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:03.554839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:03.556808 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bcfc17ee-edbf-47f0-b6d9-db57acd76903 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2958 microversion: 2.42 time: 1.320436 Dec 25 21:30:03.563653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:03.571595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:03.576738 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-614b6fda-bf08-41c8-b356-e20a2774972b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.917243 Dec 25 21:30:03.576738 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3059/6085] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:02 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:03.576943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3027/6086] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:02 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2958 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:03.654449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:03.655510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:03.662754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:03.664106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:03.665058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:03.665727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:03.722197 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41476e86-ff50-4bd1-84b8-11fc6cef272f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 14 microversion: 2.32 time: 0.072590 Dec 25 21:30:03.727076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3060/6087] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:03 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:30:04.583416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:04.584043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:04.596174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:04.597500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:04.618962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:04.619666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:04.620715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:04.623856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:04.624708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:04.631701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:04.634476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:04.636112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:05.870630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:05.875723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:05.891146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:05.894860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:05.897283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:05.899404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:05.906212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e525a049-1787-428a-bf15-54bceeea27ed tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 1.312791 Dec 25 21:30:05.906482 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23fd0f99-af10-4e9b-97a3-66f3c24d1dcb tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2958 microversion: 2.42 time: 1.325898 Dec 25 21:30:05.909557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3061/6088] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:04 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:05.923737 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3028/6089] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:04 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2958 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:05.927929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:05.929981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:05.942655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:05.943337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:05.944355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:05.945304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:06.005392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5815f142-f754-4eb0-a4b5-2b15db858793 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 16400 microversion: 2.32 time: 0.094266 Dec 25 21:30:06.008283 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3062/6090] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:05 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 16400 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:06.942726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:06.954857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:06.956037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:06.967920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:06.984147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:06.984610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:06.987024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:06.987494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:06.988294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:06.989026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:06.989875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:06.990734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:08.701282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:08.715812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:08.718278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:08.719958 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56476d14-f758-4725-982b-2f54953b80d0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 1.791976 Dec 25 21:30:08.733080 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3029/6091] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:06 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:08.739571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:08.740848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:08.764700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:08.766794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:08.775442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:08.775442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:08.868796 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec3847d8-9349-4e92-ad96-19258d198fc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 16400 microversion: 2.32 time: 0.133934 Dec 25 21:30:08.873454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3030/6092] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:08 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 16400 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:08.880139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-eea0ba48-8d51-4b6f-b878-fca202189ad4 req-71894ad0-fc8f-4725-907a-5746191a468e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-unplugged", "status": "completed", "tag": "0daa1ac7-be03-4d72-b2a5-72b1ee145ecb"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:08.883834 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:08.883834 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:30:08.891530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-eea0ba48-8d51-4b6f-b878-fca202189ad4 req-71894ad0-fc8f-4725-907a-5746191a468e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:08.891966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-eea0ba48-8d51-4b6f-b878-fca202189ad4 req-71894ad0-fc8f-4725-907a-5746191a468e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:08.908463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-eea0ba48-8d51-4b6f-b878-fca202189ad4 req-71894ad0-fc8f-4725-907a-5746191a468e service nova] Creating event network-vif-unplugged:0daa1ac7-be03-4d72-b2a5-72b1ee145ecb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:08.915253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-eea0ba48-8d51-4b6f-b878-fca202189ad4 req-71894ad0-fc8f-4725-907a-5746191a468e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043137 Dec 25 21:30:08.916390 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3031/6093] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:08 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:30:09.249324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:09.265776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:09.268984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:09.271723 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-890963cc-1d13-413b-b309-a2c5a99ca105 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2958 microversion: 2.42 time: 2.340761 Dec 25 21:30:09.273739 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3063/6094] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:06 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2958 bytes in 2343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:09.743782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:09.745031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:09.755104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:09.755831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:09.757929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:09.758671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:09.881400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:09.883752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:09.900856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:09.901585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:09.902565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:09.903215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:09.979586 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b781b60-371d-4fa4-8663-d6a5b955c2d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 16400 microversion: 2.32 time: 0.102143 Dec 25 21:30:09.984399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3064/6095] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:09 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 16400 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:10.301041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:10.303045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:10.318686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:10.322189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:10.322189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:10.322189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:10.504445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:10.551390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:10.553087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:10.554885 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94485c55-872e-4b2a-9e4b-9a77ad72497f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.818622 Dec 25 21:30:10.571768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3032/6096] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:09 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:10.964466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-unplugged", "status": "completed", "tag": "fd6aa216-385a-41e5-8c5e-3aae2253a5ab"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-unplugged", "status": "completed", "tag": "9c0613e4-0268-4ae9-8585-76b021617ef8"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-unplugged", "status": "completed", "tag": "634d748d-c261-4855-913b-beb5992df4cb"}, {"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-unplugged", "status": "completed", "tag": "8de83a8d-9b83-433c-af96-f34c522b12b1"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:10.968130 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:10.968130 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:30:10.987059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:10.991428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:11.020411 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Creating event network-vif-unplugged:2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:11.021308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Creating event network-vif-unplugged:fd6aa216-385a-41e5-8c5e-3aae2253a5ab for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:11.022017 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Creating event network-vif-unplugged:9c0613e4-0268-4ae9-8585-76b021617ef8 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:11.024267 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Creating event network-vif-unplugged:634d748d-c261-4855-913b-beb5992df4cb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:11.033735 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] Creating event network-vif-unplugged:8de83a8d-9b83-433c-af96-f34c522b12b1 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:11.042793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c679861f-1af1-4ad5-aaf2-611f45d1d5e3 req-31661e35-1401-4eb9-983c-3146f715f9ab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.083926 Dec 25 21:30:11.043409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3033/6097] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:10 2021] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:30:11.048800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:11.055121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:11.074866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:11.075341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:11.076168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:11.076630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:11.188168 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-961411f1-c357-4b78-b130-f16f272e9735 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.143006 Dec 25 21:30:11.193817 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3034/6098] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:11 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:11.595625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:11.596960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:11.617261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:11.618067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:11.619085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:11.625503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:11.844635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:11.864817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:11.867236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:11.875902 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a26a62e7-3b62-45a0-8dc3-00adccd90a55 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2937 microversion: 2.42 time: 1.581637 Dec 25 21:30:11.876527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3065/6099] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:10 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2937 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:12.202270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:12.203122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:12.210869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:12.212256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:12.214182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:12.215085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:12.292146 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e865944c-150d-4538-9178-8f52905777d6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.093868 Dec 25 21:30:12.297710 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3066/6100] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:12 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:12.897352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:12.907297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:12.918121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:12.920633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:12.923129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:12.926290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:13.299486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:13.323361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:13.325751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:13.328370 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65815edb-b393-486b-9b3c-b7491706a674 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 1.737209 Dec 25 21:30:13.331935 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3035/6101] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:11 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:13.343658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:13.344682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:13.356291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:13.357173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:13.358603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:13.359258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:13.452371 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f5553ee-f16e-4e71-b934-7c4a6d372d16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.119066 Dec 25 21:30:13.453512 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3036/6102] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:13 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:14.033263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:14.033263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:14.033263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:14.033263 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9315280c-0063-4c21-9c7c-591c22de22ae tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2916 microversion: 2.42 time: 1.038128 Dec 25 21:30:14.033263 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3067/6103] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:12 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2916 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:14.351080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:14.351893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:14.379162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:14.380020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:14.381206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:14.381782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:14.464736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:14.467525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:14.494808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:14.495530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:14.496363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:14.496812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:14.571592 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13f69d30-beaf-42ae-aaef-8980df43c424 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.110364 Dec 25 21:30:14.575531 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3068/6104] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:14 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:14.856565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:14.868694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:14.870808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:14.872516 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e9e6c77-7059-4885-98ec-9f18d2980243 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.527180 Dec 25 21:30:14.873721 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3037/6105] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:14 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:15.051649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:15.072028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:15.074112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.080653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:15.081895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.082608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:15.601601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:15.602677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:15.619916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.620392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:15.621367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.621981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:15.680253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:15.696069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:15.704704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:15.708253 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63d33815-4219-4d20-9dfc-d18e608e6b22 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2916 microversion: 2.42 time: 0.662072 Dec 25 21:30:15.724869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3069/6106] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:15 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2916 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:15.726242 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a2815b4-a651-4006-bbf7-950283f07d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.144376 Dec 25 21:30:15.727343 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3038/6107] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:15 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:15.853527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-74549d61-18e2-4b34-af90-da7829730978 req-bd306181-c5e8-4f32-85e8-b697b9a53779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-deleted", "tag": "9c0613e4-0268-4ae9-8585-76b021617ef8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:15.856149 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:15.856149 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:30:15.870668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-74549d61-18e2-4b34-af90-da7829730978 req-bd306181-c5e8-4f32-85e8-b697b9a53779 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.873541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-74549d61-18e2-4b34-af90-da7829730978 req-bd306181-c5e8-4f32-85e8-b697b9a53779 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:15.896106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:15.898211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:15.911471 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-74549d61-18e2-4b34-af90-da7829730978 req-bd306181-c5e8-4f32-85e8-b697b9a53779 service nova] Creating event network-vif-deleted:9c0613e4-0268-4ae9-8585-76b021617ef8 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:15.932542 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-74549d61-18e2-4b34-af90-da7829730978 req-bd306181-c5e8-4f32-85e8-b697b9a53779 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083246 Dec 25 21:30:15.933395 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3070/6108] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:30:15.937319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.938156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:15.950161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:15.950842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:16.732380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:16.734396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:16.736832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:16.744280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:16.744946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:16.745926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:16.746521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:16.757793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:16.763114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:16.768417 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1336c1c-c448-4cac-a3a5-e2deadbc11a7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.876401 Dec 25 21:30:16.769905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3039/6109] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:15 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:16.777042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:16.778531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:16.788696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:16.789552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:16.790656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:16.791259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:16.847911 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d857230-07d7-4d6b-9e63-57626629ad2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.076424 Dec 25 21:30:16.852637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3040/6110] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:16 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:17.658739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:17.673720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:17.676318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:17.677928 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4eb0194-3226-46b1-bdcc-899c63401bd8 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2756 microversion: 2.42 time: 0.949790 Dec 25 21:30:17.694758 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3071/6111] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:16 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2756 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:17.792864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:17.794496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:17.809744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:17.810239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:17.811108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:17.811547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:17.860382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:17.862040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:17.871755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:17.872215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:17.877358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:17.878327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:18.008648 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0efec6b-27bd-40b8-ac07-5f7573f5303f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.148073 Dec 25 21:30:18.012921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3072/6112] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:17 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:18.657619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:18.680745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:18.684344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:18.686308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-045dd221-4f74-4424-8ebf-194fa85cba3b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.902108 Dec 25 21:30:18.687140 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3041/6113] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:17 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:18.703502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:18.704217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:18.719982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:18.725691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:18.730543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:18.730543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:18.734000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-abfe8746-1326-4fa3-95ec-562faa7a1b3f req-22480ab1-71da-4b0f-8f35-c67be7edce27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-deleted", "tag": "8de83a8d-9b83-433c-af96-f34c522b12b1"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:18.735663 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:18.735663 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:30:18.743095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-abfe8746-1326-4fa3-95ec-562faa7a1b3f req-22480ab1-71da-4b0f-8f35-c67be7edce27 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:18.743681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-abfe8746-1326-4fa3-95ec-562faa7a1b3f req-22480ab1-71da-4b0f-8f35-c67be7edce27 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:18.757038 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-abfe8746-1326-4fa3-95ec-562faa7a1b3f req-22480ab1-71da-4b0f-8f35-c67be7edce27 service nova] Creating event network-vif-deleted:8de83a8d-9b83-433c-af96-f34c522b12b1 for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:18.763363 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-abfe8746-1326-4fa3-95ec-562faa7a1b3f req-22480ab1-71da-4b0f-8f35-c67be7edce27 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033089 Dec 25 21:30:18.764061 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3042/6114] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:30:19.023346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:19.024611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:19.031429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:19.032251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:19.033118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:19.033640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:19.077943 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b444b58-ba39-486a-8f17-733f177a003c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.060662 Dec 25 21:30:19.078890 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3043/6115] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:19 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:19.244401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:19.254031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:19.255586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:19.256855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef194d30-07e0-4b38-95ba-4e678d08c27f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2710 microversion: 2.42 time: 0.559083 Dec 25 21:30:19.257436 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3073/6116] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:18 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2710 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:19.534156 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:30:19.534408 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:30:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:30:19.708035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:19.708891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:19.716588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:19.717170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:19.718068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:19.718607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:20.090812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:20.092058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:20.100005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:20.108252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:20.108252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:20.108252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:20.143710 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81c33248-53c6-4810-869e-cb581caab9b9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.056428 Dec 25 21:30:20.144745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3074/6117] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:20 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:20.247300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:20.256815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:20.264577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:20.265912 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb94522a-0f6e-4065-98b5-b99319d12bc8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.562236 Dec 25 21:30:20.266716 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3044/6118] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:19 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:20.278150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:20.279719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:20.292287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:20.293992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:20.295127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:20.295750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:20.816586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-282e3f46-0fe8-4c75-8990-aae43985cc7f req-2c85f70f-941a-4ce1-b858-cd0ddebb30f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-deleted", "tag": "0daa1ac7-be03-4d72-b2a5-72b1ee145ecb"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:20.818159 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:20.818159 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:30:20.838950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-282e3f46-0fe8-4c75-8990-aae43985cc7f req-2c85f70f-941a-4ce1-b858-cd0ddebb30f7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:20.838950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-282e3f46-0fe8-4c75-8990-aae43985cc7f req-2c85f70f-941a-4ce1-b858-cd0ddebb30f7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:20.861677 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-282e3f46-0fe8-4c75-8990-aae43985cc7f req-2c85f70f-941a-4ce1-b858-cd0ddebb30f7 service nova] Creating event network-vif-deleted:0daa1ac7-be03-4d72-b2a5-72b1ee145ecb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:20.863491 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-282e3f46-0fe8-4c75-8990-aae43985cc7f req-2c85f70f-941a-4ce1-b858-cd0ddebb30f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050796 Dec 25 21:30:20.864400 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3045/6119] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:30:20.886349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:20.902023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:20.904009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:20.905920 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a656e91-deeb-43df-b78c-0eade2449436 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2551 microversion: 2.42 time: 0.633755 Dec 25 21:30:20.918374 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3075/6120] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:20 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2551 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:21.156762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:21.157793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:21.164455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:21.169352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:21.169352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:21.169352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:21.209919 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6e2d6bf-a666-44f7-97d2-24ad1e7e0e89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057032 Dec 25 21:30:21.213949 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3046/6121] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:21 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:21.285546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:21.286299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:21.294386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:21.295709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:21.296546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:21.297027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:21.604654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:21.614121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:21.615273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:21.617176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9150f3cf-9012-46ff-a564-87e3d3bc9f7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.335559 Dec 25 21:30:21.617745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3076/6122] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:21 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:21.927699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:21.930417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:21.938592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:21.939117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:21.940021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:21.940361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.222425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:22.227594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:22.238371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:22.238833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.242593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:22.242593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.347752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2edebb47-41ae-453d-a274-57ca6568b122 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.127266 Dec 25 21:30:22.350757 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3077/6123] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:22 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:22.600720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5152de6b-5d06-48b7-bad9-62b6edf7dbfe req-10afc830-57dc-4f96-a293-d8f1700aa05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "name": "network-vif-plugged", "status": "completed", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:22.604506 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:22.604506 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:30:22.619081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5152de6b-5d06-48b7-bad9-62b6edf7dbfe req-10afc830-57dc-4f96-a293-d8f1700aa05b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:22.619744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5152de6b-5d06-48b7-bad9-62b6edf7dbfe req-10afc830-57dc-4f96-a293-d8f1700aa05b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.635279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5152de6b-5d06-48b7-bad9-62b6edf7dbfe req-10afc830-57dc-4f96-a293-d8f1700aa05b service nova] Creating event network-vif-plugged:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:30:22.640680 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5152de6b-5d06-48b7-bad9-62b6edf7dbfe req-10afc830-57dc-4f96-a293-d8f1700aa05b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049207 Dec 25 21:30:22.641417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3078/6124] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:30:22.646684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:22.647525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:22.654321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:22.654852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:22.655302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.661033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:22.661033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.689549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:22.691323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:22.694427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67e18e06-168a-4d23-932d-ceebc13428b4 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2348 microversion: 2.42 time: 0.770309 Dec 25 21:30:22.695754 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3047/6125] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:21 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2348 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:22.894229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-773eff9d-9c5a-4a14-ae70-d6ec8e9445d4 req-1bd3c900-03cf-4a78-a3eb-82a03dbe063a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-deleted", "tag": "2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:22.896218 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:22.896218 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:30:22.906632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-773eff9d-9c5a-4a14-ae70-d6ec8e9445d4 req-1bd3c900-03cf-4a78-a3eb-82a03dbe063a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:22.907532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-773eff9d-9c5a-4a14-ae70-d6ec8e9445d4 req-1bd3c900-03cf-4a78-a3eb-82a03dbe063a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:22.936347 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-773eff9d-9c5a-4a14-ae70-d6ec8e9445d4 req-1bd3c900-03cf-4a78-a3eb-82a03dbe063a service nova] Creating event network-vif-deleted:2eb143cf-a0c7-4e74-a5f2-177a4bc1db2c for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:22.974181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-773eff9d-9c5a-4a14-ae70-d6ec8e9445d4 req-1bd3c900-03cf-4a78-a3eb-82a03dbe063a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085122 Dec 25 21:30:22.976494 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3048/6126] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:30:23.367378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:23.368935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:23.376558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:23.377425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:23.378428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:23.379521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:23.381119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:23.392587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:23.394873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:23.398240 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-40d65943-c97e-42e2-8284-f66f0432e7ea tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.754289 Dec 25 21:30:23.399009 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3079/6127] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:22 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:23.436546 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65692308-a479-4723-aeb7-7bde4db5b155 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.074142 Dec 25 21:30:23.437992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3049/6128] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:23 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:23.714081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:23.714699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:23.722072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:23.722535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:23.723654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:23.724091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:24.417491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:24.419005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:24.435376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:24.435376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:24.435376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:24.435376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:24.484781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:24.501210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:24.504962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:24.507771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83752347-4add-49a7-9bf7-cee492efbe2d tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 2234 microversion: 2.42 time: 0.797431 Dec 25 21:30:24.511528 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3080/6129] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:23 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 2234 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:24.516267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:24.524481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:24.565715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:24.566806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:24.569034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:24.572423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:24.668520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a4a28401-a5a5-4666-a330-6f3f17243e3a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.155622 Dec 25 21:30:24.670237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3081/6130] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:24 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:24.801487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:24.816339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:24.821820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:24.826787 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-378ecec4-8b25-4ae9-aca4-7a264d814671 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.411518 Dec 25 21:30:24.826787 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3050/6131] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:24 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:30:25.085490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-6ea94240-a31d-496d-96ea-05b4658c8547 req-9a2dd791-9782-4070-a8e4-80e2eac41a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa2d5924-6a22-461e-b48b-e73f52f4b72c", "name": "network-vif-deleted", "tag": "634d748d-c261-4855-913b-beb5992df4cb"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:25.087082 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:30:25.087082 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:30:25.109446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6ea94240-a31d-496d-96ea-05b4658c8547 req-9a2dd791-9782-4070-a8e4-80e2eac41a96 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.109917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-6ea94240-a31d-496d-96ea-05b4658c8547 req-9a2dd791-9782-4070-a8e4-80e2eac41a96 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:25.140816 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-6ea94240-a31d-496d-96ea-05b4658c8547 req-9a2dd791-9782-4070-a8e4-80e2eac41a96 service nova] Creating event network-vif-deleted:634d748d-c261-4855-913b-beb5992df4cb for instance aa2d5924-6a22-461e-b48b-e73f52f4b72c on nch2-master-1 Dec 25 21:30:25.159324 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-6ea94240-a31d-496d-96ea-05b4658c8547 req-9a2dd791-9782-4070-a8e4-80e2eac41a96 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077589 Dec 25 21:30:25.163749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3082/6132] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:30:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:30:25.527999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:25.529813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:25.540526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.542815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:25.543690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.544142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:25.664282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:25.674315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:25.675928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:25.677851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6800091a-d9d8-4e69-951f-9f447a492a06 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1874 microversion: 2.42 time: 0.153701 Dec 25 21:30:25.679166 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3051/6133] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:25 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1874 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:25.685387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:25.691178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:25.702379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.703093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:25.704159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.704707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:25.757031 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec17fb9f-30c0-4420-9bdc-ed0202843174 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.078065 Dec 25 21:30:25.758151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3083/6134] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:25 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:25.843507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:25.844116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:25.850566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.851040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:25.851907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:25.852421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:26.285646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:26.297064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:26.300510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:26.304307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-602c0dc7-012e-407d-a42e-8393756f6b10 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.464552 Dec 25 21:30:26.322215 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3052/6135] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:25 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:26.699675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:26.702853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:26.716912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:26.716912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:26.716912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:26.716912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:26.767929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:26.769365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:26.783240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:26.783691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:26.784492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:26.786826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:26.873815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d019897c-3f93-4472-b097-9dd3ae082204 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.108921 Dec 25 21:30:26.875680 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3053/6136] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:26 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:26.893293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:26.906268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:26.913605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a85842dabc3d4a219d28c154e36c293c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4571ece0fa3450b83fde221178518c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:26.913605 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-637d64ca-25f7-4313-b590-b3f5aa915e10 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 200 len: 1874 microversion: 2.42 time: 0.216055 Dec 25 21:30:26.913605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3084/6137] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:26 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 1874 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:27.331977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:27.332692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:27.347386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:27.347838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:27.349651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:27.351302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:27.668042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:27.679826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:27.681691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:27.694495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3233026-e6e8-4ad1-baf7-7358ab67aef0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1805 microversion: 2.20 time: 0.359584 Dec 25 21:30:27.694495 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3054/6138] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:27 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1805 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:27.887035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:27.890364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:27.930452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:27.931776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:27.940537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:27.942816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:27.943569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:27.945921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:27.947106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:27.949357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:27.952641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:27.953533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:28.000831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] HTTP exception thrown: Instance aa2d5924-6a22-461e-b48b-e73f52f4b72c could not be found. Dec 25 21:30:28.001815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Returning 404 to user: Instance aa2d5924-6a22-461e-b48b-e73f52f4b72c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:30:28.002965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4503fc9-7b41-46a8-8cb9-71149baed62f tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 404 len: 111 microversion: 2.42 time: 0.076666 Dec 25 21:30:28.011677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3055/6139] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:27 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:30:28.017826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86538c6d-1e1c-4919-b348-5e88d0c18f4e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '.version_select at 0x7fa4f72acc10>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:28.028538 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b34aa806-9e81-42c3-ace2-8893841dc6f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.146026 Dec 25 21:30:28.029493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3085/6140] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:27 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:28.143770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86538c6d-1e1c-4919-b348-5e88d0c18f4e tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989741099" status: 204 len: 0 microversion: 2.42 time: 0.130212 Dec 25 21:30:28.151762 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3056/6141] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:30:28 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1989741099 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:30:28.707084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:28.708056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:28.719454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:28.719454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:28.719454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:28.719454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:29.041470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:29.042381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:29.050009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:29.050542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:29.051415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:29.053257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:29.094048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:29.116683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:29.120958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:30:29.122206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a9ed270-eff1-40cf-83a1-a9a84033b3d6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1792 microversion: 2.20 time: 0.420139 Dec 25 21:30:29.122781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3086/6142] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:28 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1792 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:30:29.149682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7b4d58c-28c3-478a-9599-0b70f8f339a3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.113331 Dec 25 21:30:29.150593 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3057/6143] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:29 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:30:30.164991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:30.165877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:30.185790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:30.191069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:30.191069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:30.191069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:30.288467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8693d097-9f58-47c8-a9fc-b42a4f4831de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.121837 Dec 25 21:30:30.293847 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3087/6144] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:30 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:31.300273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:31.301237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:31.308946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:31.309643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:31.310665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:31.311277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:31.369590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-404ae977-ec4b-4369-b85f-5a94fbf60d93 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.073223 Dec 25 21:30:31.370268 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3058/6145] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:31 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:32.383084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:32.384119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:32.401294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:32.401896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:32.404572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:32.404572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:32.493814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a2300fec-f9e1-49e7-8c3a-58699f45c892 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.115591 Dec 25 21:30:32.494374 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3088/6146] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:32 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:33.511839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:33.515360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:33.525644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:33.526255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:33.527191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:33.527873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:33.586745 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ee60fb8-3dae-47c8-a679-6e7eff1735d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.078846 Dec 25 21:30:33.587590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3059/6147] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:33 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:34.317888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:34.319260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:34.338624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:34.341056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:34.342080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:34.346389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:34.368652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] HTTP exception thrown: Instance aa2d5924-6a22-461e-b48b-e73f52f4b72c could not be found. Dec 25 21:30:34.369875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Returning 404 to user: Instance aa2d5924-6a22-461e-b48b-e73f52f4b72c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:30:34.371270 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0aab6526-73b1-4ee6-b3fe-cf96e0ca3c86 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 404 len: 111 microversion: 2.42 time: 0.060668 Dec 25 21:30:34.372562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3089/6148] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:30:34 2021] DELETE /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:30:34.381508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:34.382466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] [instance: aa2d5924-6a22-461e-b48b-e73f52f4b72c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:34.391699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:34.392236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:34.396263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:34.402922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:34.429836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] HTTP exception thrown: Instance aa2d5924-6a22-461e-b48b-e73f52f4b72c could not be found. Dec 25 21:30:34.430549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] Returning 404 to user: Instance aa2d5924-6a22-461e-b48b-e73f52f4b72c could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:30:34.431442 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-872a536c-46f6-4ddc-b4bb-b233ef6a8040 tempest-TaggedBootDevicesTest_v242-1707178338 tempest-TaggedBootDevicesTest_v242-1707178338-project] 10.222.0.32 "GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c" status: 404 len: 111 microversion: 2.42 time: 0.054932 Dec 25 21:30:34.432581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3060/6149] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:30:34 2021] GET /compute/v2.1/servers/aa2d5924-6a22-461e-b48b-e73f52f4b72c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:30:34.598978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:34.600001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:34.607241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:34.607696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:34.608482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:34.608945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:34.671710 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bcac4a49-27fe-49ec-a24a-e8c35dd572b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.076494 Dec 25 21:30:34.675802 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3090/6150] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:34 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:35.683956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:35.684907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:35.696993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:35.697458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:35.698276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:35.698722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:35.764479 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c2edf982-f3c0-4406-872b-9ddcd55ecd43 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.084225 Dec 25 21:30:35.765615 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3061/6151] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:35 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:36.779055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:36.780770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:36.790655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:36.791622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:36.792707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:36.793182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:36.844461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-324cc9b8-0ba2-472c-a3dd-aac6b22d6dfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.070158 Dec 25 21:30:36.846245 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3091/6152] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:36 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:37.865259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:37.867406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:37.888786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:37.889443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:37.893727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:37.894413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:37.973197 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0215de7-b569-4d62-ab46-7a742003c932 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.118886 Dec 25 21:30:37.975342 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3062/6153] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:37 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:38.991512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:38.993519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:39.003236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:39.004057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:39.005619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:39.006244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:39.079524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a20cefe2-8aa5-4bde-8b53-cd5073305230 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.094110 Dec 25 21:30:39.080549 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3092/6154] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:38 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:40.114754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:40.117453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:40.129999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:40.131022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:40.132035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:40.132644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:40.204484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49a86bc0-dfee-40af-b0b9-1b8a9a84d5bc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.108841 Dec 25 21:30:40.205205 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3063/6155] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:40 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:41.217930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:41.219079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:41.227527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:41.227998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:41.228990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:41.229441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:41.272279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24f2e578-26b5-4693-9a43-9da508779aa0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058472 Dec 25 21:30:41.276118 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3093/6156] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:41 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:42.284629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:42.287756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:42.316691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:42.317282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:42.318562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:42.319195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:42.371508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb613e42-e9bd-4d11-af3f-78bbed47b987 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.091333 Dec 25 21:30:42.376207 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3064/6157] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:42 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:43.387635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:43.389282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:43.397779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:43.398261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:43.399065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:43.399511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:43.449235 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6805669d-1365-4c4e-9ba8-ac2283658092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.065826 Dec 25 21:30:43.453077 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3094/6158] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:43 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:44.462274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:44.463302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:44.476798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:44.477279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:44.478094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:44.478547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:44.591160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0828bb17-5eb6-4ba6-9c57-0d552c6c13d7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.133795 Dec 25 21:30:44.609382 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3065/6159] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:44 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:45.628151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:45.632406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:45.660855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:45.661917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:45.662746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:45.663856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:45.762869 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-473d720e-4b13-44fb-83d6-8647ac07b237 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.152857 Dec 25 21:30:45.763726 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3095/6160] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:45 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:46.776912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:46.778023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:46.787038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:46.787495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:46.788530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:46.789007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:46.833835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98a45a75-458a-426b-90e0-0155cceeb029 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.060783 Dec 25 21:30:46.837844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3066/6161] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:46 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:47.853632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:47.855390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:47.877093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:47.878278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:47.879718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:47.880482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:48.001526 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d2cbf4d2-5cf6-4ebf-ac27-06b7b302bc54 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.154060 Dec 25 21:30:48.002305 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3096/6162] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:47 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:49.020865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:49.022338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:49.029481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:49.032332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:49.036455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:49.037527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:49.122685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a99e9782-edc2-4170-846e-2460ebd93118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.112544 Dec 25 21:30:49.126774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3067/6163] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:49 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:50.136021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:50.137534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:50.157448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:50.160182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:50.165664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:50.166505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:50.289052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b09f762d-90a0-4aaa-ba83-45e724041f73 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.157336 Dec 25 21:30:50.293284 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3097/6164] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:50 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:51.302737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:51.304698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:51.312862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:51.314993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:51.318161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:51.318784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:51.388073 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a5c14bd-483e-4f12-a253-4e7ed090a48c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.090947 Dec 25 21:30:51.390149 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3068/6165] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:51 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:52.401938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:52.403618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:52.427509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:52.428341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:52.431460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:52.432204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:52.535505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1151eac-c20a-4323-aac7-a7b62cf177c9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.138525 Dec 25 21:30:52.537577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3098/6166] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:52 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:53.548831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:53.550237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:53.571119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:53.571556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:53.572375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:53.572820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:53.657750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f08df580-f62a-4b6f-9bb3-8b94066f85da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.112987 Dec 25 21:30:53.665285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3069/6167] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:54.677954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:54.681690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:54.724825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:54.735042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:54.736051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:54.736498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:54.856717 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a6b0e58a-ab79-4b44-9bcf-588b76c2b594 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.189535 Dec 25 21:30:54.857435 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3099/6168] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:54 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:55.868586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:55.869375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:55.877112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:55.877491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:55.878938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:55.882594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:55.926968 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c8ce1aa-ebd7-4e8c-a0be-9681b8ab4f13 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.062783 Dec 25 21:30:55.927671 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3070/6169] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:55 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:56.940250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:56.941488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:56.959852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:56.960546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:56.962775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:56.964511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:57.057336 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-35031515-491f-409a-ad51-ccf2efe0a73d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.121464 Dec 25 21:30:57.062025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3100/6170] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:56 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:58.076029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:58.078004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:58.092987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:58.094458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:58.108345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:58.111819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:58.181882 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8787c6c-1a01-48b7-acce-cba454051e44 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.115906 Dec 25 21:30:58.183246 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3071/6171] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:58 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:58.617216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:58.618558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:58.641893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:58.646191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:58.647708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:58.648116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:58.728652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42099dd3-49f8-4c9b-ae1c-5538be59974e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments/06661aab-01cf-4a95-94d1-d80c006009d6" status: 200 len: 194 microversion: 2.20 time: 0.116566 Dec 25 21:30:58.731943 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3101/6172] 10.222.0.32 () {60 vars in 1453 bytes} [Sat Dec 25 21:30:58 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments/06661aab-01cf-4a95-94d1-d80c006009d6 => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:30:58.845222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:58.852223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:58.862801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:58.870932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:58.872138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:58.872765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:58.994926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lazy-loading 'services' on Instance uuid 65490ad4-5baf-4c89-9877-006d581b4758 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:30:59.197242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:30:59.198783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:59.210493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:59.210493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:59.211396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:59.211844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:59.288893 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45e72d47-8672-4462-b9b6-1ab88d9d42d4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.096875 Dec 25 21:30:59.290178 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3102/6173] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:30:59 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:30:59.334291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-053b1072-2585-472b-93b0-686f64b0d98d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments/06661aab-01cf-4a95-94d1-d80c006009d6" status: 202 len: 0 microversion: 2.20 time: 0.494772 Dec 25 21:30:59.337242 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3072/6174] 10.222.0.32 () {60 vars in 1456 bytes} [Sat Dec 25 21:30:58 2021] DELETE /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments/06661aab-01cf-4a95-94d1-d80c006009d6 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:30:59.348619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:30:59.350350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:30:59.363060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:59.364097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:59.364963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:30:59.365552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:30:59.417368 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aaff07a7-9036-4e33-9972-8b264664de9c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075805 Dec 25 21:30:59.423902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3103/6175] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:30:59 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:31:00.301288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:00.303231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:00.310860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:00.311434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:00.312450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:00.314144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:00.420822 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5184c59d-f71d-4856-84bd-03f64ccbcf4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.117262 Dec 25 21:31:00.420822 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3073/6176] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:00 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:00.429726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:00.430659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:00.438568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:00.439479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:00.440654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:00.441364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:00.495223 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af7ba049-8bdf-4aec-b7b8-d7bd8ddfe5c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070065 Dec 25 21:31:00.501444 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3104/6177] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:31:00 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:00.603781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:00.604571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:00.618067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:00.619129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:00.619533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:00.619947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:00.675707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:31:01.075760 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-691b6efc-56e6-4d33-971d-c407615f1717 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 204 len: 0 microversion: 2.20 time: 0.475728 Dec 25 21:31:01.077015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3074/6178] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:31:00 2021] DELETE /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:31:01.090143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:01.090970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:01.101129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:01.101750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:01.102869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:01.103441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:01.358350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:01.367943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:01.370440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:01.371895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50989720-8262-4579-981c-3e5aae4da554 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.286736 Dec 25 21:31:01.372787 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3105/6179] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:01 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:01.430244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:01.431832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:01.444556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:01.445350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:01.446365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:01.446822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:01.504667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1c97e738-71bb-48c6-8632-cfeeaf13bccc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.079067 Dec 25 21:31:01.506135 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3075/6180] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:01 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:02.391074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:02.391701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:02.405645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:02.406062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:02.407361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:02.408219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:02.524248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:02.527222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:02.540586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:02.541789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:02.542774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:02.546334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:02.632179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-970b870b-6c1a-4734-85ed-1b432e695d85 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.111857 Dec 25 21:31:02.632179 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3076/6181] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:02 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:31:02.871278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:02.891293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:02.893610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:02.897851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-949e9046-a392-40a8-9f33-b0f5ade27c65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1720 microversion: 2.20 time: 0.509870 Dec 25 21:31:02.899154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3106/6182] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:02 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1720 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:03.638886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:03.639980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:03.662595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:03.663114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:03.666668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:03.667134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:03.774549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6978fd54-bd38-40aa-85b6-af2385260235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.139715 Dec 25 21:31:03.775346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3077/6183] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:03 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:03.918757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:03.919443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:03.934644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:03.935116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:03.937165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:03.937623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:04.076788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:04.093522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:04.095201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:04.096462 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32c232a7-7fe2-4f6a-8f19-51b634c149f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1652 microversion: 2.20 time: 0.182948 Dec 25 21:31:04.107133 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3107/6184] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:03 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1652 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:04.788717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:04.789943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:04.809877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:04.813417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:04.815301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:04.815993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:04.902900 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3dfd9d9-5f1d-4118-8c94-d6bde0191819 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.119901 Dec 25 21:31:04.905910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3078/6185] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:04 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:05.115026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:05.115661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:05.124403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:05.124863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:05.125788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:05.126393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:05.427677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:05.495811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:05.503887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:05.505352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb459bcc-ae94-4a7d-af3c-1cc53cae8f67 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1652 microversion: 2.20 time: 0.395174 Dec 25 21:31:05.515479 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3108/6186] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:05 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1652 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:05.704028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8fb38c32-10fc-4831-bacc-bbf1388db8e2 req-30c5c6fc-7b7b-483e-901f-900217b47e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65490ad4-5baf-4c89-9877-006d581b4758", "name": "network-vif-deleted", "tag": "35a15c05-bcca-4842-8606-5c79e44fa713"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:05.709759 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:05.709759 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:05.731077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8fb38c32-10fc-4831-bacc-bbf1388db8e2 req-30c5c6fc-7b7b-483e-901f-900217b47e3d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:05.731530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8fb38c32-10fc-4831-bacc-bbf1388db8e2 req-30c5c6fc-7b7b-483e-901f-900217b47e3d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:05.758028 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8fb38c32-10fc-4831-bacc-bbf1388db8e2 req-30c5c6fc-7b7b-483e-901f-900217b47e3d service nova] Creating event network-vif-deleted:35a15c05-bcca-4842-8606-5c79e44fa713 for instance 65490ad4-5baf-4c89-9877-006d581b4758 on nch2-master-1 Dec 25 21:31:05.766850 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8fb38c32-10fc-4831-bacc-bbf1388db8e2 req-30c5c6fc-7b7b-483e-901f-900217b47e3d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070767 Dec 25 21:31:05.771364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3079/6187] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:05.916428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:05.919249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:05.925076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:05.926496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:05.927722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:05.928317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:06.003166 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d384151-c566-435c-8e39-5ab70d7c419c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.089618 Dec 25 21:31:06.004387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3109/6188] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:05 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:06.528716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:06.529753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:06.542365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:06.542811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:06.543598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:06.544037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:06.648869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:06.649407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:06.649877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lazy-loading 'fault' on Instance uuid 65490ad4-5baf-4c89-9877-006d581b4758 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:31:06.795081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:06.822611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:06.827971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:06.839179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b5a12fa-ae0a-4754-b72e-c020e03f500b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 200 len: 1371 microversion: 2.20 time: 0.316205 Dec 25 21:31:06.852348 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3080/6189] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:06 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 1371 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:07.030217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:07.039331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:07.067794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:07.068505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:07.069500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:07.070115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:07.201432 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a2343a1-4f0e-41a9-a169-6ea696a78830 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.189227 Dec 25 21:31:07.202877 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3110/6190] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:07 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:07.869704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:07.870367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:07.897123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:07.897932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:07.899042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:07.899551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:07.935920 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] HTTP exception thrown: Instance 65490ad4-5baf-4c89-9877-006d581b4758 could not be found. Dec 25 21:31:07.936568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Returning 404 to user: Instance 65490ad4-5baf-4c89-9877-006d581b4758 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:31:07.937803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12af5761-11d7-4741-82f3-296c220ca774 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 404 len: 111 microversion: 2.20 time: 0.075010 Dec 25 21:31:07.946116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3081/6191] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:07 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:31:07.952175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc2bb44c-01bc-4240-a117-eabbec128a61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '.version_select at 0x7fa4f74e4f70>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:08.062566 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc2bb44c-01bc-4240-a117-eabbec128a61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-119889696" status: 204 len: 0 microversion: 2.20 time: 0.114551 Dec 25 21:31:08.067511 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3111/6192] 10.222.0.32 () {60 vars in 1258 bytes} [Sat Dec 25 21:31:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-119889696 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:31:08.215560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:08.217588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:08.229254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:08.230916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:08.235826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:08.236427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:08.352534 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f0ddca5b-978c-49f7-8b38-6a29bc46c11e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.139168 Dec 25 21:31:08.361669 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3082/6193] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:08 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:09.368347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:09.369427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:09.377186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:09.377635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:09.379430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:09.379940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:09.462276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-915b818f-d335-4f9a-8547-aa5904b2a0aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.096328 Dec 25 21:31:09.466027 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3112/6194] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:09 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:10.502784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:10.506287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:10.541174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:10.541952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:10.543182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:10.544021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:10.724348 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74e5e198-10b5-461a-9f83-d0aa557b830b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.246055 Dec 25 21:31:10.725593 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3083/6195] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:10 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:10.924255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3b07b9b-2498-4ffb-bd3b-97f9984ed0f5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'create', calling method: .version_select at 0x7fa4f73a6160>, body: {"keypair": {"name": "tempest-keypair-1100770141"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:10.969555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a3b07b9b-2498-4ffb-bd3b-97f9984ed0f5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:10.979289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a3b07b9b-2498-4ffb-bd3b-97f9984ed0f5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for user 517838d2d4a942bfa8b332c767c60904 and project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:11.299536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a3b07b9b-2498-4ffb-bd3b-97f9984ed0f5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:11.317589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-a3b07b9b-2498-4ffb-bd3b-97f9984ed0f5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for user 517838d2d4a942bfa8b332c767c60904 and project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:11.340638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3b07b9b-2498-4ffb-bd3b-97f9984ed0f5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.421139 Dec 25 21:31:11.349899 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3113/6196] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:31:10 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 432 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:31:11.737781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:11.738883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:11.757879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:11.758337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:11.759168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:11.759615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:11.851825 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-169c0483-d638-4de3-8cc4-49ef93e2ff2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.119613 Dec 25 21:31:11.852867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3084/6197] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:11 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:12.865585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:12.867265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:12.900836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:12.907535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:12.908417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:12.909090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:13.010243 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23748f11-8828-4566-a430-888b73cc1f41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.149957 Dec 25 21:31:13.011910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3114/6198] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:12 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:14.023705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:14.024766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:14.033243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:14.034061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:14.036187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:14.038029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:14.138855 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-805f222f-df43-4d78-ac7e-a552c9106da5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.108623 Dec 25 21:31:14.143116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3085/6199] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:14 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:15.152124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:15.153445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:15.167136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:15.167588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:15.168405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:15.168853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:15.297142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dddec3c6-c664-4c3e-90e4-5ee9eb341235 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.144052 Dec 25 21:31:15.298679 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3115/6200] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:15 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:16.327731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:16.334079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:16.344989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:16.345560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:16.347093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:16.347938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:16.406531 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ce2a484-d1f7-4e41-833a-423055c59909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.099025 Dec 25 21:31:16.407193 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3086/6201] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:16 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:17.428229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:17.433300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:17.459418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:17.460182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:17.461578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:17.462271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:17.540429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67e88814-c781-476a-9b6f-fde9e4b41093 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.124607 Dec 25 21:31:17.541633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3116/6202] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:17 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:18.234187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1450697650", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8199f70-d579-4a7f-8b38-5d569ea5e784"}], "security_groups": [{"name": "tempest-securitygroup--1104330488"}], "key_name": "tempest-keypair-1100770141", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:18.553604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:18.555272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:18.576766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:18.577311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:18.578712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:18.579344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:18.647889 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-918eaed3-64ad-4783-80f1-19e2df23d2a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.098117 Dec 25 21:31:18.650335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3117/6203] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:18 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:19.004571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] validate_networks() for [('c8199f70-d579-4a7f-8b38-5d569ea5e784', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:31:19.666707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:19.669558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:19.692397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:19.697731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:19.698878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:19.699552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:19.786167 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d0e8829-c02e-42f0-9c3e-4d1fe3ac2062 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.128593 Dec 25 21:31:19.788095 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3118/6204] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:19 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:20.798533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:20.799534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:20.813468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:20.816275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:20.820026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:20.820484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:20.954624 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98ca50a6-8105-4872-90e4-aa3336cb9f58 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.159821 Dec 25 21:31:20.956216 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3119/6205] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:20 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:20.966434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:31:20.967359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:31:20.968006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:31:20.968766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:31:20.969417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:31:20.985763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:20.988062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:20.988062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:20.988248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:21.055033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:21.064254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Getting quotas for user 517838d2d4a942bfa8b332c767c60904 and project 0560c323ec8e41b3bc05939e12e049d5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:21.086330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:31:21.089071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:21.276971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e69770a-368c-42fa-a77b-2d20f375f3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.047191 Dec 25 21:31:21.278028 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3087/6206] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:31:18 2021] POST /compute/v2.1/servers => generated 402 bytes in 3049 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:31:21.288702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8816b6ab-eb9f-48df-9092-7d84181fe079 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:21.289906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8816b6ab-eb9f-48df-9092-7d84181fe079 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:21.447002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8816b6ab-eb9f-48df-9092-7d84181fe079 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:21.486204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8816b6ab-eb9f-48df-9092-7d84181fe079 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:21.490147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8816b6ab-eb9f-48df-9092-7d84181fe079 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:21.493555 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8816b6ab-eb9f-48df-9092-7d84181fe079 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1282 microversion: 2.20 time: 0.208770 Dec 25 21:31:21.509076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3120/6207] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:21 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:21.969982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:21.970985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:21.983539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:21.990248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:21.991244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:21.991868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:22.077404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8699522e-d741-473c-9bfb-244ff173cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.114070 Dec 25 21:31:22.078276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3088/6208] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:21 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:22.520067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08250389-4147-4eed-9171-fc4db7c711ae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:22.523090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08250389-4147-4eed-9171-fc4db7c711ae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:23.057986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1761154590", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de58f787-39ab-41e4-85ea-78281c9ae3af"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:23.166680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] validate_networks() for [('de58f787-39ab-41e4-85ea-78281c9ae3af', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:31:23.244590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08250389-4147-4eed-9171-fc4db7c711ae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:23.273846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08250389-4147-4eed-9171-fc4db7c711ae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:23.285525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08250389-4147-4eed-9171-fc4db7c711ae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:23.286904 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08250389-4147-4eed-9171-fc4db7c711ae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1282 microversion: 2.20 time: 0.777053 Dec 25 21:31:23.287987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3121/6209] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:22 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1282 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:23.295697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:23.304705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:23.311545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:23.318148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:23.318975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:23.319560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:23.411899 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49faaa06-1650-4a5c-a0ed-7f4d7818d701 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.121661 Dec 25 21:31:23.413325 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3122/6210] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:23 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:24.092319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:31:24.092788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:31:24.093241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:31:24.093649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:31:24.094258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:31:24.117622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:24.118397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:24.127738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:24.130824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:24.187733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Getting quotas for project 8ece5e5ef72d4614b89456ee37fe94f3. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:24.218346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Getting quotas for user 0af5c61e37b747608ee6af2f8f75f412 and project 8ece5e5ef72d4614b89456ee37fe94f3. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:24.261078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:31:24.265113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:24.320430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:24.321825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:24.348000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:24.353039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:24.355999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:24.356533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:24.520338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:24.532086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:24.535017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:24.537037 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-74516a7f-5345-4dde-8ef1-3271c09c453b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1334 microversion: 2.20 time: 0.233962 Dec 25 21:31:24.538037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23c8ebcb-30d8-4e25-b0bf-0f6aaa981ac8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.487018 Dec 25 21:31:24.538430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3123/6211] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:24 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1334 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:24.545660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:24.546547 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3089/6212] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:31:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:31:24.552751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:24.555151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-521adbd5-389d-449a-8bc6-7e24d030ddff tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:24.557046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-521adbd5-389d-449a-8bc6-7e24d030ddff tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:24.560718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:24.562102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:24.563169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:24.563917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:24.630780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63cd235f-2742-4bfb-89ff-1403c7168447 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.090618 Dec 25 21:31:24.632668 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3124/6213] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:24 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:24.751397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-521adbd5-389d-449a-8bc6-7e24d030ddff tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:24.763887 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-521adbd5-389d-449a-8bc6-7e24d030ddff tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1214 microversion: 2.1 time: 0.216183 Dec 25 21:31:24.774317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3090/6214] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:24 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1214 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:25.561312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:25.562012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:25.576568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:25.577053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:25.577865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:25.578304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:25.645224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:25.646221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:25.665611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:25.666062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:25.670734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:25.675961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:25.748953 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6dc6dce9-1fea-4a1a-8f7c-e619a109fdfc tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.109045 Dec 25 21:31:25.754792 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3091/6215] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:25 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:31:25.784735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7ccac28-152d-4bf4-808e-804ead13b4be tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:25.785504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7ccac28-152d-4bf4-808e-804ead13b4be tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:25.804751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:25.819305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:25.820862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:25.822056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e00a6e2f-f547-434d-b06f-85f5e85fbf7e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1352 microversion: 2.20 time: 0.265516 Dec 25 21:31:25.822633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3125/6216] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:25 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1352 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:26.149434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7ccac28-152d-4bf4-808e-804ead13b4be tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:26.161866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7ccac28-152d-4bf4-808e-804ead13b4be tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1214 microversion: 2.1 time: 0.384698 Dec 25 21:31:26.175525 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3092/6217] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:25 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1214 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:26.759969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:26.761505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:26.774855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:26.775592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:26.776735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:26.782213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:26.843679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:26.845039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:26.860217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:26.864069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:26.869725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:26.869725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:26.906045 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-da2d1f0a-7a48-4ea7-8e6d-98e9851e675a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.149420 Dec 25 21:31:26.907139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3126/6218] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:26 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:27.138907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:27.148628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:27.159956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:27.160489 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3751e0b8-7d12-45e5-b890-ca2335b184f3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1340 microversion: 2.20 time: 0.320726 Dec 25 21:31:27.167393 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3093/6219] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:26 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1340 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:27.185219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:27.186300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:27.203592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:27.204054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:27.208338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:27.208798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:27.376289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:27.387987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7855336-af72-46e3-b630-6bcd69f0abf1 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1266 microversion: 2.1 time: 0.207022 Dec 25 21:31:27.390440 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3127/6220] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:27 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:27.919825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:27.928653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:27.940792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:27.941825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:27.943243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:27.944095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:28.034004 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd49ac3e-7347-4aad-a70e-071a79e8a23c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.118752 Dec 25 21:31:28.039864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3094/6221] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:27 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:28.188760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:28.189441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:28.210662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:28.211418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:28.212577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:28.213539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:28.408346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:28.409525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:28.421927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:28.422385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:28.423189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:28.423630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:28.681234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:28.691502 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21e83c6a-3ee0-4022-b31d-4d2b5c885501 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1272 microversion: 2.1 time: 0.287686 Dec 25 21:31:28.702142 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3095/6222] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:28 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1272 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:29.060740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:29.061937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:29.072029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:29.073570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:29.076324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:29.078741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:29.192997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46c9f935-a0fb-400d-ab94-c5e127f8781b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.141381 Dec 25 21:31:29.197328 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3096/6223] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:29 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:29.498650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:29.515060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:29.524421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:29.526304 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-670eb4e9-50ee-427d-98d7-d763f7f4f02b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 1.343334 Dec 25 21:31:29.531187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3128/6224] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:28 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:29.722546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:29.736303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:29.759460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:29.779608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:29.781908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:29.784862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:30.033108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:30.049789 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b77839fd-6cc5-442e-b2b3-dd7461353016 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1272 microversion: 2.1 time: 0.339046 Dec 25 21:31:30.052281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3097/6225] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:29 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1272 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:30.222962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:30.226261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:30.246328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:30.246853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:30.248711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:30.250063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:30.330183 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a75b86e7-8c6a-4e41-b9d5-a3ed4be7b07e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.127629 Dec 25 21:31:30.332550 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3129/6226] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:30 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:31:30.547487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:30.548106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:30.564276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:30.564738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:30.567438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:30.567438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:31.069487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:31.070680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:31.079676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:31.080391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:31.081989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:31.082439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:31.122277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:31.140219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:31.142702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:31.145611 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a221c06-5f69-4121-9102-47d5e8f40126 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.600802 Dec 25 21:31:31.148096 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3098/6227] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:30 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:31.345901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:31.347027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:31.365220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:31.375275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:31.377960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:31.378640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:31.495751 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-894e7a32-1ab3-4a4f-b723-f59c62bf8fdd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.156256 Dec 25 21:31:31.496422 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3099/6228] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:31 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:32.131925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:32.146972 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-335d31a2-b4a4-4499-980a-25b4384bca02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 1.082304 Dec 25 21:31:32.148236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3130/6229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:31 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:32.168784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:32.170838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:32.179868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:32.180821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:32.181888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:32.182538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:32.509601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:32.510579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:32.520402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:32.521144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:32.522113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:32.522847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:32.574947 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92bb99aa-ff83-4283-9086-90421094e34c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.070213 Dec 25 21:31:32.576526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3131/6230] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:32 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:32.973313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:32.988752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:32.991159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:32.992765 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b1806c7-845c-40d8-9ad1-42665dd5ace1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.831568 Dec 25 21:31:33.007519 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3100/6231] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:32 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:33.167324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:33.167324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:33.186823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:33.189453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:33.192905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:33.193476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:33.423639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4dfe9b53-c0f3-4d7a-8f81-a5ab8ca6931c req-0085fdd5-d775-4bd1-a3e6-b6205dbbe81c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:33.428661 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:33.428661 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:33.462326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4dfe9b53-c0f3-4d7a-8f81-a5ab8ca6931c req-0085fdd5-d775-4bd1-a3e6-b6205dbbe81c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:33.463036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4dfe9b53-c0f3-4d7a-8f81-a5ab8ca6931c req-0085fdd5-d775-4bd1-a3e6-b6205dbbe81c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:33.480851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4dfe9b53-c0f3-4d7a-8f81-a5ab8ca6931c req-0085fdd5-d775-4bd1-a3e6-b6205dbbe81c service nova] Creating event network-changed:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch2-master-1 Dec 25 21:31:33.493239 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4dfe9b53-c0f3-4d7a-8f81-a5ab8ca6931c req-0085fdd5-d775-4bd1-a3e6-b6205dbbe81c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088990 Dec 25 21:31:33.497191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3101/6232] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:31:33.588207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:33.589241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:33.599510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:33.602967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:33.612767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:33.612767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:33.685186 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-72da0613-22f9-4610-9e07-c60d7242ac2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.100860 Dec 25 21:31:33.686254 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3102/6233] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:33 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:33.692563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-29323166", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:33.790111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] validate_networks() for None {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:31:34.624769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:34.650353 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a8a6a4d-ce63-4674-87d2-518d58776874 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 1.487611 Dec 25 21:31:34.653011 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3132/6234] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:33 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:34.659560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:34.671530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:34.673396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:34.674068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:34.675068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:34.675706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.536432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:31:35.540592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:31:35.541208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:31:35.547347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:31:35.547976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:31:35.584484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:35.584484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.585751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:35.586211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.613253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Getting quotas for project 1b4189d0115b4d849f8f9bce9deef49f. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:35.620181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Getting quotas for user c2b731b2ca634360afda4cfc55acc81f and project 1b4189d0115b4d849f8f9bce9deef49f. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:35.651490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:31:35.654332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:35.865431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:35.880192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68db328f-02d1-41dd-a72e-c6c0aa3431a8 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.190955 Dec 25 21:31:35.885321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3103/6235] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:31:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 2198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:31:35.892766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:35.895115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:35.906123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:35.906360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:35.907357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.909303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:35.910628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.913358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:35.918231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-771386a5-e7be-407b-b6b6-a112e358c172 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 1.262083 Dec 25 21:31:35.923097 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3133/6236] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:34 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:35.932518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:35.933462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:35.944417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:35.944417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.944417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:35.944417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:35.993373 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-faa56341-c958-4908-80b9-141ce5bbfe89 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.105726 Dec 25 21:31:35.994606 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3104/6237] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:35 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:36.005140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d4989c02-f1e8-403f-a342-c169cc6a039d req-94513efc-53e2-4420-b1d3-fe9c3d08cbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294", "tag": "a40bc1af-cf16-4f22-9e98-443b60684223"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:36.007801 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:36.007801 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:36.022392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d4989c02-f1e8-403f-a342-c169cc6a039d req-94513efc-53e2-4420-b1d3-fe9c3d08cbb7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:36.023858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d4989c02-f1e8-403f-a342-c169cc6a039d req-94513efc-53e2-4420-b1d3-fe9c3d08cbb7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:36.056142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d4989c02-f1e8-403f-a342-c169cc6a039d req-94513efc-53e2-4420-b1d3-fe9c3d08cbb7 service nova] Creating event network-changed:a40bc1af-cf16-4f22-9e98-443b60684223 for instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 on nch1-master-1 Dec 25 21:31:36.068578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d4989c02-f1e8-403f-a342-c169cc6a039d req-94513efc-53e2-4420-b1d3-fe9c3d08cbb7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071825 Dec 25 21:31:36.083016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3105/6238] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:36.097704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c4994b9-e4d2-4105-937e-851ae5e4e759 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:36.098509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c4994b9-e4d2-4105-937e-851ae5e4e759 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:36.445052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c4994b9-e4d2-4105-937e-851ae5e4e759 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:36.466492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c4994b9-e4d2-4105-937e-851ae5e4e759 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1213 microversion: 2.1 time: 0.381359 Dec 25 21:31:36.467320 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3106/6239] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:36 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:36.941852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:36.957297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:36.971429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:36.973375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:36.974234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:36.974692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:37.032234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:37.050429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efe5d364-ae3d-41c6-8e06-feeb5479db88 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 1.124486 Dec 25 21:31:37.053262 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3134/6240] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:35 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:37.059901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:37.064544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:37.082162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:37.088539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:37.094549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:37.094549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:37.168176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-340fd876-11d6-4eed-8c7f-431d01d48f5a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.112261 Dec 25 21:31:37.175718 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3135/6241] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:37 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:37.488249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03949c45-8e12-4151-9e3a-08e2bd4ec04f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:37.488249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03949c45-8e12-4151-9e3a-08e2bd4ec04f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:37.628172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03949c45-8e12-4151-9e3a-08e2bd4ec04f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:37.651277 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03949c45-8e12-4151-9e3a-08e2bd4ec04f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1213 microversion: 2.1 time: 0.169230 Dec 25 21:31:37.656957 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3136/6242] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:37 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1213 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:37.795620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:37.805585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:37.835983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:37.835983 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0caf43ec-580a-4f8e-9d43-ed242efd3da5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.888685 Dec 25 21:31:37.835983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3107/6243] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:36 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:31:38.075381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:38.076567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:38.084683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.097126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.098648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.099949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.183366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:38.184216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:38.193242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.194179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.197046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.200077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.307188 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f456767a-b12b-4a04-8974-3a45c63fa5ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.127713 Dec 25 21:31:38.308666 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3108/6244] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:38 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:38.535527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:38.544112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cb4a99f9-a660-4f60-b364-3fd50cfebae4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 0.476027 Dec 25 21:31:38.554281 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3137/6245] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:38 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:38.681739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:38.686312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:38.709646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.710850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.714963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.714963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.835076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:38.845344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7eda70a9-13de-4d40-9e40-f025eb6d2f4a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1265 microversion: 2.1 time: 0.174099 Dec 25 21:31:38.855909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:38.855909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:38.856911 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3109/6246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:38 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:38.857373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.858473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:38.859358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:38.859806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.133291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:39.146036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:39.147964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:39.150757 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb8f999b-8e51-401e-aaa2-8ffc2d15506b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.309537 Dec 25 21:31:39.151736 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3138/6247] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:38 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:39.319061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:39.319975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:39.342267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:39.343621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.349538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:39.350218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.415347 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d1a3127-6875-4356-847a-a19e24df205d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.099842 Dec 25 21:31:39.417041 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3110/6248] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:39 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:39.566810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:39.566810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:39.571503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:39.572015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.572815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:39.573280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.865436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:39.867437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:39.875802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:39.876480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.879092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:39.879534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:39.996178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:40.009586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:40.011602 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-241f4766-671d-4087-93fb-6853fe05c49a tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 0.448259 Dec 25 21:31:40.014102 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3139/6249] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:39 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:40.026777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d3db5db4-1c74-4309-a9a1-bf5d6833cc4e tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1271 microversion: 2.1 time: 0.166824 Dec 25 21:31:40.031938 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3111/6250] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:39 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:40.186167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:40.188279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:40.215997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:40.229089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:40.230062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:40.230517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:40.428033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:40.429566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:40.451260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:40.452574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:40.453441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:40.453889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:40.511824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f464bff-3428-4cfb-a61a-ce49f852b1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.088099 Dec 25 21:31:40.517840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3112/6251] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:40 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:31:40.752755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:40.762429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:40.765025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:40.766383 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fff88f95-6959-483d-a7b8-62ecf78c0dae tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.596337 Dec 25 21:31:40.767169 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3140/6252] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:40 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:41.032488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:41.033474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:41.047758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:41.049491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:41.059769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:41.063264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:41.063566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:41.065105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:41.065879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:41.066585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:41.067665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:41.070110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.008144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:42.018048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01a16d5a-6326-4479-b61e-81e2770f6d1f tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.974629 Dec 25 21:31:42.022996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:42.029387 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3141/6253] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:41 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:42.035689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:42.037120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:42.037881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd173dcc-9cc9-4cf9-b1ec-fac6cd187a64 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 1.010139 Dec 25 21:31:42.041636 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3113/6254] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:41 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:42.049634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:42.050416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.060705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b667bd93-0939-41b4-ac5f-3ff29f7b014e req-8ee26ab8-3ec7-4f92-bb18-f80b7cc13dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "name": "network-vif-plugged", "status": "completed", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:42.066923 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:42.066923 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:42.070319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:42.070802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.100652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b667bd93-0939-41b4-ac5f-3ff29f7b014e req-8ee26ab8-3ec7-4f92-bb18-f80b7cc13dd7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:42.101221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b667bd93-0939-41b4-ac5f-3ff29f7b014e req-8ee26ab8-3ec7-4f92-bb18-f80b7cc13dd7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.122844 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b667bd93-0939-41b4-ac5f-3ff29f7b014e req-8ee26ab8-3ec7-4f92-bb18-f80b7cc13dd7 service nova] Creating event network-vif-plugged:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch2-master-1 Dec 25 21:31:42.128729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b667bd93-0939-41b4-ac5f-3ff29f7b014e req-8ee26ab8-3ec7-4f92-bb18-f80b7cc13dd7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085846 Dec 25 21:31:42.129785 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3114/6255] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:42.136882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:42.137926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:42.170027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:42.171369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.172727 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37b18e68-e519-401f-a957-200b3419640b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.141979 Dec 25 21:31:42.182804 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3142/6256] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:42 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:42.184315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:42.188135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.552058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:42.560677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:42.562521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:42.568200 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02328487-1807-496f-b0b0-6451c67d92e7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.433309 Dec 25 21:31:42.568200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3115/6257] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:42 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:42.911135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e688842f-e6e5-491d-ab56-39670f52a718 req-d3123461-b9c1-465a-a090-ef23599d11fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d", "tag": "28d39838-5105-46f2-ab15-5f4dad4e0e34"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:42.913562 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:42.913562 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:31:42.925776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e688842f-e6e5-491d-ab56-39670f52a718 req-d3123461-b9c1-465a-a090-ef23599d11fb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:42.926764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e688842f-e6e5-491d-ab56-39670f52a718 req-d3123461-b9c1-465a-a090-ef23599d11fb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:42.940418 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e688842f-e6e5-491d-ab56-39670f52a718 req-d3123461-b9c1-465a-a090-ef23599d11fb service nova] Creating event network-changed:28d39838-5105-46f2-ab15-5f4dad4e0e34 for instance 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d on nch2-master-1 Dec 25 21:31:42.951669 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e688842f-e6e5-491d-ab56-39670f52a718 req-d3123461-b9c1-465a-a090-ef23599d11fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046122 Dec 25 21:31:42.952861 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3143/6258] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:43.034756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:43.036587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:43.045343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.047215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.051467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.051999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.060774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:43.062014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:43.074916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.075681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.076702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.081538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.497070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:43.508326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:43.516365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-94d00702-e8ba-4ab2-b519-502987c562cf tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.485288 Dec 25 21:31:43.519064 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83ac35e0-b754-4d06-89de-78a976d18a02 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 0.462395 Dec 25 21:31:43.522163 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3116/6259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:43 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:43.522298 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3144/6260] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:43 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:43.532715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:43.534266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:43.540675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.541176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.542349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.542951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.584069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:43.585968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:43.597310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.597798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.598609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:43.599109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:43.605101 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b5ad745-14e2-4069-852a-1234523dfb01 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.075937 Dec 25 21:31:43.605773 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3117/6261] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:43 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:43.920706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:43.930033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:43.931855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:43.933552 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d73029b-6bbe-4927-b6e9-9b7590c5b10b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1408 microversion: 2.20 time: 0.354267 Dec 25 21:31:43.934681 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3145/6262] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:43 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1408 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:44.171545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0b75d44d-6cf1-4c70-85f8-9ebdb42d6b72 req-ee571287-8975-4591-aa57-b7562074e819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294", "name": "network-vif-plugged", "status": "completed", "tag": "a40bc1af-cf16-4f22-9e98-443b60684223"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:44.173072 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:44.173072 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:44.181659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0b75d44d-6cf1-4c70-85f8-9ebdb42d6b72 req-ee571287-8975-4591-aa57-b7562074e819 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.182109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0b75d44d-6cf1-4c70-85f8-9ebdb42d6b72 req-ee571287-8975-4591-aa57-b7562074e819 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.221273 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0b75d44d-6cf1-4c70-85f8-9ebdb42d6b72 req-ee571287-8975-4591-aa57-b7562074e819 service nova] Creating event network-vif-plugged:a40bc1af-cf16-4f22-9e98-443b60684223 for instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 on nch1-master-1 Dec 25 21:31:44.226452 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0b75d44d-6cf1-4c70-85f8-9ebdb42d6b72 req-ee571287-8975-4591-aa57-b7562074e819 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058856 Dec 25 21:31:44.234945 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3118/6263] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:31:44.535481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:44.536094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:44.537896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:44.538481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:44.543202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.543937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.545064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.545438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.545902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.546174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.546855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.547431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.821509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:44.829502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:44.836689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-33017793-3585-454f-81e2-42a634259059 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1314 microversion: 2.1 time: 0.304595 Dec 25 21:31:44.837019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86ea2498-37e5-4783-8440-f8c89e36b84a tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.305453 Dec 25 21:31:44.837412 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3146/6264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:44 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:44.847397 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3119/6265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:44 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:44.856701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:44.858433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:44.872791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.872791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.872791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.872791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.914099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-650bb60e-a680-497c-9d97-d44448db64ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.075099 Dec 25 21:31:44.914772 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3147/6266] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:44 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:44.952984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:44.953595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:44.980569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.981132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:44.982176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:44.982811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:45.258778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:45.274172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:45.275780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:45.279103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-895a04e9-e5cc-4d7d-a3df-9b9976d98c6f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1597 microversion: 2.20 time: 0.330110 Dec 25 21:31:45.280510 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3120/6267] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:31:44 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1597 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:31:45.302267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:45.302859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:45.316396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:45.317103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:45.320060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:45.320736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:45.528435 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3aa6d2e-17b5-49fd-b1ed-939eb1342cab tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.232666 Dec 25 21:31:45.535171 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3148/6268] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Dec 25 21:31:45 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-interface => generated 284 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:31:45.855616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:45.857229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:45.870527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:45.871356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:45.872383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:45.881088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:45.997176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-884560128", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "a7e1816e-e061-48f4-919c-0820a13aab5b"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:46.078053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] validate_networks() for [('a7e1816e-e061-48f4-919c-0820a13aab5b', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:31:46.203602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:46.216318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64371c65-c398-4f7c-9629-6bcbcbf0c288 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.364715 Dec 25 21:31:46.219128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3149/6269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:45 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:46.237487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:46.243339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:46.251335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:46.253642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:46.256734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:46.257391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:46.664904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:46.675461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a953576-e8d2-4f40-924c-20523412a1e3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1499 microversion: 2.1 time: 0.454665 Dec 25 21:31:46.676858 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3150/6270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:46 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1499 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:46.687937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:46.689465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:46.700333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:46.701145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:46.702415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:46.703163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:46.762367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8bc40142-81de-4cd6-9d78-e5c1e58cfa72 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.082517 Dec 25 21:31:46.764399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3151/6271] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:46 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:46.787158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:31:46.788633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:31:46.789502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:31:46.790586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:31:46.791213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:31:46.805832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:46.805832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:46.805832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:46.805832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:46.826462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Getting quotas for project d3625a8207df4cb0a4da19210ca5c80c. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:46.833656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Getting quotas for user 54abf7f90439451081ee3b38676b6b65 and project d3625a8207df4cb0a4da19210ca5c80c. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:46.847800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Going to run 3 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:31:46.850979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:47.015615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=67e16f08-7bce-4669-ac08-be4cf324dc04,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:47.129712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=1bb28ccd-3dc5-481f-873e-9836f6f1586e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:47.234115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:47.235683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:47.243914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.244675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.248129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.248911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.425323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad9194ef-8295-483c-9c6b-656e948cf69a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.982734 Dec 25 21:31:47.440360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3121/6272] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:31:45 2021] POST /compute/v2.1/servers => generated 380 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:31:47.440360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:47.444592 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:47.444592 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:47.445747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:47.446520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:31:47.513463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.514171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.515265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.520031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.542617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f29cd25-d006-4664-9d93-98a5de966bb4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.108243 Dec 25 21:31:47.547271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:47.550557 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3122/6273] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:31:47 2021] GET /compute/v2.1/servers => generated 1015 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:47.555346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4374b504-6aab-4918-a206-e9306b3379d9 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:47.556137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4374b504-6aab-4918-a206-e9306b3379d9 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:47.556609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5b16524-0c71-4144-8011-2a04c9d14f9b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.326709 Dec 25 21:31:47.557239 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3152/6274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:47 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:47.632983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4374b504-6aab-4918-a206-e9306b3379d9 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:47.644605 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4374b504-6aab-4918-a206-e9306b3379d9 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1222 microversion: 2.1 time: 0.092890 Dec 25 21:31:47.645575 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3123/6275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:47 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:47.780132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:47.783913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:47.816065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.816524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.820994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.824288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.830433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:47.831805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:47.862241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.883747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.885973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.886581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.951736 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c4765c2-ca18-4130-a293-5423c5623beb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.179294 Dec 25 21:31:47.956126 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3153/6276] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:47 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:47.963463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b8dc057d-60ca-42a1-8ba2-047e4ff19a81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 14 microversion: 2.20 time: 0.132672 Dec 25 21:31:47.963463 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3124/6277] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:47 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:47.968464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-13dadfa1-5792-45b4-845c-152e38c2ec41 req-6b74f7cc-3dfa-496e-ab36-bbdaafd32d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:47.971605 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:47.971605 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:31:47.974555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:47.975154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:47.990606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-13dadfa1-5792-45b4-845c-152e38c2ec41 req-6b74f7cc-3dfa-496e-ab36-bbdaafd32d67 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.991058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-13dadfa1-5792-45b4-845c-152e38c2ec41 req-6b74f7cc-3dfa-496e-ab36-bbdaafd32d67 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.993048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.995448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:47.995448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:47.995448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:48.018001 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-13dadfa1-5792-45b4-845c-152e38c2ec41 req-6b74f7cc-3dfa-496e-ab36-bbdaafd32d67 service nova] Creating event network-changed:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch2-master-1 Dec 25 21:31:48.026314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-13dadfa1-5792-45b4-845c-152e38c2ec41 req-6b74f7cc-3dfa-496e-ab36-bbdaafd32d67 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072111 Dec 25 21:31:48.030731 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3154/6278] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:48.042645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:31:48.527516 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcabc915-4af1-49b5-8520-b3cdac0ae1cc tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 204 len: 0 microversion: 2.1 time: 0.563565 Dec 25 21:31:48.528308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3125/6279] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:31:47 2021] DELETE /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:31:48.543396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:48.545586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:48.559970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:48.560679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:48.562602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:48.563228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:48.575673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:48.577068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:48.606627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:48.612191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:48.619776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:48.622243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:49.019207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:49.031606 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0fe1ebd9-a788-476c-8b5b-cef3aafd41cb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.461178 Dec 25 21:31:49.032449 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3126/6280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:48 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:49.041153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:49.052361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53d8ec66-3f22-4ac9-a86a-238df131ef56 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:49.068550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53d8ec66-3f22-4ac9-a86a-238df131ef56 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:49.069500 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0ef8720-7211-45df-a71f-f7bf4f38970f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1505 microversion: 2.1 time: 0.523894 Dec 25 21:31:49.069500 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3155/6281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:48 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:49.072026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1096086983", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cc684306-48c1-4377-9775-39fc12aed847", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d257b68f-9132-4584-b1b0-827fbb5ce176"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:49.130749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-53d8ec66-3f22-4ac9-a86a-238df131ef56 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:49.143663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53d8ec66-3f22-4ac9-a86a-238df131ef56 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1222 microversion: 2.1 time: 0.099566 Dec 25 21:31:49.149467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3127/6282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:49 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:49.172648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:49.176289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:49.198889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:49.201957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:49.204067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:49.205813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:49.244043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] validate_networks() for [('d257b68f-9132-4584-b1b0-827fbb5ce176', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:31:49.284013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-28c109ec-ee88-45ed-ac0d-6c8c8f9a7492 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.136588 Dec 25 21:31:49.285134 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3128/6283] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:49 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:49.294831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:49.298045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:49.314419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:49.315113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:49.316206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:49.317503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:49.389484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c5feb70-9266-43bf-a7a9-0fe254ee8ab3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 14 microversion: 2.20 time: 0.101038 Dec 25 21:31:49.396465 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3129/6284] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:49 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:49.430260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5a954283-1738-45b5-996f-e5eafe844f19 req-bfae8985-d6e9-4373-a278-02219c32d8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d", "name": "network-vif-plugged", "status": "completed", "tag": "28d39838-5105-46f2-ab15-5f4dad4e0e34"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:49.432668 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:49.432668 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:49.445412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5a954283-1738-45b5-996f-e5eafe844f19 req-bfae8985-d6e9-4373-a278-02219c32d8d8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:49.446135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5a954283-1738-45b5-996f-e5eafe844f19 req-bfae8985-d6e9-4373-a278-02219c32d8d8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:49.465704 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5a954283-1738-45b5-996f-e5eafe844f19 req-bfae8985-d6e9-4373-a278-02219c32d8d8 service nova] Creating event network-vif-plugged:28d39838-5105-46f2-ab15-5f4dad4e0e34 for instance 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d on nch2-master-1 Dec 25 21:31:49.475108 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5a954283-1738-45b5-996f-e5eafe844f19 req-bfae8985-d6e9-4373-a278-02219c32d8d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048703 Dec 25 21:31:49.478045 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3130/6285] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:50.059446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:50.060351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:50.075295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:50.078168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:50.078168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:50.078522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:50.617420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:31:50.618404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:31:50.618951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:31:50.619355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:31:50.619769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:31:50.642765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:50.643765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:50.644776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:50.645430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:50.670322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:50.677581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for user 171c198b6b734cd698b3c1eaf76a0234 and project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:50.693580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:31:50.695768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='cc684306-48c1-4377-9775-39fc12aed847',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:50.843337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:50.851220 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afafc8d7-38b1-422e-bfce-71e34c299c5b tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1313 microversion: 2.1 time: 0.805366 Dec 25 21:31:50.852075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3131/6286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:50 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1313 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:50.856918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:50.857523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:50.863715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:50.867929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:50.869122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:50.869730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:50.889563 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [3859d5b1-d001-48d5-b671-70f3130eb1b9] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 21:31:51.036798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:51.049257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06f3f358-6c30-4db1-87ab-944f1961fd7d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1463 microversion: 2.1 time: 0.194427 Dec 25 21:31:51.050862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3132/6287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:50 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1463 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:51.056252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad92d8f0-0076-4386-bd3c-5b1bc7d1cf0d tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:51.057152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad92d8f0-0076-4386-bd3c-5b1bc7d1cf0d tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:51.162884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad92d8f0-0076-4386-bd3c-5b1bc7d1cf0d tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:51.172640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad92d8f0-0076-4386-bd3c-5b1bc7d1cf0d tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1222 microversion: 2.1 time: 0.120450 Dec 25 21:31:51.174674 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3133/6288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:51 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1222 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:51.187745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:51.188757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:51.198768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.199368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.200308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.200808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.250975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf8694c4-da7d-40e8-b96f-41cae3f7d4a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.073526 Dec 25 21:31:51.252814 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3134/6289] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:51 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:51.258944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:51.260014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:51.267459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.268262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.269655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.270316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.313215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1fd51d38-eec4-4dee-ae53-41ac957aa891 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 14 microversion: 2.20 time: 0.058691 Dec 25 21:31:51.315060 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3135/6290] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:51 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 14 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:51.322668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e1cb3251-12f1-4708-8620-0f536bc93ae9 req-69c91bcc-e792-4e14-9c2b-f0b2cba6d5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294", "name": "network-vif-deleted", "tag": "a40bc1af-cf16-4f22-9e98-443b60684223"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:51.324478 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:51.324478 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:31:51.334921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e1cb3251-12f1-4708-8620-0f536bc93ae9 req-69c91bcc-e792-4e14-9c2b-f0b2cba6d5e7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.335563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e1cb3251-12f1-4708-8620-0f536bc93ae9 req-69c91bcc-e792-4e14-9c2b-f0b2cba6d5e7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.352690 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e1cb3251-12f1-4708-8620-0f536bc93ae9 req-69c91bcc-e792-4e14-9c2b-f0b2cba6d5e7 service nova] Creating event network-vif-deleted:a40bc1af-cf16-4f22-9e98-443b60684223 for instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 on nch1-master-1 Dec 25 21:31:51.358888 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e1cb3251-12f1-4708-8620-0f536bc93ae9 req-69c91bcc-e792-4e14-9c2b-f0b2cba6d5e7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Dec 25 21:31:51.360010 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3136/6291] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:51.868615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:51.869349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:51.876193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.876685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.877518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:51.877964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:51.904334 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [3859d5b1-d001-48d5-b671-70f3130eb1b9] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38594. Dec 25 21:31:51.920763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9baed7a7-b7a1-4cd5-87e0-4d653caeb92d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.858268 Dec 25 21:31:51.930307 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3156/6292] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:31:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 2868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:31:51.941593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fbae1633-6e1e-47e9-9121-7a29ada1ac46 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:51.943835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fbae1633-6e1e-47e9-9121-7a29ada1ac46 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:52.104493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fbae1633-6e1e-47e9-9121-7a29ada1ac46 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:52.116183 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fbae1633-6e1e-47e9-9121-7a29ada1ac46 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1057 microversion: 2.1 time: 0.184298 Dec 25 21:31:52.128442 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3157/6293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:51 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1057 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:52.137678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:52.138769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:52.153146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.153833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.154838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.155537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.201272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.202053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.202712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lazy-loading 'fault' on Instance uuid ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:31:52.314969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:52.326350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c8eaeab-16a2-44cf-a275-934479929dd9 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 200 len: 1304 microversion: 2.1 time: 0.195304 Dec 25 21:31:52.330060 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3158/6294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:52 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 1304 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:52.338460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:52.339463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:52.346936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.347606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.348614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.349246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.467100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:52.471615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:52.473823 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-238a1ce1-f320-4b41-befe-2ec9feb09a7b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1274 microversion: 2.1 time: 0.139826 Dec 25 21:31:52.474628 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3159/6295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:52 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1274 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:52.480063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:52.481085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:52.482118 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e54be853-e02b-4ed6-8996-df71eaeb40a1 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1463 microversion: 2.1 time: 0.617586 Dec 25 21:31:52.483200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3137/6296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:51 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1463 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:52.487986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.489933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.489933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.489933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.521194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:52.522146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:52.538087 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1114dc7a-494c-4f27-b0c3-77c827b4367e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.061626 Dec 25 21:31:52.538769 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3160/6297] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:52 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:52.541758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.545326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.546386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.546995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.548342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:52.549193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:52.556964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.559043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.559043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:52.559043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:52.596182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:31:52.604764 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d61e5042-0207-47c0-8aed-80f7c230e4a0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 14 microversion: 2.20 time: 0.118339 Dec 25 21:31:52.606402 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3138/6298] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:52 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:53.049746 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2ee8cb2-c8b6-4e57-ba5a-2e1d8285c64d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "DELETE /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 204 len: 0 microversion: 2.1 time: 0.507725 Dec 25 21:31:53.056276 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3161/6299] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:31:52 2021] DELETE /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:31:53.064575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:53.065494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:53.073680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.074238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.075110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.075666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.134189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3619b11-3ace-4bff-8d43-a867e9a27942 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:53.134984 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3619b11-3ace-4bff-8d43-a867e9a27942 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:53.288451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a3619b11-3ace-4bff-8d43-a867e9a27942 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:53.300867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3619b11-3ace-4bff-8d43-a867e9a27942 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1057 microversion: 2.1 time: 0.170569 Dec 25 21:31:53.317319 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3162/6300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:53 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1057 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:53.345973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:53.346610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:53.352495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.352994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.353785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.354224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.371191 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] HTTP exception thrown: Instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 could not be found. Dec 25 21:31:53.371994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Returning 404 to user: Instance ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:31:53.372946 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd7a0af5-8dea-49ff-8676-38283e947c48 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294" status: 404 len: 111 microversion: 2.1 time: 0.030762 Dec 25 21:31:53.373713 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3163/6301] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:53 2021] GET /compute/v2.1/servers/ccaf2ac9-c8d5-4d9d-beea-c3bd24d44294 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:31:53.477653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:53.486811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9e15cc6-6a96-4a40-abd0-549496739c3d tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1469 microversion: 2.1 time: 0.427049 Dec 25 21:31:53.487300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3139/6302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:53 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1469 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:53.504648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:53.508985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:53.509148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-35302517", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "de58f787-39ab-41e4-85ea-78281c9ae3af"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:53.520511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.520995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.521820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.522248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.567408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] validate_networks() for [('de58f787-39ab-41e4-85ea-78281c9ae3af', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:31:53.611597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:53.635375 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-93563f37-7a21-49b8-8f70-7dcfccbaba43 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1292 microversion: 2.1 time: 0.145855 Dec 25 21:31:53.637514 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3164/6303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:53 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1292 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:53.642604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:53.643781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:53.650455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.650919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.651836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.652293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.705967 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-adfc5ece-1ae9-43a0-829f-f594973b7b9b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.066007 Dec 25 21:31:53.707774 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3165/6304] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:53.715864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:53.716908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:53.725249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.725703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.726558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:53.726993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:53.769839 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7ba09b2-d409-4a30-b4c1-8dd6f4c9ed2e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 14 microversion: 2.20 time: 0.059734 Dec 25 21:31:53.773195 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3166/6305] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:53 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:54.319664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:54.321135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:54.330956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:54.332368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:54.333638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:54.334288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:54.477769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:54.485639 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b1b383a2-05f1-42eb-9a91-ec64c4ef0e74 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1109 microversion: 2.1 time: 0.170093 Dec 25 21:31:54.492241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3167/6306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:54 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1109 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:54.506623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:54.511940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:54.518423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:54.518882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:54.520580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:54.521547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.165629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:31:55.167225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:31:55.167728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:31:55.168149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:31:55.168602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:31:55.176908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:55.178684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.179341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.180338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.181160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.200370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53bbd56a-4ed7-433a-a658-b822fc1bf965 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1469 microversion: 2.1 time: 0.697040 Dec 25 21:31:55.210675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Getting quotas for project 8ece5e5ef72d4614b89456ee37fe94f3. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:31:55.210675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Getting quotas for user 0af5c61e37b747608ee6af2f8f75f412 and project 8ece5e5ef72d4614b89456ee37fe94f3. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:31:55.212389 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3168/6307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:54 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1469 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:55.217352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:55.218197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:55.223354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:31:55.225812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:31:55.227358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.228240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.229425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.230083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.385241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b22c7f58-a07d-4ee6-b909-c58dc17c4127 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883424 Dec 25 21:31:55.388606 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3140/6308] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:31:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 1885 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:31:55.396553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:55.424600 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c6d3f3d-b637-43ae-950d-866f7ec12d87 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1280 microversion: 2.1 time: 0.210748 Dec 25 21:31:55.444139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:55.444139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:55.444708 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3169/6309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:55 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1280 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:55.452750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:55.457099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:55.460072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.466947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.467835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.468291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.480279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.480740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.481588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.482030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.596125 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e02a09b2-6769-44ee-a14a-3a4199a2bdb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.207543 Dec 25 21:31:55.601261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3141/6310] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:55 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:55.607561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b69c9122-d8d4-4a2a-9190-d1c07fc9fdaa tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:55.608311 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07d55940-0f88-4da6-8ee8-a40641f7a7b8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 14 microversion: 2.20 time: 0.170390 Dec 25 21:31:55.608848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b69c9122-d8d4-4a2a-9190-d1c07fc9fdaa tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:55.613085 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3170/6311] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:55 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 14 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:55.619822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:55.619822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:55.631253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.631802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.633133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:55.634626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:55.713050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b69c9122-d8d4-4a2a-9190-d1c07fc9fdaa tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:55.725089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b69c9122-d8d4-4a2a-9190-d1c07fc9fdaa tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1212 microversion: 2.1 time: 0.122128 Dec 25 21:31:55.726900 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3142/6312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:55 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1212 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:55.793400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:55.806328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe500d4a-c439-405d-90ca-f179c3e6817c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1127 microversion: 2.1 time: 0.192254 Dec 25 21:31:55.817563 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3171/6313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:55 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1127 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:56.222048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:56.223815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:56.232755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.234850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.236803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.238043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.273137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-23c3ad7d-a86c-4af1-b8fc-36e0333863cb req-2a66de95-76cd-41d6-973c-58a527a95801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d", "name": "network-vif-deleted", "tag": "28d39838-5105-46f2-ab15-5f4dad4e0e34"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:56.282984 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:56.282984 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:31:56.304766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-23c3ad7d-a86c-4af1-b8fc-36e0333863cb req-2a66de95-76cd-41d6-973c-58a527a95801 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.307809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-23c3ad7d-a86c-4af1-b8fc-36e0333863cb req-2a66de95-76cd-41d6-973c-58a527a95801 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.349745 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-23c3ad7d-a86c-4af1-b8fc-36e0333863cb req-2a66de95-76cd-41d6-973c-58a527a95801 service nova] Creating event network-vif-deleted:28d39838-5105-46f2-ab15-5f4dad4e0e34 for instance 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d on nch2-master-1 Dec 25 21:31:56.359256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b731b2ca634360afda4cfc55acc81f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b4189d0115b4d849f8f9bce9deef49f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:56.367690 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-23c3ad7d-a86c-4af1-b8fc-36e0333863cb req-2a66de95-76cd-41d6-973c-58a527a95801 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101145 Dec 25 21:31:56.373897 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3172/6314] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:31:56.402173 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a2615ddd-569d-49a4-b013-5669b0fb72fb tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 200 len: 1427 microversion: 2.1 time: 0.181510 Dec 25 21:31:56.404438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3143/6315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:56 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:56.453139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:56.453827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:56.472603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.478430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.481809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.482337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.614854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:56.615811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:56.623825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.624569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.625593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.626788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.694259 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5e70b65-4eac-492f-b771-096ed8597f82 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.089646 Dec 25 21:31:56.694943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3144/6316] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:56 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:56.704086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:56.705899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:56.717179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.723018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.724642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.725582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.800340 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e57b5bf0-2a76-45fa-a699-ab4dc952f561 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 8197 microversion: 2.20 time: 0.103077 Dec 25 21:31:56.801028 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3145/6317] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:56 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 8197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:31:56.810921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:56.812662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:56.825076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.826712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.827729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.828344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.967581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:56.970697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:56.979096 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15db7a4f-7eb4-4eab-8b51-e8492c6ce1e5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.530381 Dec 25 21:31:56.979322 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2614bcf9-b0cf-4fc4-8806-534e133f94f3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1216 microversion: 2.1 time: 0.176836 Dec 25 21:31:56.980497 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3173/6318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:56 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:56.985567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:56.988746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:56.995251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.996219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:56.998442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:56.999136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.011095 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3146/6319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:56 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1216 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:57.423989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:57.424963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] [instance: 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:57.435065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:57.435961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.437338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:57.437946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.458253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] HTTP exception thrown: Instance 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d could not be found. Dec 25 21:31:57.459138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] Returning 404 to user: Instance 77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:31:57.460165 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e99ee958-fd9c-4c11-8be4-e82981f94ff9 tempest-VolumesNegativeTest-763913042 tempest-VolumesNegativeTest-763913042-project] 10.222.0.32 "GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d" status: 404 len: 111 microversion: 2.1 time: 0.042628 Dec 25 21:31:57.461838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3147/6320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:57 2021] GET /compute/v2.1/servers/77f09b4b-c1be-4f85-9ebf-48b16aaa0b7d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:31:57.707363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:57.709625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:57.724643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:57.725154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.727051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:57.727685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.775431 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87a82449-e600-4290-9e87-c3ddce99a5b7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.072897 Dec 25 21:31:57.776303 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3148/6321] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:57 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:31:57.814345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:57.816188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:57.826544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:57.827289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.828548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:57.829744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:57.910589 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2bbfdbf1-c5ed-444e-b070-80daabb70f92 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 16389 microversion: 2.20 time: 0.101932 Dec 25 21:31:57.911895 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3149/6322] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:57 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 16389 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:57.976349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:57.983999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-adb2e7c2-b787-48f0-8a78-fa699a822790 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1169 microversion: 2.1 time: 1.002240 Dec 25 21:31:57.984536 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3174/6323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:56 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1169 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:58.002763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:58.003502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:58.013719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.013936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:58.014566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.014697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:58.016409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.017721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.022493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.023226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.024229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.026459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.202697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:58.212193 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a8a2b14-e414-4da7-9452-d6c1ca14fa2e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1264 microversion: 2.1 time: 0.202221 Dec 25 21:31:58.213710 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3175/6324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:58 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:58.542399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b3d64efd-2bc6-4c85-9909-c89a9cbc7cf4 req-d8c88f90-2ff8-4839-a7c4-86eaee68cf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e16f08-7bce-4669-ac08-be4cf324dc04", "tag": "0558fb1c-8cdb-4c71-b053-b7bff883ff9b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:58.544683 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:58.544683 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:31:58.561132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b3d64efd-2bc6-4c85-9909-c89a9cbc7cf4 req-d8c88f90-2ff8-4839-a7c4-86eaee68cf31 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.561839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b3d64efd-2bc6-4c85-9909-c89a9cbc7cf4 req-d8c88f90-2ff8-4839-a7c4-86eaee68cf31 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.578993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b3d64efd-2bc6-4c85-9909-c89a9cbc7cf4 req-d8c88f90-2ff8-4839-a7c4-86eaee68cf31 service nova] Creating event network-changed:0558fb1c-8cdb-4c71-b053-b7bff883ff9b for instance 67e16f08-7bce-4669-ac08-be4cf324dc04 on nch1-master-1 Dec 25 21:31:58.594953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b3d64efd-2bc6-4c85-9909-c89a9cbc7cf4 req-d8c88f90-2ff8-4839-a7c4-86eaee68cf31 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057318 Dec 25 21:31:58.596676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3176/6325] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:31:58.739605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a97edcf7-edcf-4b96-badd-b8a425966f4c req-86187a19-82b0-4b43-bc2a-f2179884499c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335c07b3-3db8-4683-9af2-5dd2d3923ccd", "tag": "144f1a3a-207e-4bda-9b5e-951b5824198a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:58.742101 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:31:58.742101 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:31:58.751461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a97edcf7-edcf-4b96-badd-b8a425966f4c req-86187a19-82b0-4b43-bc2a-f2179884499c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.751461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a97edcf7-edcf-4b96-badd-b8a425966f4c req-86187a19-82b0-4b43-bc2a-f2179884499c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.768475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a97edcf7-edcf-4b96-badd-b8a425966f4c req-86187a19-82b0-4b43-bc2a-f2179884499c service nova] Creating event network-changed:144f1a3a-207e-4bda-9b5e-951b5824198a for instance 335c07b3-3db8-4683-9af2-5dd2d3923ccd on nch1-master-1 Dec 25 21:31:58.769220 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a97edcf7-edcf-4b96-badd-b8a425966f4c req-86187a19-82b0-4b43-bc2a-f2179884499c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036753 Dec 25 21:31:58.770148 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3177/6326] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:31:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:31:58.790585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:58.791795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:58.799253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.799715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.800524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.801166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.846986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:58.855463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d85b446-e2ad-45fd-921e-7fa2c1bda696 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.857899 Dec 25 21:31:58.856364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3150/6327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:57 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:31:58.857110 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d85f140-d778-4e42-8d42-353cdbfa2f86 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.072486 Dec 25 21:31:58.857950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3178/6328] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:58 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:31:58.922283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:58.923976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:58.935792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.936254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:58.937082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:58.937525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.004705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:59.006738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:59.019604 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ec8e271-fe59-44bd-90c4-8773b9758842 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 16389 microversion: 2.20 time: 0.100890 Dec 25 21:31:59.023683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3151/6329] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:58 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 16389 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:31:59.023808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.023808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.024765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.025599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.231116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:59.232897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:59.247533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.248000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.251054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.253058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.479802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:59.490207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06b6c23d-7004-4513-b109-2b5dbe0d8549 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1270 microversion: 2.1 time: 0.263997 Dec 25 21:31:59.491508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3152/6330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:59 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1270 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:59.870352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:31:59.871906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:59.880149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.880685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.881938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:31:59.882113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.882503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.900867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9072cd66-dec4-4dda-b75f-eb486f8fdd3e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1169 microversion: 2.1 time: 0.902906 Dec 25 21:31:59.911407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3179/6331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:58 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1169 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:31:59.929854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:31:59.931065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:31:59.937800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.939496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.940320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:31:59.940774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:31:59.944624 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8211485c-19dd-4e4b-bdb6-ea4288a1280c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.078397 Dec 25 21:31:59.945735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3153/6332] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:31:59 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:00.031491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:00.033312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:00.041213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.041668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:00.042510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.042953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:00.095183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d218e1fb-abe8-4134-a334-2b8c6d5afac2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 16389 microversion: 2.20 time: 0.067804 Dec 25 21:32:00.096251 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3154/6333] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:00 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 16389 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:00.507941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:00.508653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:00.520281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.520743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:00.521592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.522037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:00.566301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:00.578185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00d89eee-4c14-4b8d-91fc-fedc874d3a7e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.673703 Dec 25 21:32:00.579610 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3180/6334] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:31:59 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:00.640650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b8c4b0a2-71cb-4e67-99c7-c1a90b3e93e0 req-588824b9-335c-4174-8599-1815fd19cee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bb28ccd-3dc5-481f-873e-9836f6f1586e", "tag": "dcfdb4d9-b426-41f4-8901-12074cee232d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:00.642373 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:00.642373 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:00.653415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b8c4b0a2-71cb-4e67-99c7-c1a90b3e93e0 req-588824b9-335c-4174-8599-1815fd19cee8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.654102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b8c4b0a2-71cb-4e67-99c7-c1a90b3e93e0 req-588824b9-335c-4174-8599-1815fd19cee8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:00.670706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b8c4b0a2-71cb-4e67-99c7-c1a90b3e93e0 req-588824b9-335c-4174-8599-1815fd19cee8 service nova] Creating event network-changed:dcfdb4d9-b426-41f4-8901-12074cee232d for instance 1bb28ccd-3dc5-481f-873e-9836f6f1586e on nch2-master-1 Dec 25 21:32:00.678196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b8c4b0a2-71cb-4e67-99c7-c1a90b3e93e0 req-588824b9-335c-4174-8599-1815fd19cee8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049483 Dec 25 21:32:00.680065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3181/6335] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:00.919922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:00.921062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:00.929384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.933231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:00.936365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:00.937549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.190936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:01.199143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a83a1cc-8846-43b8-a26e-e356eef79bcd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1270 microversion: 2.1 time: 0.695212 Dec 25 21:32:01.205267 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3155/6336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:00 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1270 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:01.222458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:01.222458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:01.228809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:01.230536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.231604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:01.232251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.289301 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e66f48c-287b-4317-b938-2c9a5d3c712a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.082436 Dec 25 21:32:01.290663 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3156/6337] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:01 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:01.596080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:01.597214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:01.605136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:01.605723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.606548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:01.607164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.666528 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e512142a-530c-4f81-bcca-43aa029b318f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 16389 microversion: 2.20 time: 0.374441 Dec 25 21:32:01.670739 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3157/6338] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:01 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 16389 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:01.680924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:01.682693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:01.697538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:01.700157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.701030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:01.701476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:01.801358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:01.823142 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1ec2493c-672b-4914-9130-a84272a2856f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1169 microversion: 2.1 time: 0.894844 Dec 25 21:32:01.823142 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3182/6339] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:00 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1169 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:02.226556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:02.229752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:02.240103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.240563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.243592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.243592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.256838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:02.281514 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-635497ae-d132-4ab3-9036-cf486832eacc tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.606656 Dec 25 21:32:02.282648 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3158/6340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:01 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:02.307088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:02.308209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:02.327429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.334598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.355608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.355608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.461212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-faba9749-cf0e-4d45-b5a8-9b571e4d9902 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.159890 Dec 25 21:32:02.490308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3159/6341] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:02 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:02.680382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:02.682012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:02.694942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.698751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.698751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.698751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.809277 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-774e943c-c563-4faf-8065-a508da272dbe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.134005 Dec 25 21:32:02.817386 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3160/6342] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:02 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:02.828355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8935018c-e285-4888-aa62-cbf6e893135e req-fe76db48-086b-4732-b23e-abeb99279eac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "145ff3db-fc66-40a9-90da-07251e851506", "tag": "753f318c-7dd3-4858-acc2-c7906120f3ba"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:02.833770 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:02.833770 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:02.868845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8935018c-e285-4888-aa62-cbf6e893135e req-fe76db48-086b-4732-b23e-abeb99279eac service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.874278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8935018c-e285-4888-aa62-cbf6e893135e req-fe76db48-086b-4732-b23e-abeb99279eac service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.906207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8935018c-e285-4888-aa62-cbf6e893135e req-fe76db48-086b-4732-b23e-abeb99279eac service nova] Creating event network-changed:753f318c-7dd3-4858-acc2-c7906120f3ba for instance 145ff3db-fc66-40a9-90da-07251e851506 on nch1-master-1 Dec 25 21:32:02.923448 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8935018c-e285-4888-aa62-cbf6e893135e req-fe76db48-086b-4732-b23e-abeb99279eac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101630 Dec 25 21:32:02.924593 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3161/6343] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:02.929937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:02.930640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:02.968986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.970082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:02.979728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:02.981658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:03.029755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:03.040527 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f5433ac-d4ae-4627-8bdf-2c908b8b58c8 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.822390 Dec 25 21:32:03.051730 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3183/6344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:02 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:03.299974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:03.301040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:03.313626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:03.317377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:03.318557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:03.321618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.019617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:04.033460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d74310d4-e01f-483a-9770-cfc1098a513d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1169 microversion: 2.1 time: 1.107316 Dec 25 21:32:04.035561 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3162/6345] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:02 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1169 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:04.050265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:04.050265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:04.067963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:04.069695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.070990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:04.071826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.147796 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e621d5d3-886d-4ed4-84de-24d697f5725c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.108777 Dec 25 21:32:04.147796 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3163/6346] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:04 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:04.164366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:04.168357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:04.197054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:04.198074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.199096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:04.199963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.252092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7463bce6-4a43-4401-abab-0fd672f8406e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.099550 Dec 25 21:32:04.256436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3164/6347] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:04 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:04.285892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:04.288380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:04.311427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:04.311969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.312811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:04.313856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:04.860683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:04.877553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d09bf32d-53ff-43d9-8faf-feff1d8b1e37 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 1.580188 Dec 25 21:32:04.879152 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3184/6348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:03 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:05.054654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:05.055740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:05.065400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.066245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.067579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.068317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.234410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:05.244275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2abb0c6-d92d-4962-917b-57aab11d2c1f tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.986326 Dec 25 21:32:05.248195 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3165/6349] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:04 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:05.265510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:05.274711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:05.285588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.293727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.294808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.295446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.372788 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d31f18d3-5749-40ce-beda-50f5df4d0401 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.110999 Dec 25 21:32:05.373280 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3166/6350] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:05 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:05.383414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:05.392509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:05.406604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.408321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.420397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.421394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.492420 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ce29da6-0c24-4a9f-828a-c327d0cd4e78 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.113893 Dec 25 21:32:05.494588 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3167/6351] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:05 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:05.897039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:05.899336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:05.911324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:05.911896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.912418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.913508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:05.914361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:05.921318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43df5db1-0935-4f6b-a77b-09480a2ecf88 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1215 microversion: 2.1 time: 0.871939 Dec 25 21:32:05.923260 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3185/6352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:05 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1215 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:06.266568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:06.267449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:06.274474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.275219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.276072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.276498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.409438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:06.421000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5df249eb-d1fe-42c2-9bf9-07d3feb5db58 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.529597 Dec 25 21:32:06.422158 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3168/6353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:05 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:06.435371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:06.444021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:06.460602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.461361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.462199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.464128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.549895 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe9046e4-8d42-4e6c-94f5-655a60e2b52c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.123633 Dec 25 21:32:06.550683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3169/6354] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:06 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:06.562650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:06.566276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:06.587355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.588592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.589834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.590686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.661613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11dcbe5f-2188-4416-9655-2aa8b8500f55 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.109393 Dec 25 21:32:06.662645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3170/6355] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:06 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:06.842782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3d3e083d-9b2b-4a6a-88f8-034a9ee537f0 req-1d914852-fa59-4736-8319-089edc2007a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c61d007c-5265-460b-989f-7006e9caeba7", "tag": "914b055e-69b0-4157-ad7c-92e60fbd5a57"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:06.845049 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:06.845049 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:06.867086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3d3e083d-9b2b-4a6a-88f8-034a9ee537f0 req-1d914852-fa59-4736-8319-089edc2007a6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.867549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3d3e083d-9b2b-4a6a-88f8-034a9ee537f0 req-1d914852-fa59-4736-8319-089edc2007a6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.879888 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3d3e083d-9b2b-4a6a-88f8-034a9ee537f0 req-1d914852-fa59-4736-8319-089edc2007a6 service nova] Creating event network-changed:914b055e-69b0-4157-ad7c-92e60fbd5a57 for instance c61d007c-5265-460b-989f-7006e9caeba7 on nch2-master-1 Dec 25 21:32:06.886496 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3d3e083d-9b2b-4a6a-88f8-034a9ee537f0 req-1d914852-fa59-4736-8319-089edc2007a6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049875 Dec 25 21:32:06.887817 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3171/6356] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:06.941935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:06.943484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:06.952365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.952845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:06.954488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:06.954842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.052293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:07.086256 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7bdec55-1b95-4f1e-85bd-596e6d351402 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.823390 Dec 25 21:32:07.087573 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3186/6357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:06 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:07.445112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:07.449013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:07.451846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:07.472247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-09166451-c8f0-4dbc-bedf-bdcb055f1a8f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1203 microversion: 2.1 time: 0.536245 Dec 25 21:32:07.475125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:07.476381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.478678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:07.486211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.494375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3172/6358] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:06 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1203 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:07.564115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:07.565557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:07.574590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:07.581529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.583871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:07.586264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.686783 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4204f0c3-1532-492f-a1a1-605320b35e8f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.127640 Dec 25 21:32:07.691496 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3173/6359] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:07 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:07.705601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:07.711787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:07.728282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:07.729640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.732573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:07.736048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:07.822911 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ed8d23e-2b35-4569-9ce2-fca21813e289 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.129641 Dec 25 21:32:07.823700 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3174/6360] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:07 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:08.112404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:08.112404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:08.123679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:08.127671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:08.128764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:08.131264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:08.136527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:08.150065 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-103423f4-4df6-40a9-ad65-d81f40713e65 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.714079 Dec 25 21:32:08.151361 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3187/6361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:07 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:08.396309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-00581e9d-f2ab-4cb9-b5ee-3f99dcc2cef7 req-2d86a408-59bd-48b1-8e7e-2bba568c4a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c07b3-3db8-4683-9af2-5dd2d3923ccd", "name": "network-vif-plugged", "status": "completed", "tag": "144f1a3a-207e-4bda-9b5e-951b5824198a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:08.398378 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:08.398378 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:08.415360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-00581e9d-f2ab-4cb9-b5ee-3f99dcc2cef7 req-2d86a408-59bd-48b1-8e7e-2bba568c4a53 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:08.417095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-00581e9d-f2ab-4cb9-b5ee-3f99dcc2cef7 req-2d86a408-59bd-48b1-8e7e-2bba568c4a53 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:08.454383 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-00581e9d-f2ab-4cb9-b5ee-3f99dcc2cef7 req-2d86a408-59bd-48b1-8e7e-2bba568c4a53 service nova] Creating event network-vif-plugged:144f1a3a-207e-4bda-9b5e-951b5824198a for instance 335c07b3-3db8-4683-9af2-5dd2d3923ccd on nch1-master-1 Dec 25 21:32:08.468688 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-00581e9d-f2ab-4cb9-b5ee-3f99dcc2cef7 req-2d86a408-59bd-48b1-8e7e-2bba568c4a53 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076724 Dec 25 21:32:08.469707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3188/6362] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:08.495595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:08.495595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:08.511347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:08.512129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:08.513207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:08.513934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.428077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:09.442193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-add8ff62-7395-4374-9e7e-5f98399b5976 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 1.341947 Dec 25 21:32:09.443118 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3175/6363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:08 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:09.451157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:09.452960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:09.470239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:09.470960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.472040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:09.472754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.517198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:09.528172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aaa094c7-0f4f-4636-8f79-4dc6bc8dfb44 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1203 microversion: 2.1 time: 1.038602 Dec 25 21:32:09.540772 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-76468e14-5465-48f4-8df0-2fac61c23845 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.089274 Dec 25 21:32:09.540772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3176/6364] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:09 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:09.541988 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3189/6365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:08 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1203 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:09.546837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:09.547006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:09.547900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:09.552775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:09.555789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:09.556477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.557487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:09.558291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.574306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:09.575037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.576316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:09.577010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:09.632685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0bcaa66d-0a85-40cb-a3cf-f0ee1aa6a45c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.096845 Dec 25 21:32:09.644226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3177/6366] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:09 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:09.856631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:09.876184 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07708f50-1c25-47b2-8b7d-e7413838671a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1322 microversion: 2.1 time: 0.328022 Dec 25 21:32:09.878775 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3190/6367] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:09 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:10.463839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:10.464569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:10.473057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.473839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:10.475089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.475749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:10.510489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-503946bf-647f-4550-85dc-dcf0d3f2d8ab req-a444468d-8664-4df2-9c8e-83aef8a18083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb28ccd-3dc5-481f-873e-9836f6f1586e", "name": "network-vif-plugged", "status": "completed", "tag": "dcfdb4d9-b426-41f4-8901-12074cee232d"}, {"server_uuid": "67e16f08-7bce-4669-ac08-be4cf324dc04", "name": "network-vif-plugged", "status": "completed", "tag": "0558fb1c-8cdb-4c71-b053-b7bff883ff9b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:10.512623 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:10.512623 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:10.534943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-503946bf-647f-4550-85dc-dcf0d3f2d8ab req-a444468d-8664-4df2-9c8e-83aef8a18083 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.535593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-503946bf-647f-4550-85dc-dcf0d3f2d8ab req-a444468d-8664-4df2-9c8e-83aef8a18083 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:10.567658 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-503946bf-647f-4550-85dc-dcf0d3f2d8ab req-a444468d-8664-4df2-9c8e-83aef8a18083 service nova] Creating event network-vif-plugged:dcfdb4d9-b426-41f4-8901-12074cee232d for instance 1bb28ccd-3dc5-481f-873e-9836f6f1586e on nch2-master-1 Dec 25 21:32:10.570735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-503946bf-647f-4550-85dc-dcf0d3f2d8ab req-a444468d-8664-4df2-9c8e-83aef8a18083 service nova] Creating event network-vif-plugged:0558fb1c-8cdb-4c71-b053-b7bff883ff9b for instance 67e16f08-7bce-4669-ac08-be4cf324dc04 on nch1-master-1 Dec 25 21:32:10.586566 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-503946bf-647f-4550-85dc-dcf0d3f2d8ab req-a444468d-8664-4df2-9c8e-83aef8a18083 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079820 Dec 25 21:32:10.588933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3191/6368] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:10.594010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:10.603248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:10.615747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.616433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:10.617564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.618254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:10.699104 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a17cca6d-c70c-4239-bd21-f29ea43ff0c3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.108237 Dec 25 21:32:10.700531 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3192/6369] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:10 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:10.709363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:10.710388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:10.718580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.719856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:10.720661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:10.721371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.029967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:11.040149 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe980eaa-480d-4b63-86c3-411beb999b83 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.583390 Dec 25 21:32:11.042517 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3178/6370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:10 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:11.057324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:11.058523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:11.067713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.073875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.074904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.075513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.152122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:11.162528 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-363cfe88-2ed7-4ddb-92f1-050a6dd9f8d1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1203 microversion: 2.1 time: 0.459714 Dec 25 21:32:11.165207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3193/6371] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:10 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1203 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:11.168283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:11.169156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:11.178107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.178557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.179355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.179785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.206708 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c903c938-4c8a-4bab-97f2-fa9e4439933c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.155137 Dec 25 21:32:11.208165 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3179/6372] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:11 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:11.435382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:11.443629 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b3b10941-d74d-4fff-8d04-19a784d5a720 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1514 microversion: 2.1 time: 0.279277 Dec 25 21:32:11.444466 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3194/6373] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:11 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:11.461339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:11.462484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:11.471589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.473343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.474386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.475630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.712452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:11.714070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:11.721890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.722346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.723559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:11.724168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:11.727471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:11.738057 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1600219-5b73-4f45-b610-5ee738f5b2fa tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 200 len: 1322 microversion: 2.1 time: 0.281500 Dec 25 21:32:11.738759 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3180/6374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:11 2021] GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:11.770821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c80f77b-9ae7-4e2e-921e-108cc984fc87 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.061886 Dec 25 21:32:11.772810 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3195/6375] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:11 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:12.059273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:12.060114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:12.069828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.070981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.073352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.074602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.184251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:12.185146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:12.194153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.194758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.195680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.196226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.422683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:12.429799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c133a67-0f02-4d44-9209-b8529bf77c8e tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.374201 Dec 25 21:32:12.430592 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3181/6376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:12 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:12.445317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:12.447848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:12.453041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.454253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.455222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.455822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.506157 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-32d9c544-3d2e-4ce7-aa3a-461a2761f77d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.064745 Dec 25 21:32:12.508028 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3182/6377] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:12 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:12.567646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:12.575659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c63a74c-2097-4852-98c2-c30b55febca1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1203 microversion: 2.1 time: 0.397262 Dec 25 21:32:12.588795 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3196/6378] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:12 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1203 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:12.755833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:12.756853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:12.764220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.764944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.766743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.767596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.783354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:12.784919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:12.792950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.793734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.794707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:12.795310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:12.856257 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c3656900-0098-48c5-a271-e91037f7ae7f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.077572 Dec 25 21:32:12.861828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3197/6379] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:12 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:12.968323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:12.976508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52b19727-6b72-406a-ad56-5cbe401a1ba2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 200 len: 1514 microversion: 2.1 time: 0.225082 Dec 25 21:32:12.977132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3183/6380] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:12 2021] GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:12.993162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:12.993871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:13.000899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.001357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.002150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.002593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.158477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:13.167647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db7a8c7c-b155-4944-a951-55832b3f03d5 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 200 len: 1514 microversion: 2.1 time: 0.178568 Dec 25 21:32:13.169936 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3198/6381] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:12 2021] GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:13.190470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:13.190977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:13.197380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.197837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.198631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.199075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.226700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:13.450417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:13.451120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:13.462534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.463010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.463915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.464419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.560248 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-52b1abc0-4109-468c-a5b9-8db5fff506e4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "DELETE /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 204 len: 0 microversion: 2.1 time: 0.371795 Dec 25 21:32:13.561571 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3184/6382] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:13 2021] DELETE /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:13.578364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:13.580404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:13.596105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.599516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.599516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.599516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.646034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:13.655611 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-76ca33c7-78f6-4a3e-b9a0-c8a751a2d504 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.212218 Dec 25 21:32:13.656211 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3199/6383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:13 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:13.661125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:13.661737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:13.668183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.674140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.674278 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afd4fbe9-b41f-4a08-ba96-fa0cc4bce52d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.105525 Dec 25 21:32:13.674382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.674382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.674562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3185/6384] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:13 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:13.683388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:13.684011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:13.696380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.698624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:13.700045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:13.701075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.085510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:14.095383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:14.095613 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fdef3d21-b4d7-44ab-9795-5bb69879d790 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 200 len: 1520 microversion: 2.1 time: 0.437804 Dec 25 21:32:14.096028 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3200/6385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:13 2021] GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 1520 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:14.102212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3c12151f-3e43-4cc5-9d71-4c109afa0e8a req-0ca261b4-b6d8-474a-a032-00245274b666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145ff3db-fc66-40a9-90da-07251e851506", "name": "network-vif-plugged", "status": "completed", "tag": "753f318c-7dd3-4858-acc2-c7906120f3ba"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:14.104309 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:14.104309 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:14.118290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-041b103a-7e05-47e9-904a-704edefc61b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1203 microversion: 2.1 time: 0.439367 Dec 25 21:32:14.118290 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3186/6386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:13 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1203 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:14.122997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:14.124228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:14.130654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.131170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.132042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.132553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.138105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3c12151f-3e43-4cc5-9d71-4c109afa0e8a req-0ca261b4-b6d8-474a-a032-00245274b666 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.138555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3c12151f-3e43-4cc5-9d71-4c109afa0e8a req-0ca261b4-b6d8-474a-a032-00245274b666 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.150991 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3c12151f-3e43-4cc5-9d71-4c109afa0e8a req-0ca261b4-b6d8-474a-a032-00245274b666 service nova] Creating event network-vif-plugged:753f318c-7dd3-4858-acc2-c7906120f3ba for instance 145ff3db-fc66-40a9-90da-07251e851506 on nch1-master-1 Dec 25 21:32:14.155797 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3c12151f-3e43-4cc5-9d71-4c109afa0e8a req-0ca261b4-b6d8-474a-a032-00245274b666 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058680 Dec 25 21:32:14.157299 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3201/6387] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:14.178860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d69704c1-4441-48d3-8093-9abaa7cdea63 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.061253 Dec 25 21:32:14.184271 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3187/6388] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:14 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:14.673016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:14.673889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:14.680898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.681467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.682409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.682932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.684479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:14.686202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:14.705541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.705541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.705541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:14.705541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:14.804082 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53b6da47-d133-48a5-87e8-724d7abc9942 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 24568 microversion: 2.20 time: 0.123336 Dec 25 21:32:14.808634 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3188/6389] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:14 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 24568 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:14.871415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:14.881521 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c30cdf6b-0dab-42f8-8d7f-88bf0938a1c4 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.213097 Dec 25 21:32:14.893124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3202/6390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:14 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:15.118964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:15.121303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:15.134065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:15.136239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:15.141407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.144592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.145615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.148043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.148765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.149425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.154027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.154027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.526287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:15.535968 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ec186f7-7eac-4b69-8857-13055da845bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1203 microversion: 2.1 time: 0.406577 Dec 25 21:32:15.537646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3203/6391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:15 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1203 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:15.542919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:15.544161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:15.551492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.552193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.553034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.553643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.610672 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6859840-87c2-40d1-a124-584c4c26fd8d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.070818 Dec 25 21:32:15.611970 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3204/6392] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:15 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:15.728114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:15.740182 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2143bef0-a43a-452c-b2dc-cd3d876b7458 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 200 len: 1520 microversion: 2.1 time: 0.632204 Dec 25 21:32:15.740777 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3189/6393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:15 2021] GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 1520 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:15.817411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:15.818436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:15.830888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.831369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.832181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.832621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.897780 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b236799a-45da-4b2b-9799-daff40e9c737 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.084866 Dec 25 21:32:15.898842 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3205/6394] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:15 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:15.902935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:15.903857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:15.911409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.912166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:15.913267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:15.913880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.187165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3d5e5568-21ad-4f9c-ae0d-f76e3cbdb897 req-b16ed1ad-2790-4bcc-b4ee-062a2b2312fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c61d007c-5265-460b-989f-7006e9caeba7", "name": "network-vif-plugged", "status": "completed", "tag": "914b055e-69b0-4157-ad7c-92e60fbd5a57"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:16.193201 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:16.193201 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:16.214892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3d5e5568-21ad-4f9c-ae0d-f76e3cbdb897 req-b16ed1ad-2790-4bcc-b4ee-062a2b2312fb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.217172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3d5e5568-21ad-4f9c-ae0d-f76e3cbdb897 req-b16ed1ad-2790-4bcc-b4ee-062a2b2312fb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.234290 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3d5e5568-21ad-4f9c-ae0d-f76e3cbdb897 req-b16ed1ad-2790-4bcc-b4ee-062a2b2312fb service nova] Creating event network-vif-plugged:914b055e-69b0-4157-ad7c-92e60fbd5a57 for instance c61d007c-5265-460b-989f-7006e9caeba7 on nch2-master-1 Dec 25 21:32:16.242429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3d5e5568-21ad-4f9c-ae0d-f76e3cbdb897 req-b16ed1ad-2790-4bcc-b4ee-062a2b2312fb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059680 Dec 25 21:32:16.243397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3206/6395] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:16.554681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:16.555932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:16.563255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.563897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.564711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.565334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.654526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:16.666812 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9fc2e9a-a386-4f93-814a-e47693315cb3 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.771427 Dec 25 21:32:16.668560 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3190/6396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:15 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:16.674891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:16.675911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:16.686250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.687095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.689432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.690074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.777063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e8274e8-edad-4a95-a2a2-16ccc2423478 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.105204 Dec 25 21:32:16.777766 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3191/6397] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:16 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:16.788575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-132f2329-6d01-444f-a733-c88bde8f99b2 req-b97ea631-2917-408a-b91f-80aa77ce3251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e16f08-7bce-4669-ac08-be4cf324dc04", "name": "network-vif-deleted", "tag": "0558fb1c-8cdb-4c71-b053-b7bff883ff9b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:16.790133 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:16.790133 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:16.801036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-132f2329-6d01-444f-a733-c88bde8f99b2 req-b97ea631-2917-408a-b91f-80aa77ce3251 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.806388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-132f2329-6d01-444f-a733-c88bde8f99b2 req-b97ea631-2917-408a-b91f-80aa77ce3251 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.816868 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-132f2329-6d01-444f-a733-c88bde8f99b2 req-b97ea631-2917-408a-b91f-80aa77ce3251 service nova] Creating event network-vif-deleted:0558fb1c-8cdb-4c71-b053-b7bff883ff9b for instance 67e16f08-7bce-4669-ac08-be4cf324dc04 on nch1-master-1 Dec 25 21:32:16.822922 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-132f2329-6d01-444f-a733-c88bde8f99b2 req-b97ea631-2917-408a-b91f-80aa77ce3251 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041717 Dec 25 21:32:16.823736 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3192/6398] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:16.830363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:16.831290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:16.839448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.840281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.841518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.842204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.957891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:16.970415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a48e8fbc-5d0b-4011-9d82-c6ee618ba1bf tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 200 len: 1478 microversion: 2.1 time: 0.145173 Dec 25 21:32:16.971215 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3193/6399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:16 2021] GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 1478 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:16.977532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:16.981953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:16.989624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.990088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:16.990901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:16.991064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:16.991351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.006469 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ac90226-4f2c-4754-bd50-e708047dafee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1391 microversion: 2.1 time: 0.455815 Dec 25 21:32:17.007331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3207/6400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:16 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1391 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:17.024181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:17.030649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:17.043088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.043576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.051761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.052563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.065802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67ce3aab-bf8e-405e-bc47-222dcc3fd5ad tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.093153 Dec 25 21:32:17.066649 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3194/6401] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:16 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:17.310540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:17.319332 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18502283-2ce7-4c54-aa92-1e5e30af0ed2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1391 microversion: 2.1 time: 0.299342 Dec 25 21:32:17.327924 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3208/6402] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:17 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:17.337160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:17.337948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:17.345469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.345973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.346785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.347208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.524781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:17.532797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3da45c9c-a8b2-499a-9a2b-b4be46416764 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1391 microversion: 2.1 time: 0.199963 Dec 25 21:32:17.534138 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3195/6403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:17 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:17.622656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:17.623318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:17.640966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.641677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.643560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.644176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.685017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:17.685646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:17.691372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:17.702648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.705207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.707631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.708106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.903329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:17.921211 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e0918b55-4af4-485e-a35b-87abfad51e5d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1312 microversion: 2.1 time: 0.240098 Dec 25 21:32:17.923300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3196/6404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:17 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:17.928849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:17.930351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:17.937398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.938158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:17.939039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:17.939482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.009347 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e10b425-36a0-4038-ad7c-0cc3cbb5d975 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.084448 Dec 25 21:32:18.010018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3197/6405] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:17 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:18.015810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.016953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:18.024480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.024960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.025761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.026197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.057271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] HTTP exception thrown: Instance 67e16f08-7bce-4669-ac08-be4cf324dc04 could not be found. Dec 25 21:32:18.059238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 404 to user: Instance 67e16f08-7bce-4669-ac08-be4cf324dc04 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:18.060303 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-074e79da-432f-4458-8d3d-3f3eafe84d8e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 404 len: 111 microversion: 2.1 time: 0.048849 Dec 25 21:32:18.060942 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3198/6406] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:18.074310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.077412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98a39ba4-d012-4b2f-b39a-c8af532c8d35 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 204 len: 0 microversion: 2.1 time: 0.457916 Dec 25 21:32:18.085872 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3209/6407] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:17 2021] DELETE /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:18.088057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:18.090764 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:18.090764 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:18.092365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.093576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:18.094450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:18.101602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.101969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.102129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.102426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.103232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.103464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.103669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.104067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.152089 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fcd87e6-74d9-4ad3-a0c2-981a7034fa35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.070662 Dec 25 21:32:18.152886 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3210/6408] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:18 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:18.159107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.160071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:18.167077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.167521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.168478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.168946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.188688 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-471d4b68-8ad4-49c5-8806-cdfca274b779 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.122714 Dec 25 21:32:18.195842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3199/6409] 10.222.0.32 () {58 vars in 1229 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:32:18.201043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3639f8a-8703-4b59-be99-16d36e371575 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.202399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3639f8a-8703-4b59-be99-16d36e371575 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:18.203747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3639f8a-8703-4b59-be99-16d36e371575 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.005865 Dec 25 21:32:18.208584 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3200/6410] 10.222.0.32 () {58 vars in 1181 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:32:18.213544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.217573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.218264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:18.225442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.226008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.226704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.227144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.256371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:32:18.304514 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22a8fc6c-313b-4851-9ae9-6813fe519ce3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.094823 Dec 25 21:32:18.305541 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3201/6411] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers => generated 681 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:18.317993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.323371 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:18.323371 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:18.325732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.326201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.servers [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Removing options 'limit' from query {{(pid=136547) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1474}} Dec 25 21:32:18.326941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:18.337418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.337956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.338590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.339033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.347736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.356473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2c944166-811a-4bf6-8b99-328b3baf4268 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1397 microversion: 2.1 time: 0.202122 Dec 25 21:32:18.357356 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3211/6412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1397 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:18.373462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.multi_cell_list [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=136547) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:32:18.419898 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b7bf3a4-23e3-4a66-ba5a-d384ee5e23e3 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.107082 Dec 25 21:32:18.426506 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3202/6413] 10.222.0.32 () {58 vars in 1143 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:18.433778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-112507f5-b1e8-4793-9a76-5eeb58eb9595 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.435141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-112507f5-b1e8-4793-9a76-5eeb58eb9595 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:18.436201 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-112507f5-b1e8-4793-9a76-5eeb58eb9595 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.008390 Dec 25 21:32:18.436830 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3212/6414] 10.222.0.32 () {58 vars in 1141 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:32:18.459427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66a052e2-2e57-40ac-9371-0a04872098b1 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.459427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66a052e2-2e57-40ac-9371-0a04872098b1 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:18.459427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66a052e2-2e57-40ac-9371-0a04872098b1 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.016155 Dec 25 21:32:18.459427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3203/6415] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:32:18.469353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bddcfce0-6402-428a-9557-6a39750bec5a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.475441 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:18.475441 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:18.477235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bddcfce0-6402-428a-9557-6a39750bec5a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.478013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bddcfce0-6402-428a-9557-6a39750bec5a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:18.487861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.servers [None req-bddcfce0-6402-428a-9557-6a39750bec5a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Flavor 'non_existing_flavor' could not be found {{(pid=136548) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:337}} Dec 25 21:32:18.490498 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bddcfce0-6402-428a-9557-6a39750bec5a tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.026143 Dec 25 21:32:18.491097 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3213/6416] 10.222.0.32 () {58 vars in 1177 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:32:18.503849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.507219 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:18.507219 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:18.509684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.509684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136547) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:18.798690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.799317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.800125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.800579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.886664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b114fa51-504d-4328-9f89-512907c43774 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.386818 Dec 25 21:32:18.889004 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3204/6417] 10.222.0.32 () {58 vars in 1173 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:32:18.899080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.903493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:18.904167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:18.910671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.911473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.911948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.912392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.940704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:18.942627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:18.971519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.971995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:18.972959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:18.973615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.025769 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c8611e2-e2d8-42e2-8d1e-789c77f05e4b tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.128917 Dec 25 21:32:19.025769 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3214/6418] 10.222.0.32 () {58 vars in 1183 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:32:19.034823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:19.035761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:19.047154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.051983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.051983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.051983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.096306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4f1f684-d738-4307-a87e-43a07ccd38b8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.069955 Dec 25 21:32:19.099869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3215/6419] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:19 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:19.104441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:19.111066 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:19.111066 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:19.112290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:19.113110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:19.119782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.120241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.126905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.126905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.156905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:32:19.220004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:19.230247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.230935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.245071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:19.256903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fad86b81-509f-489e-b390-5cff89ae8b6b tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1496 microversion: 2.1 time: 0.321169 Dec 25 21:32:19.257830 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3205/6420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:18 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1496 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:19.262438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:19.263357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:19.282985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.283450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.284393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.284752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.362681 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fdac0f28-2332-4d44-9ffd-78e25e37ff73 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.103457 Dec 25 21:32:19.363869 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3206/6421] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:19 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:19.375373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:19.376685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:19.401148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.401758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.402596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.403328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.576789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc1dec56-c99b-442d-bef6-64360721bddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 0.478408 Dec 25 21:32:19.577456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3216/6422] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:32:19 2021] GET /compute/v2.1/servers/detail => generated 3021 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:19.596963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72ec66cf-470d-41e3-bb4f-37bc33b1771e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:19.600376 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:19.600376 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:19.601514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-72ec66cf-470d-41e3-bb4f-37bc33b1771e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:19.602583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72ec66cf-470d-41e3-bb4f-37bc33b1771e tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.009640 Dec 25 21:32:19.603113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3217/6423] 10.222.0.32 () {58 vars in 1177 bytes} [Sat Dec 25 21:32:19 2021] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 21:32:19.615618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:19.620274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:19.621022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Searching by: {'deleted': False, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 21:32:19.626872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:19.627831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.628230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.629167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.629612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.635866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d635a63e-28b0-43df-beac-e87d94698bde tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1397 microversion: 2.1 time: 0.265517 Dec 25 21:32:19.636555 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3207/6424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:19 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1397 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:19.658129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 21:32:19.692525 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b240e911-f4c8-4d83-a039-98f1a9a08e83 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.080354 Dec 25 21:32:19.693197 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3218/6425] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 21:32:19 2021] GET /compute/v2.1/servers => generated 681 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:19.704290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:19.704862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:19.711531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.711987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.712780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.713278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.727424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] HTTP exception thrown: Instance 67e16f08-7bce-4669-ac08-be4cf324dc04 could not be found. Dec 25 21:32:19.728023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 404 to user: Instance 67e16f08-7bce-4669-ac08-be4cf324dc04 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:19.728891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47ccc87f-50c2-4ea4-a4b0-135bdfe8d7b6 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "DELETE /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 404 len: 111 microversion: 2.1 time: 0.028468 Dec 25 21:32:19.729474 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3208/6426] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:19 2021] DELETE /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:32:19.738584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:19.739259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:19.745585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.746036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.746820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:19.747256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:19.773319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:20.111759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:20.124428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.137519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.137942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.138759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.139316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.191413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-714cb164-28f8-4730-a177-955e94e6a632 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.083141 Dec 25 21:32:20.198041 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3209/6427] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:20 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:20.282980 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc325954-2a2b-49d8-b355-1c951f328735 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 204 len: 0 microversion: 2.1 time: 0.548310 Dec 25 21:32:20.284169 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3219/6428] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:19 2021] DELETE /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:32:20.300520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:20.301142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.309963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.310240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.312144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.313332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.350054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:20.383947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:20.385685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.402786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.403608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.405243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.406098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.480715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c71f95c-776a-4eb3-b238-21dd1a8a6edd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.109756 Dec 25 21:32:20.482237 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3220/6429] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:20 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:20.507789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2b15a588-ebea-4498-8560-9697e8a26df9 req-2a451294-adf3-4241-afa3-12ed4213880f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "145ff3db-fc66-40a9-90da-07251e851506", "name": "network-vif-deleted", "tag": "753f318c-7dd3-4858-acc2-c7906120f3ba"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:20.509307 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:20.509307 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:20.522234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2b15a588-ebea-4498-8560-9697e8a26df9 req-2a451294-adf3-4241-afa3-12ed4213880f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.527146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2b15a588-ebea-4498-8560-9697e8a26df9 req-2a451294-adf3-4241-afa3-12ed4213880f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.535590 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2b15a588-ebea-4498-8560-9697e8a26df9 req-2a451294-adf3-4241-afa3-12ed4213880f service nova] Creating event network-vif-deleted:753f318c-7dd3-4858-acc2-c7906120f3ba for instance 145ff3db-fc66-40a9-90da-07251e851506 on nch1-master-1 Dec 25 21:32:20.540705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2b15a588-ebea-4498-8560-9697e8a26df9 req-2a451294-adf3-4241-afa3-12ed4213880f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036981 Dec 25 21:32:20.541347 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3221/6430] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:20.656859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:20.664614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.676152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.679531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.681286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.682769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.768646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-722972cd-f835-457b-b43d-ac1bf0ab8a66 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "DELETE /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 204 len: 0 microversion: 2.1 time: 0.472388 Dec 25 21:32:20.773114 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3210/6431] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:20 2021] DELETE /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 0 bytes in 474 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:20.776136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:20.777182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.778414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:20.785234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.785942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.786928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.787522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.787645 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ff5a5e1-6cd4-4dfd-a448-877d591820bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1188 microversion: 2.1 time: 0.136298 Dec 25 21:32:20.796447 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3222/6432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:20 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1188 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:20.796447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:20.796447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 67e16f08-7bce-4669-ac08-be4cf324dc04] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.799709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.800273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.801065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.801503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.815073 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] HTTP exception thrown: Instance 67e16f08-7bce-4669-ac08-be4cf324dc04 could not be found. Dec 25 21:32:20.815700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 404 to user: Instance 67e16f08-7bce-4669-ac08-be4cf324dc04 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:20.816532 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f4beb527-ffb2-4b43-adb3-9f52573991f4 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04" status: 404 len: 111 microversion: 2.1 time: 0.027422 Dec 25 21:32:20.817120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3223/6433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:20 2021] GET /compute/v2.1/servers/67e16f08-7bce-4669-ac08-be4cf324dc04 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:20.824663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:20.825420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:20.825981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:20.831577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.832104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.837146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:20.838158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:20.999392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:21.007444 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9fa425c-95b9-4109-a721-9f7bf0bd0708 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 200 len: 1520 microversion: 2.1 time: 0.186159 Dec 25 21:32:21.008075 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3224/6434] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:20 2021] GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:21.152282 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7b817a2-3139-40c1-ad5b-b66d32a395b5 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 204 len: 0 microversion: 2.1 time: 0.381346 Dec 25 21:32:21.156005 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3211/6435] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:20 2021] DELETE /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:21.164434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:21.165081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:21.185427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.186222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.187148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.187582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.215095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:21.215095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:21.225599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.226072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.226887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.227328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.289496 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9ef89496-806a-4306-a011-a149a65798af tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.080962 Dec 25 21:32:21.291441 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3212/6436] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:21 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:21.382760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:21.390164 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b98f699e-5ab3-4aa0-b440-6ea0a5017d94 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1502 microversion: 2.1 time: 0.230795 Dec 25 21:32:21.391296 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3225/6437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:21 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1502 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:21.493294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:21.494313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:21.501446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.501845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.502637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.503079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.548502 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03f84501-e612-4b7d-bf26-9618c80647f2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.059176 Dec 25 21:32:21.549603 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3213/6438] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:21 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:21.805364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:21.806571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:21.820063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.820063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.820063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.820063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.850760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:21.851213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:21.851854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lazy-loading 'fault' on Instance uuid 145ff3db-fc66-40a9-90da-07251e851506 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:32:21.926052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:21.935158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33075b6f-9e5c-4c8a-9b00-4452a2653173 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 200 len: 1193 microversion: 2.1 time: 0.133712 Dec 25 21:32:21.939397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3226/6439] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:21 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 1193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:22.025440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:22.025967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:22.034168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:22.034647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:22.035644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:22.036434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:22.110711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-528870882", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "e05170f8-cab4-47d7-8b02-4aaf3c659560"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:22.188284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] validate_networks() for [('e05170f8-cab4-47d7-8b02-4aaf3c659560', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:32:22.458636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:22.467821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01fc3540-822a-4baf-90d5-ce8b925a6b71 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 200 len: 1520 microversion: 2.1 time: 0.446835 Dec 25 21:32:22.468935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3227/6440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:22 2021] GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 1520 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:22.482272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:22.483259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:22.489852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:22.490626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:22.491600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:22.492216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:22.536360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a7e5d00-4232-408b-afac-38eaca0441f4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.064996 Dec 25 21:32:22.537320 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3228/6441] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:22 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:22.542445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:22.543145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:22.551225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:22.551863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:22.552847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:22.554468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.135677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:23.145446 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c23ecee-a0c7-49e0-8a20-e5a72bc49322 tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1502 microversion: 2.1 time: 0.606775 Dec 25 21:32:23.146246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3229/6442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:22 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1502 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:23.161802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:23.161802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:23.161802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.161802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.161802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.161802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.210317 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75c25c0e-128d-4ac0-b422-280dad25c1cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.062178 Dec 25 21:32:23.211679 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3230/6443] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:23 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:23.218067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:23.219623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:23.230703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.231466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.232617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.233329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.253318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 145ff3db-fc66-40a9-90da-07251e851506 could not be found. Dec 25 21:32:23.254270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 145ff3db-fc66-40a9-90da-07251e851506 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:23.255699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-91d5164b-4873-495e-9625-2b105c3144fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 404 len: 111 microversion: 2.1 time: 0.042775 Dec 25 21:32:23.257238 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3231/6444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:23 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:23.274369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0fb3771c-7fda-4650-b544-0ef13eab2a24 req-5d8aa490-9248-4d89-8186-4727092c3667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bb28ccd-3dc5-481f-873e-9836f6f1586e", "name": "network-vif-deleted", "tag": "dcfdb4d9-b426-41f4-8901-12074cee232d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:23.274369 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:23.274369 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:23.285531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0fb3771c-7fda-4650-b544-0ef13eab2a24 req-5d8aa490-9248-4d89-8186-4727092c3667 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.286301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0fb3771c-7fda-4650-b544-0ef13eab2a24 req-5d8aa490-9248-4d89-8186-4727092c3667 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.303545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0fb3771c-7fda-4650-b544-0ef13eab2a24 req-5d8aa490-9248-4d89-8186-4727092c3667 service nova] Creating event network-vif-deleted:dcfdb4d9-b426-41f4-8901-12074cee232d for instance 1bb28ccd-3dc5-481f-873e-9836f6f1586e on nch2-master-1 Dec 25 21:32:23.309273 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0fb3771c-7fda-4650-b544-0ef13eab2a24 req-5d8aa490-9248-4d89-8186-4727092c3667 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046623 Dec 25 21:32:23.310196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3232/6445] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:23.320327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:32:23.330114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:32:23.330114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:32:23.330114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:32:23.330114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:32:23.336691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.337235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.346475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.346937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.377641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Getting quotas for project 71418288426545dea311f347bd0cbfdb. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:23.383518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Getting quotas for user f2237f90a5db4203805e0a7f287f0964 and project 71418288426545dea311f347bd0cbfdb. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:23.400359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:32:23.402918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:32:23.488122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:23.489283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:23.497039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.497686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.498499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.499082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.537819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.538279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.538732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lazy-loading 'fault' on Instance uuid 1bb28ccd-3dc5-481f-873e-9836f6f1586e {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:32:23.576652 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7233627c-50a7-4a27-bf19-ffd3ab8c2610 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.661233 Dec 25 21:32:23.585328 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3214/6446] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:21 2021] POST /compute/v2.1/servers => generated 380 bytes in 1671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:32:23.611618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:23.611618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:23.616526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.617293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.618310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:23.618913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:23.678499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-510b992f-fd5a-471d-99e9-1df59f6df9dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.089984 Dec 25 21:32:23.683804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3215/6447] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:23 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:23.694398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-546722f8-fe19-4e1f-8100-8be664c10321 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:23.695464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-546722f8-fe19-4e1f-8100-8be664c10321 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:23.930249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-546722f8-fe19-4e1f-8100-8be664c10321 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:23.942888 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-546722f8-fe19-4e1f-8100-8be664c10321 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1213 microversion: 2.1 time: 0.256820 Dec 25 21:32:23.944293 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3216/6448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:23 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1213 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:23.955225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:23.969152 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-602e3113-38d1-41a5-aaf0-fcaa6b6b8653 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 200 len: 1312 microversion: 2.1 time: 0.486523 Dec 25 21:32:23.979908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3233/6449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:23 2021] GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 1312 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:24.163080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:24.163700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:24.172370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.172832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.173688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.174108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.224335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:24.224335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:24.232277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.232738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.233583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.234563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.292275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c78a481f-badc-4e33-92fa-69e5c3b0dc7a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.073269 Dec 25 21:32:24.293021 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3234/6450] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:24 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:24.309057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0af5c61e37b747608ee6af2f8f75f412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ece5e5ef72d4614b89456ee37fe94f3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:24.316581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e20c258f-8637-4024-8074-2b3a7928b73d tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 200 len: 1460 microversion: 2.1 time: 0.157329 Dec 25 21:32:24.317188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3217/6451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:24 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 1460 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:24.692269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:24.693491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:24.701669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.702641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.704157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.704961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.752191 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d33e2a27-3572-40a9-b11c-6a5ba7ecf0f5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.064471 Dec 25 21:32:24.753182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3235/6452] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:24 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:24.967878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:24.968505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:24.975310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.975925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.976737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.977221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.987678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:24.988374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 1bb28ccd-3dc5-481f-873e-9836f6f1586e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:24.995893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.996383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:24.997512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:24.997660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.013517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] HTTP exception thrown: Instance 1bb28ccd-3dc5-481f-873e-9836f6f1586e could not be found. Dec 25 21:32:25.014122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 404 to user: Instance 1bb28ccd-3dc5-481f-873e-9836f6f1586e could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:25.014951 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7bf85ed-442c-4dbf-a457-61b0293901e2 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e" status: 404 len: 111 microversion: 2.1 time: 0.031984 Dec 25 21:32:25.015556 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3236/6453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:24 2021] GET /compute/v2.1/servers/1bb28ccd-3dc5-481f-873e-9836f6f1586e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:32:25.023472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:25.024086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:25.030622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.031103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.031905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.032345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.054798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:25.063095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12b0c656-29d7-46a2-9ef8-fe2eae3448ae tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1217 microversion: 2.1 time: 0.100987 Dec 25 21:32:25.063878 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3218/6454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:24 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1217 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:25.069327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.069779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.070233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lazy-loading 'fault' on Instance uuid 335c07b3-3db8-4683-9af2-5dd2d3923ccd {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:32:25.110217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54abf7f90439451081ee3b38676b6b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3625a8207df4cb0a4da19210ca5c80c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:25.120597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d0468324-a0e6-4a58-80e1-9ed2bf796339 tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 200 len: 1312 microversion: 2.1 time: 0.097926 Dec 25 21:32:25.120597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3237/6455] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:25 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:25.307733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:25.308831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:25.316027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.316563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.317542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.318068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.332033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b1aa9642-f55f-4f17-80fc-21d679c85a19 req-3b4c4698-5f9d-4978-bf43-a781f151e727 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c07b3-3db8-4683-9af2-5dd2d3923ccd", "name": "network-vif-deleted", "tag": "144f1a3a-207e-4bda-9b5e-951b5824198a"}, {"server_uuid": "c61d007c-5265-460b-989f-7006e9caeba7", "name": "network-vif-deleted", "tag": "914b055e-69b0-4157-ad7c-92e60fbd5a57"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:25.333774 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:25.333774 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:25.344944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b1aa9642-f55f-4f17-80fc-21d679c85a19 req-3b4c4698-5f9d-4978-bf43-a781f151e727 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.345402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b1aa9642-f55f-4f17-80fc-21d679c85a19 req-3b4c4698-5f9d-4978-bf43-a781f151e727 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.358234 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b1aa9642-f55f-4f17-80fc-21d679c85a19 req-3b4c4698-5f9d-4978-bf43-a781f151e727 service nova] Creating event network-vif-deleted:144f1a3a-207e-4bda-9b5e-951b5824198a for instance 335c07b3-3db8-4683-9af2-5dd2d3923ccd on nch1-master-1 Dec 25 21:32:25.362555 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b1aa9642-f55f-4f17-80fc-21d679c85a19 req-3b4c4698-5f9d-4978-bf43-a781f151e727 service nova] Creating event network-vif-deleted:914b055e-69b0-4157-ad7c-92e60fbd5a57 for instance c61d007c-5265-460b-989f-7006e9caeba7 on nch2-master-1 Dec 25 21:32:25.366851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b1aa9642-f55f-4f17-80fc-21d679c85a19 req-3b4c4698-5f9d-4978-bf43-a781f151e727 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039057 Dec 25 21:32:25.367680 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3238/6456] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:25 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:25.370148 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-565943d5-07f1-45e2-8123-ecc72a017054 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.066067 Dec 25 21:32:25.370740 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3219/6457] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:25 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:25.376853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:25.377577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] [instance: c61d007c-5265-460b-989f-7006e9caeba7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:25.383806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.384266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.385113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.385566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.399738 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] HTTP exception thrown: Instance c61d007c-5265-460b-989f-7006e9caeba7 could not be found. Dec 25 21:32:25.400339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] Returning 404 to user: Instance c61d007c-5265-460b-989f-7006e9caeba7 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:25.401261 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1dfcddcb-0c5d-4b7a-b99e-7b89887abdbd tempest-VolumesActionsTest-1540518602 tempest-VolumesActionsTest-1540518602-project] 10.222.0.32 "GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7" status: 404 len: 111 microversion: 2.1 time: 0.032242 Dec 25 21:32:25.401856 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3239/6458] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:25 2021] GET /compute/v2.1/servers/c61d007c-5265-460b-989f-7006e9caeba7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:25.764299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:25.765835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:25.773203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.773669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.774464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:25.775048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:25.817854 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53f2d73e-489e-4ee8-8bbc-caf9ba8aa836 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057730 Dec 25 21:32:25.819539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3220/6459] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:25 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:26.084862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:26.085661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:26.093511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.094165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.095120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.096618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.135454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:26.137084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] [instance: 335c07b3-3db8-4683-9af2-5dd2d3923ccd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:26.145347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.145952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.147044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.147705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.162978 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] HTTP exception thrown: Instance 335c07b3-3db8-4683-9af2-5dd2d3923ccd could not be found. Dec 25 21:32:26.163588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] Returning 404 to user: Instance 335c07b3-3db8-4683-9af2-5dd2d3923ccd could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:26.164690 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ce1bb93-b904-42d0-ab72-de04914a2ddd tempest-ListServersNegativeTestJSON-1535126760 tempest-ListServersNegativeTestJSON-1535126760-project] 10.222.0.32 "GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd" status: 404 len: 111 microversion: 2.1 time: 0.033394 Dec 25 21:32:26.165507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3221/6460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:26 2021] GET /compute/v2.1/servers/335c07b3-3db8-4683-9af2-5dd2d3923ccd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:32:26.171614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:26.179124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89dec87e-164e-46c4-8ef3-553585281d9c tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1265 microversion: 2.1 time: 0.102736 Dec 25 21:32:26.180146 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3240/6461] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:26 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:26.381909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:26.382848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:26.389845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.390849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.392182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.392360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.463865 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae1439db-098f-4951-859f-5c6931d3224e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.085654 Dec 25 21:32:26.474884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3222/6462] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:26 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:26.831175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:26.832853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:26.840671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.841434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.842414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:26.843008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:26.913084 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f85b6f30-6e01-414b-838b-c787ffcb2b9f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.087587 Dec 25 21:32:26.914902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3241/6463] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:26 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:27.197252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:27.198144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:27.205753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:27.206212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:27.207015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:27.207699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:27.484989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:27.488907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:27.505257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:27.505712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:27.508273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:27.508741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:27.554943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:27.573174 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b79a270-8458-487f-a016-92a857df5084 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.379754 Dec 25 21:32:27.574544 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3223/6464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:27 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:27.599419 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-028c8634-bd66-44a2-9e58-cfbbfd533a68 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.120441 Dec 25 21:32:27.600144 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3242/6465] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:27 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:27.925710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:27.927136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:27.935759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:27.944241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:27.944241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:27.944241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:27.985296 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51de6df0-679d-4144-986e-cdb1013e2b4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.063432 Dec 25 21:32:27.988911 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3224/6466] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:27 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:28.595481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:28.598370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:28.614365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:28.615518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:28.617658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:28.618494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:28.621036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:28.623516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:28.631416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:28.636334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:28.638035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:28.642748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:28.714574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5577e91-22c8-40b1-aa18-1a109b2184e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.105052 Dec 25 21:32:28.715977 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3225/6467] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:28 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:28.722693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-252ac461-7559-45f3-9363-e63d14e86f6b req-9642f2e8-a28d-4dc3-a029-43767cffecfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3f4646-839b-4b87-b6eb-ac1157f96783", "tag": "cc6826c8-cc22-4431-ab7c-6807f8a89b79"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:28.739068 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:28.739068 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:28.755981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-252ac461-7559-45f3-9363-e63d14e86f6b req-9642f2e8-a28d-4dc3-a029-43767cffecfe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:28.758720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-252ac461-7559-45f3-9363-e63d14e86f6b req-9642f2e8-a28d-4dc3-a029-43767cffecfe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:28.786052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-252ac461-7559-45f3-9363-e63d14e86f6b req-9642f2e8-a28d-4dc3-a029-43767cffecfe service nova] Creating event network-changed:cc6826c8-cc22-4431-ab7c-6807f8a89b79 for instance aa3f4646-839b-4b87-b6eb-ac1157f96783 on nch1-master-1 Dec 25 21:32:28.795177 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-252ac461-7559-45f3-9363-e63d14e86f6b req-9642f2e8-a28d-4dc3-a029-43767cffecfe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077140 Dec 25 21:32:28.795809 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3226/6468] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:28.998275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:28.999371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:29.016015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:29.022827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:29.024860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:29.028382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:29.087086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:29.095500 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-627bac1f-1ae0-4bfc-9d23-343c0542d9a3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.506935 Dec 25 21:32:29.096100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3243/6469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:28 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:29.122339 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4ae09be-bcf8-404e-985d-503e13e82cb5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.128744 Dec 25 21:32:29.123852 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3227/6470] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:28 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:29.739301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:29.741989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:29.752967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:29.753757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:29.754811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:29.755477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:29.821413 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-753b23f2-0e53-472b-9c2b-5fc48fd560fd tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.095373 Dec 25 21:32:29.822360 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3244/6471] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:29 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:30.116950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:30.118055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:30.146696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.148681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:30.153532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.154074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.160133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.161879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.171760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.178539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.179517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.182652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.277647 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de388d87-d2f5-48ba-b5eb-51d96b74e79b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.142096 Dec 25 21:32:30.281151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3245/6472] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:30.412258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:30.420891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-835f61ca-2558-4aa8-a0d7-0938db7af63e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.309428 Dec 25 21:32:30.422773 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3228/6473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:30 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:30.479642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9360cdaf-6766-4e13-a887-7e373d523ce9 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1198148550", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.482405 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9360cdaf-6766-4e13-a887-7e373d523ce9 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] HTTP exception thrown: min_count must be <= max_count Dec 25 21:32:30.482973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9360cdaf-6766-4e13-a887-7e373d523ce9 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Returning 400 to user: min_count must be <= max_count {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.483978 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9360cdaf-6766-4e13-a887-7e373d523ce9 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.201485 Dec 25 21:32:30.484544 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3246/6474] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers => generated 74 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Dec 25 21:32:30.552961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b04e6f4e-653d-4401-b338-408c68aa8217 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-308089445", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "max_count": 0}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.555036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b04e6f4e-653d-4401-b338-408c68aa8217 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.556208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b04e6f4e-653d-4401-b338-408c68aa8217 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007823 Dec 25 21:32:30.556991 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3229/6475] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:32:30.632479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd562fe1-0a81-437c-9351-b409d6848f46 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-866268981", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "max_count": 2.5}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.634585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd562fe1-0a81-437c-9351-b409d6848f46 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.635772 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd562fe1-0a81-437c-9351-b409d6848f46 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009217 Dec 25 21:32:30.637049 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3247/6476] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers => generated 139 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:32:30.710632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78c8e6da-a773-4607-82fc-453083b88098 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-736610158", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 0}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.713213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-78c8e6da-a773-4607-82fc-453083b88098 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.715366 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-78c8e6da-a773-4607-82fc-453083b88098 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009932 Dec 25 21:32:30.716841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3230/6477] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers => generated 130 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:32:30.792052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43261a95-544a-4ab4-baec-2e9027c41472 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1586693211", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "min_count": 2.5}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.793640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:30.794211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:30.794650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43261a95-544a-4ab4-baec-2e9027c41472 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.795693 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43261a95-544a-4ab4-baec-2e9027c41472 tempest-MultipleCreateNegativeTestJSON-2121596958 tempest-MultipleCreateNegativeTestJSON-2121596958-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.012306 Dec 25 21:32:30.797597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3248/6478] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:32:30.802293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.802804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.803608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.812696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.832205 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 145ff3db-fc66-40a9-90da-07251e851506 could not be found. Dec 25 21:32:30.833130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 145ff3db-fc66-40a9-90da-07251e851506 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.834158 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1784b18-a0e7-4907-88ad-9c782f143f0f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 404 len: 111 microversion: 2.1 time: 0.049012 Dec 25 21:32:30.834486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:30.835421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3231/6479] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:30 2021] DELETE /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:32:30.835876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:30.845075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:30.848321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 145ff3db-fc66-40a9-90da-07251e851506] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:30.852365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.852827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.853689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.854193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.862299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.862759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.863561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:30.863998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:30.885699 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 145ff3db-fc66-40a9-90da-07251e851506 could not be found. Dec 25 21:32:30.889560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 145ff3db-fc66-40a9-90da-07251e851506 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:30.892721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-148e0b8f-ef19-43ea-85b2-f4016287b134 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506" status: 404 len: 111 microversion: 2.1 time: 0.052421 Dec 25 21:32:30.898375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3232/6480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:30 2021] GET /compute/v2.1/servers/145ff3db-fc66-40a9-90da-07251e851506 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:30.946076 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d75dc217-ff53-43d8-a255-08d6389c999a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.116089 Dec 25 21:32:30.955247 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3249/6481] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:30 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:31.293893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:31.297809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:31.309695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:31.310720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:31.311547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:31.312960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:31.386875 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a92d1f90-f5cd-444e-ba3b-1fb6b1b66c08 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.098938 Dec 25 21:32:31.392287 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3233/6482] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:31 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:31.439083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:31.439779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:31.449762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:31.450222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:31.451313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:31.451759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:31.709762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:31.717460 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac11f32c-c6bc-414e-8abd-dd8076fb0a41 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.282985 Dec 25 21:32:31.727400 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3250/6483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:31 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:31.971925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:31.992050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:32.015936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:32.017475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:32.018793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:32.019395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:32.077843 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-339b30ba-dca5-4ee9-ac39-0b4ab38c0107 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.122635 Dec 25 21:32:32.078500 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3234/6484] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:31 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:32.399924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:32.401207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:32.408986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:32.409768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:32.411151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:32.411756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:32.485698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54662885-b0cc-475a-8c7b-0faee0017547 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.089159 Dec 25 21:32:32.487538 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3251/6485] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:32 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:32.736645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:32.737865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:32.752009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:32.752768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:32.753612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:32.754129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:32.911344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:32.919369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a481abef-febc-49e3-a8a1-0cb894cb8b06 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.187494 Dec 25 21:32:32.920016 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3235/6486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:32 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:33.091981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:33.093096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:33.100348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:33.100911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:33.101764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:33.102259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:33.144207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a21d41e-0739-42e7-adb9-7a723e58256c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.056282 Dec 25 21:32:33.144869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3252/6487] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:33 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:33.498640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:33.501274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:33.512272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:33.513466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:33.517650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:33.519836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:33.662571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e20834c5-aa15-4c29-9ad5-98a3d0dea09a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.166687 Dec 25 21:32:33.665650 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3236/6488] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:33 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:33.940201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:33.941033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:33.965490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:33.967207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:33.973578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:33.983489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:34.156309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:34.158026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:34.178282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:34.178838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:34.179666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:34.180348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:34.250796 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-645faa09-ca70-4c30-a922-ceb54351df99 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.098542 Dec 25 21:32:34.252071 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3237/6489] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:34 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:34.300845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:34.331689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a4ed7d6c-64d5-4192-9c02-f85501ed7c45 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.396501 Dec 25 21:32:34.345592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3253/6490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:33 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:34.678494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:34.679569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:34.692487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:34.697879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:34.701457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:34.706244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:34.759817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81b1e841-f998-4e2c-a519-e85aa6900c23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.084538 Dec 25 21:32:34.761718 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3238/6491] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:34 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:35.263673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:35.265341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:35.302038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:35.304723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:35.307365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:35.308574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:35.368574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:35.370400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:35.387900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:35.401977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:35.407926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:35.408782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:35.417179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8585100-956a-4246-93fe-498516a2e2ac tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.157670 Dec 25 21:32:35.418636 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3254/6492] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:35 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:35.782288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:35.784860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:35.805721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:35.809948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:35.813105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:35.814690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:35.925359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:35.944699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea19b7dd-cc5c-45af-b4cb-d490df1fe812 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.167279 Dec 25 21:32:35.951286 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3255/6493] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:35 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:35.952256 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a9a90cc1-2fcf-41f4-846b-14511352eb9e tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.588107 Dec 25 21:32:35.954095 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3239/6494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:35 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:36.118797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-37624f3a-82c9-433e-8268-89d74587a90a req-613fdc09-7180-4b18-9e22-cff0e2779d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3f4646-839b-4b87-b6eb-ac1157f96783", "name": "network-vif-plugged", "status": "completed", "tag": "cc6826c8-cc22-4431-ab7c-6807f8a89b79"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:36.120679 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:36.120679 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:36.138731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-37624f3a-82c9-433e-8268-89d74587a90a req-613fdc09-7180-4b18-9e22-cff0e2779d34 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.138731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-37624f3a-82c9-433e-8268-89d74587a90a req-613fdc09-7180-4b18-9e22-cff0e2779d34 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:36.164257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-37624f3a-82c9-433e-8268-89d74587a90a req-613fdc09-7180-4b18-9e22-cff0e2779d34 service nova] Creating event network-vif-plugged:cc6826c8-cc22-4431-ab7c-6807f8a89b79 for instance aa3f4646-839b-4b87-b6eb-ac1157f96783 on nch1-master-1 Dec 25 21:32:36.206011 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-37624f3a-82c9-433e-8268-89d74587a90a req-613fdc09-7180-4b18-9e22-cff0e2779d34 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069224 Dec 25 21:32:36.215840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3240/6495] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:36.303135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c8868d6-0d37-41c3-afec-eec0e80e05e8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Action: 'create', calling method: .version_select at 0x7fa4f62c6550>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-981005224", "policies": ["affinity"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:36.373019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-3c8868d6-0d37-41c3-afec-eec0e80e05e8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:36.391126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-3c8868d6-0d37-41c3-afec-eec0e80e05e8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:36.430556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:36.431569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:36.438668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.439125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:36.439930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.440376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:36.491379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3fcb2ed-1c73-45e3-b604-ad24a023f154 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.064343 Dec 25 21:32:36.492618 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3241/6496] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:36 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:36.502210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-3c8868d6-0d37-41c3-afec-eec0e80e05e8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:36.508650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-3c8868d6-0d37-41c3-afec-eec0e80e05e8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:36.526400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c8868d6-0d37-41c3-afec-eec0e80e05e8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.508882 Dec 25 21:32:36.527421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3256/6497] 10.222.0.32 () {60 vars in 1173 bytes} [Sat Dec 25 21:32:36 2021] POST /compute/v2.1/os-server-groups => generated 183 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:36.540032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5cbfbbe-fbbb-43f5-b50c-cf8538a876d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Action: 'create', calling method: .version_select at 0x7fa4f5eefaf0>, body: {"server_group": {"name": "tempest-server-group-1163544733", "policies": ["affinity"]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:36.559016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a5cbfbbe-fbbb-43f5-b50c-cf8538a876d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:36.566746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a5cbfbbe-fbbb-43f5-b50c-cf8538a876d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:36.795867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a5cbfbbe-fbbb-43f5-b50c-cf8538a876d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:36.813575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a5cbfbbe-fbbb-43f5-b50c-cf8538a876d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:36.872249 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5cbfbbe-fbbb-43f5-b50c-cf8538a876d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.337828 Dec 25 21:32:36.971905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3242/6498] 10.222.0.32 () {60 vars in 1172 bytes} [Sat Dec 25 21:32:36 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:36.972026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:36.972026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:36.975334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:36.976399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:36.985532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.986301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:36.987759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.988763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:36.991549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.992518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:36.996747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:36.997294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:37.055502 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b47bb4c8-48e1-4fdb-ad66-e42a18986e51 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.101379 Dec 25 21:32:37.056093 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3257/6499] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:36 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:37.061724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2502cf23-3349-42c0-a919-f5b84c6e7077 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Action: 'create', calling method: .version_select at 0x7fa4f6394f70>, body: {"server_group": {"name": "tempest-server-group-1163544733", "policies": ["affinity"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:37.083597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-2502cf23-3349-42c0-a919-f5b84c6e7077 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:37.092328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-2502cf23-3349-42c0-a919-f5b84c6e7077 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:37.177268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:37.187589 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fac8c6cc-91ad-443a-a4f5-61c73bb4189b tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1313 microversion: 2.1 time: 0.220432 Dec 25 21:32:37.197070 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3243/6500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:36 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:37.383848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-2502cf23-3349-42c0-a919-f5b84c6e7077 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:37.390883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-2502cf23-3349-42c0-a919-f5b84c6e7077 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:37.404602 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2502cf23-3349-42c0-a919-f5b84c6e7077 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.347359 Dec 25 21:32:37.407622 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3258/6501] 10.222.0.32 () {60 vars in 1172 bytes} [Sat Dec 25 21:32:37 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:37.415600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46e8d3b6-3880-4bdf-8708-3e50ea34b031 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:37.503741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:37.504939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:37.511165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:37.511617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:37.512393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:37.513020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:37.564132 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46e8d3b6-3880-4bdf-8708-3e50ea34b031 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/42975643-cfa2-4979-9460-64041e6dd4ae" status: 204 len: 0 microversion: 2.1 time: 0.150643 Dec 25 21:32:37.564132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3244/6502] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:37 2021] DELETE /compute/v2.1/os-server-groups/42975643-cfa2-4979-9460-64041e6dd4ae => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:37.567114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fa4d4d5-71c5-4b9f-9472-0d5ff9a58aa1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.066994 Dec 25 21:32:37.571202 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3259/6503] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:37 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:37.571370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea8ccb7e-4bff-49f2-a9aa-3b1a00e9452d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:37.588672 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea8ccb7e-4bff-49f2-a9aa-3b1a00e9452d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.021216 Dec 25 21:32:37.593544 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3245/6504] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:32:37 2021] GET /compute/v2.1/os-server-groups => generated 334 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:37.605438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f822fa9f-bb0c-4cd3-94b6-9de773cbe45c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:37.694443 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f822fa9f-bb0c-4cd3-94b6-9de773cbe45c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/fe4bfa79-db62-4617-a22c-0ffc07d1f377" status: 204 len: 0 microversion: 2.1 time: 0.093881 Dec 25 21:32:37.695105 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3260/6505] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:37 2021] DELETE /compute/v2.1/os-server-groups/fe4bfa79-db62-4617-a22c-0ffc07d1f377 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:37.703761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c053378-7dcd-450d-91a7-7b2eb4b9aeb5 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:37.717510 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c053378-7dcd-450d-91a7-7b2eb4b9aeb5 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.018642 Dec 25 21:32:37.719062 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3246/6506] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:32:37 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:37.731855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c032ea7-619e-408e-919a-82ec962283f9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Action: 'create', calling method: .version_select at 0x7fa5005799d0>, body: {"server_group": {"name": "tempest-server-group-2101697279", "policies": ["affinity"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:37.763378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1c032ea7-619e-408e-919a-82ec962283f9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:37.769427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1c032ea7-619e-408e-919a-82ec962283f9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:37.905331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1c032ea7-619e-408e-919a-82ec962283f9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:37.913286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1c032ea7-619e-408e-919a-82ec962283f9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:37.936412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c032ea7-619e-408e-919a-82ec962283f9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.208774 Dec 25 21:32:37.938161 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3261/6507] 10.222.0.32 () {60 vars in 1172 bytes} [Sat Dec 25 21:32:37 2021] POST /compute/v2.1/os-server-groups => generated 164 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:37.954418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25082b6e-81df-42e2-8404-8075e4727778 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:38.063727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25082b6e-81df-42e2-8404-8075e4727778 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/f733c9df-de6b-43d5-9619-7ed1d451cd63" status: 204 len: 0 microversion: 2.1 time: 0.120108 Dec 25 21:32:38.067704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3247/6508] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:37 2021] DELETE /compute/v2.1/os-server-groups/f733c9df-de6b-43d5-9619-7ed1d451cd63 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:38.075365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d4b703b4-f152-4f52-80c2-d7c6085df3a3 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:38.089428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:38.091375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:38.103543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:38.104054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:38.105133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:38.105788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:38.106590 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d4b703b4-f152-4f52-80c2-d7c6085df3a3 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.036838 Dec 25 21:32:38.107944 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3262/6509] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:32:38 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:38.125333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72a427a9-74f0-4a5f-ab6d-3f1d780ca936 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Action: 'create', calling method: .version_select at 0x7fa4f63943a0>, body: {"server_group": {"name": "tempest-server-group-496418399", "policies": ["anti-affinity"]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:38.160516 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40afbd4e-996e-46f1-8a15-8d9a869261f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.084229 Dec 25 21:32:38.164178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3248/6510] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:38 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:38.178978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-72a427a9-74f0-4a5f-ab6d-3f1d780ca936 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:38.198685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-72a427a9-74f0-4a5f-ab6d-3f1d780ca936 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:38.210466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:38.211584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:38.220119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:38.220978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:38.221959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:38.222546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:38.383383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-72a427a9-74f0-4a5f-ab6d-3f1d780ca936 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:38.414698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-72a427a9-74f0-4a5f-ab6d-3f1d780ca936 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_groups'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:38.449963 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72a427a9-74f0-4a5f-ab6d-3f1d780ca936 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.334090 Dec 25 21:32:38.451262 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3263/6511] 10.222.0.32 () {60 vars in 1172 bytes} [Sat Dec 25 21:32:38 2021] POST /compute/v2.1/os-server-groups => generated 168 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:32:38.461285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-66ae48ae-a136-41e9-a709-4b764b85bbe9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:38.497442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:38.508315 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de547aef-cada-49cd-96c4-0935c0e6d370 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1497 microversion: 2.1 time: 0.302443 Dec 25 21:32:38.509579 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3249/6512] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:38 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1497 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:38.579452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:38.580122 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-66ae48ae-a136-41e9-a709-4b764b85bbe9 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/7e6b1d0c-58a4-49d2-9981-ab9ae4dd3cf7" status: 204 len: 0 microversion: 2.1 time: 0.122493 Dec 25 21:32:38.580368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:38.580694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3264/6513] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:38 2021] DELETE /compute/v2.1/os-server-groups/7e6b1d0c-58a4-49d2-9981-ab9ae4dd3cf7 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:32:38.588781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb2954ad-da9a-4383-a89e-c9ab996e90e7 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:38.589287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:38.589433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:38.591314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:38.591817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:38.613206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb2954ad-da9a-4383-a89e-c9ab996e90e7 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.027986 Dec 25 21:32:38.620917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3265/6514] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:32:38 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:38.674343 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a93df66-3ce5-4270-8b17-0c2ef91b524d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.098794 Dec 25 21:32:38.675688 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3250/6515] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:38 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:38.757574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1626214004", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "39a32d90-5942-4df6-ad08-b55ff8396e09"}]}, "os:scheduler_hints": {"group": "cd1e54fc-529b-48a9-a0be-5ac1d26af8de"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:38.846712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] validate_networks() for [('39a32d90-5942-4df6-ad08-b55ff8396e09', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:32:39.174118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:39.175404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:39.183514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:39.184513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:39.185936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:39.187123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:39.256231 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b397ae11-1692-431a-95dc-4e601a7650cb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.087469 Dec 25 21:32:39.259260 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3251/6516] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:39 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:39.311828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:32:39.312251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:32:39.312964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:32:39.313717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:32:39.314332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:32:39.332589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:39.333360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:39.334352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:39.335345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:39.355071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:39.361307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:39.377296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:32:39.380105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:32:39.689175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:39.690337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:39.701027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:39.703671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:39.704912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:39.705634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:39.756444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3087075-7dd7-41cf-8a61-a3f2641642e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.072168 Dec 25 21:32:39.781514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3252/6517] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:39 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:39.830934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:39.838521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:39.988488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:32:39.995816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Getting quotas for user 0f04cf22c6134aa3ac22cc1d3ae153e7 and project fd4a43ad54d448798e4a36160a2a6476. Resources: {'server_group_members'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:32:40.044622 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4200c853-276c-423e-b2f3-245019e0905b tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287095 Dec 25 21:32:40.048330 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3266/6518] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:32:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:32:40.065483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be1660fa-18cd-4594-92e5-9b201862b1e0 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:40.067175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be1660fa-18cd-4594-92e5-9b201862b1e0 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:40.219581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be1660fa-18cd-4594-92e5-9b201862b1e0 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:40.231162 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be1660fa-18cd-4594-92e5-9b201862b1e0 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1213 microversion: 2.1 time: 0.174014 Dec 25 21:32:40.231965 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3253/6519] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:40 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1213 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:40.270167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:40.271146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:40.283282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:40.283757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:40.303716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:40.304200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:40.377520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-667b3ad4-e07f-4734-8907-aea0f1fa4d78 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.112391 Dec 25 21:32:40.381572 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3267/6520] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:40 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:40.791705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:40.793744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:40.807554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:40.808956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:40.811393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:40.812293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:41.000081 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c5c005c2-a786-480a-bf49-4b90c30dcd66 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.212623 Dec 25 21:32:41.000756 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3254/6521] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:40 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:41.255706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a9ee1322-dd9c-4875-9337-f504f30ace9a tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:41.257375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a9ee1322-dd9c-4875-9337-f504f30ace9a tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:41.331021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a9ee1322-dd9c-4875-9337-f504f30ace9a tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:41.340192 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a9ee1322-dd9c-4875-9337-f504f30ace9a tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1213 microversion: 2.1 time: 0.088114 Dec 25 21:32:41.342093 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3268/6522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:41 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:41.395909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:41.398591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:41.406968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:41.407751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:41.408743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:41.409758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:41.478910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d5ee919a-38ad-471b-b439-583b4edb8306 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.080137 Dec 25 21:32:41.478910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3255/6523] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:41 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:42.015030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:42.017486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:42.033884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:42.036186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:42.041650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:42.042337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:42.113706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de729f07-24e8-489a-bcae-7342bcaa324c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.105454 Dec 25 21:32:42.114715 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3269/6524] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:42 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:42.362601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:42.363547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:42.384061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:42.387145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:42.392732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:42.393453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:42.479976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:42.481517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:42.498096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:42.500233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:42.503036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:42.503489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:42.508829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:42.523055 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd50f7a0-1964-4f4c-b4d2-4e82c0ef3aa4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1265 microversion: 2.1 time: 0.168736 Dec 25 21:32:42.526052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3256/6525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:42 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:42.595805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca704aff-347f-4815-b7d4-42762d68cbc2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.119334 Dec 25 21:32:42.600013 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3270/6526] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:42 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:43.148149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:43.148149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:43.170406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:43.175301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:43.176749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:43.177664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:43.248440 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6cef709-7780-439e-9cfd-3bfddfa45303 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.124655 Dec 25 21:32:43.252564 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3257/6527] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:43 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:43.542790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:43.556598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:43.556598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:43.556598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:43.556598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:43.560740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:43.609462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:43.610474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:43.618292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:43.619380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:43.621171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:43.622495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:43.695015 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2aa40e95-362a-41dd-9547-3adce343eb3b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.091639 Dec 25 21:32:43.699538 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3258/6528] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:43 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:43.907228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:43.916320 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24e9d239-2690-4e3f-af32-a7af477edd87 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1283 microversion: 2.1 time: 0.377795 Dec 25 21:32:43.934331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3271/6529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:43 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1283 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:44.264605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:44.265802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:44.283014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:44.283014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:44.283212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.283212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.283212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.283858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.300538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.301265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.302227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.302748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.354998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:44.406701 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3747e84-0a56-4975-9789-7aaa58cdec35 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.146229 Dec 25 21:32:44.407692 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3259/6530] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:44 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:44.708081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:44.709156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:44.722518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.724369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.725146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.726185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.789365 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39651fa1-9773-47b6-91bf-42dc33c9e1fc tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "DELETE /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 204 len: 0 microversion: 2.1 time: 0.517414 Dec 25 21:32:44.790276 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3272/6531] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:44 2021] DELETE /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:32:44.798965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:44.800088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:44.811745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.813152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.816229 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0808a3e6-f521-43d4-98e7-b2e700e50228 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.109056 Dec 25 21:32:44.816669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.817333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.821158 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3260/6532] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:44 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:44.942901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:44.943770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:44.962979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.965867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:44.974318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:44.974318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:45.214374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:45.222653 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-89b218b1-78fe-4f1f-9546-5928da4c1d63 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1503 microversion: 2.1 time: 0.427885 Dec 25 21:32:45.234461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3273/6533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:44 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1503 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:45.271165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:45.278723 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a0fdfa3-b175-46de-94b6-02b346de2edd tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1313 microversion: 2.1 time: 0.340706 Dec 25 21:32:45.279303 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3261/6534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:44 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:45.418789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:45.419996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:45.426726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:45.427940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:45.428933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:45.429538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:45.506624 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a13b5876-ab29-4c43-b3fc-fab7bb531c2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.091418 Dec 25 21:32:45.515617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3274/6535] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:45 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:45.826182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:45.827932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:45.841943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:45.843311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:45.844334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:45.845023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:45.895405 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb198714-fbfb-4f57-ad4a-48a572fcd679 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.073151 Dec 25 21:32:45.903258 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3262/6536] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:45 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:45.931281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2a5ebf1b-3542-47a6-800b-d9ea8312ffc7 req-4b61a777-6701-4592-9805-fab7bcc163aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9137b02e-d977-4dc0-b620-6553cb5b238b", "tag": "98a31078-6027-494a-a084-08838d97fd08"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:45.934013 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:45.934013 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:45.950948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2a5ebf1b-3542-47a6-800b-d9ea8312ffc7 req-4b61a777-6701-4592-9805-fab7bcc163aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:45.952396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2a5ebf1b-3542-47a6-800b-d9ea8312ffc7 req-4b61a777-6701-4592-9805-fab7bcc163aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:45.978957 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2a5ebf1b-3542-47a6-800b-d9ea8312ffc7 req-4b61a777-6701-4592-9805-fab7bcc163aa service nova] Creating event network-changed:98a31078-6027-494a-a084-08838d97fd08 for instance 9137b02e-d977-4dc0-b620-6553cb5b238b on nch2-master-1 Dec 25 21:32:45.985524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2a5ebf1b-3542-47a6-800b-d9ea8312ffc7 req-4b61a777-6701-4592-9805-fab7bcc163aa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057673 Dec 25 21:32:45.986685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3275/6537] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:46.251924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:46.253003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:46.265481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:46.268771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:46.270885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:46.272579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:46.296667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:46.297770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:46.309308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:46.314277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:46.317770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:46.318509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:47.161686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:47.169215 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f46c464-d5af-490a-8774-390abe370ca8 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1313 microversion: 2.1 time: 0.877907 Dec 25 21:32:47.169798 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3276/6538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:46 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1313 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:47.174865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:47.176069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:47.182655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:47.183107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:47.183900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:47.184337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:47.184919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:47.193257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81c38efb-020b-40c2-ac8b-83d4a20c4376 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1503 microversion: 2.1 time: 0.946744 Dec 25 21:32:47.204992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3263/6539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:46 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1503 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:47.204992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:47.204992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:47.207345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:47.207831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:47.208689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:47.209390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:47.238461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-72d487c6-7090-41b6-9d5a-d300d1207544 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.067389 Dec 25 21:32:47.239660 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3277/6540] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:47 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:47.255578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-05b967ae-1cce-4e8c-98ac-1bb8f6329f2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.060122 Dec 25 21:32:47.256351 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3264/6541] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:47 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:48.037111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-bf61e3ab-9792-4d7a-ae10-781063510595 req-f76e9f83-ec13-41e4-8f22-aa85c2345f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3f4646-839b-4b87-b6eb-ac1157f96783", "name": "network-vif-deleted", "tag": "cc6826c8-cc22-4431-ab7c-6807f8a89b79"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:48.038591 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:48.038591 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:32:48.048613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bf61e3ab-9792-4d7a-ae10-781063510595 req-f76e9f83-ec13-41e4-8f22-aa85c2345f26 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.049085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bf61e3ab-9792-4d7a-ae10-781063510595 req-f76e9f83-ec13-41e4-8f22-aa85c2345f26 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.062151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bf61e3ab-9792-4d7a-ae10-781063510595 req-f76e9f83-ec13-41e4-8f22-aa85c2345f26 service nova] Creating event network-vif-deleted:cc6826c8-cc22-4431-ab7c-6807f8a89b79 for instance aa3f4646-839b-4b87-b6eb-ac1157f96783 on nch1-master-1 Dec 25 21:32:48.067025 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-bf61e3ab-9792-4d7a-ae10-781063510595 req-f76e9f83-ec13-41e4-8f22-aa85c2345f26 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034097 Dec 25 21:32:48.067632 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3278/6542] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:48.187643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:48.189020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:48.196546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.197043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.197837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.198275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.212709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:48.213973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:48.219879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.220460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.221395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.221834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.254706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.255152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.255605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lazy-loading 'fault' on Instance uuid aa3f4646-839b-4b87-b6eb-ac1157f96783 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:32:48.299445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2237f90a5db4203805e0a7f287f0964', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71418288426545dea311f347bd0cbfdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:48.306750 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55644841-59c3-46b5-8d16-7599bdc817c1 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 200 len: 1303 microversion: 2.1 time: 0.098536 Dec 25 21:32:48.307325 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3279/6543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:48 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:48.321447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:48.324375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:48.328837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.329381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.330163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.330595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.362508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:48.370278 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-91462288-93a3-431a-8a94-e07f80a03c34 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1313 microversion: 2.1 time: 0.187329 Dec 25 21:32:48.370842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3265/6544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:48 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:48.376106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:48.377235 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81d3cc7f-965e-4f17-95d0-7a30475331a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.059661 Dec 25 21:32:48.377468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:48.377881 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3280/6545] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:48 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:48.384067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.384526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.398222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:48.398222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:48.428328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dd1a36fb-26c0-4b10-9b14-753536a74ddf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.056195 Dec 25 21:32:48.428990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3266/6546] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:48 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:49.323946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:49.324621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] [instance: aa3f4646-839b-4b87-b6eb-ac1157f96783] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:49.337197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.337656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.338453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.338919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.353513 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] HTTP exception thrown: Instance aa3f4646-839b-4b87-b6eb-ac1157f96783 could not be found. Dec 25 21:32:49.354109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] Returning 404 to user: Instance aa3f4646-839b-4b87-b6eb-ac1157f96783 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:49.354936 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd9b53d0-c681-4df2-91a4-dbca45099ff3 tempest-VolumesActionsTest-2089127211 tempest-VolumesActionsTest-2089127211-project] 10.222.0.32 "GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783" status: 404 len: 111 microversion: 2.1 time: 0.035120 Dec 25 21:32:49.355472 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3281/6547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:49 2021] GET /compute/v2.1/servers/aa3f4646-839b-4b87-b6eb-ac1157f96783 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:49.387913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:49.388612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:49.391410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:49.392349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:49.396309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.396981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.398107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.398719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.399346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.399952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.400931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.401509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.455371 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2002064-0caf-485e-af2b-2663880ece7f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.068869 Dec 25 21:32:49.456360 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3282/6548] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:49 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:49.462031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:49.467236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:49.472785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.473571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.474591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:49.475121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:49.527771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6bf46d33-291e-463a-b987-e30d07541654 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.069700 Dec 25 21:32:49.532093 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3283/6549] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:49 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:49.560339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:49.568580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de2e0c6d-6903-4948-b298-e399311dc240 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1313 microversion: 2.1 time: 0.184746 Dec 25 21:32:49.569184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3267/6550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:49 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:50.468322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:50.469360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:50.476679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:50.477154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:50.478047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:50.478478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:50.519796 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6331f63b-04f9-4771-9b5f-9c04c43000c0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.055542 Dec 25 21:32:50.520415 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3284/6551] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:50 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:50.539503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:50.540415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:50.548815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:50.549291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:50.550072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:50.550511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:50.586654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:50.587342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:50.591854 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2972e35d-a059-44ba-82dc-57266133315c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.055903 Dec 25 21:32:50.592710 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3268/6552] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:50 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:50.599014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:50.600330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:50.601175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:50.601616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:50.756203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:50.764181 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a70bff3b-cc18-4c97-9091-d388f1aa5e58 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1313 microversion: 2.1 time: 0.181881 Dec 25 21:32:50.766056 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3285/6553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:50 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:51.106364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-69621269-ae0b-4aeb-ba0f-c69d91ec49a6 req-4094f23e-0776-4615-a03e-1c87c5e86b8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9137b02e-d977-4dc0-b620-6553cb5b238b", "name": "network-vif-plugged", "status": "completed", "tag": "98a31078-6027-494a-a084-08838d97fd08"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:51.108009 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:51.108009 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:51.116013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-69621269-ae0b-4aeb-ba0f-c69d91ec49a6 req-4094f23e-0776-4615-a03e-1c87c5e86b8d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.116469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-69621269-ae0b-4aeb-ba0f-c69d91ec49a6 req-4094f23e-0776-4615-a03e-1c87c5e86b8d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.127473 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-69621269-ae0b-4aeb-ba0f-c69d91ec49a6 req-4094f23e-0776-4615-a03e-1c87c5e86b8d service nova] Creating event network-vif-plugged:98a31078-6027-494a-a084-08838d97fd08 for instance 9137b02e-d977-4dc0-b620-6553cb5b238b on nch2-master-1 Dec 25 21:32:51.132251 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-69621269-ae0b-4aeb-ba0f-c69d91ec49a6 req-4094f23e-0776-4615-a03e-1c87c5e86b8d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029941 Dec 25 21:32:51.132838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3269/6554] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:51.531498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:51.534717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:51.540198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.540698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.541503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.541940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.582069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1486e38-4e63-4f46-bd63-131a86938087 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.054874 Dec 25 21:32:51.582697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3286/6555] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:51 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:51.605427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:51.606431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:51.613538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.613997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.614797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.615282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.658882 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49e46847-286d-4610-90ae-37d4cc1bba8c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058459 Dec 25 21:32:51.659503 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3270/6556] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:51 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:51.783079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:51.783790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:51.790973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.791433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.792223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:51.792762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:51.998558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:52.010603 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-475c7e37-06b0-4e85-8f1c-a76ea6ba950d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1313 microversion: 2.1 time: 0.232120 Dec 25 21:32:52.011968 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3287/6557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:51 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:52.601623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:52.605311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:52.618656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:52.619869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:52.620888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:52.621530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:52.673500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:52.676915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:52.690665 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d562eed-0e43-4d66-93cf-4e1ab68820a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.092671 Dec 25 21:32:52.693904 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3271/6558] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:52 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:52.705017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:52.705754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:52.706865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:52.707796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:52.757417 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-beb45ca3-c71d-4bdc-b74e-3fd47be1550e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.090423 Dec 25 21:32:52.758592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3288/6559] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:52 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:53.029475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:53.031314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:53.039768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.041781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.041781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.041781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.248222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:53.257067 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6bae6c9-68e8-4f19-8a5b-884cb53b5842 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1498 microversion: 2.1 time: 0.231670 Dec 25 21:32:53.258080 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3272/6560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:53 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1498 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:53.277739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6e5cd33d-53a8-465c-a7ef-04d57e2a7707 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:53.333967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_groups [None req-6e5cd33d-53a8-465c-a7ef-04d57e2a7707 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Querying cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) for 1 instances {{(pid=136548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 25 21:32:53.335113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e5cd33d-53a8-465c-a7ef-04d57e2a7707 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.336519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6e5cd33d-53a8-465c-a7ef-04d57e2a7707 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.364576 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6e5cd33d-53a8-465c-a7ef-04d57e2a7707 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/cd1e54fc-529b-48a9-a0be-5ac1d26af8de" status: 200 len: 221 microversion: 2.1 time: 0.093617 Dec 25 21:32:53.365715 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3289/6561] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:32:53 2021] GET /compute/v2.1/os-server-groups/cd1e54fc-529b-48a9-a0be-5ac1d26af8de => generated 221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:53.376009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:53.376639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:53.383943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.384430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.385661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.386542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.431664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:32:53.704271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:53.705897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:53.719088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.719549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.720447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.720929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.773367 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-561dde4e-dd83-42d6-a3d7-4b0075052b2b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.074087 Dec 25 21:32:53.774697 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3290/6562] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:53 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:53.780093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:53.781100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:53.788558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.789279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.790252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.790838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.823800 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7b9a38b-be12-48ce-be25-d708e63bfd35 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 204 len: 0 microversion: 2.1 time: 0.452199 Dec 25 21:32:53.824461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3273/6563] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:53 2021] DELETE /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:53.833366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:53.834355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:53.846963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.848107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.849154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:53.849623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:53.860136 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88ff7349-1441-46ea-8d0c-9397a921edf0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.083828 Dec 25 21:32:53.860799 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3291/6564] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:54.070425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:54.083818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-decd805f-add8-423c-92c1-10605f3f857d tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1504 microversion: 2.1 time: 0.253909 Dec 25 21:32:54.095083 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3274/6565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:53 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1504 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:32:54.786172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:54.788074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:54.795535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:54.796147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:54.796964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:54.797579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:54.850011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8f6d0f9b-a18f-4590-81f6-06cc3825abde tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.068134 Dec 25 21:32:54.850719 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3292/6566] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:54 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:54.871584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:54.873027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:54.880063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:54.880515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:54.881342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:54.881780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:54.928609 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5968a98b-9c5f-4abf-bdb2-a8525294a3d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.059414 Dec 25 21:32:54.929457 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3275/6567] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:54 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:55.102143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:55.102952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:55.110070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.110604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.111586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.112012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.329712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:55.337185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2dbb6e11-8066-4757-85b0-28102121a9e2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1504 microversion: 2.1 time: 0.239190 Dec 25 21:32:55.337764 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3293/6568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:55 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:55.721460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2aca194b-2c8d-458a-9a62-3f33557220fa req-1172bbb3-4ee9-435b-a7ba-6603234011c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9137b02e-d977-4dc0-b620-6553cb5b238b", "name": "network-vif-deleted", "tag": "98a31078-6027-494a-a084-08838d97fd08"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:55.722944 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:32:55.722944 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:32:55.731220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2aca194b-2c8d-458a-9a62-3f33557220fa req-1172bbb3-4ee9-435b-a7ba-6603234011c8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.734090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2aca194b-2c8d-458a-9a62-3f33557220fa req-1172bbb3-4ee9-435b-a7ba-6603234011c8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.743822 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2aca194b-2c8d-458a-9a62-3f33557220fa req-1172bbb3-4ee9-435b-a7ba-6603234011c8 service nova] Creating event network-vif-deleted:98a31078-6027-494a-a084-08838d97fd08 for instance 9137b02e-d977-4dc0-b620-6553cb5b238b on nch2-master-1 Dec 25 21:32:55.748650 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2aca194b-2c8d-458a-9a62-3f33557220fa req-1172bbb3-4ee9-435b-a7ba-6603234011c8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031334 Dec 25 21:32:55.749843 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3276/6569] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:32:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:55.866221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:55.867302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:55.877875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.882582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.882582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.882582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.919576 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2bb37204-1f31-47d5-87bc-7ef25c710f37 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.061430 Dec 25 21:32:55.920458 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3294/6570] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:55 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:32:55.942138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:55.943129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:55.949609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.950078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.950874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:55.951317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:55.995580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1698701-61cd-421c-8ef0-67fc0d2c6046 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058339 Dec 25 21:32:55.996250 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3277/6571] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:55 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:56.355630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:56.356338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:56.364059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:56.364503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:56.365437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:56.365893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:56.397846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:56.398303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:56.398760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lazy-loading 'fault' on Instance uuid 9137b02e-d977-4dc0-b620-6553cb5b238b {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:32:56.441804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f04cf22c6134aa3ac22cc1d3ae153e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd4a43ad54d448798e4a36160a2a6476', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:32:56.449533 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bce14c9-3b16-4c30-91df-42f80577e61c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 200 len: 1303 microversion: 2.1 time: 0.098087 Dec 25 21:32:56.450115 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3295/6572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:56 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:32:56.931645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:56.932666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:56.941134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:56.941591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:56.942389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:56.942914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:56.985575 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f92ec92-d524-4083-a372-a1f5127cee65 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.057360 Dec 25 21:32:56.986231 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3278/6573] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:56 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:57.007370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:57.008287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:57.015010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.016533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.017140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.017576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.057205 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-487dcc95-676d-4e4c-a6bd-7b47d241b3b3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.053241 Dec 25 21:32:57.058048 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3296/6574] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:57 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:57.467494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.468127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:57.475168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.475622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.476407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.476847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.490614 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance 9137b02e-d977-4dc0-b620-6553cb5b238b could not be found. Dec 25 21:32:57.491202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance 9137b02e-d977-4dc0-b620-6553cb5b238b could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.492022 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-17f44c73-e65e-4da9-9127-4000e834b8ff tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 404 len: 111 microversion: 2.1 time: 0.028781 Dec 25 21:32:57.492555 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3279/6575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:57 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.502883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c63c0cf2-0a40-44fa-959e-bc5a7b0c912c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.518651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_groups [None req-c63c0cf2-0a40-44fa-959e-bc5a7b0c912c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Querying cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) for 1 instances {{(pid=136548) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 25 21:32:57.519436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c63c0cf2-0a40-44fa-959e-bc5a7b0c912c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.519906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c63c0cf2-0a40-44fa-959e-bc5a7b0c912c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.530139 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c63c0cf2-0a40-44fa-959e-bc5a7b0c912c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.031806 Dec 25 21:32:57.530679 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3297/6576] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:32:57 2021] GET /compute/v2.1/os-server-groups => generated 186 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:57.541155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-345607e2-2cff-4c90-aa6f-dbb21eb922b4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.555055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.server_groups [None req-345607e2-2cff-4c90-aa6f-dbb21eb922b4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Querying cell d522ade6-efc6-487a-a0a8-1d707c18c816(cell1) for 1 instances {{(pid=136547) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:68}} Dec 25 21:32:57.555855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-345607e2-2cff-4c90-aa6f-dbb21eb922b4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.556308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-345607e2-2cff-4c90-aa6f-dbb21eb922b4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.580997 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-345607e2-2cff-4c90-aa6f-dbb21eb922b4 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/os-server-groups/cd1e54fc-529b-48a9-a0be-5ac1d26af8de" status: 200 len: 183 microversion: 2.1 time: 0.043550 Dec 25 21:32:57.581580 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3280/6577] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:32:57 2021] GET /compute/v2.1/os-server-groups/cd1e54fc-529b-48a9-a0be-5ac1d26af8de => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:32:57.591555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.592259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:57.598658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.599104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.599895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.600311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.613282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance 9137b02e-d977-4dc0-b620-6553cb5b238b could not be found. Dec 25 21:32:57.613860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance 9137b02e-d977-4dc0-b620-6553cb5b238b could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.614674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8497219-8ef0-42de-a801-e0fffe41eb62 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 404 len: 111 microversion: 2.1 time: 0.026846 Dec 25 21:32:57.615199 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3298/6578] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:32:57 2021] DELETE /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.622872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.623553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] [instance: 9137b02e-d977-4dc0-b620-6553cb5b238b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:57.630074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.630528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.631326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:57.631763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:57.646364 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance 9137b02e-d977-4dc0-b620-6553cb5b238b could not be found. Dec 25 21:32:57.646951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance 9137b02e-d977-4dc0-b620-6553cb5b238b could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.647773 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5af465c-ab30-45d5-8a46-65d3da75c532 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b" status: 404 len: 111 microversion: 2.1 time: 0.028667 Dec 25 21:32:57.648299 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3281/6579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:32:57 2021] GET /compute/v2.1/servers/9137b02e-d977-4dc0-b620-6553cb5b238b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.655980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2bc751f8-52b0-43f6-b9f6-f33bc33c9469 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.662347 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2bc751f8-52b0-43f6-b9f6-f33bc33c9469 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance group 7e6b1d0c-58a4-49d2-9981-ab9ae4dd3cf7 could not be found. Dec 25 21:32:57.662914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2bc751f8-52b0-43f6-b9f6-f33bc33c9469 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance group 7e6b1d0c-58a4-49d2-9981-ab9ae4dd3cf7 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.666699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2bc751f8-52b0-43f6-b9f6-f33bc33c9469 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/7e6b1d0c-58a4-49d2-9981-ab9ae4dd3cf7" status: 404 len: 117 microversion: 2.1 time: 0.011375 Dec 25 21:32:57.666699 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3299/6580] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:57 2021] DELETE /compute/v2.1/os-server-groups/7e6b1d0c-58a4-49d2-9981-ab9ae4dd3cf7 => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.673211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-250d8469-3b57-4383-8aa0-d191b1379cd1 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.679031 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-250d8469-3b57-4383-8aa0-d191b1379cd1 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance group f733c9df-de6b-43d5-9619-7ed1d451cd63 could not be found. Dec 25 21:32:57.679606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-250d8469-3b57-4383-8aa0-d191b1379cd1 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance group f733c9df-de6b-43d5-9619-7ed1d451cd63 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.680415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-250d8469-3b57-4383-8aa0-d191b1379cd1 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/f733c9df-de6b-43d5-9619-7ed1d451cd63" status: 404 len: 117 microversion: 2.1 time: 0.010975 Dec 25 21:32:57.680940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3282/6581] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:57 2021] DELETE /compute/v2.1/os-server-groups/f733c9df-de6b-43d5-9619-7ed1d451cd63 => generated 117 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.688617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-beb8875b-75f5-439b-87a6-6bde25bba0ab tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.695358 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-beb8875b-75f5-439b-87a6-6bde25bba0ab tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance group fe4bfa79-db62-4617-a22c-0ffc07d1f377 could not be found. Dec 25 21:32:57.695894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-beb8875b-75f5-439b-87a6-6bde25bba0ab tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance group fe4bfa79-db62-4617-a22c-0ffc07d1f377 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.696708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-beb8875b-75f5-439b-87a6-6bde25bba0ab tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/fe4bfa79-db62-4617-a22c-0ffc07d1f377" status: 404 len: 117 microversion: 2.1 time: 0.012155 Dec 25 21:32:57.697251 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3300/6582] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:57 2021] DELETE /compute/v2.1/os-server-groups/fe4bfa79-db62-4617-a22c-0ffc07d1f377 => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.705384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9570d89-f909-48dc-a7fc-55369e3942d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.712076 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-d9570d89-f909-48dc-a7fc-55369e3942d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] HTTP exception thrown: Instance group 42975643-cfa2-4979-9460-64041e6dd4ae could not be found. Dec 25 21:32:57.712656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9570d89-f909-48dc-a7fc-55369e3942d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Returning 404 to user: Instance group 42975643-cfa2-4979-9460-64041e6dd4ae could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:32:57.713492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9570d89-f909-48dc-a7fc-55369e3942d2 tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/42975643-cfa2-4979-9460-64041e6dd4ae" status: 404 len: 117 microversion: 2.1 time: 0.012357 Dec 25 21:32:57.714002 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3283/6583] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:57 2021] DELETE /compute/v2.1/os-server-groups/42975643-cfa2-4979-9460-64041e6dd4ae => generated 117 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:32:57.721310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2a3c81e0-60b8-4fa6-b1ff-baecb5c1055c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:32:57.843121 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2a3c81e0-60b8-4fa6-b1ff-baecb5c1055c tempest-ServerGroupTestJSON-1944805500 tempest-ServerGroupTestJSON-1944805500-project] 10.222.0.32 "DELETE /compute/v2.1/os-server-groups/cd1e54fc-529b-48a9-a0be-5ac1d26af8de" status: 204 len: 0 microversion: 2.1 time: 0.125252 Dec 25 21:32:57.843743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3301/6584] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:32:57 2021] DELETE /compute/v2.1/os-server-groups/cd1e54fc-529b-48a9-a0be-5ac1d26af8de => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:32:57.997354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:57.998354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:58.005938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:58.006491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:58.007354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:58.007869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:58.047105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49007ce2-ccdc-45cc-936c-a59a40aad227 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.053444 Dec 25 21:32:58.048236 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3284/6585] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:57 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:58.070559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:58.071658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:58.078998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:58.079455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:58.080474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:58.081140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:58.122211 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c5aa68da-07b2-4a21-9dfb-85e7f6de9b2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.056357 Dec 25 21:32:58.123099 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3302/6586] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:58 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:59.061583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:59.062758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:59.071006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:59.071694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:59.072510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:59.073061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:59.117430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-93a0fba8-0933-4bc8-a547-00659b1184c4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.061185 Dec 25 21:32:59.118819 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3285/6587] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:59 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:32:59.135620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:32:59.136754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:32:59.145222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:59.145673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:59.146467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:32:59.146901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:32:59.207267 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed3b07f2-91c1-4631-91df-71f27615484e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.067738 Dec 25 21:32:59.207267 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3303/6588] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:32:59 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:00.130587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:00.131723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:00.144066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:00.148413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:00.148413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:00.148413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:00.190727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae2135db-675f-4bfd-aa31-584604640408 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.064406 Dec 25 21:33:00.192327 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3286/6589] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:00 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:00.217496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:00.218619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:00.234723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:00.234723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:00.234723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:00.234723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:00.328007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3429dc95-8d85-4f96-9303-2d741229a118 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.116824 Dec 25 21:33:00.333699 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3304/6590] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:00 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:01.203343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:01.204381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:01.212115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:01.212572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:01.213401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:01.216954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:01.259905 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b115082-9cec-452e-a8ea-2be9fd621979 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.060372 Dec 25 21:33:01.260858 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3287/6591] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:01 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:01.343500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:01.343500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:01.351430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:01.352123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:01.352977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:01.354501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:01.406331 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b34189db-62a4-42a7-831f-d5a213715999 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.068820 Dec 25 21:33:01.407510 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3305/6592] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:01 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:02.236051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1040456710", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "c3a130a4-e25e-4c59-825d-9c61f3e40353"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:02.274136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:02.275051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:02.282066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:02.282515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:02.283882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:02.283882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:02.294421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] validate_networks() for [('c3a130a4-e25e-4c59-825d-9c61f3e40353', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:33:02.327404 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5241555c-6e6a-4b22-8409-59adb18fdae3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.057722 Dec 25 21:33:02.328062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3306/6593] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:02 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:02.419369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:02.420413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:02.432417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:02.435508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:02.435508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:02.435508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:02.479347 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e76da92-93ac-4f78-a205-f74fda2aee90 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.064204 Dec 25 21:33:02.484273 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3307/6594] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:02 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:02.592239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-861352127", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "63db5869-7587-4d2a-ac56-8b2e33092808", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "d257b68f-9132-4584-b1b0-827fbb5ce176"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:02.656199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] validate_networks() for [('d257b68f-9132-4584-b1b0-827fbb5ce176', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:33:02.685029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:33:02.685029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:33:02.685029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:33:02.685029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:33:02.685029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:33:02.692845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:02.693323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:02.694143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:02.694585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:02.714141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Getting quotas for project ac1acf7a8cbb44ce80756e3508b9b392. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:33:02.719801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Getting quotas for user 57b60038227d40fabb353ef15c464cc2 and project ac1acf7a8cbb44ce80756e3508b9b392. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:33:02.735505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:33:02.737988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:33:02.866308 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ece6bdd-287f-440b-9f04-dd78870af39f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.756997 Dec 25 21:33:02.867308 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3288/6595] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:33:02.878553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41c1006e-093b-4286-8356-2fb4e0bb50ee tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:02.878553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41c1006e-093b-4286-8356-2fb4e0bb50ee tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:02.957714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-41c1006e-093b-4286-8356-2fb4e0bb50ee tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:02.966470 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41c1006e-093b-4286-8356-2fb4e0bb50ee tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1224 microversion: 2.1 time: 0.092838 Dec 25 21:33:02.967056 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3289/6596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:02 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1224 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:03.077793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:33:03.078155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:33:03.079165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:33:03.079572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:33:03.079980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:33:03.088800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:03.089323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:03.090175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:03.090606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:03.107711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:33:03.112957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for user 171c198b6b734cd698b3c1eaf76a0234 and project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:33:03.171071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:33:03.173494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='63db5869-7587-4d2a-ac56-8b2e33092808',volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:33:03.339166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:03.340141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:03.348673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:03.349197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:03.349992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:03.350435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:03.393565 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb1e85f8-b748-4e20-b90f-87c8f03bfd32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.057864 Dec 25 21:33:03.397594 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3290/6597] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:03 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:03.492045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:03.493160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:03.501614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:03.502097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:03.502905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:03.503351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:03.545079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-503120a9-623d-421d-948c-9ccfd2863be7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057364 Dec 25 21:33:03.545649 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3291/6598] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:03 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:03.565145 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85c02b23-17f5-4ea3-9e85-c658f4e19638 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.977347 Dec 25 21:33:03.565930 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3308/6599] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Dec 25 21:33:03.576189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6139370b-1503-4738-be55-62d59f9956fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:03.576913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6139370b-1503-4738-be55-62d59f9956fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:03.649945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6139370b-1503-4738-be55-62d59f9956fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:03.658367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6139370b-1503-4738-be55-62d59f9956fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1070 microversion: 2.1 time: 0.085183 Dec 25 21:33:03.659102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3292/6600] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:03 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1070 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:03.983392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f9d1c68-1eb4-4fde-9e34-d31b31a5aeb1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:03.984562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f9d1c68-1eb4-4fde-9e34-d31b31a5aeb1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:04.043730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f9d1c68-1eb4-4fde-9e34-d31b31a5aeb1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:04.051053 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f9d1c68-1eb4-4fde-9e34-d31b31a5aeb1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1224 microversion: 2.1 time: 0.071353 Dec 25 21:33:04.052839 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3309/6601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:03 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1224 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:04.405125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:04.405956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:04.413014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:04.413467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:04.414263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:04.414695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:04.461807 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65fb47fd-d5a0-41c6-ba6a-ca6e7546504f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.059563 Dec 25 21:33:04.463939 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3293/6602] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:04 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:04.557271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:04.558254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:04.579857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:04.580688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:04.581135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:04.581576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:04.630886 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6290450f-49b7-41fb-8d0c-452c681d7755 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.077303 Dec 25 21:33:04.631572 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3310/6603] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:04 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:04.676591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:04.677349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:04.685121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:04.685485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:04.686482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:04.686972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:04.769143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:04.785403 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c836537-1735-4d98-8e10-d83a25e4bc7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1120 microversion: 2.1 time: 0.110138 Dec 25 21:33:04.787006 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3294/6604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:04 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1120 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:05.068896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:05.073535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:05.076770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.077251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.078304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.078774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.149434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:05.157959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-071462f4-9284-469f-9b3d-4abf657dc85f tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1276 microversion: 2.1 time: 0.093795 Dec 25 21:33:05.158561 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3311/6605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:05 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:05.475623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:05.477257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:05.484206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.484763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.485654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.486366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.531350 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c791a607-e860-447c-ae78-26d863d8a245 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.059385 Dec 25 21:33:05.532612 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3295/6606] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:05 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:05.644495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:05.645460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:05.652241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.652688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.653504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.654137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.705402 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f990b38-e7dc-46e6-ac07-e716f6295b3d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.066211 Dec 25 21:33:05.706017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3312/6607] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:05 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:05.803872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:05.804770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:05.812230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.813238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.814249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:05.814694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:05.918164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:05.926412 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84a57cde-dd83-4a00-9b2f-6e6aab97da9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1112 microversion: 2.1 time: 0.126734 Dec 25 21:33:05.926997 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3296/6608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:05 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1112 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:06.176094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:06.176836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:06.184276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.184733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.185568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.186011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.533987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:06.548708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:06.549295 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb6be8b6-1dce-4665-87f8-445a5f994947 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1282 microversion: 2.1 time: 0.374535 Dec 25 21:33:06.549389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:06.549467 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3313/6609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:06 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1282 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:06.553807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.554492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.555298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.555740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.599300 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0aeb3985-1dcb-4728-b402-8c617dd2ed17 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.058538 Dec 25 21:33:06.601082 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3297/6610] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:06 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:06.717645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:06.718715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:06.730430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.730892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.731701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.732175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.782380 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f64fd882-e44e-4f95-8b2a-d5040fbb898d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.068453 Dec 25 21:33:06.783720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3314/6611] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:06 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:06.945140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:06.946168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:06.954320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.954784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:06.955589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:06.956090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.070116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:07.078152 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9cc8200d-f60a-4e08-bc1e-0131f4e7aa2c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1186 microversion: 2.1 time: 0.139174 Dec 25 21:33:07.079230 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3298/6612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:06 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1186 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:07.565094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:07.566057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:07.574305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:07.575123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.576060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:07.576602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.611778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:07.612718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:07.619723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:07.620414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.621457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:07.622082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.663329 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85155357-9b2c-4fcb-a5b3-35ff66ffbb74 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.055651 Dec 25 21:33:07.664276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3299/6613] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:07 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:07.795016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:07.796392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:07.805111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:07.805577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.806392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:07.806881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:07.856542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-886b31ba-7eb6-4be0-8d25-93f783afa17c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.066056 Dec 25 21:33:07.858170 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3300/6614] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:07 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:08.105768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:08.106871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:08.119635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:08.123560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:08.138193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:08.146173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:08.147526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:08.151786 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dcad4bdc-a16f-421f-a302-fb576d6b7ceb tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.589188 Dec 25 21:33:08.152997 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3315/6615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:07 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:08.266811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:08.276140 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f37c219-cd6e-46e5-9b4e-ddef4a05acf8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1186 microversion: 2.1 time: 0.182577 Dec 25 21:33:08.276817 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3301/6616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:08 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1186 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:08.680445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:08.680445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:08.682672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:08.683219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:08.684131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:08.684862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:08.726017 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bae737b8-ee99-4f6b-8b1f-a1c1304afc43 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.054804 Dec 25 21:33:08.726680 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3316/6617] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:08 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:08.869501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:08.870453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:08.878731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:08.879111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:08.879904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:08.880345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:08.925272 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-918986a0-4465-44cc-8a87-ffcbfbee6c6c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.059804 Dec 25 21:33:08.926011 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3302/6618] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:08 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:09.171088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:09.172472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:09.180922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.181522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.182564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.183070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.294749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:09.295457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:09.303327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.303785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.304663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.305133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.623791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:09.631623 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1ced4dc2-5e69-474f-9420-989fe45a37aa tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.464691 Dec 25 21:33:09.632254 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3317/6619] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:09 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:09.641452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-563b006a-7f4f-4d0a-b61f-19d6afc9f7df req-11aebecf-49df-4cf0-9f74-dc317e91e7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cba0a32-9aa3-4f74-9849-5afb269493c1", "tag": "c9184c22-2100-4b1d-a817-9a12de5db0fe"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:09.643159 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:09.643159 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:33:09.651433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-563b006a-7f4f-4d0a-b61f-19d6afc9f7df req-11aebecf-49df-4cf0-9f74-dc317e91e7d2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.651894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-563b006a-7f4f-4d0a-b61f-19d6afc9f7df req-11aebecf-49df-4cf0-9f74-dc317e91e7d2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.665426 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-563b006a-7f4f-4d0a-b61f-19d6afc9f7df req-11aebecf-49df-4cf0-9f74-dc317e91e7d2 service nova] Creating event network-changed:c9184c22-2100-4b1d-a817-9a12de5db0fe for instance 2cba0a32-9aa3-4f74-9849-5afb269493c1 on nch2-master-1 Dec 25 21:33:09.670695 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-563b006a-7f4f-4d0a-b61f-19d6afc9f7df req-11aebecf-49df-4cf0-9f74-dc317e91e7d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033048 Dec 25 21:33:09.671350 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3318/6620] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:09.681749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:09.690007 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c0efbbaf-b1b2-4f2c-9241-92ea8679a888 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.399769 Dec 25 21:33:09.690788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3303/6621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:09 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:09.740839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:09.742399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:09.748712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.749209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.750081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.750530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.790855 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c723a4b7-25fe-4fa9-a9ca-3a28d9290807 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.056527 Dec 25 21:33:09.791806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3319/6622] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:09 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:09.937925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:09.938899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:09.952353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.956771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:09.956771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:09.956771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:10.001281 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41f8d1be-1b55-440f-a42e-c8281abeb90e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.067045 Dec 25 21:33:10.002200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3304/6623] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:09 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:10.653703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:10.654606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:10.663431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:10.664438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:10.665276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:10.665907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:10.707561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:10.708815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:10.717342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:10.724947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:10.724947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:10.724947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:11.114794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:11.122279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d684b262-21a6-4d8a-ac0b-3d03b6074823 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.477650 Dec 25 21:33:11.122854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3320/6624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:10 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:11.126904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:11.127626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:11.128548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:11.134720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:11.135176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:11.140749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:11.140749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:11.140999 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31969a74-5fc8-4f47-b2c2-3daad22af0fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.434243 Dec 25 21:33:11.140999 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3305/6625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:10 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:11.145960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:11.147290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:11.155153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:11.155605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:11.157552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:11.158048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:11.181766 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-300ce393-f6a7-413a-8810-b50c9a21e6a5 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.057487 Dec 25 21:33:11.182438 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3321/6626] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:11 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:11.204685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b057bee2-cfa9-4ae4-8e26-c24ac30f6487 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.064342 Dec 25 21:33:11.206971 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3306/6627] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:11 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:11.686882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b97bdddd-fe3b-4874-8c44-790604e0f647 req-3816f173-b4b9-4cf4-a17e-cd472cd81685 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e4a477-e1a9-40b2-84c5-e0897ae200eb", "tag": "cd983581-6def-4cc3-8f23-314ece41e61f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:11.691424 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:11.691424 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:33:11.697967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b97bdddd-fe3b-4874-8c44-790604e0f647 req-3816f173-b4b9-4cf4-a17e-cd472cd81685 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:11.698456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b97bdddd-fe3b-4874-8c44-790604e0f647 req-3816f173-b4b9-4cf4-a17e-cd472cd81685 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:11.709788 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b97bdddd-fe3b-4874-8c44-790604e0f647 req-3816f173-b4b9-4cf4-a17e-cd472cd81685 service nova] Creating event network-changed:cd983581-6def-4cc3-8f23-314ece41e61f for instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb on nch2-master-1 Dec 25 21:33:11.714627 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b97bdddd-fe3b-4874-8c44-790604e0f647 req-3816f173-b4b9-4cf4-a17e-cd472cd81685 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031872 Dec 25 21:33:11.715477 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3322/6628] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:12.139710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:12.141238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:12.148636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.149127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.150487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.151335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.157789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:12.158553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:12.165593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.166401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.167579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.168178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.418873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:12.427076 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c344f498-47a5-4512-a55d-ff2d00fcf1f8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.291464 Dec 25 21:33:12.427809 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3307/6629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:12 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:12.427958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:12.433064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:12.434607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:12.436322 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e35a8db-cdbe-44a3-8fbd-7c79814acbe5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.284185 Dec 25 21:33:12.439071 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3323/6630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:12 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:12.443455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.444139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.445097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.445611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.451030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:12.451985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:12.458630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.459089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.460198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:12.460696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:12.496338 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3494e299-49ea-47ff-bfa9-ad374ef5b78d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.066869 Dec 25 21:33:12.497039 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3308/6631] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:12 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:12.503523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc9875a8-31cd-4cb0-9e8e-c3c718571854 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.063079 Dec 25 21:33:12.504151 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3324/6632] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:12 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:13.445611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:13.445611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:13.452428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.452925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.453717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.454262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.461902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:13.463413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:13.474483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.475290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.476561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.478304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.655442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:13.663481 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-acb0738e-4824-45d7-bd6f-c2fa1719c3c6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.223777 Dec 25 21:33:13.664278 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3309/6633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:13 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:13.668982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:13.669893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:13.675682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.676137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.676973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.677394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.689669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:13.697581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a18c386-5c74-4ec6-a596-ec1a301890df tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.243378 Dec 25 21:33:13.698350 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3325/6634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:13 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:13.703547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:13.705874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:13.712107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.712564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.713387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:13.714210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:13.720292 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-790f51be-ecf3-4792-9000-224de4fbc2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.054509 Dec 25 21:33:13.721527 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3310/6635] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:13 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:13.759396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-62497f4e-3d4b-4daf-ab4c-b7d1ab9ed881 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.059483 Dec 25 21:33:13.760213 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3326/6636] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:13 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:14.681515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:14.682222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:14.689685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.690149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.690942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.691399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.716025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:14.717395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:14.726132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.726779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.727833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.728281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.885399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:14.893707 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-562fcf3b-1895-4796-9f6f-b2b3735c350c tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.216347 Dec 25 21:33:14.894290 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3311/6637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:14 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:14.900114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:14.901153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:14.907675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.908129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.908949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.909392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.915046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:14.923438 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1082ccf-6616-40d2-b8b4-92cbf1093514 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.211563 Dec 25 21:33:14.924019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3327/6638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:14 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:14.928822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:14.929983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:14.935945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.936405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.937254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:14.940131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:14.953381 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e5368eb-7df0-4a06-82e3-dbceba332153 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.055902 Dec 25 21:33:14.955796 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3312/6639] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:14 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:14.982905 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-afbd780a-60df-4aa8-ad07-f413f1f17ee4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057559 Dec 25 21:33:14.984761 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3328/6640] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:14 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:15.340487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-cbfb6994-ceaa-4815-b958-2bbf6a8b2da2 req-fe81b83f-fd23-49af-a63d-419841039bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cba0a32-9aa3-4f74-9849-5afb269493c1", "name": "network-vif-plugged", "status": "completed", "tag": "c9184c22-2100-4b1d-a817-9a12de5db0fe"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:15.342108 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:15.342108 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:33:15.350663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cbfb6994-ceaa-4815-b958-2bbf6a8b2da2 req-fe81b83f-fd23-49af-a63d-419841039bba service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:15.351115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cbfb6994-ceaa-4815-b958-2bbf6a8b2da2 req-fe81b83f-fd23-49af-a63d-419841039bba service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:15.362863 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-cbfb6994-ceaa-4815-b958-2bbf6a8b2da2 req-fe81b83f-fd23-49af-a63d-419841039bba service nova] Creating event network-vif-plugged:c9184c22-2100-4b1d-a817-9a12de5db0fe for instance 2cba0a32-9aa3-4f74-9849-5afb269493c1 on nch2-master-1 Dec 25 21:33:15.368038 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-cbfb6994-ceaa-4815-b958-2bbf6a8b2da2 req-fe81b83f-fd23-49af-a63d-419841039bba service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031865 Dec 25 21:33:15.368592 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3313/6641] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:15.910670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:15.911976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:15.919259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:15.920486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:15.920486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:15.920898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:15.941732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:15.942474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:15.949178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:15.952698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:15.952698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:15.952698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:16.128793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:16.132725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:16.137784 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6294fd11-4d01-4aa2-adc3-9510be337f82 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1324 microversion: 2.1 time: 0.231012 Dec 25 21:33:16.138433 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3329/6642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:15 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:16.140608 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a31126d1-8049-46c5-829c-88b9132800fb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.204620 Dec 25 21:33:16.148638 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3314/6643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:15 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:16.149400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:16.149400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:16.151758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:16.152223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:16.153065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:16.153510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:16.198832 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-095606c9-8db7-4108-b859-da0ab64a179b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.059105 Dec 25 21:33:16.199739 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3330/6644] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:16 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:16.310848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:16.311841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:16.318002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:16.318467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:16.319262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:16.319711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:16.362085 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4cdcbfb8-7a62-4b9a-b3e4-457d6e21de11 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.219515 Dec 25 21:33:16.362709 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3315/6645] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:16 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:17.155354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:17.156860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.158777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:17.159717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.164265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.164818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.165713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.166225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.167574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.168209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.169327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.169783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.371092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:17.375593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:17.378923 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50fa60e5-18e9-4573-aeb6-32832a0ccb12 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.225314 Dec 25 21:33:17.379505 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3316/6646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:17 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:17.384386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d2f50f79-2b11-4f25-a469-3f8eb5344766 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1520 microversion: 2.1 time: 0.233291 Dec 25 21:33:17.389207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3331/6647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:17 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:17.391535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.392722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.399221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.399391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.400024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.400207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.401452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.401893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.417850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.418312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.424215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.424215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.445920 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-037d8bb9-fa6c-4a26-9acc-de3a4209c566 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.064851 Dec 25 21:33:17.446852 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3317/6648] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:17.451973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e6cabb1f-0875-4b75-97ab-c0f05cd03771 req-90e0c18a-599a-415b-a68e-3983219f8a1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e4a477-e1a9-40b2-84c5-e0897ae200eb", "name": "network-vif-plugged", "status": "completed", "tag": "cd983581-6def-4cc3-8f23-314ece41e61f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.453969 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:17.453969 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:33:17.469463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e6cabb1f-0875-4b75-97ab-c0f05cd03771 req-90e0c18a-599a-415b-a68e-3983219f8a1f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.469937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e6cabb1f-0875-4b75-97ab-c0f05cd03771 req-90e0c18a-599a-415b-a68e-3983219f8a1f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.483284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e6cabb1f-0875-4b75-97ab-c0f05cd03771 req-90e0c18a-599a-415b-a68e-3983219f8a1f service nova] Creating event network-vif-plugged:cd983581-6def-4cc3-8f23-314ece41e61f for instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb on nch2-master-1 Dec 25 21:33:17.488141 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e6cabb1f-0875-4b75-97ab-c0f05cd03771 req-90e0c18a-599a-415b-a68e-3983219f8a1f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040190 Dec 25 21:33:17.488745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3318/6649] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:17.511292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f718e84-79b6-4913-899c-c3c0a58e0752 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1917029248", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "c3a130a4-e25e-4c59-825d-9c61f3e40353"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.512697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f718e84-79b6-4913-899c-c3c0a58e0752 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.513587 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f718e84-79b6-4913-899c-c3c0a58e0752 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.006876 Dec 25 21:33:17.514111 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3319/6650] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers => generated 175 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:33:17.525906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5cf39e7c-9f42-4dc6-9d1d-6b9015ef3db6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:17.526922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5cf39e7c-9f42-4dc6-9d1d-6b9015ef3db6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 99e8a084-de63-4c62-b186-11bfef64ad76] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.534115 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-5cf39e7c-9f42-4dc6-9d1d-6b9015ef3db6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] HTTP exception thrown: Instance 99e8a084-de63-4c62-b186-11bfef64ad76 could not be found. Dec 25 21:33:17.534721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5cf39e7c-9f42-4dc6-9d1d-6b9015ef3db6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 404 to user: Instance 99e8a084-de63-4c62-b186-11bfef64ad76 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.539001 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca2e8114-d995-4989-bcee-0f20521722b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.144826 Dec 25 21:33:17.539887 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3332/6651] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:17.543891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5cf39e7c-9f42-4dc6-9d1d-6b9015ef3db6 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/99e8a084-de63-4c62-b186-11bfef64ad76/metadata" status: 404 len: 111 microversion: 2.1 time: 0.014341 Dec 25 21:33:17.544776 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3320/6652] 10.222.0.32 () {58 vars in 1262 bytes} [Sat Dec 25 21:33:17 2021] GET /compute/v2.1/servers/99e8a084-de63-4c62-b186-11bfef64ad76/metadata => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:33:17.658758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b5c9c68-45df-4d73-8b4f-714a6a05e883 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1464475512", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c3a130a4-e25e-4c59-825d-9c61f3e40353"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.660337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b5c9c68-45df-4d73-8b4f-714a6a05e883 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.661197 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b5c9c68-45df-4d73-8b4f-714a6a05e883 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.007815 Dec 25 21:33:17.661754 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3333/6653] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers => generated 687 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:33:17.708649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c755f939-a8b1-455e-884b-248e7d42dfd5 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1898207320", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c3a130a4-e25e-4c59-825d-9c61f3e40353"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.710101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c755f939-a8b1-455e-884b-248e7d42dfd5 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.710924 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c755f939-a8b1-455e-884b-248e7d42dfd5 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.006166 Dec 25 21:33:17.711457 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3321/6654] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers => generated 689 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:33:17.758068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d8e3103-cd2d-4926-8dce-06c0f721d422 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-944800869", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c3a130a4-e25e-4c59-825d-9c61f3e40353"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.759527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d8e3103-cd2d-4926-8dce-06c0f721d422 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.760370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d8e3103-cd2d-4926-8dce-06c0f721d422 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.006704 Dec 25 21:33:17.760903 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3334/6655] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers => generated 1197 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Dec 25 21:33:17.807340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f8b04bd-5092-427d-9c67-ba3b4ff029ce tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1447730567", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "c3a130a4-e25e-4c59-825d-9c61f3e40353"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:17.808781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f8b04bd-5092-427d-9c67-ba3b4ff029ce tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.809668 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f8b04bd-5092-427d-9c67-ba3b4ff029ce tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.006751 Dec 25 21:33:17.810176 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3322/6656] 10.222.0.32 () {60 vars in 1147 bytes} [Sat Dec 25 21:33:17 2021] POST /compute/v2.1/servers => generated 2221 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Dec 25 21:33:17.821857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b39b594f-71c4-4f30-8106-eb398ce0409d tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:17.824643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b39b594f-71c4-4f30-8106-eb398ce0409d tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: fe771771-4e3d-49eb-8b8d-dae4a3e83448] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.830721 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b39b594f-71c4-4f30-8106-eb398ce0409d tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] HTTP exception thrown: Instance fe771771-4e3d-49eb-8b8d-dae4a3e83448 could not be found. Dec 25 21:33:17.831372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b39b594f-71c4-4f30-8106-eb398ce0409d tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 404 to user: Instance fe771771-4e3d-49eb-8b8d-dae4a3e83448 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:17.833023 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b39b594f-71c4-4f30-8106-eb398ce0409d tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/fe771771-4e3d-49eb-8b8d-dae4a3e83448/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.016035 Dec 25 21:33:17.833023 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3335/6657] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 21:33:17 2021] GET /compute/v2.1/servers/fe771771-4e3d-49eb-8b8d-dae4a3e83448/metadata/test2 => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:33:17.847145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:17.847649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:17.854216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.854674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.855551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:17.855994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:17.881073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:33:18.167288 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd4ca9ef-b6b0-4d9d-a343-def8d31648d7 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "DELETE /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 204 len: 0 microversion: 2.1 time: 0.324709 Dec 25 21:33:18.171058 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3323/6658] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:33:17 2021] DELETE /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:33:18.177453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:18.178215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:18.187170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.187630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.188518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.189220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.336233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:18.344497 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61e9780e-488a-4a4c-8230-0faaaa47d3d1 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1526 microversion: 2.1 time: 0.171976 Dec 25 21:33:18.345100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3336/6659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:18 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1526 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:18.396850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:18.397566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:18.404857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.405342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.406694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.407131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.459060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:18.460613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:18.467967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.469138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.469547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.470051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.517729 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e38b517-49b0-4450-a9dd-1dcc115bcdb3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.062937 Dec 25 21:33:18.518400 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3337/6660] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:18 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:18.546908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:18.551559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:18.553222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:18.554661 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41541379-0c75-4a45-85cf-f2ca8354fb4f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1216 microversion: 2.1 time: 0.162069 Dec 25 21:33:18.555321 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3324/6661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:18 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1216 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:18.560529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.561084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.561969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:18.562945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:18.605196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a47173a6-b98c-4030-a59f-2e52ef5699ee tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057517 Dec 25 21:33:18.606088 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3338/6662] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:18 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:19.361781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:19.362401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:19.369245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.369702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.370494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.370936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.511252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:19.519286 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e608f8d8-d268-4d7f-b6ba-78b59cfa2ae8 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1526 microversion: 2.1 time: 0.161768 Dec 25 21:33:19.519962 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3325/6663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:19 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1526 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:19.529362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:19.530366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:19.538325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.538721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.539505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.539944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.572355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:19.573335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:19.579852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.580366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.585234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.585234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.585739 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d27b2b4d-b269-4727-89f4-795e8fa30ea1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.060302 Dec 25 21:33:19.589760 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3339/6664] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:19 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:19.617902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:19.618947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:19.628299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.628299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.628564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.628800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.682754 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b381a75-58c4-4155-83ca-5bf995464858 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.069245 Dec 25 21:33:19.684290 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3340/6665] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:19 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:19.826612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:19.836105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-abd50da2-f2c9-4dbf-8d1d-ba093fc0f946 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1404 microversion: 2.1 time: 0.267689 Dec 25 21:33:19.836835 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3326/6666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:19 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1404 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:19.859009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:19.860543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:19.868513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.869015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:19.869845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:19.870320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.125344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:20.137030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9baead3e-58b0-4e1f-8309-531c390d89e5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1404 microversion: 2.1 time: 0.286680 Dec 25 21:33:20.138843 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3341/6667] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:19 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1404 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:20.157181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-13633251"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:20.158296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:20.164664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.165231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.166034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.166485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.264287 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Attempting to quiesce instance before volume snapshot. Dec 25 21:33:20.332776 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Dec 25 21:33:20.357305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-455d707c-1ea0-4554-a108-ed9309f9a176 req-d9197664-3789-481f-8bf8-baa8cb9ee012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cba0a32-9aa3-4f74-9849-5afb269493c1", "name": "network-vif-deleted", "tag": "c9184c22-2100-4b1d-a817-9a12de5db0fe"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:20.361602 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:20.361602 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:33:20.372818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-455d707c-1ea0-4554-a108-ed9309f9a176 req-d9197664-3789-481f-8bf8-baa8cb9ee012 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.372818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-455d707c-1ea0-4554-a108-ed9309f9a176 req-d9197664-3789-481f-8bf8-baa8cb9ee012 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.384838 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-455d707c-1ea0-4554-a108-ed9309f9a176 req-d9197664-3789-481f-8bf8-baa8cb9ee012 service nova] Creating event network-vif-deleted:c9184c22-2100-4b1d-a817-9a12de5db0fe for instance 2cba0a32-9aa3-4f74-9849-5afb269493c1 on nch2-master-1 Dec 25 21:33:20.391430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-455d707c-1ea0-4554-a108-ed9309f9a176 req-d9197664-3789-481f-8bf8-baa8cb9ee012 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036733 Dec 25 21:33:20.391430 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3342/6668] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:33:20.536029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:20.537487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:20.546068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.547119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.548042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.548513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.601888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Creating snapshot from volume 63db5869-7587-4d2a-ac56-8b2e33092808. {{(pid=136547) snapshot_instance /opt/stack/nova/nova/compute/api.py:3399}} Dec 25 21:33:20.632083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57b60038227d40fabb353ef15c464cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1acf7a8cbb44ce80756e3508b9b392', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:20.641602 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9bb837c4-f4fd-4fe7-8d87-12328483e8f3 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 200 len: 1309 microversion: 2.1 time: 0.109634 Dec 25 21:33:20.642294 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3343/6669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:20 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:20.648257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:20.649299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:20.658547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.659169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.660189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.660786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.712016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6cc92c77-9bfb-4d8c-a94b-6d2229ab2455 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.068258 Dec 25 21:33:20.712767 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3344/6670] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:20 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:20.718707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:20.719750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:20.726790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.727311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.728099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:20.728539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:20.771461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9e2216b-68b2-4513-9ea4-1a40780c0e16 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.056906 Dec 25 21:33:20.772121 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3345/6671] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:20 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:21.658651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:21.659418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] [instance: 2cba0a32-9aa3-4f74-9849-5afb269493c1] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:21.667272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:21.667801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:21.668668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:21.669219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:21.683719 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] HTTP exception thrown: Instance 2cba0a32-9aa3-4f74-9849-5afb269493c1 could not be found. Dec 25 21:33:21.684402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] Returning 404 to user: Instance 2cba0a32-9aa3-4f74-9849-5afb269493c1 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:21.685452 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9dfb25d1-8b95-4f40-81b3-d9e620edaf46 tempest-ServerMetadataNegativeTestJSON-2133553618 tempest-ServerMetadataNegativeTestJSON-2133553618-project] 10.222.0.32 "GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1" status: 404 len: 111 microversion: 2.1 time: 0.031080 Dec 25 21:33:21.686000 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3346/6672] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:21 2021] GET /compute/v2.1/servers/2cba0a32-9aa3-4f74-9849-5afb269493c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:33:21.724948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:21.728925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:21.741482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:21.742012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:21.742898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:21.743406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:21.796082 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-231c8aa7-4365-4b07-87a2-5288d883ad32 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.075952 Dec 25 21:33:21.797423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3347/6673] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:21 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:21.805776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:21.806921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:21.813706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:21.814253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:21.815127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:21.815560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:21.864685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1662c21c-4842-4099-bca7-edbd4fabb8d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.065497 Dec 25 21:33:21.869293 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3348/6674] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:21 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:22.519938 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-827c9447-1472-4138-9009-664d2c4af047 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb/action" status: 202 len: 0 microversion: 2.1 time: 2.366791 Dec 25 21:33:22.520627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3327/6675] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:33:20 2021] POST /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb/action => generated 0 bytes in 2369 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 21:33:22.809457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:22.810492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:22.818660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:22.819118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:22.819914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:22.820354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:22.864166 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2de9ba2-4bbd-4b79-bd43-75d078f3177e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.058845 Dec 25 21:33:22.865086 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3349/6676] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:22 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:22.876921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:22.877977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:22.884272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:22.884740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:22.885573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:22.886026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:22.927581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-57304fb0-4118-43b6-b9b4-205a7914aeb8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.055380 Dec 25 21:33:22.928207 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3328/6677] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:22 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:23.876571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:23.877674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:23.885212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:23.885673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:23.886466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:23.886910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:23.932467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5bf32c5-9a7c-4634-9a50-ef88e785983b tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 32634 microversion: 2.20 time: 0.060327 Dec 25 21:33:23.933400 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3350/6678] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:23 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 32634 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:23.940483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:23.941624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:23.949375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:23.954336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:23.954336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:23.954336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:23.994037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e337395-6461-4bd6-b0f1-4e1fa38b04dd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058152 Dec 25 21:33:23.994947 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3329/6679] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:23 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:24.945832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:24.946761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:24.953917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:24.954371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:24.955160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:24.955601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:25.007105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:25.015989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:25.016282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c7c7208-e76c-4aad-b3f1-6891f514cbe0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 200 len: 40784 microversion: 2.20 time: 0.067490 Dec 25 21:33:25.016282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3351/6680] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:24 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 40784 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:25.017937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:25.018435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:25.019243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:25.019695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:25.021643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:25.022230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:25.029453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:25.029915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:25.030713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:25.031156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:25.064346 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5549e24f-8d54-4fc7-a2fd-f447485e1338 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/ips" status: 200 len: 149 microversion: 2.20 time: 0.044098 Dec 25 21:33:25.064346 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3352/6681] 10.222.0.32 () {60 vars in 1288 bytes} [Sat Dec 25 21:33:25 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:33:25.073933 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3db4889f-23cd-4aba-81e9-c32d5a694eca tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.070985 Dec 25 21:33:25.078307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3330/6682] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:25 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:25.795700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-828828918", "imageRef": "e983e74d-2c56-4aa0-a228-d6289da6692c", "flavorRef": "452", "networks": [{"uuid": "d257b68f-9132-4584-b1b0-827fbb5ce176"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:25.856272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] validate_networks() for [('d257b68f-9132-4584-b1b0-827fbb5ce176', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:33:26.086969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:26.089049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:26.099034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:26.099595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:26.100688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:26.101275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:26.152109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-539b0fc7-9ab2-4795-a69b-6f36a1bc5261 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.069368 Dec 25 21:33:26.154957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3331/6683] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:26 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:26.584796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:33:26.585290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:33:26.585714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:33:26.586204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:33:26.586540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:33:26.596407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:26.596865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:26.597720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:26.598157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:26.615640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:33:26.621269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for user 171c198b6b734cd698b3c1eaf76a0234 and project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:33:26.634233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:33:26.637051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='408acdab-9a9e-4132-bb02-430bae4d8a1d',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:33:26.773578 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82931d7c-ef42-453e-8fe5-04a9e43f36bc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988005 Dec 25 21:33:26.774587 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3353/6684] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:33:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:33:26.784450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec56ecb1-d56e-4964-9d7e-b3ff9f095fe2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:26.785276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec56ecb1-d56e-4964-9d7e-b3ff9f095fe2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:26.847422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ec56ecb1-d56e-4964-9d7e-b3ff9f095fe2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:26.852517 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec56ecb1-d56e-4964-9d7e-b3ff9f095fe2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1229 microversion: 2.1 time: 0.072152 Dec 25 21:33:26.853129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3332/6685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:26 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1229 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:27.168190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:27.169209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:27.176832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:27.193768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:27.193768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:27.193768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:27.221294 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea1c16cf-eb3e-41d7-90c9-798f0dbd8da9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058176 Dec 25 21:33:27.222231 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3354/6686] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:27 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:27.870348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:27.871092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:27.879157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:27.879623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:27.880416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:27.880867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:27.954330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:27.962631 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-74ba15ad-fe4a-41e1-a50a-1244e0a57df9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1233 microversion: 2.1 time: 0.096263 Dec 25 21:33:27.968163 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3333/6687] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:27 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1233 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:28.233444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:28.234442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:28.243225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:28.243676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:28.244461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:28.245073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:28.287931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa48cbaa-7ac2-4d47-b9ae-4b0dcc142038 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058424 Dec 25 21:33:28.288862 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3355/6688] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:28 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:28.424004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:28.424572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:28.431128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:28.431599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:28.432443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:28.432924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:28.457342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lazy-loading 'flavor' on Instance uuid 15fbb331-7835-449b-b015-adf2d50f5186 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:33:28.980269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:28.981312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:28.989488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:28.998325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:28.999447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:29.000148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:29.078124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02f26fee-823f-4d42-aedd-1ef669532057 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 202 len: 0 microversion: 2.20 time: 0.658232 Dec 25 21:33:29.080951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3334/6689] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:28 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:33:29.090935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:29.091625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:29.095488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:29.100170 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1a7b773-6795-41ad-8d3a-342591a9ba15 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1289 microversion: 2.1 time: 0.124028 Dec 25 21:33:29.101162 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3356/6690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:28 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:29.112000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:29.112533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:29.117137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:29.117137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:29.301608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:29.311081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:29.311976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:29.312602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:29.313877 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-148d5f63-bb86-4be1-9df6-9ee52ebb9d47 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.229433 Dec 25 21:33:29.314119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:29.324509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3335/6691] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:29 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:29.333027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:29.333869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:29.335043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:29.335721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:29.390288 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-939e501b-5228-4d82-a790-5207ae2544e3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.093443 Dec 25 21:33:29.394822 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3357/6692] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:29 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:30.122073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:30.123327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:30.137259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:30.137259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:30.137259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:30.137259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:30.338779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:30.339480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:30.358098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:30.358098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:30.358098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:30.358442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:30.498590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:30.509903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b787066-5fec-4f28-b4da-f1aa5477a209 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.391230 Dec 25 21:33:30.510664 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3336/6693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:30 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:30.520620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:30.522146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:30.529901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:30.536135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:30.536135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:30.536135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:30.582011 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-155743f4-88bd-4dac-ad59-ad3480280266 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.069453 Dec 25 21:33:30.583363 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3337/6694] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:30 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:30.662473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:30.672352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:30.674415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:30.675715 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa39a29c-271d-4887-b739-1fd7fe644f15 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.347685 Dec 25 21:33:30.676419 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3358/6695] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:30 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:31.292251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-af2335ac-a864-49a0-83c8-19b4a8648fbb req-ce4154d2-9263-43de-8903-a85a9b566312 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f129536-218c-4970-b2c3-e76f19189f8a", "tag": "6eab478b-40cb-4636-87bb-53aac584c1f6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:31.293981 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:31.293981 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:33:31.303959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-af2335ac-a864-49a0-83c8-19b4a8648fbb req-ce4154d2-9263-43de-8903-a85a9b566312 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.304431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-af2335ac-a864-49a0-83c8-19b4a8648fbb req-ce4154d2-9263-43de-8903-a85a9b566312 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.321551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-af2335ac-a864-49a0-83c8-19b4a8648fbb req-ce4154d2-9263-43de-8903-a85a9b566312 service nova] Creating event network-changed:6eab478b-40cb-4636-87bb-53aac584c1f6 for instance 7f129536-218c-4970-b2c3-e76f19189f8a on nch1-master-1 Dec 25 21:33:31.328241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-af2335ac-a864-49a0-83c8-19b4a8648fbb req-ce4154d2-9263-43de-8903-a85a9b566312 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054225 Dec 25 21:33:31.329884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3338/6696] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:31.527612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:31.528236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:31.540714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.541098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.542209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.542827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.598225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:31.599800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:31.607428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.608154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.609469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.610139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.661857 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b36b3fe0-48d9-4156-a6a8-a1fa71a3153a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.070163 Dec 25 21:33:31.663373 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3339/6697] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:31 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:31.695091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:31.696605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:31.711511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.711987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.713053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:31.713722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:31.810996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:31.818412 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-049e84ae-eaa2-402a-b5eb-cd9c076e522d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.294690 Dec 25 21:33:31.819009 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3359/6698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:31 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:31.967877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:31.977178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:31.978792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:31.980176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c0945e1-1893-43d2-9c13-57301281ce26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.289690 Dec 25 21:33:31.980739 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3340/6699] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:31 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:32.675031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:32.676355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:32.684392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:32.685137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:32.686090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:32.686528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:32.731024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e6c54634-5b84-43fd-af5b-ca9577e6a613 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.061532 Dec 25 21:33:32.731630 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3360/6700] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:32 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:32.835415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:32.835941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:32.843454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:32.843946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:32.844800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:32.845287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:32.991327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:32.998750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:32.998946 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2db0ae5a-5276-4597-a6df-5158164a1290 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.167302 Dec 25 21:33:32.999480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:32.999598 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3341/6701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:32 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:33.007109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:33.007599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:33.008416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:33.008852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:33.151010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:33.159776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:33.161352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:33.162523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b94d1cf1-fc31-47f0-9e9d-28c8b48fb9da tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.168144 Dec 25 21:33:33.165597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3361/6702] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:32 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:33.743581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:33.744754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:33.752575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:33.753220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:33.754067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:33.754521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:33.798084 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9717ecc6-9b6e-4e3a-ad56-cde1081dc2b6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058924 Dec 25 21:33:33.798742 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3342/6703] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:33 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:34.016416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:34.017652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:34.025172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:34.025638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:34.026447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:34.026892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:34.167616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:34.175964 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-751e6fe7-f006-40f5-898c-64a364826480 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.164280 Dec 25 21:33:34.176671 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3362/6704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:34 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:34.181203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:34.182448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:34.190084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:34.190542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:34.191355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:34.191808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:34.336518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:34.344762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:34.346202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:34.347396 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cce373f3-07de-4edd-8d46-889990c676e0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.170583 Dec 25 21:33:34.347954 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3343/6705] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:34 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:34.809503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:34.810447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:34.825088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:34.826449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:34.827847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:34.828708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:34.874400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb8ffc82-c291-4066-b5f2-53aa2056bf56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.068429 Dec 25 21:33:34.874952 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3363/6706] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:34 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:35.192994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:35.193628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:35.200647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:35.201147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:35.202013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:35.202641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:35.367242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:35.367892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:35.368525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:35.377893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:35.379715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:35.381880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce178805-61f4-445d-ab04-3c4606cda9f5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.192693 Dec 25 21:33:35.382844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3344/6707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:35 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:35.384831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:35.386596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:35.556012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:35.574092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:35.575654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:35.576836 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec7e335c-0626-4695-8128-29fa619a8eb4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.214330 Dec 25 21:33:35.577739 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3364/6708] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:35 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:35.886432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:35.887361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:35.895339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:35.895810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:35.898786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:35.898786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:35.941908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-20a58cc7-d048-4eef-b160-dd99f3f6bec3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058861 Dec 25 21:33:35.942861 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3345/6709] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:35 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:36.400005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:36.400632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:36.409395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:36.409974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:36.410765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:36.411205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:36.565502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:36.577454 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85941adb-0217-4b68-a25b-73cdff60925e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.181558 Dec 25 21:33:36.579957 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3365/6710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:36 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:36.597238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:36.604962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:36.618209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:36.618209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:36.618209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:36.618209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:36.785168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:36.794039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:36.795601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:36.797803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f4f8f01-694b-4c51-960b-854353346024 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.205841 Dec 25 21:33:36.798391 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3346/6711] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:36 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:36.956442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:36.957912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:36.965450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:36.967707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:36.969468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:36.969864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:37.025871 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5dc18957-0d45-41cc-a8e4-ae697a27215b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.074212 Dec 25 21:33:37.026648 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3366/6712] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:36 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:37.600149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:37.600859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:37.608278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:37.613463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:37.613463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:37.613463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:37.753560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:37.762091 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-017523e9-b520-41f9-a991-76c14888083b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1341 microversion: 2.1 time: 0.165689 Dec 25 21:33:37.762890 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3347/6713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:37 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:37.817433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:37.818129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:37.829638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:37.830100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:37.830898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:37.831350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:37.985787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:37.993233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:37.994737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:37.995939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9647ce7-dd92-4aff-b232-1f8ca05b2124 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.182692 Dec 25 21:33:37.996555 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3367/6714] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:37 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:38.037780 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:38.038714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:38.045118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:38.045593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:38.046392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:38.046904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:38.089257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0885d738-e786-41d7-a4bd-cd272d558e69 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.055059 Dec 25 21:33:38.091604 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3348/6715] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:38 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:38.779745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:38.781580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:38.787255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:38.787723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:38.788548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:38.789030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:38.938753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:38.946974 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8b6c70a-a9fa-439b-9e16-a357dd9b69b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.170932 Dec 25 21:33:38.947567 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3368/6716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:38 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:39.015052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:39.015804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:39.023703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:39.024401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:39.025435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:39.026171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:39.102696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:39.103790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:39.111556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:39.112629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:39.113777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:39.114711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:39.176321 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61296299-b722-4959-a444-06fcb8238617 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.077160 Dec 25 21:33:39.177608 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3369/6717] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:39 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:39.197141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:39.207190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:39.209169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:39.210556 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f484d000-431e-4b36-821b-32bdc3cd9dd7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.200000 Dec 25 21:33:39.211183 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3349/6718] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:39 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:39.965032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:39.965746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:39.973208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:39.974301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:39.974499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:39.974946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:40.116044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:40.123496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c3bd2447-a6f6-4fc1-82aa-848c120fbd03 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.162796 Dec 25 21:33:40.124069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3370/6719] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:39 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:40.187883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:40.188923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:40.196816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:40.197303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:40.198232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:40.198687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:40.230161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:40.231862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:40.238727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:40.239183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:40.239977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:40.240415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:40.242064 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6d1bc58-79a4-482f-9a1e-0fbae36f7916 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.058002 Dec 25 21:33:40.242862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3350/6720] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:40 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:40.373301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:40.381289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:40.382806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:40.383966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09775ecd-c4ab-4943-929b-8a2e0b28172c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1743 microversion: 2.20 time: 0.157672 Dec 25 21:33:40.384529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3371/6721] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:40 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:41.143341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:41.144412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:41.152218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:41.152694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:41.153707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:41.154161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:41.267099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:41.267099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:41.277182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:41.282141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:41.284374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:41.286035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:41.354531 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c291acb1-8534-4821-830b-55650434b4a4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.097443 Dec 25 21:33:41.356909 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3372/6722] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:41 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:41.370554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:41.378930 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cefccb6-979e-42cf-bd3d-a7ef06576eb8 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.241259 Dec 25 21:33:41.381655 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3351/6723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:41 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:41.418294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:41.418294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:41.418294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:41.418294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:41.418294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:41.418294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:41.586022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:41.596926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:41.598829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:41.600262 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc9965db-ebe4-43d5-8a87-7292e51d737e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1743 microversion: 2.20 time: 0.199314 Dec 25 21:33:41.601060 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3373/6724] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:41 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1743 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:42.369115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:42.370708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:42.381180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:42.382125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:42.383685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:42.384727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:42.397915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:42.398786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:42.417076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:42.420287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:42.421371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:42.421885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:42.444556 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-382bc151-73b9-47a7-bc06-95a5b8426f4d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.082103 Dec 25 21:33:42.445679 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3352/6725] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:42 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:42.580100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:42.596208 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-736b4b06-a68a-470b-b203-ee630b555058 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.198610 Dec 25 21:33:42.596208 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3374/6726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:42 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:42.620319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:42.621858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:42.634529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:42.635289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:42.636699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:42.637600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:42.842549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:42.850233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:42.852350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:42.854078 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d07aefe-7ede-4dcb-bcc3-3816a6501922 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.238204 Dec 25 21:33:42.855565 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3353/6727] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:42 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:43.311501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5075a24b-841c-4beb-bfee-9efc0da7f0ae req-aded8d5f-80ef-44fa-8080-2603963a6ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "name": "network-vif-plugged", "status": "completed", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:43.319301 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:43.319301 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:33:43.338718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5075a24b-841c-4beb-bfee-9efc0da7f0ae req-aded8d5f-80ef-44fa-8080-2603963a6ba7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.342207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5075a24b-841c-4beb-bfee-9efc0da7f0ae req-aded8d5f-80ef-44fa-8080-2603963a6ba7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.352492 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5075a24b-841c-4beb-bfee-9efc0da7f0ae req-aded8d5f-80ef-44fa-8080-2603963a6ba7 service nova] Creating event network-vif-plugged:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch2-master-1 Dec 25 21:33:43.358125 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5075a24b-841c-4beb-bfee-9efc0da7f0ae req-aded8d5f-80ef-44fa-8080-2603963a6ba7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050809 Dec 25 21:33:43.359317 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3375/6728] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:43.464494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:43.465460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:43.473914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.474617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.475428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.475883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.522241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a665eb7-7331-4045-a2a0-f448a4372188 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.067865 Dec 25 21:33:43.522811 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3354/6729] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:43 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:43.614243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:43.614951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:43.622935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.622935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.626745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.626745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.876312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:43.877074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:43.889195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.889667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.890507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:43.892128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:43.894942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:43.908803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f0df4c48-ff34-4636-9540-25881ba73f7e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.300801 Dec 25 21:33:43.914928 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3376/6730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:43 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:44.127370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:44.139301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:44.142082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:44.143734 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8cdd0c8-1899-4602-a3a0-3caae874ed1f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.272187 Dec 25 21:33:44.144459 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3355/6731] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:43 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:44.534652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:44.535592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:44.554128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:44.554571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:44.555632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:44.556066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:44.606995 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b59b904f-8c41-4225-974e-f543969e41e0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.070843 Dec 25 21:33:44.606995 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3377/6732] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:44 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:44.932516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:44.932516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:44.947832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:44.949315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:44.950142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:44.950822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:45.140141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:45.150476 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c602f724-862f-4eec-8e8c-5346967401e6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.222455 Dec 25 21:33:45.151645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3356/6733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:44 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:45.164257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:45.165417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:45.180180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:45.180795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:45.181656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:45.182820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:45.377159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1bdb5745-3b42-4093-95df-6c68c7c71138 req-ac842c62-a80b-4094-aa53-ddd830e056b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f129536-218c-4970-b2c3-e76f19189f8a", "name": "network-vif-plugged", "status": "completed", "tag": "6eab478b-40cb-4636-87bb-53aac584c1f6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:45.379731 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:45.379731 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:33:45.392721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1bdb5745-3b42-4093-95df-6c68c7c71138 req-ac842c62-a80b-4094-aa53-ddd830e056b4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:45.394104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1bdb5745-3b42-4093-95df-6c68c7c71138 req-ac842c62-a80b-4094-aa53-ddd830e056b4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:45.410689 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1bdb5745-3b42-4093-95df-6c68c7c71138 req-ac842c62-a80b-4094-aa53-ddd830e056b4 service nova] Creating event network-vif-plugged:6eab478b-40cb-4636-87bb-53aac584c1f6 for instance 7f129536-218c-4970-b2c3-e76f19189f8a on nch1-master-1 Dec 25 21:33:45.418656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1bdb5745-3b42-4093-95df-6c68c7c71138 req-ac842c62-a80b-4094-aa53-ddd830e056b4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048798 Dec 25 21:33:45.419284 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3357/6734] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:33:45.424918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:45.435510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:45.446562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:45.446562 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b1d2cfad-5507-4a3d-b382-abdd7f3f6d2d tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.280125 Dec 25 21:33:45.446562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3378/6735] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:45 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:45.614888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:45.616143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:45.625180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:45.625180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:45.625180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:45.625571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:45.794109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2627e1ed-3767-4237-b157-fe8cb0b0b9aa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.183149 Dec 25 21:33:45.794817 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3358/6736] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:45 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:46.170898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:46.171789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:46.182481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:46.182481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:46.182481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:46.182481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:46.354607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:46.370325 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-818e792e-1ed9-4ffd-82ac-0da19a50ec9e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.205954 Dec 25 21:33:46.370911 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3379/6737] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:46 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:46.463833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:46.464926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:46.476173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:46.476679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:46.477518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:46.477967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:46.715596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:46.727437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:46.729008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:46.730416 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee4f223f-2ba3-4c9b-b716-eadd1e10687a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.270661 Dec 25 21:33:46.730975 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3359/6738] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:46 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:46.812299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:46.813667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:46.820819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:46.821576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:46.822613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:46.823246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:46.888076 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fff247b1-ca1b-4b37-bbcb-bd2a2827492f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.085806 Dec 25 21:33:46.892860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3380/6739] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:46 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:47.387103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:47.387965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:47.399424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:47.402548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:47.403598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:47.405338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:47.581037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:47.596988 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-670e5a07-ac71-4272-bb2f-48e2e9e328d0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1375 microversion: 2.1 time: 0.213308 Dec 25 21:33:47.598520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3360/6740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:47 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1375 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:47.748015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:47.749406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:47.757551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:47.762564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:47.762564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:47.762564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:47.899891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:47.902487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:47.920479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:47.921010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:47.923521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:47.924673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:47.925575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:47.932533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:47.934127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:47.935305 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6efda75f-e50e-4cea-a98b-3ce617872088 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.191418 Dec 25 21:33:47.937289 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3381/6741] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:47 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:48.000582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-309b74d2-59f5-4901-8eea-0946ce981e2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.104463 Dec 25 21:33:48.004556 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3361/6742] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:47 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:48.615016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:48.615955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:48.630804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:48.632234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:48.633577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:48.634094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:48.852203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:48.868617 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c6d5fce-2f53-4c01-9130-02a67e6db934 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1562 microversion: 2.1 time: 0.257498 Dec 25 21:33:48.869248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3382/6743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:48 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1562 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:48.886978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:48.889259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:48.896321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:48.896793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:48.898035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:48.898504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:48.956985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:48.958148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:48.966817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:48.973497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:48.973497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:48.973497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:49.146836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:49.154981 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aad57ca4-0731-475b-9e07-247fe812dd49 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1562 microversion: 2.1 time: 0.272188 Dec 25 21:33:49.156637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3362/6744] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:48 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1562 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:49.161834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:49.163063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:49.171094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:49.172353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:49.173394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:49.174011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:49.214730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:49.224339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:49.226202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:49.226726 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8abd7fb-ebf4-4ef6-8850-cf3530de52eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.068605 Dec 25 21:33:49.227421 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-31aba3eb-9009-466d-a3cc-f542a27505fe tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.275823 Dec 25 21:33:49.227581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3363/6745] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:49 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:49.232334 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3383/6746] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:48 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:49.262311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:49.263035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:49.271301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:49.271860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:49.272673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:49.273176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:49.306653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:33:49.810538 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31f64b63-61b6-484d-9aa0-869b45a4ebac tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 204 len: 0 microversion: 2.1 time: 0.555733 Dec 25 21:33:49.817339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3364/6747] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:33:49 2021] DELETE /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:33:49.822114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:49.823097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:49.841545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:49.841545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:49.841545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:49.841545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:50.006871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:50.018690 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7b45e09-524f-4202-9a93-4276984f544b tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1568 microversion: 2.1 time: 0.200227 Dec 25 21:33:50.019339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3384/6748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:49 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:50.239762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:50.240775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:50.249181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:50.250386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:50.252048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:50.252048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:50.253913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:50.255044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:50.271322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:50.271887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:50.272816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:50.273407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:50.312159 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b2e28da-6e60-4d3a-bb86-35f13ad1d2e9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.076161 Dec 25 21:33:50.312818 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3365/6749] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:50 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:50.512749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:50.528900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:50.534717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:50.537308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a61a5f8a-913d-4f44-b65f-56d5db03f8f6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.295173 Dec 25 21:33:50.538552 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3385/6750] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:50 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:51.037853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:51.038851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:51.049055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:51.049804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:51.052189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:51.052916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:51.244129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:51.256897 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ecc78ce9-65ff-4126-b3cc-6d1e7e5100d4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1568 microversion: 2.1 time: 0.223465 Dec 25 21:33:51.259370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3366/6751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:51 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:51.323901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:51.329825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:51.335889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:51.342670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:51.343567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:51.344017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:51.393152 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc9ba5e8-c3c8-488f-a6e1-45ddeb2c7d49 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.072726 Dec 25 21:33:51.394437 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3386/6752] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:51 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:51.557893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:51.558524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:51.566113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:51.566787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:51.567765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:51.568374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:51.865124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:51.871966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:51.873771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:51.875295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d0fdd88-6476-4f07-9656-6645a17cbcbb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.322122 Dec 25 21:33:51.875942 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3367/6753] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:51 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:52.157050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a9afbbe7-33cb-430e-b64d-6caabe8f4168 req-24b16960-e76f-4566-b37b-577689c87b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f129536-218c-4970-b2c3-e76f19189f8a", "name": "network-vif-deleted", "tag": "6eab478b-40cb-4636-87bb-53aac584c1f6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:52.158562 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:52.158562 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:33:52.172598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a9afbbe7-33cb-430e-b64d-6caabe8f4168 req-24b16960-e76f-4566-b37b-577689c87b5d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.173070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a9afbbe7-33cb-430e-b64d-6caabe8f4168 req-24b16960-e76f-4566-b37b-577689c87b5d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:52.196609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a9afbbe7-33cb-430e-b64d-6caabe8f4168 req-24b16960-e76f-4566-b37b-577689c87b5d service nova] Creating event network-vif-deleted:6eab478b-40cb-4636-87bb-53aac584c1f6 for instance 7f129536-218c-4970-b2c3-e76f19189f8a on nch1-master-1 Dec 25 21:33:52.203663 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a9afbbe7-33cb-430e-b64d-6caabe8f4168 req-24b16960-e76f-4566-b37b-577689c87b5d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051408 Dec 25 21:33:52.224147 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3387/6754] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:33:52.278948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:52.281183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:52.299060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.299767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:52.301654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.304471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:52.417218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:52.419233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:52.425891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:52.429407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.430066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:52.431322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.432183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:52.439198 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc6302f8-ebf9-4f83-b9a3-b6fa295f26f1 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1360 microversion: 2.1 time: 0.164081 Dec 25 21:33:52.440174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3368/6755] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:52 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1360 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:52.492259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92bff5a4-cce7-4d79-931b-4a98711c3dc8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.090178 Dec 25 21:33:52.496825 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3388/6756] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:52 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:52.898863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:52.900557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:52.909379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.910046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:52.911541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:52.912327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:53.102337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:53.127993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:53.139567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:53.139567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-270797c5-e026-47b7-9dcf-7afc5941aa3e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.237564 Dec 25 21:33:53.139567 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3369/6757] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:52 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:53.461332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:53.462037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:53.469741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:53.470195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:53.470980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:53.471419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:53.505245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:53.506723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:53.515307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:53.515771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:53.516581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:53.517131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:53.537954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:53.546590 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7dde54ef-9120-4cf8-a683-870a86c0c65c tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1360 microversion: 2.1 time: 0.088816 Dec 25 21:33:53.547172 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3389/6758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:53 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:53.567089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2acba200-35ff-4fa7-90eb-07d8dfe23f6b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.066471 Dec 25 21:33:53.567761 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3370/6759] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:54.155695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:54.157311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:54.167475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:54.168187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:54.169045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:54.169870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:54.337070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:54.346229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:54.347751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:54.348982 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-720df317-d1cc-4d99-b98a-d4e7bfc36d26 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.197240 Dec 25 21:33:54.349550 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3390/6760] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:54 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:54.576568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:54.576568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:54.576568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:54.576568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:54.576568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:54.576568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:54.578847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:54.579763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:54.586584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:54.587047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:54.587837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:54.588450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:54.631374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-252ecb1e-1815-47e0-8b1c-880ff35fff4a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.056062 Dec 25 21:33:54.635321 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3391/6761] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:54 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:54.643708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:54.653985 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-940330d5-dde3-43eb-a9ce-58b614624fb5 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1360 microversion: 2.1 time: 0.092831 Dec 25 21:33:54.654819 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3371/6762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:54 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1360 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:55.367834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:55.369276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:55.376340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:55.376797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:55.377623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:55.378081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:55.520219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:55.528629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:55.532422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:55.532422 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c17f7816-fd6f-4128-a858-5aa667d3e8e8 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1738 microversion: 2.20 time: 0.167825 Dec 25 21:33:55.532422 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3392/6763] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:55 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:55.643351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:55.644323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:55.651901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:55.652824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:55.653701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:55.654153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:55.670818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:55.672369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:55.679777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:55.688395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:55.688395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:55.688395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:55.705790 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-181c6bb7-7c02-40a1-87b9-5c0773026660 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.066270 Dec 25 21:33:55.711516 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3372/6764] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:55 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:33:55.751723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:55.759935 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18741940-c6a2-429e-ae12-d69e921e95ee tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1360 microversion: 2.1 time: 0.092938 Dec 25 21:33:55.760532 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3393/6765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:55 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1360 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:33:56.549919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:56.550797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:56.558035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:56.558510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:56.559418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:56.559835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:56.698180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:56.705343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:56.706894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:56.708082 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-936f1527-c828-402b-81ed-64d73aed4b48 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1720 microversion: 2.20 time: 0.163019 Dec 25 21:33:56.718885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:56.719972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:56.720318 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3373/6766] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:56 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:56.730465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:56.731015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:56.732068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:56.732563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:56.777312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:56.777947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:56.780827 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4868c418-80dc-44e0-8825-69ce71da7b7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.066241 Dec 25 21:33:56.781485 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3394/6767] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:56 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:56.784438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:56.784944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:56.785757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:56.786215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:56.849548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:56.857128 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eedd3f9e-8f26-41c5-b5b8-9491baf5aad7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1360 microversion: 2.1 time: 0.083956 Dec 25 21:33:56.857711 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3374/6768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:56 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1360 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:57.728461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:57.729419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:57.738251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.739724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.740848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.741565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.793412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:57.794414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:57.805217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.805695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.806693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.807155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.851866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6fafe02-a4c3-4e92-ba4a-b9c1ac8db7ba tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.063026 Dec 25 21:33:57.855306 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3375/6769] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:57 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:57.875196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:57.876020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:57.883331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.883805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.884625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.885122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.913268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:57.922685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:57.924502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:57.925856 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9206dddc-6628-4ddc-b7e1-519cd876dfd2 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1720 microversion: 2.20 time: 0.202342 Dec 25 21:33:57.926696 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3395/6770] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:57 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1720 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:33:57.926852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:57.927206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:57.927677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lazy-loading 'fault' on Instance uuid 7f129536-218c-4970-b2c3-e76f19189f8a {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:33:57.978473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:57.987777 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-459d1e2f-6417-4c6c-a0c3-a44a44081141 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 200 len: 1365 microversion: 2.1 time: 0.117106 Dec 25 21:33:57.988940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3376/6771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:57 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:33:58.863168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:58.864974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:58.873419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:58.874396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:58.875186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:58.875632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:58.917342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ce3897d-6584-400d-8bd0-146ea5d114f2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057775 Dec 25 21:33:58.917992 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3396/6772] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:58 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:33:58.943596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:58.944260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:58.952897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:58.954700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:58.954700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:58.954700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.007223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:33:59.007839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:59.017321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.018977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.018977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.020728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.035823 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 7f129536-218c-4970-b2c3-e76f19189f8a could not be found. Dec 25 21:33:59.036861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 7f129536-218c-4970-b2c3-e76f19189f8a could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:33:59.037444 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f703d601-8b5f-49b2-803e-6b319a8b23b3 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 404 len: 111 microversion: 2.1 time: 0.034471 Dec 25 21:33:59.038384 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3397/6773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:33:59 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:33:59.093928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:59.102419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:59.104046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:33:59.105422 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6e7ef662-d1bc-467d-a33e-5fda59c504f0 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1663 microversion: 2.20 time: 0.165642 Dec 25 21:33:59.106102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3377/6774] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:33:58 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:33:59.123249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6f19b7c-8208-496f-b21d-a897c1383467"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:59.125110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:59.132021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.132526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.133336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.133775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.421725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8669fe85-dc19-46e0-b66d-3eaa91f1dc27 req-32d70ff0-7677-4894-afb3-a16dab53f2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "name": "network-vif-unplugged", "status": "completed", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:59.423493 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:33:59.423493 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:33:59.433579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8669fe85-dc19-46e0-b66d-3eaa91f1dc27 req-32d70ff0-7677-4894-afb3-a16dab53f2dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.434052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8669fe85-dc19-46e0-b66d-3eaa91f1dc27 req-32d70ff0-7677-4894-afb3-a16dab53f2dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.446890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.compute.server_external_events [req-8669fe85-dc19-46e0-b66d-3eaa91f1dc27 req-32d70ff0-7677-4894-afb3-a16dab53f2dc service nova] Unable to find a host for instance 15fbb331-7835-449b-b015-adf2d50f5186. Dropping event network-vif-unplugged {{(pid=136547) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 21:33:59.448094 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8669fe85-dc19-46e0-b66d-3eaa91f1dc27 req-32d70ff0-7677-4894-afb3-a16dab53f2dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030750 Dec 25 21:33:59.448706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3378/6775] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Dec 25 21:33:59.927886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:33:59.928820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:33:59.935913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.936697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.937789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:33:59.938370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:33:59.982010 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd2c8796-5a31-4905-ab37-60e4d580442d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.057728 Dec 25 21:33:59.986738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3379/6776] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:33:59 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:00.446289 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf7eb8a0-cc92-4d0b-b0a0-5db0a86a524a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.327029 Dec 25 21:34:00.447270 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3398/6777] 10.222.0.32 () {62 vars in 1363 bytes} [Sat Dec 25 21:33:59 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-volume_attachments => generated 188 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:34:00.567121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:00.567964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:00.576215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:00.581885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:00.581885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:00.581885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:00.994439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:00.995543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:01.001958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:01.002411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:01.003187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:01.003630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:01.047712 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27862ae2-275f-47b6-9979-c7f6ae8563b4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.056885 Dec 25 21:34:01.048385 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3399/6778] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:00 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:01.205562 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d1dc7fa0-473a-44e8-a8fc-030c39d48eb6 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-volume_attachments/c6f19b7c-8208-496f-b21d-a897c1383467" status: 202 len: 0 microversion: 2.20 time: 0.643723 Dec 25 21:34:01.206528 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3380/6779] 10.222.0.32 () {60 vars in 1456 bytes} [Sat Dec 25 21:34:00 2021] DELETE /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-volume_attachments/c6f19b7c-8208-496f-b21d-a897c1383467 => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:34:01.267305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:01.268023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:01.275175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:01.275680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:01.276480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:01.276925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:01.523597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f56d626-a68f-4ce4-a324-6b10874e938f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action" status: 202 len: 0 microversion: 2.20 time: 0.260779 Dec 25 21:34:01.527597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3400/6780] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:01 2021] POST /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:34:01.533409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:01.534043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:01.543781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:01.543781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:01.544550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:01.545041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:02.068707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:02.069920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:02.077114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:02.077595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:02.078457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:02.078895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:02.317945 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23789894-aace-432d-9a74-9b87eda4a8bb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.079430 Dec 25 21:34:02.317945 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3401/6781] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:02 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:02.321290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:02.321290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:02.321290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:02.321290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-82903bfb-d6fd-42c4-aa9b-842b5e8f15cb tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1671 microversion: 2.20 time: 0.645853 Dec 25 21:34:02.321290 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3381/6782] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:01 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1671 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:03.149229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:03.159693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:03.159693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:03.159693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:03.160021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:03.160220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:03.194094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:03.194883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:03.201205 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d80f3e12-a465-43d2-80e9-951380c65182 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.055806 Dec 25 21:34:03.201859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3402/6783] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:03 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:03.202501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:03.203470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:03.204263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:03.204719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:03.348089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:03.356010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:03.357525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:03.358763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f8c2c60-755c-40b1-88dc-7ed2406c9272 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.168690 Dec 25 21:34:03.359418 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3382/6784] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:03 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:04.214175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:04.216245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:04.227119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:04.227573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:04.228368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:04.229199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:04.283637 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e34c357b-ed77-4acd-89ff-8ac82358ddb4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.073336 Dec 25 21:34:04.284377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3403/6785] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:04 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:04.377909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:04.379712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:04.390223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:04.390223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:04.392590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:04.393676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:04.657027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:04.667492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:04.670063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:04.671584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b7b8383-af9a-4073-8ee6-34ab9319b2b7 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.297965 Dec 25 21:34:04.685163 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3383/6786] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:04 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:05.114118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-51125afb-3b18-4bd0-a308-3e5f9bcd070e req-f16b4436-5e95-4f20-987b-c04e3aef3b44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:05.117680 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:05.117680 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:34:05.123929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-51125afb-3b18-4bd0-a308-3e5f9bcd070e req-f16b4436-5e95-4f20-987b-c04e3aef3b44 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:05.124375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-51125afb-3b18-4bd0-a308-3e5f9bcd070e req-f16b4436-5e95-4f20-987b-c04e3aef3b44 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:05.135490 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-51125afb-3b18-4bd0-a308-3e5f9bcd070e req-f16b4436-5e95-4f20-987b-c04e3aef3b44 service nova] Creating event network-changed:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch1-master-1 Dec 25 21:34:05.142755 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-51125afb-3b18-4bd0-a308-3e5f9bcd070e req-f16b4436-5e95-4f20-987b-c04e3aef3b44 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.294970 Dec 25 21:34:05.143690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3404/6787] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:34:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:34:05.295776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:05.297785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:05.303858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:05.304420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:05.305353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:05.305808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:05.366248 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-befd44ae-9dbf-4197-935b-9567c3725bd1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.074340 Dec 25 21:34:05.367226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3384/6788] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:05 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:05.696457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:05.696457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:05.716549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:05.717121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:05.717987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:05.718466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:06.050306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:06.066899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:06.072155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:06.075311 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-295c08d2-0ca6-458c-ada8-28f62e56aa61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.387191 Dec 25 21:34:06.078296 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3405/6789] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:05 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:06.380798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:06.382706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:06.395176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:06.399344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:06.399344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:06.399344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:07.099041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:07.099658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:07.106535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:07.107015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:07.107804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:07.108251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:07.331934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:07.340936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:07.342725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:07.344172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e423f3eb-12b6-4f91-b071-b13825b6eb84 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.249011 Dec 25 21:34:07.344741 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3406/6790] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:07 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:08.362496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:08.364613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:08.377709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:08.385623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:08.385623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:08.385623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:08.633906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:08.651836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:08.653526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:08.655089 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b89b4bfb-a77f-4815-a5c9-e8afd275274c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.296406 Dec 25 21:34:08.656092 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3407/6791] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:08 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:09.675001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:09.675712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:09.690606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:09.692000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:09.692842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:09.693514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:09.907195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:09.918155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:09.920402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:09.922118 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-34a9f508-97e6-4ec3-9a47-1b5fcad6d3f4 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.251489 Dec 25 21:34:09.923210 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3408/6792] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:09 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:10.949681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:10.951075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:10.959251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:10.959939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:10.960997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:10.961729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:11.165893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:11.174701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:11.176937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:11.182606 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45f01662-a7a4-451b-98c6-a7724e0dee81 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.233904 Dec 25 21:34:11.182606 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3409/6793] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:10 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:12.197832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:12.198678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:12.206988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:12.207521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:12.208337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:12.208780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:12.379977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:12.388453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:12.391561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:12.392773 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f0c29708-2408-4043-80d3-cb4857c80822 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.199171 Dec 25 21:34:12.393411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3410/6794] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:12 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:13.412221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:13.413882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:13.420690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:13.421349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:13.422251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:13.422744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:13.596450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:13.607804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:13.609935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:13.611387 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b5e1f8b5-cc46-42b1-a919-f484046adb42 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.203663 Dec 25 21:34:13.612509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3411/6795] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:13 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:14.631089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:14.631708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:14.639510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:14.644484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:14.644484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:14.644484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:14.825202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:14.833701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:14.838375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:14.838375 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0bdb41a3-4ee9-4ffc-a9c9-ed0d8b3edcb1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.209994 Dec 25 21:34:14.838375 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3412/6796] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:14 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:15.870284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:15.871040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:15.877846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:15.878307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:15.879144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:15.879585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:16.028217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:16.035766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:16.037393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:16.038600 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bc7486d7-6f84-48db-9f9a-2a42eb5e245c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.188667 Dec 25 21:34:16.039174 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3413/6797] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:15 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:16.929781 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a2ff7f2-d888-4569-ad43-b762fe20ee29 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 10.553577 Dec 25 21:34:16.931023 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3385/6798] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:06 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 10557 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:17.056796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:17.057546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:17.070375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:17.071100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:17.072148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:17.073530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:17.313824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:17.326543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:17.328222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:17.329471 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48abd069-018a-4fc8-a0a6-ebcc10cb7ed1 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.276797 Dec 25 21:34:17.330129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3414/6799] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:17 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:34:17.942060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:17.952172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:17.960064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:17.960539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:17.961383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:17.962017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:18.016110 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2cb8fa4-695a-4aea-be68-59ffc74ce36f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.078298 Dec 25 21:34:18.017555 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3386/6800] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:17 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:18.356966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:18.357714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:18.364502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:18.365212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:18.366313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:18.366916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:18.698388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:18.706545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:18.708092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:18.709282 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1524606e-c7d6-46d0-aad9-041c2e77672a tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.364991 Dec 25 21:34:18.709865 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3415/6801] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:18 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:19.028344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:19.033219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:19.037500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:19.037972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:19.038792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:19.039252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:19.085155 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-958c4df6-3952-4cf2-a63b-845919d40dff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.060715 Dec 25 21:34:19.089381 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3387/6802] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:19 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:19.727521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:19.728125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:19.735318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:19.739813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:19.739813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:19.739813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:19.949171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:19.976280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:19.978101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:19.979476 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6bdb7506-a546-4d60-a4a4-b7dcad0f0a52 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.255768 Dec 25 21:34:19.990811 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3416/6803] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:19 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:20.101175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:20.102344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:20.112778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:20.113286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:20.114312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:20.114795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:20.159710 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b494b2fe-e133-4159-b423-2f82e74b3b3c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 24588 microversion: 2.32 time: 0.064883 Dec 25 21:34:20.163717 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3388/6804] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:20 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 24588 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:20.997821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:20.998469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:21.006169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:21.008715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:21.008715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:21.008715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:21.156936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:21.164941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:21.167192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:21.168296 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25a0d4bb-3abf-4707-9fc3-cf694e6b9d14 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.174413 Dec 25 21:34:21.168862 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3417/6805] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:20 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:21.175164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:21.175164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:21.184005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:21.184417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:21.185438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:21.185899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:21.252611 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2387e441-d694-4e24-8327-0fe6f8896dec tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.084260 Dec 25 21:34:21.253324 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3389/6806] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:21 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:22.147988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c73753ea-8b0e-4615-8665-1b78684dc45e req-7b6b2c0e-b8b5-46cf-b696-24ae04c244bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "name": "network-vif-plugged", "status": "completed", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:22.149082 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:22.149082 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:34:22.160027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c73753ea-8b0e-4615-8665-1b78684dc45e req-7b6b2c0e-b8b5-46cf-b696-24ae04c244bc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:22.160756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c73753ea-8b0e-4615-8665-1b78684dc45e req-7b6b2c0e-b8b5-46cf-b696-24ae04c244bc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:22.178011 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c73753ea-8b0e-4615-8665-1b78684dc45e req-7b6b2c0e-b8b5-46cf-b696-24ae04c244bc service nova] Creating event network-vif-plugged:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch1-master-1 Dec 25 21:34:22.183507 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c73753ea-8b0e-4615-8665-1b78684dc45e req-7b6b2c0e-b8b5-46cf-b696-24ae04c244bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041514 Dec 25 21:34:22.184537 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3418/6807] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:34:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:34:22.189868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:22.191382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:22.200266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:22.205435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:22.205435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:22.205435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:22.265412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:22.267026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:22.273700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:22.274161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:22.275013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:22.275455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:22.333594 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-effc6974-cd20-4374-ae36-d36e74156278 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.072968 Dec 25 21:34:22.334695 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3419/6808] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:22 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:22.412123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:22.420868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:22.422433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:22.423758 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9189f52-e480-4851-a3ab-7c2ef4b5fbbf tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.240857 Dec 25 21:34:22.435128 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3390/6809] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:22 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:23.346959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:23.347614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:23.355671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:23.356133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:23.357180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:23.357617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:23.404557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e0b13e81-98c3-4fde-9598-5c414e03f739 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.062433 Dec 25 21:34:23.407076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3420/6810] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:23 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:23.442347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:23.442994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:23.450366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:23.452559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:23.452559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:23.452911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:23.660135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:23.669230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:23.670799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:23.671978 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-222f282c-3861-4c82-845e-772742e38237 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.234025 Dec 25 21:34:23.672532 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3391/6811] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:23 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:24.420076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:24.424248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:24.428663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:24.429326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:24.430127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:24.430569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:24.483338 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bf6d360-92d7-4436-8568-a1772bbbf0d8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.067066 Dec 25 21:34:24.484724 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3421/6812] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:24 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:24.690629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:24.691268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:24.698361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:24.698889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:24.699697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:24.700163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:24.874177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:24.882188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:24.883742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:24.884989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f4036e2-e254-474f-aa15-e76a4191463e tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1729 microversion: 2.20 time: 0.198618 Dec 25 21:34:24.885554 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3392/6813] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:24 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1729 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:25.500438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:25.500438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:25.507263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:25.507720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:25.508504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:25.508968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:25.555033 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f25ff4b5-7cf3-4dd7-9d4a-f90db48d9f20 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.062629 Dec 25 21:34:25.559117 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3422/6814] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:25 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:25.903430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:25.904074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:25.910822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:25.911294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:25.912096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:25.912556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:26.072051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:26.081785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:26.083540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:26.084836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8bbb5f16-cfdf-4ba6-9d04-d8b3d888cba3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1716 microversion: 2.20 time: 0.185277 Dec 25 21:34:26.085524 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3393/6815] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:25 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1716 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:26.568048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:26.569079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:26.576155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:26.576723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:26.577532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:26.577965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:26.625000 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e231b99-3681-4ae1-bd84-c9759d7d86fa tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.060842 Dec 25 21:34:26.625916 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3423/6816] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:26 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:27.636924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:27.638489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:27.646656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:27.647356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:27.648330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:27.649033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:27.694639 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36128126-9136-49ac-a9c9-7b11c997335b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.061425 Dec 25 21:34:27.696209 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3394/6817] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:27 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:28.707169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:28.708233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:28.716625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:28.717720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:28.722473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:28.722473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:28.767028 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-91cbefc1-a7ff-47b3-95e8-cf9740bfeca3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.060950 Dec 25 21:34:28.767028 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3424/6818] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:28 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:29.775915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:29.776967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:29.784567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:29.785511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:29.785857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:29.786301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:29.831631 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12992446-f75b-4028-a704-dcc5491d0ea9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.058671 Dec 25 21:34:29.831631 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3395/6819] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:29 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:30.842762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:30.843787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:30.852004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:30.852458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:30.853270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:30.853703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:30.896672 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b571797d-4cf1-4c1d-97f9-6388d96bbf1f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.057920 Dec 25 21:34:30.897371 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3425/6820] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:30 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:31.908199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:31.917066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:31.917066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:31.917066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:31.917906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:31.918357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:31.965738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19da4f12-5392-4dcc-8d44-63597bdc7ccf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.061542 Dec 25 21:34:31.966645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3396/6821] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:31 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:32.977705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:32.978682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:32.986080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:32.986539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:32.987411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:32.987790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:33.030842 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a24bdd5a-c823-42ae-ad60-fdb44ebe32a0 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.057006 Dec 25 21:34:33.032735 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3426/6822] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:32 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:34.043807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:34.045007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:34.053259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:34.053728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:34.054554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:34.055028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:34.096951 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b196d8f7-9136-4178-a16c-380d23330336 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.057230 Dec 25 21:34:34.097587 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3397/6823] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:34 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:35.109497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:35.110521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:35.117868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:35.118323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:35.119107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:35.119560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:35.167611 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86c73bee-dfa0-4251-bc02-53a70a9c32d3 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.062051 Dec 25 21:34:35.168456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3427/6824] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:35 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:36.181033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:36.182041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:36.189861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:36.190326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:36.191118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:36.191569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:36.248089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0075537-8dd5-41e7-a297-3f8de7ed95fd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.071398 Dec 25 21:34:36.248681 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3398/6825] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:36 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:37.260251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:37.261591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:37.268975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:37.269432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:37.270220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:37.270662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:37.330966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a796c61-325d-4ec7-aaf3-888c7d229519 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.074667 Dec 25 21:34:37.331893 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3428/6826] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:37 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:38.349278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:38.350826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:38.359526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:38.359995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:38.360868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:38.361343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:38.418461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e89e5dc6-5188-4473-83e4-58fec6430582 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.075054 Dec 25 21:34:38.419333 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3399/6827] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:38 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:39.431714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:39.432719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:39.442252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:39.442715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:39.443507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:39.444003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:39.491493 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43407fe9-509c-45e6-8403-889ac66394ab tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.063648 Dec 25 21:34:39.492134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3429/6828] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:39 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:40.503800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:40.504853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:40.512651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:40.513158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:40.513976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:40.514531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:40.562618 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c3b573f-7323-4253-aacd-32bf672d198c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.062913 Dec 25 21:34:40.563889 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3400/6829] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:40 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:41.576427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:41.577854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:41.586415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:41.586948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:41.587998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:41.588522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:41.640245 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4486535-c384-469f-9e20-b4c9481f98d2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.068930 Dec 25 21:34:41.641135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3430/6830] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:41 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:42.652628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:42.653763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:42.661239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:42.661793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:42.662705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:42.663238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:42.707163 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-453c5c0c-5c4c-48f7-bbe0-9d79f30f6c2f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.058839 Dec 25 21:34:42.707758 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3401/6831] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:42 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:43.154676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:43.155050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:43.168914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:43.169808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:43.170796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:43.171263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:43.197899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:34:43.518674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-148fd7a8-d857-4bce-88e9-29a8930f6dd0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 204 len: 0 microversion: 2.1 time: 0.368473 Dec 25 21:34:43.519268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3431/6832] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:34:43 2021] DELETE /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:34:43.528603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:43.529448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:43.538065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:43.538543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:43.539366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:43.539851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:43.690259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:43.697793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75e6c076-1f67-4c12-82b1-b65be0822dad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1410 microversion: 2.1 time: 0.173818 Dec 25 21:34:43.698352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3402/6833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:34:43 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1410 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:34:43.718823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:43.721825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:43.728238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:43.729035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:43.730072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:43.730649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:43.790606 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85665781-ee75-4d49-a8aa-04b1e1c07ec6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.076189 Dec 25 21:34:43.791265 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3432/6834] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:43 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:44.714835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:44.715466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:44.723576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:44.724053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:44.738160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:44.738647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:44.804228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:44.805251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:44.812436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:44.813461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:44.814447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:44.815058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:44.862703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-453bba5d-8895-4f60-91bf-e49e310feace tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.061848 Dec 25 21:34:44.864092 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3433/6835] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:44 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:44.893833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:44.902662 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47d86ac5-3233-4751-bf8c-9d879c18bc2f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1410 microversion: 2.1 time: 0.191468 Dec 25 21:34:44.903258 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3403/6836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:34:44 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1410 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:34:45.819796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f849f6a2-2009-48f1-8fa4-59aa28f94433 req-ad6df92e-4d29-4063-9036-7bad420c04ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e4a477-e1a9-40b2-84c5-e0897ae200eb", "name": "network-vif-deleted", "tag": "cd983581-6def-4cc3-8f23-314ece41e61f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:45.825124 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:45.825124 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:34:45.832286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f849f6a2-2009-48f1-8fa4-59aa28f94433 req-ad6df92e-4d29-4063-9036-7bad420c04ef service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:45.832834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f849f6a2-2009-48f1-8fa4-59aa28f94433 req-ad6df92e-4d29-4063-9036-7bad420c04ef service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:45.846443 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f849f6a2-2009-48f1-8fa4-59aa28f94433 req-ad6df92e-4d29-4063-9036-7bad420c04ef service nova] Creating event network-vif-deleted:cd983581-6def-4cc3-8f23-314ece41e61f for instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb on nch2-master-1 Dec 25 21:34:45.851810 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f849f6a2-2009-48f1-8fa4-59aa28f94433 req-ad6df92e-4d29-4063-9036-7bad420c04ef service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038764 Dec 25 21:34:45.852420 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3434/6837] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:34:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:34:45.878057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:45.879401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:45.887063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:45.887535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:45.888387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:45.889028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:45.922556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:45.923583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:45.930628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:45.931083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:45.934178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:45.934178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:45.938161 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f452b7a-9091-4bc6-87c9-a20ae57f7fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.064246 Dec 25 21:34:45.939399 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3404/6838] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:45 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:45.998677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:46.006550 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a2741cca-80a7-4ca1-b1cc-636a83baefc9 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1368 microversion: 2.1 time: 0.090513 Dec 25 21:34:46.007210 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3435/6839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:34:45 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:34:46.950218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:46.951185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:46.958415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:46.958599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Calling method '.version_select at 0x7fa50075f550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:46.959038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:46.959655 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:34:46.959655 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:34:46.959879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:46.960253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:46.961664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:46.962262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:46.977456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:46.977918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:46.988756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:46.989268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:46.995393 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee61a584-eb0b-4c99-b79c-ff917f4fc519 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233 tempest-PortsAdminExtendedAttrsIpV6TestJSON-379751233-project-admin] 10.222.0.32 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.170176 Dec 25 21:34:46.999099 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3405/6840] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:34:46 2021] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:34:47.006971 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-11aa67fd-8e29-4f6a-b1f6-0ec1faeae195 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.060277 Dec 25 21:34:47.007873 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3436/6841] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:46 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:47.025825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:47.027888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:47.033100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:47.033573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:47.034376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:47.034854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:47.065512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:47.065984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:47.066514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lazy-loading 'fault' on Instance uuid 74e4a477-e1a9-40b2-84c5-e0897ae200eb {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:34:47.107085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:47.115451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9e54f80-5531-4a56-b50e-01279ea39fad tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 200 len: 1206 microversion: 2.1 time: 0.093348 Dec 25 21:34:47.116300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3406/6842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:34:47 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 1206 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:34:48.022881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:48.023959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:48.031196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:48.032406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:48.033232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:48.033673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:48.085631 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df648c1f-d2cd-46e1-aebd-d02e14bf7814 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.067290 Dec 25 21:34:48.086537 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3437/6843] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:48 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:48.134371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:48.135017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:48.142703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:48.143102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:48.143896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:48.144403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:48.160823 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb could not be found. Dec 25 21:34:48.161740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:34:48.162380 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-093525af-fbda-41b3-bb7e-4d2bd4d11ed7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 404 len: 111 microversion: 2.1 time: 0.031835 Dec 25 21:34:48.162941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3407/6844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:34:48 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:34:49.098602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:49.099698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:49.107159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:49.107606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:49.108397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:49.108901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:49.155707 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-308418e3-508a-4716-8f62-dbf14ff3702b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.061688 Dec 25 21:34:49.156375 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3438/6845] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:49 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:50.167848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:50.168818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:50.176131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:50.176615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:50.177606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:50.178092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:50.221845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc11ba00-4fb0-46eb-964f-e4a9e9511b5e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.057719 Dec 25 21:34:50.222438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3408/6846] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:50 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:51.234931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:51.236042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:51.244037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:51.244503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:51.248026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:51.248026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:51.294209 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7e05108-403a-4a7c-beb1-9d0890d656e2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.064086 Dec 25 21:34:51.294865 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3439/6847] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:51 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:52.309482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:52.310499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:52.317988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:52.318466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:52.319276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:52.319736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:52.366144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77cbdc97-ecec-465f-8380-f07557450092 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.060594 Dec 25 21:34:52.367217 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3409/6848] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:52 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:53.379390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:53.380443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:53.388191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:53.388645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:53.389452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:53.389892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:53.431777 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ceb811bc-c13c-418b-9e82-e701e0a81f2e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.056984 Dec 25 21:34:53.432719 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3440/6849] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:54.444457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:54.445545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:54.452687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:54.454120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:54.454636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:54.455103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:54.502395 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6705514b-fe05-4f88-ba46-7963e693273e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.062188 Dec 25 21:34:54.503071 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3410/6850] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:54 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:55.518390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:55.519327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:55.527051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:55.527502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:55.528280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:55.528718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:55.574249 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-767ee36e-0c16-4896-8581-d86984d5106f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.060462 Dec 25 21:34:55.574885 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3441/6851] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:55 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:56.587559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:56.588606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:56.596545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:56.597052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:56.597864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:56.598347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:56.642219 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f3858d0-474b-497b-92b6-abc3e0a64f99 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.058593 Dec 25 21:34:56.643521 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3411/6852] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:56 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:56.812087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:56.814041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:56.827523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:56.827980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:56.828826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:56.829299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:56.863207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3679260a-4645-475e-bfb4-6e3e9f8c7cc3 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055249 Dec 25 21:34:56.863772 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3442/6853] 10.222.0.32 () {60 vars in 1342 bytes} [Sat Dec 25 21:34:56 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:34:56.919968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:56.920573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:56.927622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:56.930607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:56.930607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:56.930607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:56.957046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:34:57.358428 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2ad4be1c-6350-433a-a045-c993982bcb71 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 204 len: 0 microversion: 2.20 time: 0.442220 Dec 25 21:34:57.359027 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3412/6854] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:34:56 2021] DELETE /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:34:57.367580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:57.368215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:57.374867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:57.376106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:57.377108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:57.377787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:57.520693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:57.528977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:57.530652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:57.532229 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d840928a-6a37-4f4b-a8bf-e8a33e208a3f tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.168567 Dec 25 21:34:57.532899 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3443/6855] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:57 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:57.660712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:57.662371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:57.676054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:57.685479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:57.686690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:57.687304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:57.743214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7e5584bb-25f6-40cc-8dc5-6ab313e06af2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 32489 microversion: 2.32 time: 0.091869 Dec 25 21:34:57.747203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3413/6856] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:57 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 32489 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:34:58.554351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:58.555054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:58.562717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:58.563475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:58.564365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:58.564807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:58.737395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:58.746942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:58.749676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:34:58.756574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:58.757613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:58.761668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18f0f3b7-02a8-4dc5-a73c-1aa43742a758 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1722 microversion: 2.20 time: 0.199585 Dec 25 21:34:58.766588 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3444/6857] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:58 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:34:58.768174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:58.768642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:58.769490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:58.769988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:58.838094 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77a13227-9634-40ef-b5fb-e2370a24b085 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.085835 Dec 25 21:34:58.839615 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3414/6858] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:58 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:34:59.783832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:34:59.784683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:59.798515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:59.799731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:59.806649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:59.806649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:59.858396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:34:59.860744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:34:59.907647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:59.908422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:34:59.909526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:34:59.912184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:00.020853 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b954439a-4670-46c7-847e-cc55882c424a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.173516 Dec 25 21:35:00.022876 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3415/6859] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:34:59 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:00.028403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b35cf193-0177-4bfe-b9dd-0e192b1f0d07 req-7e018419-799e-404a-9004-97f93c2d4858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15fbb331-7835-449b-b015-adf2d50f5186", "name": "network-vif-deleted", "tag": "9011d65b-fbaf-42ac-99a9-d60be63e84b8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:00.030509 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:35:00.030509 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:35:00.032801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:00.040089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b35cf193-0177-4bfe-b9dd-0e192b1f0d07 req-7e018419-799e-404a-9004-97f93c2d4858 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:00.040439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b35cf193-0177-4bfe-b9dd-0e192b1f0d07 req-7e018419-799e-404a-9004-97f93c2d4858 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:00.042965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:00.044597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517838d2d4a942bfa8b332c767c60904', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0560c323ec8e41b3bc05939e12e049d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:00.045847 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0b237875-9eb3-4c37-bbfa-92f27370a622 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 200 len: 1654 microversion: 2.20 time: 0.265977 Dec 25 21:35:00.046428 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3445/6860] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:34:59 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 1654 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:35:00.083739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b35cf193-0177-4bfe-b9dd-0e192b1f0d07 req-7e018419-799e-404a-9004-97f93c2d4858 service nova] Creating event network-vif-deleted:9011d65b-fbaf-42ac-99a9-d60be63e84b8 for instance 15fbb331-7835-449b-b015-adf2d50f5186 on nch1-master-1 Dec 25 21:35:00.083739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b35cf193-0177-4bfe-b9dd-0e192b1f0d07 req-7e018419-799e-404a-9004-97f93c2d4858 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051628 Dec 25 21:35:00.083739 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3416/6861] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:35:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:01.033572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:01.035163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:01.044064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:01.044698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:01.046413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:01.047033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:01.068167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:01.068913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:01.077302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:01.077619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:01.079017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:01.079472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:01.111078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-76a39e3c-73be-4f4c-878a-997284a94945 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.081106 Dec 25 21:35:01.115494 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3446/6862] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:01 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:01.115656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] HTTP exception thrown: Instance 15fbb331-7835-449b-b015-adf2d50f5186 could not be found. Dec 25 21:35:01.115656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Returning 404 to user: Instance 15fbb331-7835-449b-b015-adf2d50f5186 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:01.115656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-69dd2043-a502-4b7b-9711-786cd9240514 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 404 len: 111 microversion: 2.20 time: 0.052854 Dec 25 21:35:01.118503 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3417/6863] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:35:01 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:35:01.124512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1ba5de6-82ec-4e3c-9bb3-0435cb649f01 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '.version_select at 0x7fa4f618f280>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:01.245150 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1ba5de6-82ec-4e3c-9bb3-0435cb649f01 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100770141" status: 204 len: 0 microversion: 2.20 time: 0.125094 Dec 25 21:35:01.246110 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3447/6864] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:35:01 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1100770141 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Dec 25 21:35:02.123091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:02.123928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:02.131707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:02.132476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:02.133334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:02.133812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:02.183350 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cbc894a9-0cae-47aa-b66f-d8a99634af41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.063694 Dec 25 21:35:02.184823 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3418/6865] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:02 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:03.198126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:03.199917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:03.207920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:03.208772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:03.209887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:03.210667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:03.263743 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e535b4e5-f226-4b76-8a1f-e39009d080da tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.070893 Dec 25 21:35:03.264611 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3448/6866] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:03 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:04.276397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:04.277606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:04.284807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:04.285304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:04.286118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:04.286599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:04.334523 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41d6a576-d125-4de2-ab09-d8b95b834a41 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.062104 Dec 25 21:35:04.335200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3419/6867] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:04 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:05.352728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:05.353800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:05.365289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:05.372419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:05.372419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:05.372419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:05.421255 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-109f9a82-2052-4e31-a309-00f31927be95 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.072517 Dec 25 21:35:05.422039 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3449/6868] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:05 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:06.434035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:06.435413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:06.450426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:06.451465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:06.452948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:06.453917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:06.525495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b16a6d7-6d78-4257-95d5-706af84f6601 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.095863 Dec 25 21:35:06.534725 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3420/6869] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:06 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:07.263707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:07.264394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:07.271626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:07.272082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:07.272866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:07.273354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:07.289145 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 7f129536-218c-4970-b2c3-e76f19189f8a could not be found. Dec 25 21:35:07.291211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 7f129536-218c-4970-b2c3-e76f19189f8a could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:07.292112 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e7f86580-7181-4e26-8840-4343c0e72554 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 404 len: 111 microversion: 2.1 time: 0.033046 Dec 25 21:35:07.292681 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3450/6870] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:35:07 2021] DELETE /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:35:07.302341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:07.303118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 7f129536-218c-4970-b2c3-e76f19189f8a] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:07.310733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:07.314021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:07.314021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:07.314021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:07.339938 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 7f129536-218c-4970-b2c3-e76f19189f8a could not be found. Dec 25 21:35:07.341227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 7f129536-218c-4970-b2c3-e76f19189f8a could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:07.342125 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab278d31-9380-416c-bb27-c26613f516b7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a" status: 404 len: 111 microversion: 2.1 time: 0.044513 Dec 25 21:35:07.347075 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3421/6871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:07 2021] GET /compute/v2.1/servers/7f129536-218c-4970-b2c3-e76f19189f8a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:35:07.538615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:07.539663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:07.562222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:07.562686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:07.563492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:07.564456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:07.651362 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f57ca92e-9013-4967-ac35-a3dbd7c08985 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.116462 Dec 25 21:35:07.652271 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3451/6872] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:07 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:08.382264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:08.385913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:08.389839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:08.390298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:08.391095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:08.391542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:08.405025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb could not be found. Dec 25 21:35:08.405620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:08.406474 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9ba42f9-0da5-48a9-a71a-75a8fd80af61 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 404 len: 111 microversion: 2.1 time: 0.027975 Dec 25 21:35:08.406996 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3422/6873] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:35:08 2021] DELETE /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:35:08.415962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:08.417115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 74e4a477-e1a9-40b2-84c5-e0897ae200eb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:08.426117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:08.427196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:08.427795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:08.428488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:08.444749 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb could not be found. Dec 25 21:35:08.445221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 74e4a477-e1a9-40b2-84c5-e0897ae200eb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:08.446143 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2424db4a-6807-47a6-9042-fa78542cfae6 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb" status: 404 len: 111 microversion: 2.1 time: 0.034374 Dec 25 21:35:08.447492 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3452/6874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:08 2021] GET /compute/v2.1/servers/74e4a477-e1a9-40b2-84c5-e0897ae200eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:35:08.542829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-132db2b7-3d67-4830-b9be-dc48233c9a9f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'create', calling method: .version_select at 0x7fa4f5e95700>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-385736057"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:08.565099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-132db2b7-3d67-4830-b9be-dc48233c9a9f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:35:08.570974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-132db2b7-3d67-4830-b9be-dc48233c9a9f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for user 171c198b6b734cd698b3c1eaf76a0234 and project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:35:08.665320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:08.666250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:08.683248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:08.683715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:08.684542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:08.685014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:08.770372 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab0b0ff2-4b47-4e66-8582-9e98306c106c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.108625 Dec 25 21:35:08.772092 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3453/6875] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:08 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:08.882817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-132db2b7-3d67-4830-b9be-dc48233c9a9f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:35:08.889514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-132db2b7-3d67-4830-b9be-dc48233c9a9f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for user 171c198b6b734cd698b3c1eaf76a0234 and project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:35:08.916747 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-132db2b7-3d67-4830-b9be-dc48233c9a9f tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.372072 Dec 25 21:35:08.916747 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3423/6876] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:35:08 2021] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:09.784102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:09.785099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:09.792537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:09.793022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:09.793819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:09.794263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:09.840724 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd57dc75-d149-4978-9e90-a14e53bc89ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.061367 Dec 25 21:35:09.841902 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3454/6877] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:09 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:10.853512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:10.859577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:10.870590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:10.872286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:10.874259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:10.875219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:10.929142 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8f0bec5-76e9-49d8-9132-4cfe015ab16d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.079902 Dec 25 21:35:10.931514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3424/6878] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:10 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:11.951959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:11.953012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:11.962113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:11.962578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:11.963423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:11.964102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:12.013294 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-461876dc-a8b7-466d-8079-a28e2e7dc1f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.066839 Dec 25 21:35:12.014138 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3455/6879] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:11 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:13.026763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:13.028447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:13.043752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:13.044221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:13.045061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:13.045512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:13.100409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-60e262b7-d418-4d54-8ea0-c64185f7abc4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.078753 Dec 25 21:35:13.101759 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3425/6880] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:13 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:14.114961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:14.116923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:14.130905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:14.131439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:14.132402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:14.133091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:14.187156 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e65b9557-82ab-4a8f-8f72-0f63d3be8549 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.077583 Dec 25 21:35:14.188382 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3456/6881] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:14 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:15.199517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:15.200596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:15.209003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:15.209545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:15.210416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:15.210956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:15.258394 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a48ba7f8-1ff2-41a1-8852-9b8d1386e903 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.062951 Dec 25 21:35:15.263162 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3426/6882] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:15 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:16.271494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:16.273116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:16.280577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:16.281072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:16.281879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:16.282323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:16.327713 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f1b1037e-e9d1-400f-8da1-7a644d4b6909 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.060518 Dec 25 21:35:16.357848 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3457/6883] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:16 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:17.340237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:17.341320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:17.349300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:17.349774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:17.350613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:17.351085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:17.405774 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6c07af9-1ac2-4d04-93ae-487c1b38f85b tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.069248 Dec 25 21:35:17.406844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3427/6884] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:17 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:18.419011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:18.420009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:18.428040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:18.428488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:18.429308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:18.429760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:18.473679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5bebeff-1491-4e26-bb6e-68de51eba172 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.058718 Dec 25 21:35:18.474373 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3458/6885] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:18 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:19.486173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:19.487113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:19.495055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:19.495529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:19.496328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:19.496784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:19.544732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c9b0049-116a-4f42-8318-33bffeca19d9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.062584 Dec 25 21:35:19.552202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3428/6886] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:19 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:20.434995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:20.434995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:20.442191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:20.442547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:20.443539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:20.444159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:20.466619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] HTTP exception thrown: Instance 15fbb331-7835-449b-b015-adf2d50f5186 could not be found. Dec 25 21:35:20.467230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Returning 404 to user: Instance 15fbb331-7835-449b-b015-adf2d50f5186 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:20.468069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-062270cd-d175-4e0c-ba8e-d711246d6c7c tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 404 len: 111 microversion: 2.20 time: 0.040516 Dec 25 21:35:20.468634 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3459/6887] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:35:20 2021] DELETE /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:35:20.484218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:20.485212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 15fbb331-7835-449b-b015-adf2d50f5186] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:20.492839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:20.498090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:20.498090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:20.498090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:20.510285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] HTTP exception thrown: Instance 15fbb331-7835-449b-b015-adf2d50f5186 could not be found. Dec 25 21:35:20.511235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Returning 404 to user: Instance 15fbb331-7835-449b-b015-adf2d50f5186 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:20.512095 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e520a5cc-7ec8-49ae-bc88-6bf085126ffc tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186" status: 404 len: 111 microversion: 2.20 time: 0.032040 Dec 25 21:35:20.512659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3429/6888] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:35:20 2021] GET /compute/v2.1/servers/15fbb331-7835-449b-b015-adf2d50f5186 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:35:20.557258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:20.560453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:20.565265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:20.566481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:20.567428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:20.567923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:20.623073 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8541e53b-2473-4c36-87f3-07b6b364ebcd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.069914 Dec 25 21:35:20.623824 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3460/6889] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:20 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:21.638082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:21.639036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:21.647279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:21.647753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:21.648568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:21.649058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:21.700309 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bfed8eb-cf5e-4007-9647-2b2b5c1a93a7 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.066173 Dec 25 21:35:21.701052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3430/6890] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:21 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:22.714320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:22.714320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:22.721117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:22.721572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:22.722864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:22.723484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:23.016084 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a4af27b-c777-48f6-aa97-3f702c3a5b9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.307292 Dec 25 21:35:23.018966 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3461/6891] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:22 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:24.034115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:24.035205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:24.042795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:24.043263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:24.044065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:24.044519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:24.090035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36d64f14-6127-4c04-9129-8f52cdbca815 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.059914 Dec 25 21:35:24.091071 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3431/6892] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:24 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:25.103652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:25.104740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:25.127330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:25.140132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:25.145563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:25.145563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:25.188693 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00915ff0-edb7-42f6-b2f4-1349b7b4c2e5 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.089840 Dec 25 21:35:25.189474 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3462/6893] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:25 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:25.239395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-735399231", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-385736057", "security_groups": [{"name": "tempest-secgroup-smoke-1294012541"}], "block_device_mapping_v2": [{"uuid": "1f66629a-ecb8-47cb-8a87-8abb304c2f96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d257b68f-9132-4584-b1b0-827fbb5ce176"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:25.337739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] validate_networks() for [('d257b68f-9132-4584-b1b0-827fbb5ce176', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:35:25.770427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:35:25.770871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:35:25.771396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:35:25.771827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:35:25.772258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:35:25.781314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:25.781787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:25.782680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:25.783135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:25.801677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:35:25.806886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Getting quotas for user 171c198b6b734cd698b3c1eaf76a0234 and project c77dc74a46d64a67991d82bf12adb1dc. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:35:25.870317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:35:25.872601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1f66629a-ecb8-47cb-8a87-8abb304c2f96',volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:35:26.201903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:26.207111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:26.210703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:26.211152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:26.211944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:26.212378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:26.257233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f38e3a4-946e-4ee9-bc9c-85e9b7a9b060 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.059202 Dec 25 21:35:26.258299 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3463/6894] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:26 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:26.505888 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ee845d7-f7b4-4cd4-8432-466b7a61bd02 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.289637 Dec 25 21:35:26.507404 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3432/6895] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:35:25 2021] POST /compute/v2.1/servers => generated 406 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:35:26.518139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff050c5c-b049-4346-b685-27ba93152aa7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:26.520646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff050c5c-b049-4346-b685-27ba93152aa7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:26.586289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff050c5c-b049-4346-b685-27ba93152aa7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:26.593342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff050c5c-b049-4346-b685-27ba93152aa7 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1093 microversion: 2.1 time: 0.079098 Dec 25 21:35:26.594730 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3464/6896] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:26 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:27.269826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:27.277735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:27.302064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:27.302926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:27.304006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:27.304695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:27.355049 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a7d85f8-da77-4fa5-a147-830306f0048f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.088676 Dec 25 21:35:27.359723 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3433/6897] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:27 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:27.613088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:27.613088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:27.620352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:27.620914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:27.621747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:27.622197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:27.690570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:27.698593 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-947e31e0-5490-4d8d-aa6d-076643b7cbc0 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1143 microversion: 2.1 time: 0.090938 Dec 25 21:35:27.699156 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3465/6898] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:27 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:28.367924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:28.369067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:28.378514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:28.378514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:28.378514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:28.378514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:28.426385 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0bb5ec4-ad93-406e-818f-429a8f3a1493 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.062129 Dec 25 21:35:28.427242 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3434/6899] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:28 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:28.720866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:28.721505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:28.729732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:28.730182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:28.731030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:28.731468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:28.805613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:28.813556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c01ce2a9-f198-4920-989c-a0ca40c1ecfc tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1199 microversion: 2.1 time: 0.096410 Dec 25 21:35:28.814142 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3466/6900] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:28 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1199 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:29.450711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:29.450711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:29.452576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:29.453173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:29.454080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:29.454763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:29.501193 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b890b65c-186e-4267-a090-0d2a9f5aa1c4 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.065208 Dec 25 21:35:29.502586 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3435/6901] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:29 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:29.832136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:29.834914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:29.845210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:29.849421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:29.852552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:29.853261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:30.144776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:30.152866 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-983091fa-a213-4180-a3b3-bafc386af4ab tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1277 microversion: 2.1 time: 0.324986 Dec 25 21:35:30.153991 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3467/6902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:29 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:30.513509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:30.514524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:30.522922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:30.529561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:30.529561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:30.529561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:30.588467 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d530447-0c29-491e-bf02-f2197270a59a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.079057 Dec 25 21:35:30.589797 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3436/6903] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:30 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:30.711001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7097a874-be4f-4036-a62d-26be58b20d86 req-01ea3987-abd6-4b13-b598-a62a0e3254a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70451b2f-7bb3-4ea7-b6c9-824c3287928f", "tag": "d121181f-10e4-43bd-bc6a-60afaaa17f9a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:30.712996 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:35:30.712996 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:35:30.721734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7097a874-be4f-4036-a62d-26be58b20d86 req-01ea3987-abd6-4b13-b598-a62a0e3254a0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:30.722446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7097a874-be4f-4036-a62d-26be58b20d86 req-01ea3987-abd6-4b13-b598-a62a0e3254a0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:30.737138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7097a874-be4f-4036-a62d-26be58b20d86 req-01ea3987-abd6-4b13-b598-a62a0e3254a0 service nova] Creating event network-changed:d121181f-10e4-43bd-bc6a-60afaaa17f9a for instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f on nch2-master-1 Dec 25 21:35:30.742504 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7097a874-be4f-4036-a62d-26be58b20d86 req-01ea3987-abd6-4b13-b598-a62a0e3254a0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035910 Dec 25 21:35:30.743241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3468/6904] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:35:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:35:31.171363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:31.172309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:31.189633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:31.190381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:31.191407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:31.192558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:31.403491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:31.416687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7144d892-461c-415c-b2e8-a5a94ed9c13d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.248336 Dec 25 21:35:31.416687 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3437/6905] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:31 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:31.601627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:31.603722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:31.611391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:31.626702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:31.626702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:31.626702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:31.658926 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4322086d-9413-429d-a3c3-6331a7fdafb1 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.061787 Dec 25 21:35:31.659577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3469/6906] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:31 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:32.431862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:32.432497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:32.441147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:32.441609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:32.443406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:32.443406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:32.583018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:32.590706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9998df3-9e8c-4ee0-9550-bdfb850b6c8e tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.162668 Dec 25 21:35:32.591287 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3438/6907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:32 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:32.673712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:32.675079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:32.683433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:32.683986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:32.684905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:32.685619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:32.737427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e95ffe10-b312-4d0b-b5dd-1adfc8cca6ff tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.068620 Dec 25 21:35:32.740943 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3470/6908] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:32 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:33.607270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:33.607957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:33.615086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:33.615549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:33.616654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:33.617128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:33.750869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:33.751954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:33.762556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:33.767908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:33.767908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:33.767908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:33.769783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:33.779253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a1672da9-5779-47ae-be03-57445918a9fd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.176018 Dec 25 21:35:33.779981 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3439/6909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:33 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:33.821276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-62221ed6-d845-4f81-b91b-38861b54edfe tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.074195 Dec 25 21:35:33.822608 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3471/6910] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:33 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:34.612742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:34.613313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:34.620457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.620982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.621799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.622260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.638572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] HTTP exception thrown: Instance 65490ad4-5baf-4c89-9877-006d581b4758 could not be found. Dec 25 21:35:34.639471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Returning 404 to user: Instance 65490ad4-5baf-4c89-9877-006d581b4758 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:34.640341 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51bf309c-69ab-4c72-a20e-9df159704500 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "DELETE /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 404 len: 111 microversion: 2.20 time: 0.031518 Dec 25 21:35:34.641278 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3440/6911] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:35:34 2021] DELETE /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:35:34.653028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:34.654131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] [instance: 65490ad4-5baf-4c89-9877-006d581b4758] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:34.661016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.661323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.662120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.662561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.677411 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] HTTP exception thrown: Instance 65490ad4-5baf-4c89-9877-006d581b4758 could not be found. Dec 25 21:35:34.680745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] Returning 404 to user: Instance 65490ad4-5baf-4c89-9877-006d581b4758 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:35:34.680745 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7fd586c-0ea9-4ceb-a5de-e8bfeb2f0c61 tempest-AttachVolumeShelveTestJSON-1279821748 tempest-AttachVolumeShelveTestJSON-1279821748-project] 10.222.0.32 "GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758" status: 404 len: 111 microversion: 2.20 time: 0.030428 Dec 25 21:35:34.680745 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3472/6912] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:35:34 2021] GET /compute/v2.1/servers/65490ad4-5baf-4c89-9877-006d581b4758 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:35:34.797385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:34.798166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:34.805396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.806298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.807412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.807943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.836039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:34.836039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:34.844266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.844803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.846441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:34.846963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:34.902362 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-183a44fa-661b-4a55-a8a9-16dc48dd2653 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.070141 Dec 25 21:35:34.904972 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3473/6913] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:34 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:34.982329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:34.990678 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae4bee33-c414-4317-923c-7afe5c198e51 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.197809 Dec 25 21:35:34.991267 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3441/6914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:34 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:35.914060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:35.918588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:35.922391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:35.922851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:35.927166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:35.927607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:35.984196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f8e1eca-233b-4a16-9e24-e547ff495c9c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.074041 Dec 25 21:35:35.989093 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3474/6915] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:35 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:36.008519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:36.009911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:36.017853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:36.018443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:36.019584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:36.020730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:36.178035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:36.193201 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9459beca-f27b-449d-8bbe-2d42dfb085e4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.189066 Dec 25 21:35:36.193711 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3442/6916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:36 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:36.998993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:37.000752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:37.011578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:37.012039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:37.012839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:37.013319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:37.062679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7276e7f-ef97-4695-a841-82916c190bd2 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.068214 Dec 25 21:35:37.063382 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3475/6917] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:36 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:37.210591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:37.211942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:37.218834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:37.219324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:37.220124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:37.220576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:37.388426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:37.402580 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa76b265-cf60-4be2-9361-b401064a9d92 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.191588 Dec 25 21:35:37.413723 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3443/6918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:37 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:38.076072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:38.077283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:38.097401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:38.098762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:38.099816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:38.100471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:38.156713 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb0ba849-241d-479a-aa5d-4299db6803de tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.083922 Dec 25 21:35:38.158501 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3476/6919] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:38 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:38.419903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:38.420433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:38.429529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:38.430407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:38.431418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:38.432046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:38.626745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:38.640059 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad6927a0-8b61-4382-a3ac-5ec0bf9faef4 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.223369 Dec 25 21:35:38.653530 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3444/6920] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:38 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:35:39.170629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:39.171755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:39.180205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:39.184925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:39.186292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:39.187161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:39.236926 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08a59e23-b242-4e82-a83e-c8544e2774ed tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.069495 Dec 25 21:35:39.239243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3477/6921] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:39 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:39.659866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:39.661276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:39.668113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:39.668671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:39.669556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:39.670241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:39.824430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:39.839284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0a5c8a0b-c5e8-4838-9ef1-06b752d61286 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.183352 Dec 25 21:35:39.839888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3445/6922] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:39 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:39.933749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-bfe941be-8186-48b2-849d-29c8f2fc0ac2 req-27669bb6-89c3-4b65-836e-13cf22fc1ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70451b2f-7bb3-4ea7-b6c9-824c3287928f", "name": "network-vif-plugged", "status": "completed", "tag": "d121181f-10e4-43bd-bc6a-60afaaa17f9a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:39.936249 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:35:39.936249 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:35:39.945542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bfe941be-8186-48b2-849d-29c8f2fc0ac2 req-27669bb6-89c3-4b65-836e-13cf22fc1ff2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:39.946596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-bfe941be-8186-48b2-849d-29c8f2fc0ac2 req-27669bb6-89c3-4b65-836e-13cf22fc1ff2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:39.964539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-bfe941be-8186-48b2-849d-29c8f2fc0ac2 req-27669bb6-89c3-4b65-836e-13cf22fc1ff2 service nova] Creating event network-vif-plugged:d121181f-10e4-43bd-bc6a-60afaaa17f9a for instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f on nch2-master-1 Dec 25 21:35:39.975499 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-bfe941be-8186-48b2-849d-29c8f2fc0ac2 req-27669bb6-89c3-4b65-836e-13cf22fc1ff2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227084 Dec 25 21:35:39.977529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3478/6923] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:35:39 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:35:40.253195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:40.254413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:40.261132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:40.261870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:40.262709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:40.263166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:40.311760 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a6fdd5a-f794-4f96-8e36-b03da065dd7d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.063493 Dec 25 21:35:40.312732 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3446/6924] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:40 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:40.866372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:40.866372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:40.870868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:40.871775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:40.873420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:40.874119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:41.052707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:41.060381 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b66ec16d-98d7-46e9-8ec4-28897a47051d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1265 microversion: 2.1 time: 0.201819 Dec 25 21:35:41.060993 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3479/6925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:40 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:35:41.327036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:41.327036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:41.333664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:41.334135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:41.334946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:41.335403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:41.387678 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-506dcd75-bdef-4f3b-a6fb-96ecf04f35ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.066987 Dec 25 21:35:41.388551 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3447/6926] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:41 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:41.699404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Action: 'create', calling method: .version_select at 0x7fa4f62381f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-299267865"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:42.080858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:42.081599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:42.088595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:42.089158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:42.090051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:42.090447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:42.262420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:42.271244 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa43c3d6-aaa9-4146-b649-a01ebf88a35a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1452 microversion: 2.1 time: 0.194425 Dec 25 21:35:42.271811 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3448/6927] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:42 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:35:42.287329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:42.287827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:42.293766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:42.294864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:42.295027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:42.295482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:42.453174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:42.462283 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98baf324-568f-4a86-a768-1b5028896beb tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1452 microversion: 2.1 time: 0.179197 Dec 25 21:35:42.463103 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3449/6928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:35:42 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:35:42.467990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:42.468938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:42.476159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:42.476279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:42.477259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:42.477724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:42.486111 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-918c1d32-4729-4a2c-942c-a8bfb8f8cf4b tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 337 microversion: 2.1 time: 0.912176 Dec 25 21:35:42.486768 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3480/6929] 10.222.0.32 () {60 vars in 1154 bytes} [Sat Dec 25 21:35:41 2021] POST /compute/v2.1/os-volumes => generated 337 bytes in 914 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Dec 25 21:35:42.497461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6caaecb3-252b-47b5-9387-cc10dc3f4822 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa500690550>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:42.542316 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b106a6e-f9e5-4d04-8675-42fcc30e5a61 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.077059 Dec 25 21:35:42.544428 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3450/6930] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:42 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:42.580064 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6caaecb3-252b-47b5-9387-cc10dc3f4822 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.086222 Dec 25 21:35:42.580637 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3481/6931] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:35:42 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:43.555869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:43.557041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:43.565995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:43.566833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:43.568493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:43.568602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:43.593892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05bc92bd-9988-4c37-b6d5-ec90e7fb0807 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f74f4670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:43.630664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8537c5ee-e73c-4d4d-b2e7-339b9c060541 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.078602 Dec 25 21:35:43.631421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3451/6932] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:43 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:43.673067 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05bc92bd-9988-4c37-b6d5-ec90e7fb0807 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.083238 Dec 25 21:35:43.674241 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3482/6933] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:35:43 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:44.643322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:44.645166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:44.653238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:44.653879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:44.655016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:44.656016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:44.687930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa9436e9-0177-445b-b59e-72c62afa7a4a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa500690790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:44.712828 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0282644b-f62f-42c3-a9d1-fb03145db124 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.072638 Dec 25 21:35:44.713851 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3452/6934] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:44 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:44.742185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa9436e9-0177-445b-b59e-72c62afa7a4a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.060195 Dec 25 21:35:44.747144 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3483/6935] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:35:44 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:35:45.101471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-de9c360d-7d53-4257-89bd-2e1473efb3d0 req-6bec218f-2d77-4702-b54f-b8820e73e161 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70451b2f-7bb3-4ea7-b6c9-824c3287928f", "tag": "d121181f-10e4-43bd-bc6a-60afaaa17f9a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:45.102971 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:35:45.102971 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:35:45.110782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-de9c360d-7d53-4257-89bd-2e1473efb3d0 req-6bec218f-2d77-4702-b54f-b8820e73e161 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:45.111235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-de9c360d-7d53-4257-89bd-2e1473efb3d0 req-6bec218f-2d77-4702-b54f-b8820e73e161 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:45.123638 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-de9c360d-7d53-4257-89bd-2e1473efb3d0 req-6bec218f-2d77-4702-b54f-b8820e73e161 service nova] Creating event network-changed:d121181f-10e4-43bd-bc6a-60afaaa17f9a for instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f on nch2-master-1 Dec 25 21:35:45.149429 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-de9c360d-7d53-4257-89bd-2e1473efb3d0 req-6bec218f-2d77-4702-b54f-b8820e73e161 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045498 Dec 25 21:35:45.149429 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3453/6936] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:35:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:45.727782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:45.734915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:45.756845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2ddcab7-5873-479d-b426-a63ab6ec64f9 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f72c6430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:45.765584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:45.766205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:45.767266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:45.771242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:45.836214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2ddcab7-5873-479d-b426-a63ab6ec64f9 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 338 microversion: 2.1 time: 0.084977 Dec 25 21:35:45.837803 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3454/6937] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:35:45 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:35:45.840218 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bae115f4-0e12-4dc9-8d2d-f6e78f9683ce tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.118699 Dec 25 21:35:45.840904 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3484/6938] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:45 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:45.849534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2481281-5cd6-4eb7-aa79-e2310af9b835 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Action: 'create', calling method: .version_select at 0x7fa4f6fe8040>, body: {"snapshot": {"volume_id": "95fba560-1770-4ea5-b1d4-7ba870d51fc5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-168002538"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:46.419675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2481281-5cd6-4eb7-aa79-e2310af9b835 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.574515 Dec 25 21:35:46.420687 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3455/6939] 10.222.0.32 () {60 vars in 1161 bytes} [Sat Dec 25 21:35:45 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:35:46.431839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25134082-0f1d-4d5e-aea9-b1c521e93ab0 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa500690ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:46.461722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25134082-0f1d-4d5e-aea9-b1c521e93ab0 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.034924 Dec 25 21:35:46.462302 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3485/6940] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:46 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:46.471947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3ad996d-9fa1-4db1-ac05-baeb6b7946f0 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f72ee9d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:46.506247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3ad996d-9fa1-4db1-ac05-baeb6b7946f0 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038057 Dec 25 21:35:46.506837 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3456/6941] 10.222.0.32 () {58 vars in 1139 bytes} [Sat Dec 25 21:35:46 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:46.522212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b0417fc-a54a-4eac-b8af-1826de8fd69f tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6dc1820>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:46.559685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b0417fc-a54a-4eac-b8af-1826de8fd69f tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.044682 Dec 25 21:35:46.560352 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3486/6942] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:46 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:46.852485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:46.853655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:46.860702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:46.861208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:46.862004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:46.862481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:46.908846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd6017a2-bfa9-4bfe-99a2-1cf04f5d615d tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.060848 Dec 25 21:35:46.910052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3457/6943] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:46 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:47.572783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4737f1ab-8eb1-4d2f-acc3-0f6cad8c776a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6379e50>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:47.603457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4737f1ab-8eb1-4d2f-acc3-0f6cad8c776a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.035310 Dec 25 21:35:47.604025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3487/6944] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:47 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:47.921604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:47.922651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:47.930063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:47.930530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:47.931349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:47.931807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:47.986525 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e34facb-6dcb-4d54-b0c2-d5c4ada98fcf tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.068918 Dec 25 21:35:47.990961 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3458/6945] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:47 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:48.615813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec3eb2ef-076b-461b-ab93-82cfe7ede550 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f63a8430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:48.644827 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec3eb2ef-076b-461b-ab93-82cfe7ede550 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.034210 Dec 25 21:35:48.645421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3488/6946] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:48 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:48.999230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:49.000330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:49.010120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:49.010593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:49.011665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:49.012128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:49.058784 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43525314-254a-494a-abad-c87f15592f5f tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.063534 Dec 25 21:35:49.059437 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3459/6947] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:48 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:49.657588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ec1c401-332c-4589-88a7-0a319a9914e0 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f637d1f0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:49.689020 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ec1c401-332c-4589-88a7-0a319a9914e0 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.035872 Dec 25 21:35:49.689647 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3489/6948] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:49 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:50.071960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:50.073039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:50.080662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:50.081200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:50.082017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:50.082477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:50.125031 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa47cce7-7928-420d-b6e2-ee2ea07efabb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.057732 Dec 25 21:35:50.125960 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3460/6949] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:50 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:50.702236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-607a08f8-f927-4fa1-ae97-1e2bd16f652d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa500566430>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:50.731711 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-607a08f8-f927-4fa1-ae97-1e2bd16f652d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.033967 Dec 25 21:35:50.732306 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3490/6950] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:50 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:51.138946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:51.140101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:51.148501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:51.152619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:51.152619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:51.152619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:51.194681 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b317d3fb-49a8-432d-97c9-a4cc5f5e4ccd tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.061081 Dec 25 21:35:51.195311 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3461/6951] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:51 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:51.744246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b40d30c-5e3c-4dcc-8a71-7ffa36364f2d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f637dd30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:51.774416 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b40d30c-5e3c-4dcc-8a71-7ffa36364f2d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.035462 Dec 25 21:35:51.775108 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3491/6952] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:51 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:52.206624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:52.207643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:52.215645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:52.216125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:52.216973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:52.217437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:52.272925 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-440c094c-1ceb-4bad-a0c5-37075139da56 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.070285 Dec 25 21:35:52.273631 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3462/6953] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:52 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:35:52.786003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3662829-0146-494f-bb20-4e150960a5b8 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa50054a3a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:52.814917 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3662829-0146-494f-bb20-4e150960a5b8 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 287 microversion: 2.1 time: 0.033380 Dec 25 21:35:52.815478 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3492/6954] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:52 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:52.837327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40db6867-75c9-426e-986f-936c90b39f08 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f72ce310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:52.994453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40db6867-75c9-426e-986f-936c90b39f08 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 202 len: 0 microversion: 2.1 time: 0.161144 Dec 25 21:35:52.995070 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3463/6955] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:35:52 2021] DELETE /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:53.003167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b4585f1-02e9-4c78-a32e-aa8592d1d8f1 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6379790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:53.031906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b4585f1-02e9-4c78-a32e-aa8592d1d8f1 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.032487 Dec 25 21:35:53.032471 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3493/6956] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:52 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:35:53.286587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:35:53.288240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:53.294657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:53.295128 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:53.295933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:53.296419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:53.346210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-df99913c-85e0-4136-a71e-a8babbc7e707 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.064067 Dec 25 21:35:53.353031 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3464/6957] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:35:53 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:35:53.357920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:53.361690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:53.364737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:53.365220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:53.366587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:53.367030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:53.561567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:53.570795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:53.572333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:35:53.573666 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b130e478-7b93-4195-a9c9-34a49fe192eb tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2945 microversion: 2.32 time: 0.219627 Dec 25 21:35:53.574229 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3494/6958] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:35:53 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2945 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:35:53.605602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:53.606194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:35:53.613303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:53.613832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:53.614624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:35:53.615071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:35:53.748281 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2599cf96-0a86-468c-ab41-079c2ee98754 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.146779 Dec 25 21:35:53.749089 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3465/6959] 10.222.0.32 () {60 vars in 1315 bytes} [Sat Dec 25 21:35:53 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/os-interface => generated 1831 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:35:54.053159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b432ba5-30d2-4045-a20a-2922d9222c5f tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f632aca0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:54.078685 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6b432ba5-30d2-4045-a20a-2922d9222c5f tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.035535 Dec 25 21:35:54.079350 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3495/6960] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:54 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:55.097740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ed601ca-7fee-4847-9e0d-d5f874e1e2c8 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6e53310>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:55.129014 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ed601ca-7fee-4847-9e0d-d5f874e1e2c8 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.037930 Dec 25 21:35:55.133445 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3466/6961] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:55 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:56.144087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dea942f-ab42-4a32-8e2b-e1956a4a5d6b tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f61dad30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:56.175368 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4dea942f-ab42-4a32-8e2b-e1956a4a5d6b tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.037085 Dec 25 21:35:56.175947 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3496/6962] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:56 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:57.189278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc362db5-49a2-4e8d-bebe-a4ead3d24f08 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f730f0d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:57.221663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc362db5-49a2-4e8d-bebe-a4ead3d24f08 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.037600 Dec 25 21:35:57.226337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3467/6963] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:57 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:58.236192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d9077ca-557c-42d2-9f25-00fadb493418 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f61e49d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:58.266031 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d9077ca-557c-42d2-9f25-00fadb493418 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.034245 Dec 25 21:35:58.266598 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3497/6964] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:58 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:35:59.278600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39c1cefa-fc9d-4cc3-bde9-737d3a291c6d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f738a5e0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:35:59.308492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39c1cefa-fc9d-4cc3-bde9-737d3a291c6d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.034447 Dec 25 21:35:59.309131 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3468/6965] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:35:59 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:00.322089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-421b3f3e-f944-43d6-80d7-e67a211617a9 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f637d160>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:00.351248 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-421b3f3e-f944-43d6-80d7-e67a211617a9 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.035550 Dec 25 21:36:00.354721 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3498/6966] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:00 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:01.364083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4df99ca3-d614-4fd9-9edb-5438b6eb55bb tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f7555b80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:01.399290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4df99ca3-d614-4fd9-9edb-5438b6eb55bb tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.039628 Dec 25 21:36:01.399865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3469/6967] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:01 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:02.422205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98024e66-5ef5-4e4d-af3b-200c8a19d662 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f61e4dc0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:02.458333 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98024e66-5ef5-4e4d-af3b-200c8a19d662 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.040063 Dec 25 21:36:02.458578 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3499/6968] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:02 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:03.471241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25e8533d-7d81-496e-9ec0-c3745481f72d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f732fe50>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:03.504841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25e8533d-7d81-496e-9ec0-c3745481f72d tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.038191 Dec 25 21:36:03.509990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3470/6969] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:03 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:04.519622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fbaf8323-46e0-4be9-8eae-ab4ece03f771 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f74f4670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:04.549242 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fbaf8323-46e0-4be9-8eae-ab4ece03f771 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.033268 Dec 25 21:36:04.549811 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3500/6970] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:04 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:05.562352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02e099d2-315d-48b2-aeb5-13b646330b98 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6207550>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:05.602331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02e099d2-315d-48b2-aeb5-13b646330b98 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.044537 Dec 25 21:36:05.602904 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3471/6971] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:05 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:06.614332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecf027ba-8d57-4856-b470-2e0023823761 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6238670>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:06.643263 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecf027ba-8d57-4856-b470-2e0023823761 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 200 len: 286 microversion: 2.1 time: 0.033347 Dec 25 21:36:06.643978 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3501/6972] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:06 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:07.662121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-973b491b-3e94-4e6e-a45f-f2683a643f87 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f732faf0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:07.699271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-973b491b-3e94-4e6e-a45f-f2683a643f87 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] HTTP exception thrown: Snapshot e781a766-01ea-4d7b-8ed5-4c8a2999e449 could not be found. Dec 25 21:36:07.701402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-973b491b-3e94-4e6e-a45f-f2683a643f87 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Returning 404 to user: Snapshot e781a766-01ea-4d7b-8ed5-4c8a2999e449 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:36:07.701748 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-973b491b-3e94-4e6e-a45f-f2683a643f87 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449" status: 404 len: 111 microversion: 2.1 time: 0.048084 Dec 25 21:36:07.702568 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3472/6973] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 21:36:07 2021] GET /compute/v2.1/os-snapshots/e781a766-01ea-4d7b-8ed5-4c8a2999e449 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:36:07.711260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-723d6a63-5d62-45be-b88d-c106da8eec13 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6394310>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:07.988897 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-723d6a63-5d62-45be-b88d-c106da8eec13 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 202 len: 0 microversion: 2.1 time: 0.282050 Dec 25 21:36:07.992823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3502/6974] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:36:07 2021] DELETE /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:36:07.998184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-182d5ca5-ee03-4535-b0a2-5d6fb45d10c1 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6863940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:08.164427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-182d5ca5-ee03-4535-b0a2-5d6fb45d10c1 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.170470 Dec 25 21:36:08.166780 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3473/6975] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:07 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:36:09.179698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a521bcfd-3a3b-47ed-950b-0255df471cbb tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f70de9d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:09.249701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a521bcfd-3a3b-47ed-950b-0255df471cbb tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.075785 Dec 25 21:36:09.250847 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3503/6976] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:09 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:10.264521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-82978725-b70d-4a72-a831-3793467e8dfe tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f68aaca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:10.310610 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-82978725-b70d-4a72-a831-3793467e8dfe tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.051563 Dec 25 21:36:10.311238 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3474/6977] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:10 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:11.323924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1c5ab662-4694-4542-8d11-2af4a324af20 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f63944c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:11.376906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1c5ab662-4694-4542-8d11-2af4a324af20 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.054348 Dec 25 21:36:11.376906 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3504/6978] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:11 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:12.394424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3af39160-6e43-4b9e-a3d4-0de0cbae8456 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f72ceee0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:12.443973 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3af39160-6e43-4b9e-a3d4-0de0cbae8456 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.061437 Dec 25 21:36:12.444551 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3475/6979] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:12 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:13.460334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7942878-2511-4065-a8bd-1a024af8d288 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa5005669d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:13.513194 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e7942878-2511-4065-a8bd-1a024af8d288 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.057303 Dec 25 21:36:13.513813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3505/6980] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:13 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:14.527120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6dd96005-6b30-4450-b5b3-1cba20081281 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f68aa8b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:14.573635 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6dd96005-6b30-4450-b5b3-1cba20081281 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.051625 Dec 25 21:36:14.574277 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3476/6981] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:14 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:36:15.586162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01bdca82-334b-4cd7-8c1e-74491f85bb5e tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6a129d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:15.635960 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01bdca82-334b-4cd7-8c1e-74491f85bb5e tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.052368 Dec 25 21:36:15.635960 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3506/6982] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:15 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:16.649900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de937f1b-378d-446d-8d79-89ba2755afdd tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4fc229820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:16.710394 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de937f1b-378d-446d-8d79-89ba2755afdd tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.061652 Dec 25 21:36:16.710394 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3477/6983] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:16 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:17.720946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eff5d072-fc58-4f2e-8e54-cc3227165c87 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f6140c10>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:17.767487 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eff5d072-fc58-4f2e-8e54-cc3227165c87 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.054034 Dec 25 21:36:17.768059 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3507/6984] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:17 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:18.792088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-decbdeb0-ec9c-46ad-b967-aec1d1303897 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa50055a820>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:18.838372 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-decbdeb0-ec9c-46ad-b967-aec1d1303897 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 200 len: 337 microversion: 2.1 time: 0.051507 Dec 25 21:36:18.838942 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3478/6985] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:18 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 337 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:19.851576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ca717cf-4811-495b-8f80-d4d569a806f3 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f618f4c0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:19.882021 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7ca717cf-4811-495b-8f80-d4d569a806f3 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] HTTP exception thrown: Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5 could not be found. Dec 25 21:36:19.882627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ca717cf-4811-495b-8f80-d4d569a806f3 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Returning 404 to user: Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:36:19.883460 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ca717cf-4811-495b-8f80-d4d569a806f3 tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 404 len: 109 microversion: 2.1 time: 0.036592 Dec 25 21:36:19.884040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3508/6986] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:19 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:36:19.896252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f77fdf42-9bbc-490a-81cb-9d22cdf02b5a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa50075f3a0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:19.922672 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-f77fdf42-9bbc-490a-81cb-9d22cdf02b5a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] HTTP exception thrown: Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5 could not be found. Dec 25 21:36:19.930285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f77fdf42-9bbc-490a-81cb-9d22cdf02b5a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Returning 404 to user: Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:36:19.930285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f77fdf42-9bbc-490a-81cb-9d22cdf02b5a tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 404 len: 109 microversion: 2.1 time: 0.032599 Dec 25 21:36:19.930285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3479/6987] 10.222.0.32 () {58 vars in 1247 bytes} [Sat Dec 25 21:36:19 2021] DELETE /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:36:19.932793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e101bd7e-c612-4cae-9bbf-58bef91c7ded tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Calling method '.version_select at 0x7fa4f618f790>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:19.963266 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e101bd7e-c612-4cae-9bbf-58bef91c7ded tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] HTTP exception thrown: Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5 could not be found. Dec 25 21:36:19.963266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e101bd7e-c612-4cae-9bbf-58bef91c7ded tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] Returning 404 to user: Volume 95fba560-1770-4ea5-b1d4-7ba870d51fc5 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:36:19.963266 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e101bd7e-c612-4cae-9bbf-58bef91c7ded tempest-VolumesSnapshotsTestJSON-606812821 tempest-VolumesSnapshotsTestJSON-606812821-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5" status: 404 len: 109 microversion: 2.1 time: 0.032637 Dec 25 21:36:19.963266 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3509/6988] 10.222.0.32 () {58 vars in 1244 bytes} [Sat Dec 25 21:36:19 2021] GET /compute/v2.1/os-volumes/95fba560-1770-4ea5-b1d4-7ba870d51fc5 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:36:43.348436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1246792472", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "b30f51af-5cf5-4b7f-96c1-3dabf1030017"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:36:43.400318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] validate_networks() for [('b30f51af-5cf5-4b7f-96c1-3dabf1030017', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:36:43.861639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:36:43.862077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:36:43.862565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:36:43.862985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:36:43.863410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:36:43.872234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:43.872693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:43.873558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:43.874001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:43.890832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Getting quotas for project a416565d81324f55b88111b36c4a777c. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:36:43.896034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Getting quotas for user c3a55c151bef4387a4fef00ab6687a20 and project a416565d81324f55b88111b36c4a777c. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:36:43.909389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:36:43.911764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:36:44.044459 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-868ecfc9-1211-4438-a1fe-c111566bacf1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700921 Dec 25 21:36:44.045057 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3480/6989] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:36:43 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:36:44.056643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87070918-59f9-4496-b13d-85e929b5e96e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:44.057453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87070918-59f9-4496-b13d-85e929b5e96e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:44.122228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87070918-59f9-4496-b13d-85e929b5e96e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:44.129468 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87070918-59f9-4496-b13d-85e929b5e96e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1219 microversion: 2.1 time: 0.078352 Dec 25 21:36:44.131227 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3510/6990] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:44 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:45.150448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd181e30-173a-4f42-8661-53e3ed1a1388 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:45.151107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd181e30-173a-4f42-8661-53e3ed1a1388 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:45.204832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd181e30-173a-4f42-8661-53e3ed1a1388 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:45.211730 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd181e30-173a-4f42-8661-53e3ed1a1388 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1219 microversion: 2.1 time: 0.066241 Dec 25 21:36:45.212306 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3481/6991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:45 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:46.229041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:46.229693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:46.236930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:46.237397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:46.238197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:46.238645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:46.300765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:46.313819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9e724b92-f3b0-494e-9a64-e3cee7a28031 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1271 microversion: 2.1 time: 0.084265 Dec 25 21:36:46.313819 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3511/6992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:46 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:47.333422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:47.334064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:47.342236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:47.342954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:47.343766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:47.344217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:47.554548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:47.563369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41dc304f-568a-41ef-933e-2a9660b69f41 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.233738 Dec 25 21:36:47.563969 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3482/6993] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:47 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:36:48.397126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5dcfd3f2-d021-4580-b2b7-3806e802eef9 req-b8d86033-ae8c-481b-b98c-a7ec544c16e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b0c1e7-aea8-4495-a6c3-336527595f49", "tag": "b12092bd-6061-46a7-b9df-71a40619530e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:36:48.409159 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:48.409159 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:36:48.425788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5dcfd3f2-d021-4580-b2b7-3806e802eef9 req-b8d86033-ae8c-481b-b98c-a7ec544c16e3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:48.426236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5dcfd3f2-d021-4580-b2b7-3806e802eef9 req-b8d86033-ae8c-481b-b98c-a7ec544c16e3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:48.438401 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5dcfd3f2-d021-4580-b2b7-3806e802eef9 req-b8d86033-ae8c-481b-b98c-a7ec544c16e3 service nova] Creating event network-changed:b12092bd-6061-46a7-b9df-71a40619530e for instance f2b0c1e7-aea8-4495-a6c3-336527595f49 on nch2-master-1 Dec 25 21:36:48.444036 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5dcfd3f2-d021-4580-b2b7-3806e802eef9 req-b8d86033-ae8c-481b-b98c-a7ec544c16e3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051587 Dec 25 21:36:48.444647 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3512/6994] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:36:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:48.581052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:48.586964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:48.589468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:48.590014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:48.590838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:48.591886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:48.820936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:48.837041 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d0790f6-0ad1-47a1-92d5-ec9ed3726f75 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.252186 Dec 25 21:36:48.837041 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3483/6995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:48 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:49.852699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:49.853435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:49.860456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:49.860943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:49.861743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:49.862192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:50.013187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:50.021442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7f902e0-dd53-4131-9ccf-7bfca2ab5db1 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.172695 Dec 25 21:36:50.022276 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3513/6996] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:49 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:51.039473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:51.041020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:51.050051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:51.051471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:51.052941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:51.053634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:51.297040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:51.311577 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-394b6fb8-7cfe-4ee5-bbe3-55ef35f9b65e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.276459 Dec 25 21:36:51.312531 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3484/6997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:51 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:52.329885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:52.330706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:52.337868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:52.338565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:52.339361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:52.339800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:52.569399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:52.577493 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05791e91-6bba-454c-a1b7-6084cbb5df92 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.252329 Dec 25 21:36:52.578064 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3514/6998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:52 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:53.594739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:53.596205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:53.603645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:53.604180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:53.604928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:53.605567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:53.746907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:53.755387 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b1803b5-861c-4244-98a9-393d7d13e71c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.164877 Dec 25 21:36:53.756607 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3485/6999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:53 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:54.772786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:54.773665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:54.783183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:54.783774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:54.784810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:54.785504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:54.984406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:54.998583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e52da29a-3dea-45c6-a8ee-4c567952a33c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.228737 Dec 25 21:36:54.999080 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3515/7000] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:54 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:56.015803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:56.016468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:56.023803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:56.024393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:56.025444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:56.026261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:56.209514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c530b9ab-2fd5-41f9-a65f-bae22fe626b3 req-9bede61e-59c0-41cb-acfa-972a87001a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b0c1e7-aea8-4495-a6c3-336527595f49", "name": "network-vif-plugged", "status": "completed", "tag": "b12092bd-6061-46a7-b9df-71a40619530e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:36:56.211220 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:36:56.211220 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:36:56.229245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c530b9ab-2fd5-41f9-a65f-bae22fe626b3 req-9bede61e-59c0-41cb-acfa-972a87001a0f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:56.229697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c530b9ab-2fd5-41f9-a65f-bae22fe626b3 req-9bede61e-59c0-41cb-acfa-972a87001a0f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:56.255459 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c530b9ab-2fd5-41f9-a65f-bae22fe626b3 req-9bede61e-59c0-41cb-acfa-972a87001a0f service nova] Creating event network-vif-plugged:b12092bd-6061-46a7-b9df-71a40619530e for instance f2b0c1e7-aea8-4495-a6c3-336527595f49 on nch2-master-1 Dec 25 21:36:56.265055 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c530b9ab-2fd5-41f9-a65f-bae22fe626b3 req-9bede61e-59c0-41cb-acfa-972a87001a0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058979 Dec 25 21:36:56.265841 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3516/7001] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:36:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:36:56.271109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:56.282112 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebba4627-d5e0-4afe-92bb-67ab25e5cbb0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.270452 Dec 25 21:36:56.283069 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3486/7002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:56 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:57.300637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:57.301395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:57.307996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:57.308464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:57.309379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:57.312497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:57.454814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:57.471158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6ff93d99-722e-4029-9776-cb4d29fdecc6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1319 microversion: 2.1 time: 0.175384 Dec 25 21:36:57.471919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3517/7003] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:57 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:36:58.487192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:36:58.487891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:36:58.497225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:58.497225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:58.497225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:36:58.497225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:36:58.654804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:36:58.662376 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eee7b4fe-2f44-488c-9633-e7aa58b4c247 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1506 microversion: 2.1 time: 0.178988 Dec 25 21:36:58.662949 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3487/7004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:36:58 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1506 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:37:01.434105 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:37:01.434558 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:37:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:37:06.834343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7", "device": "/dev/sdb"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:37:06.836233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:37:06.843919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:37:06.844657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:37:06.845552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:37:06.846226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:37:07.678828 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d93f50d2-6c9e-4202-aae9-655299177a1c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "POST /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.848230 Dec 25 21:37:07.679443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3518/7005] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:37:06 2021] POST /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:11.809570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-526b5845-fdfa-47a3-b4c7-aa3fd2da09c4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: .version_select at 0x7fa4f736edc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1236245657"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:11.826235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-526b5845-fdfa-47a3-b4c7-aa3fd2da09c4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:38:11.832022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-526b5845-fdfa-47a3-b4c7-aa3fd2da09c4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:38:12.196027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-526b5845-fdfa-47a3-b4c7-aa3fd2da09c4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:38:12.210506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-526b5845-fdfa-47a3-b4c7-aa3fd2da09c4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:38:12.220639 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-526b5845-fdfa-47a3-b4c7-aa3fd2da09c4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.612977 Dec 25 21:38:12.221940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3488/7006] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:38:11 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:38:24.674435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-815857376", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "d227a8f7-d82b-444c-89d0-511b922f2260"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1236245657", "security_groups": [{"name": "tempest-secgroup-smoke-1175426493"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:25.162985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] validate_networks() for [('d227a8f7-d82b-444c-89d0-511b922f2260', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:38:26.377306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:38:26.377923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:38:26.378488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:38:26.378998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:38:26.379575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:38:26.411709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:26.412335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:26.414002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:26.416271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:26.486051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:38:26.513694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:38:26.541147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:38:26.548021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:38:26.777625 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ae8f79d-6115-492f-ae0f-0bc4115015e6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.120408 Dec 25 21:38:26.792508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f466d0b1-b64e-46b5-8cee-b98528f671ea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:26.793332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3519/7007] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:38:24 2021] POST /compute/v2.1/servers => generated 406 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:38:26.795815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f466d0b1-b64e-46b5-8cee-b98528f671ea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:27.081138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f466d0b1-b64e-46b5-8cee-b98528f671ea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:27.101479 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f466d0b1-b64e-46b5-8cee-b98528f671ea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1266 microversion: 2.1 time: 0.316337 Dec 25 21:38:27.117344 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3489/7008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:26 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:28.119612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d08519a-9d3c-4bcb-a3b3-eaf3f47adb28 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:28.121641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d08519a-9d3c-4bcb-a3b3-eaf3f47adb28 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:28.193547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9d08519a-9d3c-4bcb-a3b3-eaf3f47adb28 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:28.202177 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d08519a-9d3c-4bcb-a3b3-eaf3f47adb28 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1266 microversion: 2.1 time: 0.086617 Dec 25 21:38:28.213849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3520/7009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:28 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:29.220939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46fddc95-426f-40ae-a43b-da3fed5359d1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:29.221642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46fddc95-426f-40ae-a43b-da3fed5359d1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:29.311510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46fddc95-426f-40ae-a43b-da3fed5359d1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:29.322430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46fddc95-426f-40ae-a43b-da3fed5359d1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1266 microversion: 2.1 time: 0.104253 Dec 25 21:38:29.323443 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3490/7010] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:29 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:30.340385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a195a1cc-78d9-441a-8815-31fda4bccafc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:30.341798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a195a1cc-78d9-441a-8815-31fda4bccafc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:30.474196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a195a1cc-78d9-441a-8815-31fda4bccafc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:30.483999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a195a1cc-78d9-441a-8815-31fda4bccafc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1266 microversion: 2.1 time: 0.148155 Dec 25 21:38:30.497099 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3521/7011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:30 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:31.504540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:31.505853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:31.516291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:31.517156 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:31.518208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:31.518849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:31.594268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:31.608271 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-669c94f4-c5c8-4e42-baef-1a7a2153f99b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1270 microversion: 2.1 time: 0.102225 Dec 25 21:38:31.609280 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3491/7012] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:31 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:32.626412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:32.627034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:32.636176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:32.637174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:32.643093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:32.643093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:32.707281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:32.717316 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09d4107d-4765-45e1-9185-4b277a4f5c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1270 microversion: 2.1 time: 0.094580 Dec 25 21:38:32.719236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3522/7013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:32 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:33.735857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:33.736507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:33.753830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:33.756842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:33.757967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:33.758603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:33.899745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:33.908430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c708f91-6ced-4c9d-8461-d50da17019b5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1326 microversion: 2.1 time: 0.176429 Dec 25 21:38:33.909411 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3492/7014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:33 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1326 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:34.928365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:34.929037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:34.945805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:34.946273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:34.947162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:34.947623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:35.063707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:35.072999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2b408aa-99ad-4aeb-a35a-ecbef6106d98 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1324 microversion: 2.1 time: 0.149151 Dec 25 21:38:35.074192 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3523/7015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:34 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1324 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:36.092795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:36.094708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:36.103947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:36.104419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:36.109689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:36.110185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:36.605657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:36.622753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1cfa65be-1aeb-437d-b871-8b997cbdc6bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1392 microversion: 2.1 time: 0.531743 Dec 25 21:38:36.622753 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3493/7016] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:36 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1392 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:37.611413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-df3a25a4-aaa8-401e-89f5-494659398652 req-0958fd4e-b2d6-447a-9d80-365ddd970483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:37.614388 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:37.614388 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:37.637748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:37.639357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:37.654271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-df3a25a4-aaa8-401e-89f5-494659398652 req-0958fd4e-b2d6-447a-9d80-365ddd970483 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:37.655086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-df3a25a4-aaa8-401e-89f5-494659398652 req-0958fd4e-b2d6-447a-9d80-365ddd970483 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:37.662548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:37.668531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:37.669949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:37.670840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:37.725571 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-df3a25a4-aaa8-401e-89f5-494659398652 req-0958fd4e-b2d6-447a-9d80-365ddd970483 service nova] Creating event network-changed:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch1-master-1 Dec 25 21:38:37.747921 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-df3a25a4-aaa8-401e-89f5-494659398652 req-0958fd4e-b2d6-447a-9d80-365ddd970483 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140211 Dec 25 21:38:37.752177 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3524/7017] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:38:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:38:38.283408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:38.300122 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c6a76ade-6d02-44b4-8892-eabbe27217b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1392 microversion: 2.1 time: 0.661296 Dec 25 21:38:38.301416 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3494/7018] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:37 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1392 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:39.318354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:39.319070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:39.335463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:39.338967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:39.344838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:39.345707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:39.665327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:39.673577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9fb24ebe-e7a9-424d-aaa9-c633131669b8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1392 microversion: 2.1 time: 0.359906 Dec 25 21:38:39.684215 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3525/7019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:39 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1392 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:40.701098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:40.701098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:40.702690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0a6b4a43-640e-408a-96d2-e2566e10c79c tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-193291855", "availability_zone": "foo_zone"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:40.702690 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:40.702690 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:40.703405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.aggregate [None req-0a6b4a43-640e-408a-96d2-e2566e10c79c tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Generated uuid 076b28cd-8cc6-4c42-836f-e701257a1901 for aggregate {{(pid=136547) create /opt/stack/nova/nova/objects/aggregate.py:298}} Dec 25 21:38:40.709738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:40.710761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:40.711827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:40.712349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:40.840114 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0a6b4a43-640e-408a-96d2-e2566e10c79c tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.293087 Dec 25 21:38:40.841878 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3495/7020] 10.222.0.32 () {60 vars in 1163 bytes} [Sat Dec 25 21:38:40 2021] POST /compute/v2.1/os-aggregates => generated 208 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:40.856718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-386e4542-4b6d-44a2-bc07-5a54df0f5ccc tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:40.859777 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:40.859777 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:40.925504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:40.938742 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb369e82-f0e6-4277-ac3a-660eb87c2a5a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1392 microversion: 2.1 time: 0.248436 Dec 25 21:38:40.955001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3526/7021] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:40 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:40.966769 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-386e4542-4b6d-44a2-bc07-5a54df0f5ccc tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.116716 Dec 25 21:38:40.967803 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3496/7022] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:38:40 2021] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:40.980270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dfe16d7a-6c28-4d48-9981-3b13955d9d9b tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:40.981906 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:40.981906 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:40.984164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfe16d7a-6c28-4d48-9981-3b13955d9d9b tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:40.984623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfe16d7a-6c28-4d48-9981-3b13955d9d9b tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:40.985545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfe16d7a-6c28-4d48-9981-3b13955d9d9b tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:40.986442 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dfe16d7a-6c28-4d48-9981-3b13955d9d9b tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:41.018746 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dfe16d7a-6c28-4d48-9981-3b13955d9d9b tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.043914 Dec 25 21:38:41.020062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3527/7023] 10.222.0.32 () {58 vars in 1175 bytes} [Sat Dec 25 21:38:40 2021] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.030456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b0d1888-6c8a-448b-80d5-25dc44eb9cbc tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:41.031304 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.031304 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:41.046391 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b0d1888-6c8a-448b-80d5-25dc44eb9cbc tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.017746 Dec 25 21:38:41.047934 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3497/7024] 10.222.0.32 () {58 vars in 1142 bytes} [Sat Dec 25 21:38:41 2021] GET /compute/v2.1/os-aggregates => generated 297 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.061169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd2bfcdb-aeca-4f10-97e2-09202b7ab6a6 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:41.062459 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.062459 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:41.080619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd2bfcdb-aeca-4f10-97e2-09202b7ab6a6 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:41.080619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd2bfcdb-aeca-4f10-97e2-09202b7ab6a6 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:41.462509 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd2bfcdb-aeca-4f10-97e2-09202b7ab6a6 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.407241 Dec 25 21:38:41.463595 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3528/7025] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:38:41 2021] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.474222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3bee27f5-d697-4266-9d90-85e78b7d9d75 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:41.475322 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.475322 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:41.485376 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3bee27f5-d697-4266-9d90-85e78b7d9d75 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.015059 Dec 25 21:38:41.495893 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3498/7026] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:38:41 2021] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.499368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9fc4a846-a965-41d6-83af-c1c94e967aa3 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1027123562", "availability_zone": "foo_zone"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:41.633965 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.633965 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:41.752381 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9fc4a846-a965-41d6-83af-c1c94e967aa3 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.258566 Dec 25 21:38:41.757712 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3529/7027] 10.222.0.32 () {60 vars in 1172 bytes} [Sat Dec 25 21:38:41 2021] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.776367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-357d186f-0db2-4a0c-a779-4bf71d219f05 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:41.776367 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.776367 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:41.860124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-357d186f-0db2-4a0c-a779-4bf71d219f05 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.100476 Dec 25 21:38:41.861187 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3499/7028] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:38:41 2021] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.873816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36d07350-cc89-4143-b520-9ec25a9ac97e tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:41.874657 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.874657 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:41.889194 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36d07350-cc89-4143-b520-9ec25a9ac97e tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.017404 Dec 25 21:38:41.889194 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3530/7029] 10.222.0.32 () {58 vars in 1151 bytes} [Sat Dec 25 21:38:41 2021] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:41.898991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8beb7827-67b2-4dfa-92f9-8f7041e8e4e4 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:41.900364 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:41.900364 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:41.914655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8beb7827-67b2-4dfa-92f9-8f7041e8e4e4 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:41.915295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8beb7827-67b2-4dfa-92f9-8f7041e8e4e4 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:42.066630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:42.067379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:42.077931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:42.078871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:42.079945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:42.080609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:42.311960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:42.321822 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2158522c-290f-4321-ab10-796fedc4310d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1396 microversion: 2.1 time: 0.259443 Dec 25 21:38:42.322405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3531/7030] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:42 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1396 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:38:42.423315 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8beb7827-67b2-4dfa-92f9-8f7041e8e4e4 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.528244 Dec 25 21:38:42.423933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3500/7031] 10.222.0.32 () {60 vars in 1193 bytes} [Sat Dec 25 21:38:41 2021] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:42.435796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fcb56dc-c6a0-48ff-913a-309af8c10939 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:42.438244 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:42.438244 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:42.546518 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fcb56dc-c6a0-48ff-913a-309af8c10939 tempest-TestAggregatesBasicOps-88123950 tempest-TestAggregatesBasicOps-88123950-project-admin] 10.222.0.32 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.110331 Dec 25 21:38:42.546518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3532/7032] 10.222.0.32 () {58 vars in 1154 bytes} [Sat Dec 25 21:38:42 2021] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Dec 25 21:38:43.224599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "name": "network-vif-plugged", "status": "completed", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:43.226209 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:43.226209 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:38:43.235482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:43.235948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:43.256964 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] Creating event network-vif-plugged:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch1-master-1 Dec 25 21:38:43.260962 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] [87a614cc-8a73-43fb-9f4e-e32397e4f5fd] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 21:38:43.340848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:43.341944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:43.352698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:43.356523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:43.356523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:43.356523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:43.522311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:43.529701 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc7f7d7e-0142-45df-ac80-d5788f06d3ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1392 microversion: 2.1 time: 0.194548 Dec 25 21:38:43.534677 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3533/7033] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:43 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1392 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:44.272217 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] [87a614cc-8a73-43fb-9f4e-e32397e4f5fd] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 52238. Dec 25 21:38:44.277208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-20259b5a-23d7-4137-a29b-bcf8fa12294b req-3c96664c-82e9-4a2e-8dd8-079554817875 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.058644 Dec 25 21:38:44.278084 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3501/7034] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:38:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:38:44.547905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:44.549519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:44.558308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:44.559838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:44.561181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:44.562283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:44.795041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:44.805138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84833504-f3ab-417c-bfee-a6ee883241fb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1392 microversion: 2.1 time: 0.261246 Dec 25 21:38:44.812924 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3534/7035] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:44 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1392 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:45.823630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:45.824266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:45.839146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:45.840306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:45.841588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:45.842213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:46.126893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:46.137677 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbcbb4fd-fd14-43a5-a3a3-a3965f4b4633 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1564 microversion: 2.1 time: 0.318073 Dec 25 21:38:46.139133 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3502/7036] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:45 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1564 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:46.157552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:46.158168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:46.171523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:46.174095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:46.175867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:46.178211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:46.748338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:46.762207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-57e70e00-df4d-4981-b4b9-ee7030f0928a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1564 microversion: 2.1 time: 0.608316 Dec 25 21:38:46.779641 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3535/7037] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:46 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1564 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:49.463678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:38:49.465014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:38:49.472736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:49.473422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:49.474332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:49.474853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:49.725820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:38:49.735738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de41cd0f-b3f4-4fad-a52a-17cdbb11ebbe tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1564 microversion: 2.1 time: 0.276394 Dec 25 21:38:49.739986 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3503/7038] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:38:49 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1564 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:38:49.778202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-16c6b2ae-930a-4744-a46e-d20c1dcbea3d req-4b582803-8071-4adf-8756-ceb296046632 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:38:49.779354 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:38:49.779354 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:38:49.818150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-16c6b2ae-930a-4744-a46e-d20c1dcbea3d req-4b582803-8071-4adf-8756-ceb296046632 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:38:49.818624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-16c6b2ae-930a-4744-a46e-d20c1dcbea3d req-4b582803-8071-4adf-8756-ceb296046632 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:38:49.872738 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-16c6b2ae-930a-4744-a46e-d20c1dcbea3d req-4b582803-8071-4adf-8756-ceb296046632 service nova] Creating event network-changed:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch1-master-1 Dec 25 21:38:49.890376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-16c6b2ae-930a-4744-a46e-d20c1dcbea3d req-4b582803-8071-4adf-8756-ceb296046632 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426694 Dec 25 21:38:49.892516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3536/7039] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:38:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:09.321551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:09.322102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:09.329085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:09.329378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:09.330204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:09.330665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:09.434940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lazy-loading 'services' on Instance uuid f2b0c1e7-aea8-4495-a6c3-336527595f49 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:39:09.667770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f46ce7c-9c9e-4950-a7f9-6b5a238f2fe0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49/os-volume_attachments/84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7" status: 202 len: 0 microversion: 2.1 time: 0.350284 Dec 25 21:39:09.668966 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3504/7040] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:39:09 2021] DELETE /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49/os-volume_attachments/84b7c2f5-06e2-4582-b712-ba8e2cf1d2a7 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:39:11.746814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:11.748190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:11.755843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:11.756298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:11.757333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:11.757919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:11.811077 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b687993-c057-4580-835e-a4d0fd3d1e04 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action" status: 200 len: 24567 microversion: 2.1 time: 0.068382 Dec 25 21:39:11.811733 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3537/7041] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:39:11 2021] POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action => generated 24567 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:39:11.909358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:11.910618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:11.918139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:11.918670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:11.919496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:11.919955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:11.947005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:39:12.278273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:12.279283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:12.288201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.288665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.289602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.290046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.336839 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb99c900-6854-4335-ba08-87caf3751f87 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "DELETE /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 204 len: 0 microversion: 2.1 time: 0.431315 Dec 25 21:39:12.337753 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3505/7042] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:39:11 2021] DELETE /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:39:12.339173 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-228750b2-a4bf-4cb7-91c4-4c5a739f854e tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action" status: 200 len: 40210 microversion: 2.32 time: 0.362700 Dec 25 21:39:12.340516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3538/7043] 10.222.0.32 () {62 vars in 1318 bytes} [Sat Dec 25 21:39:11 2021] POST /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd/action => generated 40210 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:39:12.346343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:12.347713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:12.354225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.354840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.356777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:12.357397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:12.361073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.362312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.364787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.365446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.366389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.366972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.396343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:39:12.549672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:12.557337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-881117e0-e1e6-43e9-a533-15163e64cdb6 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1512 microversion: 2.1 time: 0.215034 Dec 25 21:39:12.557934 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3506/7044] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:12 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1512 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:12.694495 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a4bea617-2de0-45df-982b-da4c3c3bef7c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 204 len: 0 microversion: 2.32 time: 0.345785 Dec 25 21:39:12.698437 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3539/7045] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:39:12 2021] DELETE /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:39:12.704028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:12.704826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:12.712071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.712623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.713537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:12.714087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:12.921427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:12.933528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:12.936908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:12.938802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d3c78e15-223b-4b91-b498-c87f1902a66c tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2951 microversion: 2.32 time: 0.238614 Dec 25 21:39:12.954963 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3507/7046] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:12 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2951 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:39:13.575156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:13.575896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:13.583843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:13.584312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:13.585156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:13.585611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:13.724929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:13.732616 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bbecc20f-d5f1-4cbb-bb5b-d49267c0bed2 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1512 microversion: 2.1 time: 0.161666 Dec 25 21:39:13.734094 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3540/7047] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:13 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:13.962743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:13.966582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:13.974913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:13.975317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:13.976140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:13.976597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:14.393342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:14.407830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:14.409886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:14.412016 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46aadc71-84bf-4c6e-9273-93c20e4294f9 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2951 microversion: 2.32 time: 0.453460 Dec 25 21:39:14.413304 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3508/7048] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:13 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2951 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:39:14.750860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:14.757614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:14.759814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:14.760278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:14.761154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:14.761627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:14.848803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:14.857040 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9d638af-f29f-4bc8-9131-3d2ed6649ee5 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 200 len: 1470 microversion: 2.1 time: 0.110379 Dec 25 21:39:14.857632 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3541/7049] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:14 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 1470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:14.903195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-269afec3-f010-4544-95a9-af27cea726f1 req-ffee4dc8-e867-472b-9ddd-758c081a95d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b0c1e7-aea8-4495-a6c3-336527595f49", "name": "network-vif-deleted", "tag": "b12092bd-6061-46a7-b9df-71a40619530e"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:14.904765 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:14.904765 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:14.919754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-269afec3-f010-4544-95a9-af27cea726f1 req-ffee4dc8-e867-472b-9ddd-758c081a95d2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:14.920318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-269afec3-f010-4544-95a9-af27cea726f1 req-ffee4dc8-e867-472b-9ddd-758c081a95d2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:14.933016 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-269afec3-f010-4544-95a9-af27cea726f1 req-ffee4dc8-e867-472b-9ddd-758c081a95d2 service nova] Creating event network-vif-deleted:b12092bd-6061-46a7-b9df-71a40619530e for instance f2b0c1e7-aea8-4495-a6c3-336527595f49 on nch2-master-1 Dec 25 21:39:14.938177 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-269afec3-f010-4544-95a9-af27cea726f1 req-ffee4dc8-e867-472b-9ddd-758c081a95d2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124557 Dec 25 21:39:14.938933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3509/7050] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:15.433540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:15.434412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:15.441472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:15.441939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:15.442898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:15.443409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:15.586739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:15.586739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:15.594251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:15.594709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:15.595599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:15.596057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:15.651944 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b8889fe-ff9b-4150-aa9c-8755b5af6387 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "POST /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f/action" status: 200 len: 24565 microversion: 2.1 time: 0.201420 Dec 25 21:39:15.653150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3510/7051] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:39:15 2021] POST /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f/action => generated 24565 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:39:15.872914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:15.879944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:15.881141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: f2b0c1e7-aea8-4495-a6c3-336527595f49] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:15.886349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:15.888985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:15.889739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:15.890460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:15.890580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:15.890989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:15.892627 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ff149e17-34e1-4238-800f-ad1cc13a9150 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2930 microversion: 2.32 time: 0.463023 Dec 25 21:39:15.893335 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3542/7052] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:15 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2930 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:39:15.906793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] HTTP exception thrown: Instance f2b0c1e7-aea8-4495-a6c3-336527595f49 could not be found. Dec 25 21:39:15.907396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Returning 404 to user: Instance f2b0c1e7-aea8-4495-a6c3-336527595f49 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:39:15.908283 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6681199e-0a63-4309-abd2-52dec4eb9a3a tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49" status: 404 len: 111 microversion: 2.1 time: 0.037564 Dec 25 21:39:15.908932 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3511/7053] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:15 2021] GET /compute/v2.1/servers/f2b0c1e7-aea8-4495-a6c3-336527595f49 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:39:16.761869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:16.762386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:16.768301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-102c7ed1-6471-436d-9c54-5cfec6d8f18f req-e2da0d6e-5acd-45ac-a810-5aff5b11d64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70451b2f-7bb3-4ea7-b6c9-824c3287928f", "tag": "d121181f-10e4-43bd-bc6a-60afaaa17f9a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:16.771920 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:16.771920 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:16.772176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:16.772867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:16.773893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:16.774566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:16.784569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-102c7ed1-6471-436d-9c54-5cfec6d8f18f req-e2da0d6e-5acd-45ac-a810-5aff5b11d64f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:16.785054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-102c7ed1-6471-436d-9c54-5cfec6d8f18f req-e2da0d6e-5acd-45ac-a810-5aff5b11d64f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:16.808241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-102c7ed1-6471-436d-9c54-5cfec6d8f18f req-e2da0d6e-5acd-45ac-a810-5aff5b11d64f service nova] Creating event network-changed:d121181f-10e4-43bd-bc6a-60afaaa17f9a for instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f on nch2-master-1 Dec 25 21:39:16.814424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-102c7ed1-6471-436d-9c54-5cfec6d8f18f req-e2da0d6e-5acd-45ac-a810-5aff5b11d64f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049740 Dec 25 21:39:16.815354 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3512/7054] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:39:16.829964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:39:16.914192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:16.915021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:16.922985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:16.923521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:16.924359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:16.924820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:17.291018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-90f4eef7-c7c1-4cb6-92bc-6a8dfc8e2e1d tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 204 len: 0 microversion: 2.1 time: 0.532399 Dec 25 21:39:17.291698 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3543/7055] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:39:16 2021] DELETE /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:39:17.309351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-66fa63a3-821e-4995-9fd8-070d520ee7d1 req-34642ef5-3b9d-4539-a25f-bf1e0cbae8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-deleted", "tag": "c1259bc6-d32f-4b81-b593-3660604ed03e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:17.312513 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:17.312513 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:39:17.322163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-66fa63a3-821e-4995-9fd8-070d520ee7d1 req-34642ef5-3b9d-4539-a25f-bf1e0cbae8c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:17.323390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-66fa63a3-821e-4995-9fd8-070d520ee7d1 req-34642ef5-3b9d-4539-a25f-bf1e0cbae8c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:17.344189 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-66fa63a3-821e-4995-9fd8-070d520ee7d1 req-34642ef5-3b9d-4539-a25f-bf1e0cbae8c7 service nova] Creating event network-vif-deleted:c1259bc6-d32f-4b81-b593-3660604ed03e for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:17.350113 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-66fa63a3-821e-4995-9fd8-070d520ee7d1 req-34642ef5-3b9d-4539-a25f-bf1e0cbae8c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051086 Dec 25 21:39:17.352219 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3544/7056] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:17.361218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:17.362235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:17.371493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:17.372243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:17.373456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:17.374030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:17.526845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:17.541352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:17.545195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:17.547754 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d74cd2e-8e45-40bb-a38f-d5c6475de2ac tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2863 microversion: 2.32 time: 0.639781 Dec 25 21:39:17.561526 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3513/7057] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:16 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2863 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:39:17.561526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-baf9aaad-a207-461f-a8b6-c71d9eddfae0 req-fc0bbd65-6dea-483e-9a38-93165f4c75c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a5dc77-7743-4d72-8f35-550325e4dc63"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:17.561526 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:17.561526 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:17.564133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-baf9aaad-a207-461f-a8b6-c71d9eddfae0 req-fc0bbd65-6dea-483e-9a38-93165f4c75c6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:17.564607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-baf9aaad-a207-461f-a8b6-c71d9eddfae0 req-fc0bbd65-6dea-483e-9a38-93165f4c75c6 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:17.579996 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-baf9aaad-a207-461f-a8b6-c71d9eddfae0 req-fc0bbd65-6dea-483e-9a38-93165f4c75c6 service nova] Creating event network-vif-unplugged:c4a5dc77-7743-4d72-8f35-550325e4dc63 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:17.586974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-baf9aaad-a207-461f-a8b6-c71d9eddfae0 req-fc0bbd65-6dea-483e-9a38-93165f4c75c6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036677 Dec 25 21:39:17.588722 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3514/7058] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:17 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:17.742708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:17.755253 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f066758f-2fb3-4dac-9f22-935e53691c66 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1577 microversion: 2.1 time: 0.399079 Dec 25 21:39:17.765909 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3545/7059] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:17 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1577 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:18.147340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:18.148171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:18.161650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:18.161650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:18.162406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:18.162955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:18.571068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:18.572038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:18.579521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:18.583481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:18.583481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:18.583481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:18.813794 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cb84958-f75b-4cd8-a5f7-d6863e538fe6 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1834 microversion: 2.1 time: 0.671363 Dec 25 21:39:18.826549 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3515/7060] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:18 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1834 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:18.833789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:18.835061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:18.845242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:18.846401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:18.848385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:18.852420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:18.986075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:19.001529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:19.003084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:19.004556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c75bd17-17b5-4225-be07-808d3bd5ab97 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2703 microversion: 2.32 time: 0.438574 Dec 25 21:39:19.005163 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3546/7061] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:18 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2703 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:39:19.009876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:19.010827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:19.018337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:19.019311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:19.019727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:19.020680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:19.529033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:19.538051 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46649b02-a1a3-4465-bb7e-101e8017c8cd tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1458 microversion: 2.1 time: 0.710223 Dec 25 21:39:19.538639 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3516/7062] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:18 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1458 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:19.544350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-29e57a77-5f50-4533-9694-f73efc47dfc1 req-e934be69-1194-46d3-a5c4-f8e113559747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-deleted", "tag": "dbad079c-9ad0-47fd-8d51-bc9c6d074098"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:19.546231 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:19.546231 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:19.577801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-29e57a77-5f50-4533-9694-f73efc47dfc1 req-e934be69-1194-46d3-a5c4-f8e113559747 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:19.578349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-29e57a77-5f50-4533-9694-f73efc47dfc1 req-e934be69-1194-46d3-a5c4-f8e113559747 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:19.593688 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-29e57a77-5f50-4533-9694-f73efc47dfc1 req-e934be69-1194-46d3-a5c4-f8e113559747 service nova] Creating event network-vif-deleted:dbad079c-9ad0-47fd-8d51-bc9c6d074098 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:19.604965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-29e57a77-5f50-4533-9694-f73efc47dfc1 req-e934be69-1194-46d3-a5c4-f8e113559747 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064591 Dec 25 21:39:19.606150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3517/7063] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:19.619520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-31fc0533-a35f-4c47-bf32-d729a3cc148e req-45b22dee-1d51-4d42-9fcb-3869585a3644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-unplugged", "status": "completed", "tag": "d1b259e7-c1c4-46a5-8fa8-934e76ffd08c"}, {"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-unplugged", "status": "completed", "tag": "bbeefdb7-89c8-4442-a2e7-858c459b3b9a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:19.621897 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:19.621897 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:19.631108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-31fc0533-a35f-4c47-bf32-d729a3cc148e req-45b22dee-1d51-4d42-9fcb-3869585a3644 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:19.631964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-31fc0533-a35f-4c47-bf32-d729a3cc148e req-45b22dee-1d51-4d42-9fcb-3869585a3644 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:19.646874 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-31fc0533-a35f-4c47-bf32-d729a3cc148e req-45b22dee-1d51-4d42-9fcb-3869585a3644 service nova] Creating event network-vif-unplugged:d1b259e7-c1c4-46a5-8fa8-934e76ffd08c for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:19.647414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-31fc0533-a35f-4c47-bf32-d729a3cc148e req-45b22dee-1d51-4d42-9fcb-3869585a3644 service nova] Creating event network-vif-unplugged:bbeefdb7-89c8-4442-a2e7-858c459b3b9a for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:19.653346 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-31fc0533-a35f-4c47-bf32-d729a3cc148e req-45b22dee-1d51-4d42-9fcb-3869585a3644 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.038288 Dec 25 21:39:19.654145 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3518/7064] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:19 2021] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:19.716669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:19.726803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54e946a2-cdb1-4515-b4f3-d29fb65c5ee5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1683 microversion: 2.1 time: 0.720388 Dec 25 21:39:19.727652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3547/7065] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:19 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1683 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:19.859772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:19.861110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:19.868211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:19.868838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:19.869817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:19.870401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:19.928597 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-247a4543-2ff5-45ef-ae3f-c44ef4976cf4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action" status: 200 len: 32643 microversion: 2.1 time: 0.072759 Dec 25 21:39:19.929306 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3519/7066] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:39:19 2021] POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action => generated 32643 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:39:20.023961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:20.024577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:20.036434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.036907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.037878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.038659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.106963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:20.107566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:20.115061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.115530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.116551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.117043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.168784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '58358a2e96c94ea3b018b93c1aef29ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852b86f977de452a989c0d5ab77e2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:20.168784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] flavor_id is None. Assuming migration. {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 25 21:39:20.168784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:39:20.333123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:20.344168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:20.347630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:20.348315 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0731123-1880-434a-9e6f-a5e1107738f6 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2370 microversion: 2.32 time: 0.327698 Dec 25 21:39:20.359000 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3548/7067] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:20 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:39:20.556224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:20.556812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:20.563063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.563515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.564370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.564797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.636395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:20.655260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b4599c5-b9ac-4ab9-b8eb-1359303bbf8a tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1390 microversion: 2.1 time: 0.102870 Dec 25 21:39:20.655866 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3549/7068] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:20 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:20.678540 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85fedd43-d3c9-459d-af29-2458720e4975 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action" status: 202 len: 0 microversion: 2.1 time: 0.575694 Dec 25 21:39:20.685772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3520/7069] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:39:20 2021] POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:39:20.695330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:20.695949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:20.704865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.705428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:20.707086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:20.707086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.078263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:21.088559 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-344d1353-6fde-456a-8a3d-ee1837bb6e06 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1692 microversion: 2.1 time: 0.397563 Dec 25 21:39:21.122027 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3550/7070] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:20 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1692 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:21.377890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:21.379237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:21.401604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:21.402094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.402944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:21.403411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.633457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-deleted", "tag": "bbeefdb7-89c8-4442-a2e7-858c459b3b9a"}, {"server_uuid": "70451b2f-7bb3-4ea7-b6c9-824c3287928f", "name": "network-vif-deleted", "tag": "d121181f-10e4-43bd-bc6a-60afaaa17f9a"}, {"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-deleted", "tag": "c4a5dc77-7743-4d72-8f35-550325e4dc63"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:21.635749 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:21.635749 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:39:21.646293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:21.646746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.648529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:21.658332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:21.660526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:21.661342 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] Creating event network-vif-deleted:bbeefdb7-89c8-4442-a2e7-858c459b3b9a for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:21.661812 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-104bf5e2-d7fa-4e52-9cd9-27bc84dc8e23 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 2324 microversion: 2.32 time: 0.288086 Dec 25 21:39:21.661909 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] Creating event network-vif-deleted:d121181f-10e4-43bd-bc6a-60afaaa17f9a for instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f on nch2-master-1 Dec 25 21:39:21.662361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] Creating event network-vif-deleted:c4a5dc77-7743-4d72-8f35-550325e4dc63 for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:21.662505 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3521/7071] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:21 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 2324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:39:21.678174 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-33676e33-c85e-4aac-ba14-50aebe2e7812 req-aab335d5-7139-4db6-9bf0-d68a5b643dd9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.048863 Dec 25 21:39:21.678773 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3551/7072] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:21 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:39:21.678918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:21.680052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:21.688910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:21.688910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.688910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:21.689163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.727798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:21.728478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:21.728996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lazy-loading 'fault' on Instance uuid 70451b2f-7bb3-4ea7-b6c9-824c3287928f {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:39:21.800297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '171c198b6b734cd698b3c1eaf76a0234', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c77dc74a46d64a67991d82bf12adb1dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:21.810667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86d87bde-3a45-434e-9b4f-63e0a3a4cab2 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 200 len: 1229 microversion: 2.1 time: 0.135750 Dec 25 21:39:21.811254 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3522/7073] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:21 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 1229 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:22.107491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:22.108287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:22.128608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:22.129105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:22.129929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:22.130378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:22.309348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:22.317747 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5d37a581-9228-4378-92da-4592fba78fa1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1692 microversion: 2.1 time: 0.214500 Dec 25 21:39:22.318409 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3552/7074] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:22 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1692 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:22.684981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:22.686167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:22.694761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:22.695227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:22.696259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:22.696665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:22.772526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:22.781824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:22.783357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d9b0c5962544b66b24db53b7e9b8333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '980165331b334d7795b91adc96459725', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:22.784538 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47e38178-d481-4262-b336-8a6884c56f48 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 200 len: 1604 microversion: 2.32 time: 0.103479 Dec 25 21:39:22.785254 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3523/7075] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:22 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 1604 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:39:22.833133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:22.834580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] [instance: 70451b2f-7bb3-4ea7-b6c9-824c3287928f] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:22.843597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:22.844294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:22.845168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:22.845605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:22.861250 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] HTTP exception thrown: Instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f could not be found. Dec 25 21:39:22.861889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Returning 404 to user: Instance 70451b2f-7bb3-4ea7-b6c9-824c3287928f could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:39:22.862742 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-785886db-847e-448e-b8de-3405a68b6512 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f" status: 404 len: 111 microversion: 2.1 time: 0.034608 Dec 25 21:39:22.863304 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3553/7076] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:22 2021] GET /compute/v2.1/servers/70451b2f-7bb3-4ea7-b6c9-824c3287928f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:39:23.334133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:23.334881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:23.341393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:23.341861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:23.342753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:23.343261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:23.481020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:23.489053 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26c99db7-fb33-41a7-8678-36bb1371fbdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1692 microversion: 2.1 time: 0.158379 Dec 25 21:39:23.489632 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3524/7077] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:23 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:23.695373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ed0680ff-8e67-4d0e-97bd-c5fa7c78d85a req-b40afb48-12ca-4ec5-9629-06d73741e1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8d6684-f19c-4a86-ac0c-6c056fa351fd", "name": "network-vif-deleted", "tag": "d1b259e7-c1c4-46a5-8fa8-934e76ffd08c"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:23.697656 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:23.697656 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:39:23.704720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ed0680ff-8e67-4d0e-97bd-c5fa7c78d85a req-b40afb48-12ca-4ec5-9629-06d73741e1d7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:23.705211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ed0680ff-8e67-4d0e-97bd-c5fa7c78d85a req-b40afb48-12ca-4ec5-9629-06d73741e1d7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:23.716334 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ed0680ff-8e67-4d0e-97bd-c5fa7c78d85a req-b40afb48-12ca-4ec5-9629-06d73741e1d7 service nova] Creating event network-vif-deleted:d1b259e7-c1c4-46a5-8fa8-934e76ffd08c for instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd on nch1-master-1 Dec 25 21:39:23.722180 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ed0680ff-8e67-4d0e-97bd-c5fa7c78d85a req-b40afb48-12ca-4ec5-9629-06d73741e1d7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030454 Dec 25 21:39:23.722784 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3554/7078] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:23.803821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:23.804547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:23.811679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:23.812230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:23.813088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:23.813585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:23.827504 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] HTTP exception thrown: Instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd could not be found. Dec 25 21:39:23.828112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Returning 404 to user: Instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:39:23.829000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b0fbb552-3a78-4caf-8cac-596721ce2193 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 404 len: 111 microversion: 2.32 time: 0.029394 Dec 25 21:39:23.829552 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3525/7079] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:23 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:39:23.838767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a53e7f3-4d04-401e-bbe1-e83e93f6430a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '.version_select at 0x7fa4f61e43a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:23.970256 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a53e7f3-4d04-401e-bbe1-e83e93f6430a tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399369495" status: 204 len: 0 microversion: 2.32 time: 0.135928 Dec 25 21:39:23.970850 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3555/7080] 10.222.0.32 () {60 vars in 1261 bytes} [Sat Dec 25 21:39:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1399369495 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:39:24.510376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:24.511131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:24.523540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:24.524008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:24.524811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:24.525287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:24.728195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:24.737557 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bded9a5e-4131-4534-8723-8a0bd2b402e5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.231599 Dec 25 21:39:24.738364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3526/7081] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:24 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:25.759539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:25.760299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:25.768917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:25.769371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:25.770178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:25.770619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:26.035622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:26.043877 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b59ac7c-a557-453a-89aa-7f945e7f36d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.292054 Dec 25 21:39:26.044460 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3556/7082] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:25 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:27.062646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:27.063242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:27.071576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:27.072112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:27.073252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:27.073718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:27.255738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:27.266984 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ee7adc3-60be-4db0-ba8b-ebc1b1c7dbb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.209479 Dec 25 21:39:27.267584 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3527/7083] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:27 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:27.837172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:27.838208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:27.848503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:27.849516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:27.850707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:27.851286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:27.870232 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] HTTP exception thrown: Instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd could not be found. Dec 25 21:39:27.871510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Returning 404 to user: Instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:39:27.872735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37a9c029-5941-46d2-8490-731355317fe8 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 404 len: 111 microversion: 2.32 time: 0.042619 Dec 25 21:39:27.873823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3557/7084] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:39:27 2021] DELETE /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:39:27.884575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:27.885681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] [instance: 7a8d6684-f19c-4a86-ac0c-6c056fa351fd] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:27.910862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:27.910862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:27.910862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:27.910862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:27.933727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] HTTP exception thrown: Instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd could not be found. Dec 25 21:39:27.934356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] Returning 404 to user: Instance 7a8d6684-f19c-4a86-ac0c-6c056fa351fd could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:39:27.937583 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b2a8842-f16d-4765-8a67-0b4d2a8c5e21 tempest-TaggedBootDevicesTest-292780470 tempest-TaggedBootDevicesTest-292780470-project] 10.222.0.32 "GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd" status: 404 len: 111 microversion: 2.32 time: 0.057364 Dec 25 21:39:27.937583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3528/7085] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:39:27 2021] GET /compute/v2.1/servers/7a8d6684-f19c-4a86-ac0c-6c056fa351fd => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Dec 25 21:39:28.285553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:28.286183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:28.293613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:28.294068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:28.294851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:28.295286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:28.434241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:28.441813 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fcaf14a-e890-4de4-935a-edffd678ccf2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.161471 Dec 25 21:39:28.442377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3558/7086] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:28 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:29.459869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:29.463871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:29.467035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:29.467498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:29.468284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:29.468734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:29.601619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:29.609534 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01aa5ea7-28ed-415b-8a22-4de48104392a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.154309 Dec 25 21:39:29.610101 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3529/7087] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:29 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:30.627094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:30.627646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:30.634951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:30.635391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:30.636187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:30.636643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:30.773421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:30.780860 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3afd505e-ae26-420e-b176-07ce255390bc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.157674 Dec 25 21:39:30.781448 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3559/7088] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:30 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:31.798040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:31.798673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:31.806237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:31.806738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:31.807539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:31.807997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:31.950165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:31.958128 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d964619-e549-4373-8d22-05734575728e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.163890 Dec 25 21:39:31.958640 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3530/7089] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:31 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:32.110636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-568961685", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "b30f51af-5cf5-4b7f-96c1-3dabf1030017"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:32.168193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] validate_networks() for [('b30f51af-5cf5-4b7f-96c1-3dabf1030017', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:39:32.532371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:39:32.532806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:39:32.533323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:39:32.533814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:39:32.534243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:39:32.545466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:32.545619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:32.546453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:32.546864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:32.563936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Getting quotas for project a416565d81324f55b88111b36c4a777c. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:39:32.569085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Getting quotas for user c3a55c151bef4387a4fef00ab6687a20 and project a416565d81324f55b88111b36c4a777c. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:39:32.581330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:39:32.583676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:39:32.744276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb499376-ee08-4ced-a1b1-4d0aa174baea tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637453 Dec 25 21:39:32.744965 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3560/7090] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:39:32 2021] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:39:32.754718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3537664-d61a-404e-88b6-ef774c32f627 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:32.755379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f3537664-d61a-404e-88b6-ef774c32f627 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:32.808126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f3537664-d61a-404e-88b6-ef774c32f627 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:32.814922 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3537664-d61a-404e-88b6-ef774c32f627 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1218 microversion: 2.1 time: 0.064033 Dec 25 21:39:32.815531 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3531/7091] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:32 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:32.976178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:32.976788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:32.983120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:32.983573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:32.984489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:32.984958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:33.121357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:33.130165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-934e0883-0330-4ca9-b144-aca90cff3b4c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.158198 Dec 25 21:39:33.130741 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3561/7092] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:32 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:33.837940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:33.838569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:33.846209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:33.846621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:33.847420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:33.847873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:34.149565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:34.150171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:34.157204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:34.157663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:34.158460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:34.158902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:34.224224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:34.242373 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8be0c48-c61d-4a78-b796-c77866f74402 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1222 microversion: 2.1 time: 0.408686 Dec 25 21:39:34.242994 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3532/7093] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:33 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1222 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:34.340977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:34.351767 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c490e59-6366-44c5-9a4c-c0a3231758c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.206082 Dec 25 21:39:34.356570 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3562/7094] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:34 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:35.260030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:35.260581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:35.269051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:35.269632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:35.270513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:35.271061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:35.357665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:35.366268 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9800d7e9-9025-4601-a30a-1ea8a0503f8d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1276 microversion: 2.1 time: 0.110431 Dec 25 21:39:35.366814 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3533/7095] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:35 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1276 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:35.369321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:35.374159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:35.379377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:35.379890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:35.380688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:35.381818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:35.620203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:35.627627 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-696e0a48-dc2d-406e-b332-d99b0c258b10 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.262194 Dec 25 21:39:35.631961 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3563/7096] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:35 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:36.384222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:36.384854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:36.392777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:36.392777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:36.393642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:36.394104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:36.639237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:36.645228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:36.645843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:36.646512 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa0254e1-16f0-462b-b9cc-97c9469ec8ff tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.266550 Dec 25 21:39:36.647784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3534/7097] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:36 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:36.660430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:36.660908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:36.661893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:36.662357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:36.842138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:36.849849 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-28ef3537-b163-4c6e-9926-c2ca75212732 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.208282 Dec 25 21:39:36.850434 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3564/7098] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:36 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:36.894369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e4b52517-3a0a-4bb4-8e4b-be7a6b14371b req-3d824796-5c39-474d-962e-e38352527983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af5d7b62-4aa9-4e2f-9421-86d6fe783711", "tag": "294d86ae-25e5-48a6-b97f-4ab051ca3e0a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:36.895934 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:36.895934 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:36.903716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e4b52517-3a0a-4bb4-8e4b-be7a6b14371b req-3d824796-5c39-474d-962e-e38352527983 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:36.904834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e4b52517-3a0a-4bb4-8e4b-be7a6b14371b req-3d824796-5c39-474d-962e-e38352527983 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:36.916687 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e4b52517-3a0a-4bb4-8e4b-be7a6b14371b req-3d824796-5c39-474d-962e-e38352527983 service nova] Creating event network-changed:294d86ae-25e5-48a6-b97f-4ab051ca3e0a for instance af5d7b62-4aa9-4e2f-9421-86d6fe783711 on nch2-master-1 Dec 25 21:39:36.921629 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e4b52517-3a0a-4bb4-8e4b-be7a6b14371b req-3d824796-5c39-474d-962e-e38352527983 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031173 Dec 25 21:39:36.922289 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3535/7099] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:37.663694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:37.664314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:37.672325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:37.672325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:37.680408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:37.680408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:37.811539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:37.819359 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-752043a1-d51c-4949-bce4-fecf75c93ec0 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.159390 Dec 25 21:39:37.819946 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3565/7100] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:37 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:37.868389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:37.869162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:37.875268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:37.875732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:37.876589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:37.878934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:38.024853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:38.032455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f965c35c-56df-42f1-9935-cd3c098ef1f3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.169544 Dec 25 21:39:38.033056 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3536/7101] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:37 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:38.836296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:38.837082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:38.844530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:38.845026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:38.845828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:38.846468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:39.017205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:39.024803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c05fd91e-4149-4927-abcf-14bcb26c1607 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.193008 Dec 25 21:39:39.025456 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3566/7102] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:38 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:39.050010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:39.050667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:39.058347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:39.058859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:39.059682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:39.060165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:39.200648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:39.208143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7d0aae2-31e8-4208-9c1b-fc9621bd1599 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.162072 Dec 25 21:39:39.208719 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3537/7103] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:39 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:40.041922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:40.042537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:40.049867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:40.050103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:40.050777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:40.051207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:40.197006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:40.204491 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-13e662a2-689f-42db-8775-7c852bef92cd tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.167011 Dec 25 21:39:40.205112 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3567/7104] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:40 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:40.225430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:40.226069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:40.233038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:40.233498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:40.234321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:40.234833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:40.369381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:40.378793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9aebbe38-fb68-48f5-89fd-acbcc8450e35 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.156979 Dec 25 21:39:40.390051 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3538/7105] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:40 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:41.220336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:41.221078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:41.229841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:41.230299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:41.231088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:41.231528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:41.379392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:41.387460 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a15d50b-a0d0-4464-a2ac-395ce3efdf42 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.170727 Dec 25 21:39:41.388056 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3568/7106] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:41 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:41.403615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:41.404280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:41.411093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:41.411561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:41.413249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:41.413249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:41.564025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:41.571697 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56e1567d-9ccc-4418-9372-938271451a84 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1697 microversion: 2.1 time: 0.171892 Dec 25 21:39:41.572273 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3539/7107] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:41 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:42.201681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b076f5de-6b6f-4126-a889-4982a3a29653 req-c4b6b458-aa08-4561-b8e6-1d90f7f46de9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "name": "network-vif-unplugged", "status": "completed", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:42.203266 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:42.203266 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:39:42.210214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b076f5de-6b6f-4126-a889-4982a3a29653 req-c4b6b458-aa08-4561-b8e6-1d90f7f46de9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:42.210657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b076f5de-6b6f-4126-a889-4982a3a29653 req-c4b6b458-aa08-4561-b8e6-1d90f7f46de9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:42.222201 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b076f5de-6b6f-4126-a889-4982a3a29653 req-c4b6b458-aa08-4561-b8e6-1d90f7f46de9 service nova] Creating event network-vif-unplugged:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch2-master-1 Dec 25 21:39:42.229019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-b076f5de-6b6f-4126-a889-4982a3a29653 req-c4b6b458-aa08-4561-b8e6-1d90f7f46de9 service nova] Instance 0e933ee6-6f1f-4ab6-a383-83013426d722 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:39:42.240048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b076f5de-6b6f-4126-a889-4982a3a29653 req-c4b6b458-aa08-4561-b8e6-1d90f7f46de9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041982 Dec 25 21:39:42.241334 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3569/7108] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:39:42.405287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:42.405931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:42.413295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:42.414151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:42.415133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:42.415713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:42.590284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:42.591337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:42.598349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:42.599007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:42.600701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:42.601252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:42.710517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:42.718449 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a21a5472-c009-4a6f-b4cc-e7e1976b68eb tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.317209 Dec 25 21:39:42.719030 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3540/7109] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:42 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:42.842291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:42.850475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b94cd51-202c-4619-8298-c76310290ddc tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1696 microversion: 2.1 time: 0.264619 Dec 25 21:39:42.851065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3570/7110] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:42 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1696 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:39:43.217908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8d199190-1950-4d21-9b25-4c20924f5335 req-f03fd739-8008-46e8-b422-e793becfee6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af5d7b62-4aa9-4e2f-9421-86d6fe783711", "name": "network-vif-plugged", "status": "completed", "tag": "294d86ae-25e5-48a6-b97f-4ab051ca3e0a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:43.219888 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:43.219888 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:43.228526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8d199190-1950-4d21-9b25-4c20924f5335 req-f03fd739-8008-46e8-b422-e793becfee6f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:43.229252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8d199190-1950-4d21-9b25-4c20924f5335 req-f03fd739-8008-46e8-b422-e793becfee6f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:43.247314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8d199190-1950-4d21-9b25-4c20924f5335 req-f03fd739-8008-46e8-b422-e793becfee6f service nova] Creating event network-vif-plugged:294d86ae-25e5-48a6-b97f-4ab051ca3e0a for instance af5d7b62-4aa9-4e2f-9421-86d6fe783711 on nch2-master-1 Dec 25 21:39:43.253140 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8d199190-1950-4d21-9b25-4c20924f5335 req-f03fd739-8008-46e8-b422-e793becfee6f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038859 Dec 25 21:39:43.253782 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3541/7111] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:39:43.735341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:43.735996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:43.743580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:43.744046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:43.744891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:43.745328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:43.878613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:43.879439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:43.887236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:43.887646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:43.888466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:43.889219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:44.505710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:44.515483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d1c7656-816f-43e2-9adc-7a4863ef7193 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1318 microversion: 2.1 time: 0.784000 Dec 25 21:39:44.516078 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3571/7112] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:43 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1318 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:44.521375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2108af1e-aef7-4b40-a570-af803e95d511 req-1980d2a8-e419-44a6-8811-4b0daac636f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:44.522895 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:44.522895 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:39:44.530434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2108af1e-aef7-4b40-a570-af803e95d511 req-1980d2a8-e419-44a6-8811-4b0daac636f7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:44.534166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2108af1e-aef7-4b40-a570-af803e95d511 req-1980d2a8-e419-44a6-8811-4b0daac636f7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:44.545608 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2108af1e-aef7-4b40-a570-af803e95d511 req-1980d2a8-e419-44a6-8811-4b0daac636f7 service nova] Creating event network-changed:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch2-master-1 Dec 25 21:39:44.550140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:44.555928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-2108af1e-aef7-4b40-a570-af803e95d511 req-1980d2a8-e419-44a6-8811-4b0daac636f7 service nova] Instance 0e933ee6-6f1f-4ab6-a383-83013426d722 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:39:44.578336 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2108af1e-aef7-4b40-a570-af803e95d511 req-1980d2a8-e419-44a6-8811-4b0daac636f7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059989 Dec 25 21:39:44.579936 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3572/7113] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:44.585231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4d5c7c7-3d89-4438-b5b1-7c3794440354 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] Calling method '.version_select at 0x7fa4f69979d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:44.587430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80f753fc-143b-425b-a697-cbc2674ed2ec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1696 microversion: 2.1 time: 0.714390 Dec 25 21:39:44.588042 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3542/7114] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:43 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1696 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:44.669706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4d5c7c7-3d89-4438-b5b1-7c3794440354 tempest-TestVolumeBootPattern-1499667379 tempest-TestVolumeBootPattern-1499667379-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-385736057" status: 202 len: 0 microversion: 2.1 time: 0.088224 Dec 25 21:39:44.676749 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3573/7115] 10.222.0.32 () {58 vars in 1259 bytes} [Sat Dec 25 21:39:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-385736057 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:39:45.531462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:45.532726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:45.540084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:45.540791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:45.541735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:45.542357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:45.610503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:45.611885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:45.619790 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:45.620465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:45.621288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:45.621895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:45.839292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:45.856643 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4bcc0495-20ce-454c-8219-fb21b21b082d tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1505 microversion: 2.1 time: 0.328606 Dec 25 21:39:45.857454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3543/7116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:45 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1505 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:45.875687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f03e9745-84e8-42ce-aae1-83a861dbd629", "device": "/dev/sdb"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:45.885345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:45.897794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:45.898264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:45.899084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:45.899726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:45.923461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:45.932532 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ebd11136-6c96-490c-99a6-6b47e93f9cc8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1694 microversion: 2.1 time: 0.328320 Dec 25 21:39:45.943777 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3574/7117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:45 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1694 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:46.815537 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9084de4-c529-4b36-aa67-d3c469819fef tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "POST /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944062 Dec 25 21:39:46.816275 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3544/7118] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:39:45 2021] POST /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711/os-volume_attachments => generated 194 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:39:46.958173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:46.958808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:46.978516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:46.978973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:46.979786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:46.980222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:47.187852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:47.197744 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92591b49-5661-458b-9dd0-2d9a3c5c3737 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1691 microversion: 2.1 time: 0.250801 Dec 25 21:39:47.198377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3575/7119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:46 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1691 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:47.220355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:47.220355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:47.222510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:47.222980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:47.224092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:47.224735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:47.434593 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8f78b100-3edc-4d11-934e-b925b0ffe1ba tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action" status: 204 len: 0 microversion: 2.1 time: 0.223425 Dec 25 21:39:47.435540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3545/7120] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:39:47 2021] POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:39:47.443810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:47.444689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:47.454016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:47.455982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:47.457675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:47.464925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:47.793851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:47.811024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67bd3ac8-f7d4-4e63-9c04-eb3dcb934652 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1691 microversion: 2.1 time: 0.365095 Dec 25 21:39:47.811742 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3576/7121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:47 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1691 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:48.849300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:48.850800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:48.860654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:48.861463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:48.862688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:48.863384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:49.123924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:49.140762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf305c26-dbe0-4467-8bf4-1d8ce974bc76 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1691 microversion: 2.1 time: 0.312879 Dec 25 21:39:49.147559 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3546/7122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:48 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1691 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:50.163825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:50.168270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:50.172739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:50.173240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:50.174081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:50.174521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:50.337803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:50.345783 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ee55e8f-567e-4da9-8956-55b0523e9aec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1683 microversion: 2.1 time: 0.185752 Dec 25 21:39:50.346374 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3577/7123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:50 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:39:53.151187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-27a40522-acdb-4512-895e-b8fc1b10c89a req-26424ffb-744c-4f65-b1f9-da381a3a029d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "name": "network-vif-plugged", "status": "completed", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:53.153027 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:39:53.153027 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:39:53.165527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-27a40522-acdb-4512-895e-b8fc1b10c89a req-26424ffb-744c-4f65-b1f9-da381a3a029d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:53.166353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-27a40522-acdb-4512-895e-b8fc1b10c89a req-26424ffb-744c-4f65-b1f9-da381a3a029d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:53.181980 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-27a40522-acdb-4512-895e-b8fc1b10c89a req-26424ffb-744c-4f65-b1f9-da381a3a029d service nova] Creating event network-vif-plugged:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch2-master-1 Dec 25 21:39:53.187740 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-27a40522-acdb-4512-895e-b8fc1b10c89a req-26424ffb-744c-4f65-b1f9-da381a3a029d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042835 Dec 25 21:39:53.188524 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3547/7124] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:39:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:39:58.480863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-424574035", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:39:58.532170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:39:58.810543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:39:58.810974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:39:58.811490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:39:58.811907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:39:58.812355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:39:58.821279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:58.823979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:58.823979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:39:58.823979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:39:58.840541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Getting quotas for project 2a6f7f2d4b1243369e6e2a101f68557c. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:39:58.846310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Getting quotas for user 0b6c0fe828da4c18ae9764400f30740d and project 2a6f7f2d4b1243369e6e2a101f68557c. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:39:58.859088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:39:58.861464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:39:58.992677 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ac1d726a-6cfb-4723-8c96-1096725e1be9 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515600 Dec 25 21:39:58.993367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3578/7125] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:39:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:39:59.005114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c845a66b-228c-41c5-bd21-ad51576aa406 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:39:59.006507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c845a66b-228c-41c5-bd21-ad51576aa406 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:39:59.376577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c845a66b-228c-41c5-bd21-ad51576aa406 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:39:59.383872 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c845a66b-228c-41c5-bd21-ad51576aa406 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1213 microversion: 2.1 time: 0.384255 Dec 25 21:39:59.384441 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3548/7126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:39:58 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1213 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:00.402058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:00.402673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:00.408843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:00.409332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:00.410113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:00.410555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:00.471321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:00.479449 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-71ef8a72-7fed-49df-90a9-10b700d8c87a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1217 microversion: 2.1 time: 0.082010 Dec 25 21:40:00.480381 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3579/7127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:00 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:01.495386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:01.496112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:01.504536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:01.505117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:01.507453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:01.507453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:01.579502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:01.587873 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b86732ff-4a5b-4e87-aec4-39f1c7939d49 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1273 microversion: 2.1 time: 0.096172 Dec 25 21:40:01.588462 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3549/7128] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:01 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:02.605290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:02.605916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:02.613546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:02.614009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:02.615007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:02.615440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:02.843987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:02.852138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f118cd58-2360-4f7b-9b3e-c7ec89db979b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.250616 Dec 25 21:40:02.852722 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3580/7129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:02 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:03.568699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-094582c5-18ce-42a7-bfd2-c85da13c2a96 req-ffa70bc0-db4a-4e72-a466-de9011aa1550 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35aa4ccd-799c-49ca-9e5c-7c2c0c0df866", "tag": "ede56955-d086-4b6b-a856-08d1374a3930"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:03.570730 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:03.570730 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:40:03.580770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-094582c5-18ce-42a7-bfd2-c85da13c2a96 req-ffa70bc0-db4a-4e72-a466-de9011aa1550 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:03.581529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-094582c5-18ce-42a7-bfd2-c85da13c2a96 req-ffa70bc0-db4a-4e72-a466-de9011aa1550 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:03.595127 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-094582c5-18ce-42a7-bfd2-c85da13c2a96 req-ffa70bc0-db4a-4e72-a466-de9011aa1550 service nova] Creating event network-changed:ede56955-d086-4b6b-a856-08d1374a3930 for instance 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 on nch1-master-1 Dec 25 21:40:03.601491 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-094582c5-18ce-42a7-bfd2-c85da13c2a96 req-ffa70bc0-db4a-4e72-a466-de9011aa1550 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036795 Dec 25 21:40:03.602851 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3550/7130] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:03.869020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:03.869644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:03.876501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:03.876987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:03.877789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:03.878223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:04.117159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:04.124565 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ed47668-93fe-4875-a0af-fe5fff28860b tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.259514 Dec 25 21:40:04.125214 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3581/7131] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:03 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:05.142490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:05.143197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:05.151337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:05.151785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:05.152575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:05.153069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:05.294845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:05.302130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4235e4fc-0055-418e-8fc4-39afd1dbcada tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.164021 Dec 25 21:40:05.302713 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3551/7132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:05 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:06.318771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:06.320057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:06.326905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:06.327343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:06.328125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:06.328558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:06.463853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:06.471757 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0edd1644-fbba-44be-9c2d-bdbd19965553 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.156728 Dec 25 21:40:06.472332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3582/7133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:06 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:07.489190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:07.489970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:07.499886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:07.504289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:07.504289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:07.504289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:07.639749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:07.647612 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-743b7d61-b442-4d2b-bd1b-4aa6888535d7 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.161875 Dec 25 21:40:07.648199 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3552/7134] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:07 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:08.666039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:08.666039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:08.671555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:08.672012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:08.672784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:08.673266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:08.828614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:08.836869 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b27091a7-1003-48be-ab92-0fdedf0e396a tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.176395 Dec 25 21:40:08.856407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3583/7135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:08 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:09.459974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-294ed389-5c25-4136-b44a-25f4307ffee0 req-df79031f-786b-43d9-87c7-5d15d1501f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35aa4ccd-799c-49ca-9e5c-7c2c0c0df866", "name": "network-vif-plugged", "status": "completed", "tag": "ede56955-d086-4b6b-a856-08d1374a3930"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:09.462146 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:09.462146 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:40:09.470082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-294ed389-5c25-4136-b44a-25f4307ffee0 req-df79031f-786b-43d9-87c7-5d15d1501f9b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:09.470543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-294ed389-5c25-4136-b44a-25f4307ffee0 req-df79031f-786b-43d9-87c7-5d15d1501f9b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:09.481257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-294ed389-5c25-4136-b44a-25f4307ffee0 req-df79031f-786b-43d9-87c7-5d15d1501f9b service nova] Creating event network-vif-plugged:ede56955-d086-4b6b-a856-08d1374a3930 for instance 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 on nch1-master-1 Dec 25 21:40:09.486035 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-294ed389-5c25-4136-b44a-25f4307ffee0 req-df79031f-786b-43d9-87c7-5d15d1501f9b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031456 Dec 25 21:40:09.486615 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3553/7136] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:09.854088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:09.854699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:09.861746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:09.862195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:09.862965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:09.863400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:09.998597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:10.006146 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2dd58e82-11d1-4a6f-9eec-2f2bb0cf3343 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1313 microversion: 2.1 time: 0.156455 Dec 25 21:40:10.006723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3584/7137] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:09 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:11.024121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:11.025557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:11.035677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:11.036147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:11.037033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:11.037491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:11.173643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:11.181880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-507395c3-a4fe-4ec9-8bf4-bc8d26b1cdb4 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1462 microversion: 2.1 time: 0.161871 Dec 25 21:40:11.182461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3554/7138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:11 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:11.199160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e560f62-0022-4854-a99f-ce9ce208b3c1", "device": "/dev/sdb"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:11.201126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:11.211278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:11.211732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:11.212565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:11.213046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:11.883191 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efe5669a-a1cb-4bf0-9e15-c602897211d6 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "POST /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688323 Dec 25 21:40:11.883854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3585/7139] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 21:40:11 2021] POST /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866/os-volume_attachments => generated 194 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:12.528387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:12.529719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:12.537160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:12.537624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:12.538424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:12.538872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:12.589962 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-337b5801-2371-4350-8e65-113c2d4947a2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action" status: 200 len: 24580 microversion: 2.1 time: 0.065739 Dec 25 21:40:12.604887 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3555/7140] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:40:12 2021] POST /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722/action => generated 24580 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:40:18.813944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:18.814708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:18.821044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:18.821503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:18.822284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:18.822726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:18.957181 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7957edfd-61a0-4626-9ca6-bfe8f6594258 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1834 microversion: 2.1 time: 0.148317 Dec 25 21:40:18.957765 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3586/7141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:18 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1834 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:20.232221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:20.232834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:20.247867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-62e675d6-02cd-4320-9392-eabde45f5886 req-d3769800-e909-4cad-8ccd-6eecede94c45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:20.250712 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:20.250712 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:40:20.256320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:20.256997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:20.257862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:20.258332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:20.263189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-62e675d6-02cd-4320-9392-eabde45f5886 req-d3769800-e909-4cad-8ccd-6eecede94c45 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:20.263903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-62e675d6-02cd-4320-9392-eabde45f5886 req-d3769800-e909-4cad-8ccd-6eecede94c45 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:20.278694 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-62e675d6-02cd-4320-9392-eabde45f5886 req-d3769800-e909-4cad-8ccd-6eecede94c45 service nova] Creating event network-changed:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch2-master-1 Dec 25 21:40:20.289712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:40:20.300052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-62e675d6-02cd-4320-9392-eabde45f5886 req-d3769800-e909-4cad-8ccd-6eecede94c45 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055741 Dec 25 21:40:20.300982 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3587/7142] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:20.656955 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4824f1e-89c0-4519-86af-6a01f0874127 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 204 len: 0 microversion: 2.1 time: 0.429723 Dec 25 21:40:20.657979 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3556/7143] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:40:20 2021] DELETE /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:40:20.666551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:20.667581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:20.674034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:20.674717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:20.675715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:20.676367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:21.023600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:21.040038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-af7cbb56-47be-49fa-b94f-167dae82fb90 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1689 microversion: 2.1 time: 0.377105 Dec 25 21:40:21.040450 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3588/7144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:20 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1689 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:22.058516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:22.059310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:22.068409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:22.068980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:22.069801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:22.070252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:22.705333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:22.712882 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-339e5ba6-ca14-4812-a0ac-e646439102aa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1570 microversion: 2.1 time: 0.658903 Dec 25 21:40:22.713471 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3557/7145] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:22 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1570 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:23.297678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-165d02ab-807c-4804-921d-5d58373a7133 req-85add5c1-23e9-478b-878b-f6c8ec805ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e933ee6-6f1f-4ab6-a383-83013426d722", "name": "network-vif-deleted", "tag": "f8a8588c-abcc-4eda-99f7-383ebeac328b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:23.300015 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:23.300015 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:40:23.310094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-165d02ab-807c-4804-921d-5d58373a7133 req-85add5c1-23e9-478b-878b-f6c8ec805ddc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:23.310835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-165d02ab-807c-4804-921d-5d58373a7133 req-85add5c1-23e9-478b-878b-f6c8ec805ddc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:23.324596 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-165d02ab-807c-4804-921d-5d58373a7133 req-85add5c1-23e9-478b-878b-f6c8ec805ddc service nova] Creating event network-vif-deleted:f8a8588c-abcc-4eda-99f7-383ebeac328b for instance 0e933ee6-6f1f-4ab6-a383-83013426d722 on nch2-master-1 Dec 25 21:40:23.330852 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-165d02ab-807c-4804-921d-5d58373a7133 req-85add5c1-23e9-478b-878b-f6c8ec805ddc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036967 Dec 25 21:40:23.333025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3589/7146] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:23.729705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:23.730424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:23.742542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:23.743051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:23.743949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:23.744623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:23.784275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:23.784748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:23.785254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lazy-loading 'fault' on Instance uuid 0e933ee6-6f1f-4ab6-a383-83013426d722 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:40:23.860042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:23.868746 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-095c5e7e-1bd1-44cd-acc9-3e0da2401942 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 200 len: 1356 microversion: 2.1 time: 0.143252 Dec 25 21:40:23.869362 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3558/7147] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:23 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 1356 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:24.889880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:24.890530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 0e933ee6-6f1f-4ab6-a383-83013426d722] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:24.898490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:24.899249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:24.900041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:24.900780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:24.918670 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] HTTP exception thrown: Instance 0e933ee6-6f1f-4ab6-a383-83013426d722 could not be found. Dec 25 21:40:24.919202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Returning 404 to user: Instance 0e933ee6-6f1f-4ab6-a383-83013426d722 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:40:24.920052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7575f607-4eb0-46e8-9655-c7c83700385f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722" status: 404 len: 111 microversion: 2.1 time: 0.035102 Dec 25 21:40:24.920784 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3590/7148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:24 2021] GET /compute/v2.1/servers/0e933ee6-6f1f-4ab6-a383-83013426d722 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:40:30.775393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c4b1d3b-7b1d-40fb-bf05-b8587f4ad15b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '.version_select at 0x7fa4f62329d0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:30.846814 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c4b1d3b-7b1d-40fb-bf05-b8587f4ad15b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1236245657" status: 202 len: 0 microversion: 2.1 time: 0.074878 Dec 25 21:40:30.847943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3559/7149] 10.222.0.32 () {58 vars in 1283 bytes} [Sat Dec 25 21:40:30 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1236245657 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:40:30.877402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-77c93219-8eeb-48d9-9028-65bb84a29e61 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: .version_select at 0x7fa4f6238a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-563909803"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:30.892746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-77c93219-8eeb-48d9-9028-65bb84a29e61 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:40:30.897788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-77c93219-8eeb-48d9-9028-65bb84a29e61 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:40:31.171082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-77c93219-8eeb-48d9-9028-65bb84a29e61 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:40:31.176217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-77c93219-8eeb-48d9-9028-65bb84a29e61 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:40:31.198775 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-77c93219-8eeb-48d9-9028-65bb84a29e61 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.325023 Dec 25 21:40:31.204481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3591/7150] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:40:30 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:35.459617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1373911738", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "e72701b1-b225-435a-b0b6-671bd3fcca4d"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:35.515267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] validate_networks() for [('e72701b1-b225-435a-b0b6-671bd3fcca4d', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:40:36.223169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:40:36.223945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:40:36.224443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:40:36.225266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:40:36.225717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:40:36.236094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:36.236678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:36.237778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:36.238165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:36.264238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Getting quotas for project fd48d45421c54fe18214db7c64eefb48. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:40:36.271118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Getting quotas for user 46e9ab1019684fa1af5351448f486a4f and project fd48d45421c54fe18214db7c64eefb48. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:40:36.288983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:40:36.291890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:40:36.817317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1076d6b7-bbc6-4fc5-8d89-3fd5bd8dc332 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.498640 Dec 25 21:40:36.818015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3560/7151] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:40:35 2021] POST /compute/v2.1/servers => generated 380 bytes in 1500 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:40:36.829271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2a67a10-0330-47e0-95eb-5b4fcc114e89 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:36.836744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2a67a10-0330-47e0-95eb-5b4fcc114e89 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:36.882194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2a67a10-0330-47e0-95eb-5b4fcc114e89 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:36.890084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2a67a10-0330-47e0-95eb-5b4fcc114e89 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:36.892028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f2a67a10-0330-47e0-95eb-5b4fcc114e89 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:36.893351 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2a67a10-0330-47e0-95eb-5b4fcc114e89 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1259 microversion: 2.21 time: 0.069360 Dec 25 21:40:36.896369 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3592/7152] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:36 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:37.911183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-73198fe5-7eb3-4090-87e4-cd3724a4f506 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:37.917665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-73198fe5-7eb3-4090-87e4-cd3724a4f506 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:37.983530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-73198fe5-7eb3-4090-87e4-cd3724a4f506 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:37.992166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-73198fe5-7eb3-4090-87e4-cd3724a4f506 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:37.993750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-73198fe5-7eb3-4090-87e4-cd3724a4f506 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:37.994883 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-73198fe5-7eb3-4090-87e4-cd3724a4f506 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1259 microversion: 2.21 time: 0.087505 Dec 25 21:40:37.995453 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3561/7153] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:37 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1259 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:39.012792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:39.014467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:39.022870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:39.023529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:39.027059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:39.027748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:39.114061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:39.124286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:39.125961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:39.127179 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05a8c508-c113-4164-906c-a8c6fb7f1204 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1311 microversion: 2.21 time: 0.118217 Dec 25 21:40:39.138397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3593/7154] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:39 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:40.147096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:40.148364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:40.156130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:40.157614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:40.158699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:40.159166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:40.262380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:40.281063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:40.281063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:40.281063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80622f87-52d0-4750-8b12-d942914e3259 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1317 microversion: 2.21 time: 0.134645 Dec 25 21:40:40.281063 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3562/7155] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:40 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1317 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:41.295292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:41.295941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:41.303088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:41.303918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:41.305197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:41.305314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:41.629885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:41.638412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:41.641536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:41.641536 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b4f735ca-a6fe-45f2-9695-a28c8ccbf57d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.350534 Dec 25 21:40:41.642213 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3594/7156] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:41 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:41.803906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1847760067", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "7c9a49d8-7827-4a91-972b-33a97efdb498"}], "key_name": "tempest-TestNetworkAdvancedServerOps-563909803", "security_groups": [{"name": "tempest-secgroup-smoke-567901477"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:41.975979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] validate_networks() for [('7c9a49d8-7827-4a91-972b-33a97efdb498', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:40:42.570234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:40:42.570675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:40:42.571317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:40:42.571752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:40:42.572189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:40:42.581692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.582163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.582997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.583448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.600550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:40:42.605864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:40:42.619990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:40:42.623083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:40:42.665056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:42.667964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:42.687078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.687528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.688331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.688766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.739811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b331ca9-ad73-468d-a172-5d55a3124d8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.940775 Dec 25 21:40:42.745605 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3563/7157] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:40:41 2021] POST /compute/v2.1/servers => generated 405 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:40:42.745935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3d59dca3-82e4-43fb-b6c4-415f15c88e92 req-03e3cd6c-f243-42b6-9d00-cab2bc92df6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5e83850-e30d-4526-880d-d4a212c9f515", "tag": "df10b4de-74b6-4e88-a228-8a7fd899d719"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:42.748202 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:42.748202 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:40:42.755469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3d59dca3-82e4-43fb-b6c4-415f15c88e92 req-03e3cd6c-f243-42b6-9d00-cab2bc92df6f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.755936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3d59dca3-82e4-43fb-b6c4-415f15c88e92 req-03e3cd6c-f243-42b6-9d00-cab2bc92df6f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.768362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3d59dca3-82e4-43fb-b6c4-415f15c88e92 req-03e3cd6c-f243-42b6-9d00-cab2bc92df6f service nova] Creating event network-changed:df10b4de-74b6-4e88-a228-8a7fd899d719 for instance e5e83850-e30d-4526-880d-d4a212c9f515 on nch2-master-1 Dec 25 21:40:42.782269 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3d59dca3-82e4-43fb-b6c4-415f15c88e92 req-03e3cd6c-f243-42b6-9d00-cab2bc92df6f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031646 Dec 25 21:40:42.782269 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3564/7158] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:42.782269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:42.782269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:42.789086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.789712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.790751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:42.791222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:42.942904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lazy-loading 'services' on Instance uuid 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:40:42.954102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:42.973805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:42.975338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:42.976494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-080f644a-ff86-4b1f-8af7-7e4bfeba14ff tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.321301 Dec 25 21:40:42.992432 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3595/7159] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:42 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:43.003099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0690f98a-3008-4da1-b3dc-9da3174f50ce tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:43.003726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0690f98a-3008-4da1-b3dc-9da3174f50ce tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:43.112629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0690f98a-3008-4da1-b3dc-9da3174f50ce tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:43.121012 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0690f98a-3008-4da1-b3dc-9da3174f50ce tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1266 microversion: 2.1 time: 0.126506 Dec 25 21:40:43.134703 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3596/7160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:42 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:43.249050 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f92348a-6b96-40d9-ba51-ef9eadd2e8bd tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "DELETE /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866/os-volume_attachments/2e560f62-0022-4854-a99f-ce9ce208b3c1" status: 202 len: 0 microversion: 2.1 time: 0.473304 Dec 25 21:40:43.250092 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3565/7161] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:40:42 2021] DELETE /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866/os-volume_attachments/2e560f62-0022-4854-a99f-ce9ce208b3c1 => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:40:43.996769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:43.998007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:44.012744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.014450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.015272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.015708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.140783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:44.141542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:44.149272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.149851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.151078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.151727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.216959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:44.230568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:44.233496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:44.234698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e5318f1-2e77-4c8a-be1a-73e1ecf8962d tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.244849 Dec 25 21:40:44.237002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:44.246182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3597/7162] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:43 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:44.252543 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a8b72be-21d6-45cb-8e63-bf8a438de509 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1270 microversion: 2.1 time: 0.116563 Dec 25 21:40:44.253175 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3566/7163] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:44 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1270 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:44.367904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:44.368404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:44.377587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.378252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.379394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.379839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.411092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:40:44.741844 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec0522c3-b2d6-4357-a7eb-c86d70700f06 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "DELETE /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 204 len: 0 microversion: 2.1 time: 0.377531 Dec 25 21:40:44.742536 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3598/7164] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:40:44 2021] DELETE /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:40:44.750722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:44.752054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:44.758601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.759056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.759875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:44.760332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:44.924828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:44.932846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6b110b3c-b95d-4f6c-a61f-0b1c7af42272 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1468 microversion: 2.1 time: 0.185807 Dec 25 21:40:44.933467 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3567/7165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:44 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1468 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:45.254450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:45.255796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:45.262305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:45.262752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:45.264063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:45.264743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:45.270041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:45.270737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:45.277579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:45.278171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:45.279212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:45.279739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:45.386623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:45.395106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db608371-82a2-4d08-a0d0-11fe9d259f26 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1326 microversion: 2.1 time: 0.128913 Dec 25 21:40:45.396157 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3568/7166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:45 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1326 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:40:45.527386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:45.535447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:45.537217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:45.538358 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed7e6280-de3c-47a8-89d8-b6c70176751a tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.288352 Dec 25 21:40:45.538921 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3599/7167] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:45 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:45.950677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:45.951342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:45.957988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:45.958663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:45.964087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:45.964087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:46.194658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:46.202461 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ccc7fa6d-69d0-4e25-8d87-7e636d8f0663 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1468 microversion: 2.1 time: 0.255494 Dec 25 21:40:46.214772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3569/7168] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:45 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1468 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:46.412399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:46.414641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:46.422722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:46.423099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:46.424065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:46.424543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:46.555942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:46.559375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:46.564302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:46.565051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:46.565940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:46.566678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:46.793419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:46.800947 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96b13e22-602b-48b2-a94e-d72710743f11 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.393089 Dec 25 21:40:46.801523 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3600/7169] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:46 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:46.941029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:46.949910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:46.952273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:46.953807 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-da1103d6-47a8-417b-9ab6-a8d40d851b5f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.401769 Dec 25 21:40:46.954741 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3570/7170] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:46 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:40:47.221185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:47.222231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:47.228814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.229313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:47.230219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.230548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:47.680545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:47.691208 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7d2a88c9-a77a-4772-900a-9591f26ddc2f tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1468 microversion: 2.1 time: 0.473784 Dec 25 21:40:47.691856 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3601/7171] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:47 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1468 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:47.818111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:47.818746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:47.825831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.826298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:47.827142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.827593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:47.871896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e70a6b5f-2be0-4438-9fad-8cda74f4a22e req-30fa0d92-d6f7-4f78-8023-864a5e896d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35aa4ccd-799c-49ca-9e5c-7c2c0c0df866", "name": "network-vif-deleted", "tag": "ede56955-d086-4b6b-a856-08d1374a3930"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:47.873550 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:47.873550 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:40:47.880829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e70a6b5f-2be0-4438-9fad-8cda74f4a22e req-30fa0d92-d6f7-4f78-8023-864a5e896d65 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.881349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e70a6b5f-2be0-4438-9fad-8cda74f4a22e req-30fa0d92-d6f7-4f78-8023-864a5e896d65 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:47.895408 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e70a6b5f-2be0-4438-9fad-8cda74f4a22e req-30fa0d92-d6f7-4f78-8023-864a5e896d65 service nova] Creating event network-vif-deleted:ede56955-d086-4b6b-a856-08d1374a3930 for instance 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 on nch1-master-1 Dec 25 21:40:47.900201 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e70a6b5f-2be0-4438-9fad-8cda74f4a22e req-30fa0d92-d6f7-4f78-8023-864a5e896d65 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032825 Dec 25 21:40:47.900807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3602/7172] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:47.973117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:47.973959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:47.996702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.996702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:47.997379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:47.997836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:48.064754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:48.072328 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5dd8948-69af-481c-81e2-dbbe59e470c5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.258121 Dec 25 21:40:48.082460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3571/7173] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:47 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:48.175868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:48.186408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:48.188450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:48.192173 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f00f826a-47b7-48cb-abe8-860dd2c43218 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.222646 Dec 25 21:40:48.193666 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3603/7174] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:47 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:40:48.707612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:48.708331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:48.715159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:48.715698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:48.716574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:48.717076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:48.750891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:48.751363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:48.751861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lazy-loading 'fault' on Instance uuid 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:40:48.809623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6c0fe828da4c18ae9764400f30740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a6f7f2d4b1243369e6e2a101f68557c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:48.819489 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad632b48-15c7-4221-a423-d95a7d64c763 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 200 len: 1303 microversion: 2.1 time: 0.115171 Dec 25 21:40:48.820124 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3572/7175] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:48 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 1303 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:49.088712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:49.089373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:49.096202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.096650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.097453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.097890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.210570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:49.211202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:49.218448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.218979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.219877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.221036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.244211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:49.252267 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b39a4588-4c95-4d6a-80d1-d2cb555c490e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.167229 Dec 25 21:40:49.253120 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3604/7176] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:49 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:49.360941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:49.369152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:49.370817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:49.372104 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f490cc58-18f4-4691-a23e-1ee5025c9d31 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.165538 Dec 25 21:40:49.372784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3573/7177] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:49 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:40:49.462697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-48c8c0a7-fee6-47c0-bc0d-1586ac316231 req-a624c388-891d-4343-9dbd-bd2b890c3ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e83850-e30d-4526-880d-d4a212c9f515", "name": "network-vif-plugged", "status": "completed", "tag": "df10b4de-74b6-4e88-a228-8a7fd899d719"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:49.467304 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:49.467304 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:40:49.475113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-48c8c0a7-fee6-47c0-bc0d-1586ac316231 req-a624c388-891d-4343-9dbd-bd2b890c3ae8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.475568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-48c8c0a7-fee6-47c0-bc0d-1586ac316231 req-a624c388-891d-4343-9dbd-bd2b890c3ae8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.491465 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-48c8c0a7-fee6-47c0-bc0d-1586ac316231 req-a624c388-891d-4343-9dbd-bd2b890c3ae8 service nova] Creating event network-vif-plugged:df10b4de-74b6-4e88-a228-8a7fd899d719 for instance e5e83850-e30d-4526-880d-d4a212c9f515 on nch2-master-1 Dec 25 21:40:49.498178 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-48c8c0a7-fee6-47c0-bc0d-1586ac316231 req-a624c388-891d-4343-9dbd-bd2b890c3ae8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103108 Dec 25 21:40:49.499002 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3605/7178] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:49.836970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:49.837935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] [instance: 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:49.847908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.851042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.852368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.853087 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.868415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] HTTP exception thrown: Instance 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 could not be found. Dec 25 21:40:49.869099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] Returning 404 to user: Instance 35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:40:49.869962 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e01a6fb9-2815-4465-926b-bcf182531313 tempest-VolumesBackupsTest-596628470 tempest-VolumesBackupsTest-596628470-project] 10.222.0.32 "GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866" status: 404 len: 111 microversion: 2.1 time: 0.037043 Dec 25 21:40:49.870535 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3574/7179] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:49 2021] GET /compute/v2.1/servers/35aa4ccd-799c-49ca-9e5c-7c2c0c0df866 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:40:49.917463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-68290165-be7f-4e50-9624-581bc8471cec req-36136acb-d230-4b1d-98eb-0af3652cdb3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:49.918944 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:49.918944 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:40:49.926296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-68290165-be7f-4e50-9624-581bc8471cec req-36136acb-d230-4b1d-98eb-0af3652cdb3e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:49.926748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-68290165-be7f-4e50-9624-581bc8471cec req-36136acb-d230-4b1d-98eb-0af3652cdb3e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:49.937802 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-68290165-be7f-4e50-9624-581bc8471cec req-36136acb-d230-4b1d-98eb-0af3652cdb3e service nova] Creating event network-changed:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:40:49.942727 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-68290165-be7f-4e50-9624-581bc8471cec req-36136acb-d230-4b1d-98eb-0af3652cdb3e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029282 Dec 25 21:40:49.943379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3606/7180] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:50.270309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:50.270931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:50.277662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:50.278122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:50.278923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:50.279368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:50.391814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:50.392527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:50.399481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:50.399946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:50.400773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:50.401253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:50.574106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:50.581966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac00ece0-d9b5-49c1-854b-4a5c3d336d9a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.315752 Dec 25 21:40:50.582645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3575/7181] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:50 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:50.633251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:50.642013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:50.643486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:50.644619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70f7d545-0be8-4551-aff0-0d6ae441ec9b tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1359 microversion: 2.21 time: 0.258217 Dec 25 21:40:50.645223 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3607/7182] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:50 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:40:51.598850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:51.599484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:51.606426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:51.606918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:51.607707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:51.608154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:51.662721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:51.663520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:51.671218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:51.671710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:51.674713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:51.674713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:51.783090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:51.790813 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-57a0af14-99c2-4f1c-9afe-e95b82975bec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.195803 Dec 25 21:40:51.797408 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3576/7183] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:51 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:51.846097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:51.854799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:51.860616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:51.860616 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc342b66-18a8-41b3-ac05-4f80613f2d11 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1552 microversion: 2.21 time: 0.199540 Dec 25 21:40:51.860616 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3608/7184] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:51 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1552 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:40:51.876170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:51.876727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:51.883626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:51.884353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:51.885359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:51.886489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:51.913267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:40:52.158680 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d371495a-3c6a-4e6f-9c60-7e8ad52c1037 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 204 len: 0 microversion: 2.21 time: 0.286568 Dec 25 21:40:52.159284 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3577/7185] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:40:51 2021] DELETE /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:40:52.171575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:52.171575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:52.174243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:52.174710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:52.175498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:52.176020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:52.317913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:52.325748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:52.327276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:52.332370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b79ea4e4-f318-4b19-bfab-91ae98616322 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1558 microversion: 2.21 time: 0.165056 Dec 25 21:40:52.332370 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3609/7186] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:52 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:52.808906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:52.809699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:52.817282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:52.818214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:52.818560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:52.818996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:52.968453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:52.976516 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d5a2ebf-472a-49b1-9fa4-f8ea566fe622 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.172516 Dec 25 21:40:52.980474 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3578/7187] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:52 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:53.347406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:53.348026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:53.354961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:53.355420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:53.356206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:53.356651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:53.515060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:53.523025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:53.524557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:53.525763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-78c2b472-1dd9-4583-89e9-07b3c2eeedf9 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1558 microversion: 2.21 time: 0.182231 Dec 25 21:40:53.526360 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3610/7188] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:53 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1558 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:53.647131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-aee429b8-44b3-4681-95ba-de867b6e5db2 req-4629f467-c5be-49b5-8a1c-61ae989b21c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "name": "network-vif-plugged", "status": "completed", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:53.650670 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:53.650670 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:40:53.658826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-aee429b8-44b3-4681-95ba-de867b6e5db2 req-4629f467-c5be-49b5-8a1c-61ae989b21c5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:53.659300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-aee429b8-44b3-4681-95ba-de867b6e5db2 req-4629f467-c5be-49b5-8a1c-61ae989b21c5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:53.677729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-aee429b8-44b3-4681-95ba-de867b6e5db2 req-4629f467-c5be-49b5-8a1c-61ae989b21c5 service nova] Creating event network-vif-plugged:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:40:53.677729 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-aee429b8-44b3-4681-95ba-de867b6e5db2 req-4629f467-c5be-49b5-8a1c-61ae989b21c5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Dec 25 21:40:53.677729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3579/7189] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:53.995307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:53.995943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:54.002808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:54.003540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:54.004704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:54.005798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:54.110535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2cbcba80-2368-4e1d-b971-2f5c4e879028 req-babfa0e2-c9c6-4740-b6a0-e2f25de7a617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5e83850-e30d-4526-880d-d4a212c9f515", "name": "network-vif-deleted", "tag": "df10b4de-74b6-4e88-a228-8a7fd899d719"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:54.112331 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:54.112331 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:40:54.121042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2cbcba80-2368-4e1d-b971-2f5c4e879028 req-babfa0e2-c9c6-4740-b6a0-e2f25de7a617 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:54.121719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2cbcba80-2368-4e1d-b971-2f5c4e879028 req-babfa0e2-c9c6-4740-b6a0-e2f25de7a617 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:54.133665 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2cbcba80-2368-4e1d-b971-2f5c4e879028 req-babfa0e2-c9c6-4740-b6a0-e2f25de7a617 service nova] Creating event network-vif-deleted:df10b4de-74b6-4e88-a228-8a7fd899d719 for instance e5e83850-e30d-4526-880d-d4a212c9f515 on nch2-master-1 Dec 25 21:40:54.139419 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2cbcba80-2368-4e1d-b971-2f5c4e879028 req-babfa0e2-c9c6-4740-b6a0-e2f25de7a617 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033128 Dec 25 21:40:54.140203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3580/7190] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:40:54.194971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:54.202719 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9624a7fd-367a-4a38-8c44-9d9f3ab73cd4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1391 microversion: 2.1 time: 0.212329 Dec 25 21:40:54.203561 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3611/7191] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:53 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1391 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:54.545061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:54.545687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:54.552153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:54.552638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:54.553500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:54.553952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:54.585727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:54.586193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:54.586656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lazy-loading 'fault' on Instance uuid e5e83850-e30d-4526-880d-d4a212c9f515 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:40:54.632627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:54.641849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:54.643428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e9ab1019684fa1af5351448f486a4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd48d45421c54fe18214db7c64eefb48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:54.644632 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87d40dc2-13f8-4123-9273-59d202c373e5 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 200 len: 1349 microversion: 2.21 time: 0.103853 Dec 25 21:40:54.645277 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3581/7192] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:54 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:40:55.220717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:55.221385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:55.228079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.228533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.229441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.229936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.370011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:55.380312 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca42ff9b-ff78-4870-8cf7-f5e192f8941f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1562 microversion: 2.1 time: 0.164193 Dec 25 21:40:55.383078 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3612/7193] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:55 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1562 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:55.397407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:55.398050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:55.405762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.406232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.407044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.407503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.544649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:55.553242 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a21d8699-5ed4-4ebb-bde0-8b986aff6fad tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1562 microversion: 2.1 time: 0.159474 Dec 25 21:40:55.553850 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3582/7194] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:55 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:55.661879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:55.662550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:55.668532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.669022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.669808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.670245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.685373 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] HTTP exception thrown: Instance e5e83850-e30d-4526-880d-d4a212c9f515 could not be found. Dec 25 21:40:55.685958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Returning 404 to user: Instance e5e83850-e30d-4526-880d-d4a212c9f515 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:40:55.686868 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9f2faae-3329-43b7-ad55-dd3ceb65032f tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 404 len: 111 microversion: 2.21 time: 0.028667 Dec 25 21:40:55.687418 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3613/7195] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:55 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:40:55.695712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '.version_select at 0x7fa4f6027d30>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:55.696332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:55.703741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.704202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.705153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.705663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.772118 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a25777e7-70f4-4d61-b7f1-b4305f6dacea tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.080238 Dec 25 21:40:55.772741 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3583/7196] 10.222.0.32 () {60 vars in 1336 bytes} [Sat Dec 25 21:40:55 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515/os-instance-actions => generated 611 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:40:55.785530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:55.786012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:55.791959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.792479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.793313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.793759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.807572 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] HTTP exception thrown: Instance e5e83850-e30d-4526-880d-d4a212c9f515 could not be found. Dec 25 21:40:55.808217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Returning 404 to user: Instance e5e83850-e30d-4526-880d-d4a212c9f515 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:40:55.809083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1cda2107-fdc7-4e67-b4cc-35dc504641a3 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 404 len: 111 microversion: 2.21 time: 0.027323 Dec 25 21:40:55.809618 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3614/7197] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:40:55 2021] DELETE /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:40:55.817588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:55.818248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] [instance: e5e83850-e30d-4526-880d-d4a212c9f515] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:55.824309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.824779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.825606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:55.826066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:55.858089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] HTTP exception thrown: Instance e5e83850-e30d-4526-880d-d4a212c9f515 could not be found. Dec 25 21:40:55.858089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] Returning 404 to user: Instance e5e83850-e30d-4526-880d-d4a212c9f515 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:40:55.858089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d531256-6bc2-4aeb-9308-ccc0886e6396 tempest-InstanceActionsV221TestJSON-1995988780 tempest-InstanceActionsV221TestJSON-1995988780-project] 10.222.0.32 "GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515" status: 404 len: 111 microversion: 2.21 time: 0.028317 Dec 25 21:40:55.858089 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3584/7198] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:55 2021] GET /compute/v2.1/servers/e5e83850-e30d-4526-880d-d4a212c9f515 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:40:58.022523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:58.023170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:58.028247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8cf842b9-ec17-413a-b790-560e56f5e739 req-ad66bef1-aee7-46db-bbdd-b05d01679859 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:58.029914 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:40:58.029914 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:40:58.030454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:58.030999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:58.032155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:58.032703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:58.039675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8cf842b9-ec17-413a-b790-560e56f5e739 req-ad66bef1-aee7-46db-bbdd-b05d01679859 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:58.040148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8cf842b9-ec17-413a-b790-560e56f5e739 req-ad66bef1-aee7-46db-bbdd-b05d01679859 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:58.052503 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8cf842b9-ec17-413a-b790-560e56f5e739 req-ad66bef1-aee7-46db-bbdd-b05d01679859 service nova] Creating event network-changed:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:40:58.058389 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8cf842b9-ec17-413a-b790-560e56f5e739 req-ad66bef1-aee7-46db-bbdd-b05d01679859 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035910 Dec 25 21:40:58.058812 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3585/7199] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:40:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:40:58.280948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:58.289846 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7e7d0c0e-81d5-4c9b-95bc-8db634371f7f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1562 microversion: 2.1 time: 0.271235 Dec 25 21:40:58.290819 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3615/7200] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:40:58 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1562 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:40:58.661164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1314018874", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": "none"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:40:58.719303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:40:58.719747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:40:58.720313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:40:58.720788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:40:58.721298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:40:58.730376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:58.732700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:58.732700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:40:58.732700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:40:58.755519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Getting quotas for project f6f76d86ec8a49e0b47607f2cb121c0b. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:40:58.757133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Getting quotas for user 4cab838ae2234356981342bba4a2c3e6 and project f6f76d86ec8a49e0b47607f2cb121c0b. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:40:58.769848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:40:58.772325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:40:58.927005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b7cb670-3d48-4c86-bce1-2054f14d86be tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.392370 Dec 25 21:40:58.928383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3586/7201] 10.222.0.32 () {62 vars in 1187 bytes} [Sat Dec 25 21:40:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Dec 25 21:40:58.938066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe2ec84d-dc71-4ed1-af27-ec31f9c735f3 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:40:58.939068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe2ec84d-dc71-4ed1-af27-ec31f9c735f3 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:40:59.018505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe2ec84d-dc71-4ed1-af27-ec31f9c735f3 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:59.026409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe2ec84d-dc71-4ed1-af27-ec31f9c735f3 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:59.028815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe2ec84d-dc71-4ed1-af27-ec31f9c735f3 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:40:59.030771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe2ec84d-dc71-4ed1-af27-ec31f9c735f3 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1278 microversion: 2.54 time: 0.096892 Dec 25 21:40:59.032405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3616/7202] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:40:58 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:00.051112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-252dbc97-5b26-43c6-96b2-01f9fea6182f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:00.051753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-252dbc97-5b26-43c6-96b2-01f9fea6182f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:00.107466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-252dbc97-5b26-43c6-96b2-01f9fea6182f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:00.116171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-252dbc97-5b26-43c6-96b2-01f9fea6182f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:00.117783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-252dbc97-5b26-43c6-96b2-01f9fea6182f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:00.118914 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-252dbc97-5b26-43c6-96b2-01f9fea6182f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1278 microversion: 2.54 time: 0.072684 Dec 25 21:41:00.119496 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3587/7203] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:00 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1278 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:01.138184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:01.156791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:01.156791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:01.156791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:01.156791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:01.156791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:01.213792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:01.222056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:01.223741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:01.224968 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25c91a8b-07ed-462a-9fc4-b9c3fbe8ec15 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1330 microversion: 2.54 time: 0.090757 Dec 25 21:41:01.225529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3617/7204] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:01 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1330 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:02.243388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:02.244019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:02.251336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:02.253473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:02.253473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:02.253473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:02.314527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:02.322416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:02.323941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:02.325097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4272a5a0-d653-4281-93fc-68785b515e7a tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1336 microversion: 2.54 time: 0.085487 Dec 25 21:41:02.325655 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3588/7205] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:02 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1336 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:03.343705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:03.344364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:03.351555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:03.355125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:03.355125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:03.355125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:03.464827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:03.473761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:03.475605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:03.476764 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3f08732f-3f71-495f-8118-941ecb6ad843 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1336 microversion: 2.54 time: 0.136837 Dec 25 21:41:03.477380 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3618/7206] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:03 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:04.495550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:04.496197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:04.503173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:04.503636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:04.504644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:04.505125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:04.574812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:04.583411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:04.585085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:04.586338 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-62559d45-b89e-4743-82de-ed9c6ccf7453 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1357 microversion: 2.54 time: 0.094523 Dec 25 21:41:04.586906 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3589/7207] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:04 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:04.604826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b18338b-0774-44ae-931e-96a48ec51f7c tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Action: 'create', calling method: .version_select at 0x7fa500579c10>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1710579030"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:04.619958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8b18338b-0774-44ae-931e-96a48ec51f7c tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Getting quotas for project f6f76d86ec8a49e0b47607f2cb121c0b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:41:04.625037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8b18338b-0774-44ae-931e-96a48ec51f7c tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Getting quotas for user 4cab838ae2234356981342bba4a2c3e6 and project f6f76d86ec8a49e0b47607f2cb121c0b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:41:04.850621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8b18338b-0774-44ae-931e-96a48ec51f7c tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Getting quotas for project f6f76d86ec8a49e0b47607f2cb121c0b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:41:04.855611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-8b18338b-0774-44ae-931e-96a48ec51f7c tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Getting quotas for user 4cab838ae2234356981342bba4a2c3e6 and project f6f76d86ec8a49e0b47607f2cb121c0b. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:41:04.869589 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b18338b-0774-44ae-931e-96a48ec51f7c tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.268487 Dec 25 21:41:04.870195 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3619/7208] 10.222.0.32 () {62 vars in 1198 bytes} [Sat Dec 25 21:41:04 2021] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 270 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:41:04.880187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1710579030", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:04.881800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:04.887849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:04.888312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:04.889914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:04.890360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:04.978775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:41:04.979217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:41:04.979732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:41:04.980858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:41:04.981368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:41:05.208506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:05.215615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:05.216350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:05.217634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:05.218092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:05.251932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db6b3dd8-d6b2-4eb2-b968-0ab606bd78a2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "POST /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e/action" status: 202 len: 1140 microversion: 2.54 time: 0.375411 Dec 25 21:41:05.252855 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3590/7209] 10.222.0.32 () {62 vars in 1319 bytes} [Sat Dec 25 21:41:04 2021] POST /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e/action => generated 1140 bytes in 377 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Dec 25 21:41:05.272606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:05.273459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:05.279671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:05.280128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:05.280947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:05.281394 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:05.350191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:05.358787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:05.360319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:05.361521 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d46528b-82c9-4a7c-bb15-c72d914a710f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.092939 Dec 25 21:41:05.362158 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3620/7210] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:05 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:06.379684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:06.380307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:06.387069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:06.387535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:06.388323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:06.389564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:06.453006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:06.462941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:06.464496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:06.465842 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c10eeac8-e5b9-467e-a61b-5b8d109f7d58 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.090054 Dec 25 21:41:06.469360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3591/7211] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:06 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:07.484761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:07.485492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:07.493025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:07.495166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:07.495166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:07.495166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:07.565892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:07.574099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:07.575769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:07.577162 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c00164d0-3b74-4caf-b87b-37623d291ed7 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.097292 Dec 25 21:41:07.581864 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3621/7212] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:07 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:08.596073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:08.596702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:08.603695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:08.604226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:08.605072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:08.605515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:08.674692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:08.682840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:08.690623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:08.690623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa9efb4c-75f5-4d23-bec6-f7c109c3647f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.094187 Dec 25 21:41:08.690623 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3592/7213] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:08 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:09.705906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:09.706455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:09.713642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:09.714129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:09.714983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:09.715401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:09.782270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:09.790265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:09.791795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:09.792998 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5658629f-bb16-4363-af49-d84e136f79e2 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.091505 Dec 25 21:41:09.793568 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3622/7214] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:09 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:10.811264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:10.811922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:10.819142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:10.819601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:10.820388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:10.820835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:10.886547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:10.895975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:10.897798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:10.902706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-97ec2fea-fa55-43b7-bd4d-81c1ccefb079 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.091536 Dec 25 21:41:10.902706 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3593/7215] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:10 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:11.918003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:11.918623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:11.926136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:11.926589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:11.927369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:11.927803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:11.990578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:11.998570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:12.000085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:12.001330 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84f2a016-6c8b-4984-b3af-0849b0aec972 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.087001 Dec 25 21:41:12.001894 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3623/7216] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:11 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:13.019759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:13.020380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:13.027716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:13.028189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:13.029025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:13.029480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:13.091141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:13.099238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:13.100802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:13.102126 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49b4c8be-305e-4e7f-8a9f-f501fae61981 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.086247 Dec 25 21:41:13.102687 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3594/7217] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:13 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:14.120799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:14.121741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:14.129199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:14.129651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:14.130432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:14.130868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:14.194789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:14.205012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:14.206545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:14.207779 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f33cacd2-db70-40b8-9a49-99ed6aa1adcb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.090735 Dec 25 21:41:14.208343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3624/7218] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:14 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:15.226152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:15.226808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:15.234318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:15.234782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:15.235587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:15.236174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:15.307846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:15.316241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:15.317790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:15.318953 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9dcc029f-9abe-44be-9803-bb313dd82de8 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.096769 Dec 25 21:41:15.319510 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3595/7219] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:15 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:16.337546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:16.338310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:16.345066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:16.347073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:16.347073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:16.347073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:16.415323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:16.424375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:16.426080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:16.427295 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-203b29bd-5296-47e6-a79b-5ed86aa0de29 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.093904 Dec 25 21:41:16.428059 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3625/7220] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:16 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:16.558901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e5935cfc-e01c-4f65-9da1-7f8996cb5a5c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Action: 'create', calling method: .version_select at 0x7fa4f5f469d0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-701105488"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:16.575916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e5935cfc-e01c-4f65-9da1-7f8996cb5a5c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Getting quotas for project ca293d68b8cc44e6b641d477c9a3eb50. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:41:16.581452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e5935cfc-e01c-4f65-9da1-7f8996cb5a5c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Getting quotas for user e8dd3c4dd2344bee986e909d5c45112a and project ca293d68b8cc44e6b641d477c9a3eb50. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:41:16.957814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e5935cfc-e01c-4f65-9da1-7f8996cb5a5c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Getting quotas for project ca293d68b8cc44e6b641d477c9a3eb50. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:41:16.963083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-e5935cfc-e01c-4f65-9da1-7f8996cb5a5c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Getting quotas for user e8dd3c4dd2344bee986e909d5c45112a and project ca293d68b8cc44e6b641d477c9a3eb50. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:41:16.978403 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e5935cfc-e01c-4f65-9da1-7f8996cb5a5c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.423243 Dec 25 21:41:16.979036 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3596/7221] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:41:16 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:17.445903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:17.446548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:17.454138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:17.458260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:17.458260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:17.458260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:17.519095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:17.527049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:17.528484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:17.530283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67dd40a3-861a-41af-8e5a-e8d7f904018e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.087607 Dec 25 21:41:17.530851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3626/7222] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:17 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:18.550175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:18.550802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:18.557501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:18.557963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:18.558775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:18.559224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:18.622291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:18.630698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:18.632230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:18.633440 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d96f52bc-69f1-487f-831e-db80bdacc89e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.088546 Dec 25 21:41:18.634001 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3597/7223] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:18 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:18.669063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:18.670049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:18.681695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:18.682152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:18.683052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:18.683497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:18.739534 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9fff3580-51c9-4db9-87ab-b43364b5611c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action" status: 200 len: 24573 microversion: 2.1 time: 0.073868 Dec 25 21:41:18.740212 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3627/7224] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:41:18 2021] POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action => generated 24573 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:41:19.380034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-46368564", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "beb1f33b-8577-4e27-b087-711ea8d893c7", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-701105488", "security_groups": [{"name": "tempest-secgroup-smoke-2046873696"}], "networks": [{"uuid": "1bb1be3e-1cca-429f-aa9f-4dd09951d5b0"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:19.498884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] validate_networks() for [('1bb1be3e-1cca-429f-aa9f-4dd09951d5b0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:41:19.651869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:19.652578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:19.660511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:19.661161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:19.661975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:19.662427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:19.751946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:19.760287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:19.761878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:19.763114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3d558c5a-ee22-433c-bd2f-59cca77af42b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.115326 Dec 25 21:41:19.764772 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3628/7225] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:19 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:19.916573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:41:19.917072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:41:19.917563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:41:19.917983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:41:19.918403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:41:19.927517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:19.927993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:19.930784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:19.930784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:19.946525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Getting quotas for project ca293d68b8cc44e6b641d477c9a3eb50. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:41:19.952228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Getting quotas for user e8dd3c4dd2344bee986e909d5c45112a and project ca293d68b8cc44e6b641d477c9a3eb50. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:41:20.008512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:41:20.010644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='beb1f33b-8577-4e27-b087-711ea8d893c7',volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:41:20.492109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6c09fc4-ab64-43f4-ab0f-85527f958887 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.115756 Dec 25 21:41:20.492763 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3598/7226] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:41:19 2021] POST /compute/v2.1/servers => generated 406 bytes in 1117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:41:20.503165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6f1113c-2bd2-4ce9-ac80-4d7acd252755 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:20.505019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6f1113c-2bd2-4ce9-ac80-4d7acd252755 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:20.563465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6f1113c-2bd2-4ce9-ac80-4d7acd252755 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:20.575705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6f1113c-2bd2-4ce9-ac80-4d7acd252755 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1096 microversion: 2.1 time: 0.076153 Dec 25 21:41:20.576362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3629/7227] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:20 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1096 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:20.783229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:20.783853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:20.790093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:20.791594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:20.791594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:20.791776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:20.856280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:20.866040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:20.867625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:20.868812 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6132c5fd-36e4-4863-bb7e-c35e13c31b93 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.090383 Dec 25 21:41:20.869416 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3599/7228] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:20 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:21.595780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:21.596433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:21.604034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:21.604481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:21.605287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:21.605725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:21.666039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:21.673476 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fb20bec-0961-4d85-8a06-1283661445ca tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1146 microversion: 2.1 time: 0.081541 Dec 25 21:41:21.674047 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3630/7229] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:21 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1146 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:21.886856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:21.887600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:21.894746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:21.895215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:21.896024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:21.896480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:21.961557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:21.974355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:21.977264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:21.977264 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d8202f8-5a82-41b3-bdaf-98c5fef5bd5e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.093482 Dec 25 21:41:21.977264 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3600/7230] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:21 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:22.689770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:22.690384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:22.697540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:22.697992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:22.698777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:22.699249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:22.775473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:22.783515 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12b34cfc-23d2-401b-8577-81c2d058d346 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1202 microversion: 2.1 time: 0.097713 Dec 25 21:41:22.784107 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3631/7231] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:22 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1202 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:22.997898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:22.999162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:23.010917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:23.010917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:23.010917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:23.010917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:23.102368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:23.114843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:23.117728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:23.120045 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3d811de0-a0ad-40a0-92eb-8772e71706b0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.128005 Dec 25 21:41:23.132100 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3601/7232] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:22 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:23.800279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:23.801071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:23.808868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:23.816713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:23.816713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:23.816713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:24.039539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:24.048113 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9299c5f3-485e-461d-83af-2018f80c17e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1280 microversion: 2.1 time: 0.251553 Dec 25 21:41:24.048689 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3632/7233] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:23 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1280 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:24.139932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:24.140558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:24.147900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:24.148366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:24.149261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:24.149745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:24.254105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:24.269831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:24.271482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:24.272916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58180c5c-0bf8-439e-b995-ada4cf802626 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.137605 Dec 25 21:41:24.280275 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3602/7234] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:24 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:24.552203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-0cdd9297-47c6-46f7-adb1-b9ba32c35a2a req-73d79301-7182-48cd-a21c-eb6176a5fb0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:24.553614 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:24.553614 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:41:24.563557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0cdd9297-47c6-46f7-adb1-b9ba32c35a2a req-73d79301-7182-48cd-a21c-eb6176a5fb0f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:24.564000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-0cdd9297-47c6-46f7-adb1-b9ba32c35a2a req-73d79301-7182-48cd-a21c-eb6176a5fb0f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:24.589113 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-0cdd9297-47c6-46f7-adb1-b9ba32c35a2a req-73d79301-7182-48cd-a21c-eb6176a5fb0f service nova] Creating event network-changed:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:41:24.595099 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-0cdd9297-47c6-46f7-adb1-b9ba32c35a2a req-73d79301-7182-48cd-a21c-eb6176a5fb0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046857 Dec 25 21:41:24.596048 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3633/7235] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:25.068159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:25.069560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:25.077106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:25.077578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:25.078425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:25.078878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:25.293059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:25.293761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:25.300591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:25.301077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:25.301873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:25.302307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:25.303123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:25.312091 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1387bf4b-370b-4e8b-9595-47017782b224 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.248950 Dec 25 21:41:25.313048 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3603/7236] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:25 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:25.390842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:25.398922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:25.400452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:25.401663 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-463904a4-629a-4f4e-b2ba-dc2047608729 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.113747 Dec 25 21:41:25.402235 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3634/7237] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:25 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:26.329210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:26.329763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:26.336624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:26.337127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:26.337925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:26.338379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:26.421898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:26.422577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:26.430073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:26.430818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:26.431376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:26.431826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:26.490452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:26.498228 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54910b26-debd-48c6-866a-0049108268dd tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.172954 Dec 25 21:41:26.500198 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3604/7238] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:26 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:26.505736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:26.514006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:26.515541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:26.516806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd970182-bcb9-4bab-822e-8ead32e5625d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.099611 Dec 25 21:41:26.517440 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3635/7239] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:26 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:27.514808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:27.516097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:27.522986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:27.523455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:27.524927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:27.524927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:27.544622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:27.545298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:27.552315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:27.552856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:27.553664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:27.554097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:27.628011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:27.637218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:27.639003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:27.640920 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-861b141d-b606-4c15-a86d-1ee152ec9c43 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.099356 Dec 25 21:41:27.641498 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3636/7240] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:27 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:27.692309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:27.699797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03e14c6a-fc12-45ba-a60e-d445bf7ecd86 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.189016 Dec 25 21:41:27.700378 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3605/7241] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:27 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:28.659671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:28.660266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:28.667074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:28.667522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:28.668337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:28.669070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:28.716841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:28.717518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:28.725132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:28.725593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:28.726473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:28.726922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:28.731705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:28.739832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:28.741388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:28.743014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-615c692f-be9e-427a-8129-9c748b02d388 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.087354 Dec 25 21:41:28.743278 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3637/7242] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:28 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:28.861001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:28.868490 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f05326ed-4b9b-4f6b-a185-2d178b92689b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.155731 Dec 25 21:41:28.869112 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3606/7243] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:28 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:29.732557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:29.733220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:29.741066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.741549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.742385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.742827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.761523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:29.762022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:29.768391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.769498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.770283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.770756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.840999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:29.853492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:29.855484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:29.856978 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea02f616-3705-438e-99e2-3c5709bbcb44 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.099861 Dec 25 21:41:29.857492 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3607/7244] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:29 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:29.886018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:29.886646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:29.893460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.893938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.894760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.895193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.908709 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-082ca95d-1cb2-4fcc-97c0-d56c8ca91f1b tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1831 microversion: 2.1 time: 0.179735 Dec 25 21:41:29.909324 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3638/7245] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:29 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1831 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:29.926033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:29.926033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:29.931971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.932407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:29.933232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:29.933674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.110553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:30.119429 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7eb3cc25-a6c3-4d6c-8ce1-99308bf76b11 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.237717 Dec 25 21:41:30.132401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:30.133040 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3608/7246] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:29 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:30.141728 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c31b3881-c35e-4f83-9199-da0bb5fbd5f5 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1680 microversion: 2.1 time: 0.220343 Dec 25 21:41:30.142329 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3639/7247] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:29 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:30.235656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:30.236638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:30.242692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.243166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.243944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.244387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.296945 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65e3f265-b862-434f-9b00-7637a4160822 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action" status: 200 len: 32646 microversion: 2.1 time: 0.064830 Dec 25 21:41:30.297521 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3609/7248] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:41:30 2021] POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:41:30.496217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:30.496821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:30.503341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.503837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.504592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.505066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.544110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '58358a2e96c94ea3b018b93c1aef29ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852b86f977de452a989c0d5ab77e2f09', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:30.544763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] flavor_id is None. Assuming migration. {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4073}} Dec 25 21:41:30.545241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:41:30.876705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:30.877360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:30.884707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.885205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.886011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.886461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.905391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1668bd82-a63c-4b98-8ebc-fe8c68f61b1e tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.412828 Dec 25 21:41:30.906597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3640/7249] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:41:30 2021] POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:41:30.915250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:30.916153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:30.927555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.928155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.929073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:30.929564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:30.954296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:30.971727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:30.973411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:30.974766 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8892a62a-5384-424d-a0c6-51cf759f873b tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.102719 Dec 25 21:41:30.975338 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3610/7250] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:30 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:31.071255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:31.079436 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9d2a97c1-277b-433a-9c53-76658a496d20 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1689 microversion: 2.1 time: 0.168513 Dec 25 21:41:31.079992 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3641/7251] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:30 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:31.140094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:31.140642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:31.147133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:31.147605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:31.148415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:31.148900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:31.292160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:31.300510 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e02fd8c-6e6c-485b-b5aa-65adfe5c9c3b tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.164908 Dec 25 21:41:31.301111 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3611/7252] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:31 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:31.754373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8d0fbeb4-7390-4c9b-97ce-c1a4dd4a1ebf req-961d40c5-4078-499a-bc52-0d1d48c65b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "name": "network-vif-plugged", "status": "completed", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:31.756263 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:31.756263 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:41:31.764862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8d0fbeb4-7390-4c9b-97ce-c1a4dd4a1ebf req-961d40c5-4078-499a-bc52-0d1d48c65b53 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:31.765410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8d0fbeb4-7390-4c9b-97ce-c1a4dd4a1ebf req-961d40c5-4078-499a-bc52-0d1d48c65b53 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:31.777285 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8d0fbeb4-7390-4c9b-97ce-c1a4dd4a1ebf req-961d40c5-4078-499a-bc52-0d1d48c65b53 service nova] Creating event network-vif-plugged:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:41:31.783185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8d0fbeb4-7390-4c9b-97ce-c1a4dd4a1ebf req-961d40c5-4078-499a-bc52-0d1d48c65b53 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031985 Dec 25 21:41:31.788694 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3642/7253] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:31.993632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:31.994348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:32.002392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:32.003709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:32.003823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:32.004395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:32.070027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:32.080376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:32.081940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:32.083172 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51ab3006-5f86-438b-95aa-a8d6164946eb tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1409 microversion: 2.54 time: 0.093470 Dec 25 21:41:32.083729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3612/7254] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:31 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1409 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:32.101132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:32.102389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:32.109093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:32.109549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:32.110449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:32.111044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:32.265776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:32.273374 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ebf490c2-8434-46fd-b82b-81391ca20a96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1689 microversion: 2.1 time: 0.176617 Dec 25 21:41:32.274246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3643/7255] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:32 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:32.317587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:32.318219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:32.324255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:32.324707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:32.325522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:32.325974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:32.469149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:32.476708 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e6755bb9-cdf3-4767-9d49-b822460d3fd4 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.163542 Dec 25 21:41:32.477352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3613/7256] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:32 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:33.101789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:33.102436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:33.109265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:33.109724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:33.110559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:33.111011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:33.174112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:33.182426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:33.183936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:33.185159 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-155a31bf-307f-492b-b341-242b5ef67164 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1415 microversion: 2.54 time: 0.087430 Dec 25 21:41:33.185720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3644/7257] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:33 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1415 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:33.290901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:33.291526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:33.299334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:33.299777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:33.300573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:33.301064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:33.468527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:33.476289 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7672f364-3b8d-44f0-9fc0-e9420744e98c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1689 microversion: 2.1 time: 0.189188 Dec 25 21:41:33.476900 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3614/7258] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:33 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:33.494131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:33.494791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:33.502251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:33.502711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:33.503519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:33.503964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:33.754478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:33.762814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d82400ae-f175-436d-b927-0bc724a9939d tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1268 microversion: 2.1 time: 0.272834 Dec 25 21:41:33.766656 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3645/7259] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:33 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1268 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:34.203596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:34.204124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:34.210459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.210924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.211870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.212335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.278371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:34.287610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:34.289467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:34.290941 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6b8aec1-3704-4ec4-82bf-871f6de54f4d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1415 microversion: 2.54 time: 0.091260 Dec 25 21:41:34.292262 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3615/7260] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:34 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1415 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:34.493253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:34.493899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:34.500759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.501242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.502028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.502462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.640604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:34.648694 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6fd63734-f9b4-4c33-88ee-ac0850613237 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.159264 Dec 25 21:41:34.649302 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3646/7261] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:34 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:34.780784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:34.781445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:34.789253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.789720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.790585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.791046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.944063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:34.951908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef380a45-d237-4f7c-8b88-2911867bdb85 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1457 microversion: 2.1 time: 0.174843 Dec 25 21:41:34.952477 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3616/7262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:34 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1457 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:34.968396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:34.969067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:34.975346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.975825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:34.976634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:34.977099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.114992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.121051 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-362a98b3-55f6-4fc4-bbcd-26e492e2b132 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1457 microversion: 2.1 time: 0.156532 Dec 25 21:41:35.121792 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3647/7263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:34 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1457 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:35.310756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:35.311322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:35.318892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.319513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.320442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.321010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.385660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.394397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.396035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.397265 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02b2595a-6759-4f55-8fd7-de00673acecd tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1400 microversion: 2.54 time: 0.090935 Dec 25 21:41:35.397827 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3617/7264] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:35 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1400 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:35.415276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8567e101-41de-46f5-a247-9b79f11577a0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '.version_select at 0x7fa4f6ae43a0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:35.508158 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8567e101-41de-46f5-a247-9b79f11577a0 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1710579030" status: 204 len: 0 microversion: 2.54 time: 0.096763 Dec 25 21:41:35.509079 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3648/7265] 10.222.0.32 () {60 vars in 1318 bytes} [Sat Dec 25 21:41:35 2021] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1710579030 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:41:35.522911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:35.523431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:35.529413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.529877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.530703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.531151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.560441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:41:35.667293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:35.668219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:35.678494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.678945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.679920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.680508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.821517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.829821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c054746b-7ea7-4167-b23f-ad799e7ed03f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.166957 Dec 25 21:41:35.830397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3649/7266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:35 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:35.880975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1973b963-9aa1-40fe-8ee9-7d47e8042dee tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 204 len: 0 microversion: 2.54 time: 0.362001 Dec 25 21:41:35.882061 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3618/7267] 10.222.0.32 () {60 vars in 1279 bytes} [Sat Dec 25 21:41:35 2021] DELETE /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Dec 25 21:41:35.890510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:35.891147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:35.897898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.898359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.899151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:35.899595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:35.975241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.985559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.989052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:35.989052 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3dd8ef56-da8d-4352-9119-cb7908780d17 tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1406 microversion: 2.54 time: 0.102563 Dec 25 21:41:35.996087 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3650/7268] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:35 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1406 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:36.848253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:36.848990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:36.856752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:36.857246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:36.858208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:36.858662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:37.006561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:37.009068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:37.009202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:37.015348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:37.015919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:37.017361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:37.017473 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aef9a145-4f9d-4e24-8669-92ec2f875c71 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.174056 Dec 25 21:41:37.017947 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3619/7269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:36 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:37.018084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:37.083496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:37.097914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:37.099270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:37.100500 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9237c7bd-ed42-4293-8d29-3a2b3138331d tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1406 microversion: 2.54 time: 0.097879 Dec 25 21:41:37.101088 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3651/7270] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:37 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1406 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Dec 25 21:41:37.765073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-845206fb-a9bc-474b-af11-2363089245bf req-955bb1b3-d892-4d5f-9488-950495180006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:37.765073 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:37.765073 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:41:37.772088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-845206fb-a9bc-474b-af11-2363089245bf req-955bb1b3-d892-4d5f-9488-950495180006 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:37.772767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-845206fb-a9bc-474b-af11-2363089245bf req-955bb1b3-d892-4d5f-9488-950495180006 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:37.792437 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-845206fb-a9bc-474b-af11-2363089245bf req-955bb1b3-d892-4d5f-9488-950495180006 service nova] Creating event network-changed:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:41:37.798197 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-845206fb-a9bc-474b-af11-2363089245bf req-955bb1b3-d892-4d5f-9488-950495180006 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047909 Dec 25 21:41:37.802059 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3620/7271] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:38.038054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:38.039306 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:38.047177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:38.048416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:38.049458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:38.050083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:38.128520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:38.129380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:38.138732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:38.140813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:38.153710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:38.154396 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:38.235734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:38.236325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:38.236900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lazy-loading 'fault' on Instance uuid 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:41:38.302621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:38.314611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:38.316763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:38.318716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4cab838ae2234356981342bba4a2c3e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6f76d86ec8a49e0b47607f2cb121c0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:38.320460 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8492eae4-71cb-445d-8035-1928dcd09f9e tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 200 len: 1411 microversion: 2.54 time: 0.204786 Dec 25 21:41:38.321740 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3621/7272] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:38 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 1411 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Dec 25 21:41:38.323292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-655018f2-83af-4ef0-b6e4-9897cb788c2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.289545 Dec 25 21:41:38.333626 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3652/7273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:38 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:39.339710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:39.341050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] [instance: 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:39.342555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:39.343732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:39.348679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:39.349429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:39.350252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:39.350702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:39.351611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:39.352063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:39.352861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:39.353327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:39.365201 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] HTTP exception thrown: Instance 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e could not be found. Dec 25 21:41:39.367181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] Returning 404 to user: Instance 0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:41:39.367181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7890601c-7c36-4697-9ced-d86c9309db2f tempest-ServerShowV254Test-1041780322 tempest-ServerShowV254Test-1041780322-project] 10.222.0.32 "GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e" status: 404 len: 111 microversion: 2.54 time: 0.031109 Dec 25 21:41:39.367400 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3622/7274] 10.222.0.32 () {60 vars in 1276 bytes} [Sat Dec 25 21:41:39 2021] GET /compute/v2.1/servers/0ffb8f7d-e0da-45b5-a1e7-1cbaa54f478e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Dec 25 21:41:39.503864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:39.512427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68fe11ee-310e-45ff-883a-ad2c5d5f7b69 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.173776 Dec 25 21:41:39.513033 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3653/7275] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:39 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:39.814471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ddb64415-7173-491f-bb76-04af9635c8ef req-715b3301-3540-4f47-99c2-71cbc1a7d98d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}, {"name": "network-changed", "server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:39.816447 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:39.816447 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:41:39.826147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ddb64415-7173-491f-bb76-04af9635c8ef req-715b3301-3540-4f47-99c2-71cbc1a7d98d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:39.826147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ddb64415-7173-491f-bb76-04af9635c8ef req-715b3301-3540-4f47-99c2-71cbc1a7d98d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:39.838577 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ddb64415-7173-491f-bb76-04af9635c8ef req-715b3301-3540-4f47-99c2-71cbc1a7d98d service nova] Creating event network-changed:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:41:39.839530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ddb64415-7173-491f-bb76-04af9635c8ef req-715b3301-3540-4f47-99c2-71cbc1a7d98d service nova] Creating event network-changed:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:41:39.846491 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ddb64415-7173-491f-bb76-04af9635c8ef req-715b3301-3540-4f47-99c2-71cbc1a7d98d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036338 Dec 25 21:41:39.847096 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3623/7276] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:39 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:41:40.530230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:40.532363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:40.541151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:40.542040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:40.543176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:40.543845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:40.777645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:40.786541 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe25395f-1956-4e94-94ce-550188419595 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.260004 Dec 25 21:41:40.787486 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3654/7277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:40 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:41.684714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1742d13f-ca69-4292-8eb6-7790f2173ec8 tempest-ExtensionsTest-674475175 tempest-ExtensionsTest-674475175-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:41.686449 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1742d13f-ca69-4292-8eb6-7790f2173ec8 tempest-ExtensionsTest-674475175 tempest-ExtensionsTest-674475175-project] 10.222.0.32 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.119379 Dec 25 21:41:41.686983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3624/7278] 10.222.0.32 () {58 vars in 1169 bytes} [Sat Dec 25 21:41:41 2021] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:41.695817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-024b9548-5cea-4bb0-855c-9ab8da3f4976 tempest-ExtensionsTest-674475175 tempest-ExtensionsTest-674475175-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:41.698006 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-024b9548-5cea-4bb0-855c-9ab8da3f4976 tempest-ExtensionsTest-674475175 tempest-ExtensionsTest-674475175-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.005926 Dec 25 21:41:41.698538 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3655/7279] 10.222.0.32 () {58 vars in 1133 bytes} [Sat Dec 25 21:41:41 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:41:41.804466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:41.805226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:41.832827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:41.832827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:41.832827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:41.832827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:41.955875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:41.963451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.162793 Dec 25 21:41:41.964019 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3625/7280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:41 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:42.981935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:42.982551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:42.989209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:42.989675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:42.990509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:42.990956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:43.137204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:43.147212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.169971 Dec 25 21:41:43.147935 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3656/7281] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:42 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:43.821048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:43.822042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001385 Dec 25 21:41:43.822385 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3626/7282] 10.222.0.32 () {56 vars in 885 bytes} [Sat Dec 25 21:41:43 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Dec 25 21:41:43.828908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:43.830137 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.001688 Dec 25 21:41:43.830579 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3657/7283] 10.222.0.32 () {54 vars in 1034 bytes} [Sat Dec 25 21:41:43 2021] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Dec 25 21:41:43.836558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:43.837692 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98145a5c-a151-467e-8d71-5e052d8a0a4b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Dec 25 21:41:43.838276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3627/7284] 10.222.0.32 () {54 vars in 1040 bytes} [Sat Dec 25 21:41:43 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:43.846285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:43.847279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2420ac09-208f-47b9-b701-e65feaae539e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001343 Dec 25 21:41:43.847625 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3658/7285] 10.222.0.32 () {56 vars in 885 bytes} [Sat Dec 25 21:41:43 2021] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Dec 25 21:41:44.165313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:44.165975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:44.172973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:44.174043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:44.174838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:44.175292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:44.315797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:44.324312 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13812327-6646-4eff-982a-bf7328c0dfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.163163 Dec 25 21:41:44.325417 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3628/7286] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:44 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:44.600297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:44.600834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:44.611642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:44.611642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:44.611642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:44.611642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:44.696652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lazy-loading 'services' on Instance uuid af5d7b62-4aa9-4e2f-9421-86d6fe783711 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:41:44.986083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b8a8e7dc-7f4b-4e19-bf9a-13dc92baf31e tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "DELETE /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711/os-volume_attachments/f03e9745-84e8-42ce-aae1-83a861dbd629" status: 202 len: 0 microversion: 2.1 time: 0.389558 Dec 25 21:41:44.986913 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3659/7287] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 21:41:44 2021] DELETE /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711/os-volume_attachments/f03e9745-84e8-42ce-aae1-83a861dbd629 => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:41:45.346535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:45.347211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:45.354198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:45.354670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:45.355483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:45.355939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:45.492424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:45.499926 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-405ef59d-90bb-4b41-b091-d36284f470bf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.157361 Dec 25 21:41:45.500504 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3629/7288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:45 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:46.104713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:46.105624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:46.112151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:46.112724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:46.113758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:46.114194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:46.140911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:41:46.473918 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-77059e88-1588-4f54-ada8-8139758dd6e9 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "DELETE /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 204 len: 0 microversion: 2.1 time: 0.373639 Dec 25 21:41:46.474737 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3660/7289] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:41:46 2021] DELETE /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:41:46.483117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:46.483883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:46.491022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:46.491484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:46.492283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:46.492727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:46.519750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:46.520819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:46.544016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:46.544722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:46.545712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:46.546300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:46.679153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:46.687641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8abb2643-eb4f-484b-9732-868979316588 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1511 microversion: 2.1 time: 0.208239 Dec 25 21:41:46.688226 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3630/7290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:46 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:46.733293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:46.740795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-92e34a1a-8133-48ee-a3a5-439439d7ea91 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1694 microversion: 2.1 time: 0.226794 Dec 25 21:41:46.742751 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3661/7291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:46 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1694 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:47.422399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5179ca6f-a17c-49bf-b017-7fc9fb704302 req-e99fa209-d38f-4a28-a054-a8adb1139e94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "name": "network-vif-unplugged", "status": "completed", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:47.424037 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:47.424037 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:41:47.433202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5179ca6f-a17c-49bf-b017-7fc9fb704302 req-e99fa209-d38f-4a28-a054-a8adb1139e94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:47.438473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5179ca6f-a17c-49bf-b017-7fc9fb704302 req-e99fa209-d38f-4a28-a054-a8adb1139e94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:47.447368 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5179ca6f-a17c-49bf-b017-7fc9fb704302 req-e99fa209-d38f-4a28-a054-a8adb1139e94 service nova] Creating event network-vif-unplugged:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch2-master-1 Dec 25 21:41:47.452938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-5179ca6f-a17c-49bf-b017-7fc9fb704302 req-e99fa209-d38f-4a28-a054-a8adb1139e94 service nova] Instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:41:47.463759 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5179ca6f-a17c-49bf-b017-7fc9fb704302 req-e99fa209-d38f-4a28-a054-a8adb1139e94 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045075 Dec 25 21:41:47.464356 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3631/7292] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:47 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:47.705974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:47.706594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:47.713674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:47.714130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:47.714933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:47.715422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:47.772102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:47.781586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:47.793007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:47.793815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:47.794920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:47.795850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:48.043781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:48.055108 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc41e9a6-7cf5-4807-9587-0e44bbad4933 tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1511 microversion: 2.1 time: 0.354060 Dec 25 21:41:48.056292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3662/7293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:47 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:48.129483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:48.137207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6696ff76-8ae7-4b90-bcd4-59a35b0be029 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1693 microversion: 2.1 time: 0.374711 Dec 25 21:41:48.141281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3632/7294] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:47 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1693 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:49.073299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:49.074601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:49.091855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:49.094263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:49.094263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:49.094263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:49.157104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:49.157745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:49.167209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a55c151bef4387a4fef00ab6687a20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a416565d81324f55b88111b36c4a777c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:49.167399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:49.167799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:49.168676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:49.169601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:49.175666 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f1f27f0-4551-4337-8070-1b4241185c6c tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 200 len: 1469 microversion: 2.1 time: 0.106634 Dec 25 21:41:49.176575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3663/7295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:49 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 1469 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:49.320634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:49.328770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4971362b-b3ef-4f67-aead-7b659ceb9e3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1693 microversion: 2.1 time: 0.177232 Dec 25 21:41:49.329536 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3633/7296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:49 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:49.479451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}, {"server_uuid": "af5d7b62-4aa9-4e2f-9421-86d6fe783711", "name": "network-vif-deleted", "tag": "294d86ae-25e5-48a6-b97f-4ab051ca3e0a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:49.481183 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:49.481183 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:41:49.500395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:49.500850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:49.514807 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] Creating event network-changed:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch2-master-1 Dec 25 21:41:49.515316 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] Creating event network-vif-deleted:294d86ae-25e5-48a6-b97f-4ab051ca3e0a for instance af5d7b62-4aa9-4e2f-9421-86d6fe783711 on nch2-master-1 Dec 25 21:41:49.522057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] Instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:41:49.535107 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-41e42db0-f66d-464b-a170-e04d436487b5 req-b40d506e-f611-4329-950f-263c823f0c66 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058774 Dec 25 21:41:49.535722 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3664/7297] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:49 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:41:50.193453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:50.195493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] [instance: af5d7b62-4aa9-4e2f-9421-86d6fe783711] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:50.205607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:50.206108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:50.207104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:50.207758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:50.223799 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] HTTP exception thrown: Instance af5d7b62-4aa9-4e2f-9421-86d6fe783711 could not be found. Dec 25 21:41:50.224473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] Returning 404 to user: Instance af5d7b62-4aa9-4e2f-9421-86d6fe783711 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:41:50.226520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7dbff63-a7aa-43eb-b625-41e4e7c3813f tempest-VolumesSnapshotTestJSON-639273304 tempest-VolumesSnapshotTestJSON-639273304-project] 10.222.0.32 "GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711" status: 404 len: 111 microversion: 2.1 time: 0.037282 Dec 25 21:41:50.227580 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3634/7298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:50 2021] GET /compute/v2.1/servers/af5d7b62-4aa9-4e2f-9421-86d6fe783711 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:41:50.349746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:50.350518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:50.357469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:50.358081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:50.359117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:50.359665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:50.814363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:50.822027 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ea61937-f512-472c-b4de-0b73b65501d2 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1691 microversion: 2.1 time: 0.477537 Dec 25 21:41:50.822613 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3665/7299] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:50 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1691 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:51.846254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:51.846254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:51.858669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:51.859139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:51.860126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:51.860588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:52.018178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:52.025715 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-25af01c6-234c-4bdf-8d0c-7c9f24281d23 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1688 microversion: 2.1 time: 0.187702 Dec 25 21:41:52.026620 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3635/7300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:51 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:52.043646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:52.044222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:52.051696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:52.052143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:52.052961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:52.053818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:52.385443 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18838b76-f39e-4e57-a05d-251a5c8872cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action" status: 202 len: 0 microversion: 2.1 time: 0.345259 Dec 25 21:41:52.386705 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3666/7301] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:41:52 2021] POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:41:52.403769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:52.403769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:52.403769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:52.403769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:52.403769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:52.410477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:52.572224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:52.580180 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e050edc-b0d9-4c87-8473-7e0e0e419102 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1687 microversion: 2.1 time: 0.189119 Dec 25 21:41:52.581841 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3636/7302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:52 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1687 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:53.600748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:53.601502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:53.608675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:53.609173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:53.609967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:53.610411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:53.748117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:53.755613 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-efdc8610-5611-43e0-9116-2cec94d5ca49 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1687 microversion: 2.1 time: 0.160442 Dec 25 21:41:53.756587 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3667/7303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:53 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:54.773032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:54.774728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:54.781603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:54.786160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:54.786160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:54.786160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:54.924662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:54.933397 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de751392-1dd0-47d7-b172-f7c8cb9ec4ee tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1687 microversion: 2.1 time: 0.164113 Dec 25 21:41:54.940449 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3637/7304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:54 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:55.954452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:55.955097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:55.962536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:55.963253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:55.964240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:55.964684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:56.205568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:56.215583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f2f82e1-3f84-4da9-a634-8f79d981e44f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1687 microversion: 2.1 time: 0.264821 Dec 25 21:41:56.216189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3668/7305] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:55 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1687 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:41:56.912437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9036f7dd-2018-4253-8117-f19a593f9690 req-fc62dd73-f048-4008-949f-2d448154ceaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:41:56.914352 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:41:56.914352 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:41:56.925604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9036f7dd-2018-4253-8117-f19a593f9690 req-fc62dd73-f048-4008-949f-2d448154ceaa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:56.925968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9036f7dd-2018-4253-8117-f19a593f9690 req-fc62dd73-f048-4008-949f-2d448154ceaa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:56.951243 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9036f7dd-2018-4253-8117-f19a593f9690 req-fc62dd73-f048-4008-949f-2d448154ceaa service nova] Creating event network-changed:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:41:56.958309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-9036f7dd-2018-4253-8117-f19a593f9690 req-fc62dd73-f048-4008-949f-2d448154ceaa service nova] Instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:41:56.974582 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9036f7dd-2018-4253-8117-f19a593f9690 req-fc62dd73-f048-4008-949f-2d448154ceaa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068580 Dec 25 21:41:56.980708 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3638/7306] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:41:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:41:57.233679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:57.234457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:57.242608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:57.243174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:57.244814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:57.244814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:57.603082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:57.612181 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6eede165-64cd-40f6-a90d-e2eb127f4eb7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1687 microversion: 2.1 time: 0.381049 Dec 25 21:41:57.613282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3669/7307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:57 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1687 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:58.631283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:58.631905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:58.638482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:58.638978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:58.639776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:58.640234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:58.789057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:58.797089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c00273f-ce68-4927-83ab-6efb421779d0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1687 microversion: 2.1 time: 0.170623 Dec 25 21:41:58.797383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3639/7308] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:58 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:41:59.814684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:41:59.815906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:41:59.823070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:59.823564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:59.824393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:41:59.824823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:41:59.974094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:41:59.981900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2d937649-a201-4351-933f-76910f513c36 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1680 microversion: 2.1 time: 0.171450 Dec 25 21:41:59.985090 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3670/7309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:41:59 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:03.878119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-58388b12-87db-4ecf-a1bd-b72631418626 req-6e3abcbf-528c-425c-9c36-8084821ecf82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "name": "network-vif-plugged", "status": "completed", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:03.880221 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:42:03.880221 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:42:03.888620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-58388b12-87db-4ecf-a1bd-b72631418626 req-6e3abcbf-528c-425c-9c36-8084821ecf82 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:03.889119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-58388b12-87db-4ecf-a1bd-b72631418626 req-6e3abcbf-528c-425c-9c36-8084821ecf82 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:03.900111 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-58388b12-87db-4ecf-a1bd-b72631418626 req-6e3abcbf-528c-425c-9c36-8084821ecf82 service nova] Creating event network-vif-plugged:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:42:03.905192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-58388b12-87db-4ecf-a1bd-b72631418626 req-6e3abcbf-528c-425c-9c36-8084821ecf82 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 Dec 25 21:42:03.905792 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3640/7310] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:42:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:42:24.174436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:24.175389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:24.182226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:24.182681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:24.183460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:24.183901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:24.245895 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f34850b4-450c-42b9-91c2-71d0c46c62c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action" status: 200 len: 63204 microversion: 2.1 time: 0.075051 Dec 25 21:42:24.246566 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3671/7311] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:42:24 2021] POST /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7/action => generated 63204 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:42:30.527274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:30.528026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:30.534234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:30.534701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:30.535499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:30.535955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:30.669499 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-779e41d4-8fd7-48b7-89c5-55e8ef621958 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1831 microversion: 2.1 time: 0.147047 Dec 25 21:42:30.670089 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3641/7312] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:30 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1831 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:31.662814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:31.664068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-be0b67e0-698b-4ec7-94aa-ff5934784181 req-e449811d-36ca-46b4-8190-cc83a06ba60f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:31.665415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:31.666192 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:42:31.666192 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:42:31.673915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:31.674661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:31.675663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-be0b67e0-698b-4ec7-94aa-ff5934784181 req-e449811d-36ca-46b4-8190-cc83a06ba60f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:31.675872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:31.676124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-be0b67e0-698b-4ec7-94aa-ff5934784181 req-e449811d-36ca-46b4-8190-cc83a06ba60f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:31.676509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:31.688693 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-be0b67e0-698b-4ec7-94aa-ff5934784181 req-e449811d-36ca-46b4-8190-cc83a06ba60f service nova] Creating event network-changed:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:42:31.694640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-be0b67e0-698b-4ec7-94aa-ff5934784181 req-e449811d-36ca-46b4-8190-cc83a06ba60f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034635 Dec 25 21:42:31.697982 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3642/7313] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:42:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:42:31.718443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:42:32.083807 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18a84f1b-9a8b-4f8e-bb3e-1c84647922e7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 204 len: 0 microversion: 2.1 time: 0.425714 Dec 25 21:42:32.084632 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3672/7314] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:42:31 2021] DELETE /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:42:32.094428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:32.095133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:32.101633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:32.102872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:32.103681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:32.104134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:32.329705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:32.339707 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d2f4b89-8ec2-4476-90a8-bcd0a3c4c6fd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1686 microversion: 2.1 time: 0.249187 Dec 25 21:42:32.350774 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3643/7315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:32 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1686 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:33.358299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:33.359136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:33.366997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:33.367456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:33.368247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:33.368758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:33.589874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:33.597953 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-313ebfef-a490-4621-a53a-57bd032a10dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1568 microversion: 2.1 time: 0.243919 Dec 25 21:42:33.598468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3673/7316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:33 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1568 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:34.053334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-203c6a45-2c6a-4353-9829-30c375e105be req-7a4e74c2-af63-48a4-a4d7-2e383b196e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71c99c12-b0de-47ae-a758-1c01701a1fd7", "name": "network-vif-deleted", "tag": "c78610c0-9d20-414f-8d18-8f41eeb38c6d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:34.056293 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:42:34.056293 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:42:34.062766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-203c6a45-2c6a-4353-9829-30c375e105be req-7a4e74c2-af63-48a4-a4d7-2e383b196e35 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:34.063229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-203c6a45-2c6a-4353-9829-30c375e105be req-7a4e74c2-af63-48a4-a4d7-2e383b196e35 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:34.075246 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-203c6a45-2c6a-4353-9829-30c375e105be req-7a4e74c2-af63-48a4-a4d7-2e383b196e35 service nova] Creating event network-vif-deleted:c78610c0-9d20-414f-8d18-8f41eeb38c6d for instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 on nch1-master-1 Dec 25 21:42:34.080051 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-203c6a45-2c6a-4353-9829-30c375e105be req-7a4e74c2-af63-48a4-a4d7-2e383b196e35 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030496 Dec 25 21:42:34.080656 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3644/7317] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:42:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:42:34.614699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:34.615243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:34.624738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:34.624738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:34.624738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:34.625240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:34.657614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:34.658065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:34.658520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lazy-loading 'fault' on Instance uuid 71c99c12-b0de-47ae-a758-1c01701a1fd7 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:42:34.708657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:34.717024 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02171d63-9708-47e6-93ab-eead0d302219 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 200 len: 1356 microversion: 2.1 time: 0.106121 Dec 25 21:42:34.718518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3674/7318] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:34 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 1356 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:35.740956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:35.741691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 71c99c12-b0de-47ae-a758-1c01701a1fd7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:35.748655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:35.754571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:35.754571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:35.754571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:35.764112 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] HTTP exception thrown: Instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 could not be found. Dec 25 21:42:35.764730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Returning 404 to user: Instance 71c99c12-b0de-47ae-a758-1c01701a1fd7 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:42:35.765634 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26cc9a00-cccf-4b25-87d9-a3839f9bb271 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7" status: 404 len: 111 microversion: 2.1 time: 0.031645 Dec 25 21:42:35.766191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3645/7319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:35 2021] GET /compute/v2.1/servers/71c99c12-b0de-47ae-a758-1c01701a1fd7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:42:40.985367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-284230e2-3e6a-4778-ac48-23ae1a64de1d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '.version_select at 0x7fa4f6a52940>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:41.108521 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-284230e2-3e6a-4778-ac48-23ae1a64de1d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-563909803" status: 202 len: 0 microversion: 2.1 time: 0.129410 Dec 25 21:42:41.109155 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3675/7320] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 21:42:40 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-563909803 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:42:41.146134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb749d24-887a-4d4b-8f89-2ab3e89a1c3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: .version_select at 0x7fa4f61251f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-632889024"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:41.175656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-bb749d24-887a-4d4b-8f89-2ab3e89a1c3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:42:41.181550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-bb749d24-887a-4d4b-8f89-2ab3e89a1c3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:42:41.435996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-bb749d24-887a-4d4b-8f89-2ab3e89a1c3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:42:41.441029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-bb749d24-887a-4d4b-8f89-2ab3e89a1c3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:42:41.455910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb749d24-887a-4d4b-8f89-2ab3e89a1c3e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.314953 Dec 25 21:42:41.456517 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3646/7321] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:42:41 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:53.179683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1333544072", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "7fa4d4da-0ed2-460e-90b6-5e505fd99a73"}], "key_name": "tempest-TestNetworkAdvancedServerOps-632889024", "security_groups": [{"name": "tempest-secgroup-smoke-1084400228"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:53.302386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] validate_networks() for [('7fa4d4da-0ed2-460e-90b6-5e505fd99a73', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:42:53.803109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:42:53.803543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:42:53.808660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:42:53.811249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:42:53.811693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:42:53.833214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:53.834035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:53.834839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:53.835285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:53.883411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:42:53.889913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:42:53.906440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:42:53.909297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:42:54.073457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85b573d7-747b-40a7-933c-9660a15c0fdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.898669 Dec 25 21:42:54.075419 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3676/7322] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:42:53 2021] POST /compute/v2.1/servers => generated 406 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:42:54.085257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-548a917c-3074-49b8-b0fc-227281cc847d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:54.086104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-548a917c-3074-49b8-b0fc-227281cc847d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:54.229793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-548a917c-3074-49b8-b0fc-227281cc847d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:54.238649 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-548a917c-3074-49b8-b0fc-227281cc847d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1266 microversion: 2.1 time: 0.157301 Dec 25 21:42:54.239423 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3647/7323] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:54 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:55.271376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:55.271993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:55.279767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:55.280114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:55.282191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:55.282666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:55.396666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:55.408207 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d1be068-5b13-4311-9800-7e3f9ae95750 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1270 microversion: 2.1 time: 0.140366 Dec 25 21:42:55.418132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3677/7324] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:55 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:56.426024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:56.426927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:56.445792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:56.446363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:56.449032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:56.449582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:56.547458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:56.567476 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bec70fab-1e56-47ab-aec7-b8652ff65449 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1318 microversion: 2.1 time: 0.145923 Dec 25 21:42:56.575445 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3648/7325] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:56 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:57.594081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:57.594081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:57.603749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:57.605900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:57.608722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:57.609947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:57.732289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:57.740135 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-21d8f45b-4d66-4cae-a10f-2a1d413144f9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1324 microversion: 2.1 time: 0.152282 Dec 25 21:42:57.741394 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3678/7326] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:57 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1324 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:58.764722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:42:58.765724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:42:58.787304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:58.787836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:58.788675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:58.789215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:59.064417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:42:59.113208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9eed80b0-c3ab-48a5-9046-189bbf27324e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.348677 Dec 25 21:42:59.114600 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3649/7327] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:42:58 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:42:59.298537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a2ae4314-ac00-4c16-bdba-a87e816a6258 req-e3fa127a-dfe7-419d-89fb-7946f4491f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:42:59.300220 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:42:59.300220 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:42:59.313353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a2ae4314-ac00-4c16-bdba-a87e816a6258 req-e3fa127a-dfe7-419d-89fb-7946f4491f77 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:42:59.314214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a2ae4314-ac00-4c16-bdba-a87e816a6258 req-e3fa127a-dfe7-419d-89fb-7946f4491f77 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:42:59.333927 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a2ae4314-ac00-4c16-bdba-a87e816a6258 req-e3fa127a-dfe7-419d-89fb-7946f4491f77 service nova] Creating event network-changed:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:42:59.344259 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a2ae4314-ac00-4c16-bdba-a87e816a6258 req-e3fa127a-dfe7-419d-89fb-7946f4491f77 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051075 Dec 25 21:42:59.345200 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3679/7328] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:42:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:00.131181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:00.132399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:00.145745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:00.146543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:00.147446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:00.147894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:00.343172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:00.350542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e5dbfeb-5ac1-4ae3-8261-243b69c9abdd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.223117 Dec 25 21:43:00.351125 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3650/7329] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:00 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:01.368976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:01.369780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:01.377319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:01.377795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:01.378591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:01.379054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:01.514130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:01.521657 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cbef23eb-1bdc-4523-9cfa-70b7bab4bb46 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.157466 Dec 25 21:43:01.522240 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3680/7330] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:01 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:02.538163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:02.538790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:02.546166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:02.546888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:02.552377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:02.552377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:02.758613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:02.769379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a0e1054-90bc-47ad-9b1b-44762e9940f6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.234832 Dec 25 21:43:02.769965 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3651/7331] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:02 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:03.791541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:03.794553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:03.801475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:03.805482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:03.805482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:03.805482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:04.017985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:04.026539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53b0fea5-72a8-43fc-b462-7f6278683f7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.243533 Dec 25 21:43:04.027512 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3681/7332] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:03 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:05.045383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:05.050807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:05.055595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:05.056058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:05.057106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:05.057560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:05.216693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:05.225827 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89242101-f63e-4215-8696-cf54eb4ed53a tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.186082 Dec 25 21:43:05.226699 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3652/7333] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:05 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:05.982283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5dd20ffd-8ab0-4337-839a-1478663bfe4d req-6d9d9107-798a-4c0f-8c28-0a407805521c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "name": "network-vif-plugged", "status": "completed", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:05.984483 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:05.984483 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:05.992579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5dd20ffd-8ab0-4337-839a-1478663bfe4d req-6d9d9107-798a-4c0f-8c28-0a407805521c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:05.993057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5dd20ffd-8ab0-4337-839a-1478663bfe4d req-6d9d9107-798a-4c0f-8c28-0a407805521c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:06.004776 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5dd20ffd-8ab0-4337-839a-1478663bfe4d req-6d9d9107-798a-4c0f-8c28-0a407805521c service nova] Creating event network-vif-plugged:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:43:06.009948 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5dd20ffd-8ab0-4337-839a-1478663bfe4d req-6d9d9107-798a-4c0f-8c28-0a407805521c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036020 Dec 25 21:43:06.010805 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3682/7334] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:06.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:06.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:06.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:06.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:06.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:06.325060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:06.557756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:06.565571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1decb73a-0781-4253-a3e9-4fa75ddcaffb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.326291 Dec 25 21:43:06.566729 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3653/7335] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:06 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:07.585023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:07.585830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:07.593135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:07.593694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:07.594830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:07.595284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:07.807410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:07.820916 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06f9fbe5-22cb-494d-92d9-f4cf333519b6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1392 microversion: 2.1 time: 0.239481 Dec 25 21:43:07.823423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3683/7336] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:07 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1392 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:08.839066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:08.840028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:08.849731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:08.850427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:08.852715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:08.853209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:09.034464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:09.042927 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ce078ed-e1ad-45ca-bf7a-35d694619769 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1563 microversion: 2.1 time: 0.208166 Dec 25 21:43:09.043520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3654/7337] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:08 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1563 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:09.059702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:09.060320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:09.071081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:09.073605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:09.073605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:09.073605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:09.244467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:09.252027 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8094854-e332-4cf0-a85e-73da9f668e2f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1563 microversion: 2.1 time: 0.196280 Dec 25 21:43:09.252595 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3684/7338] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:09 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:12.083443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-28162dc2-f9a3-4994-8676-a601998edd02 req-3803107f-a58d-4ab6-9365-da1f8e3ba46c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:12.087194 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:12.087194 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:12.131025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-28162dc2-f9a3-4994-8676-a601998edd02 req-3803107f-a58d-4ab6-9365-da1f8e3ba46c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:12.135525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-28162dc2-f9a3-4994-8676-a601998edd02 req-3803107f-a58d-4ab6-9365-da1f8e3ba46c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:12.162758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-28162dc2-f9a3-4994-8676-a601998edd02 req-3803107f-a58d-4ab6-9365-da1f8e3ba46c service nova] Creating event network-changed:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:43:12.174952 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-28162dc2-f9a3-4994-8676-a601998edd02 req-3803107f-a58d-4ab6-9365-da1f8e3ba46c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095222 Dec 25 21:43:12.181036 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3685/7339] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:12.374988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:12.376225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:12.383506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:12.384282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:12.385347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:12.386008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:12.716688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:12.732963 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ab50fb3-72b2-4679-af9f-a88a5e465610 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1563 microversion: 2.1 time: 0.657839 Dec 25 21:43:12.734577 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3655/7340] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:12 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1563 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:33.150720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:33.152588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:33.159633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:33.160357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:33.161484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:33.162086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:33.221295 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-713ba891-3a90-4273-8e3c-9b091465a77d tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action" status: 200 len: 24574 microversion: 2.1 time: 0.075391 Dec 25 21:43:33.221987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3686/7341] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:43:33 2021] POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action => generated 24574 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:43:39.659104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:39.660860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:39.668936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:39.669412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:39.670595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:39.671056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:40.110535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:40.118078 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98ec3310-7558-414e-9da8-f915ca2b5b96 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1682 microversion: 2.1 time: 0.462999 Dec 25 21:43:40.129698 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3656/7342] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:39 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1682 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:40.261950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:40.263404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:40.271330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:40.272038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:40.273706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:40.274375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:40.329612 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-338726c9-3227-4a92-a556-4f6cfd1eb283 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action" status: 200 len: 32644 microversion: 2.1 time: 0.074341 Dec 25 21:43:40.337382 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3687/7343] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:43:40 2021] POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action => generated 32644 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:43:40.671382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:40.672096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:40.681771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:40.682240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:40.683060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:40.683504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.050921 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-691b012d-e968-433f-9dfd-d179ae6387bd tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1833 microversion: 2.1 time: 0.519545 Dec 25 21:43:41.051867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3657/7344] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:40 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1833 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:41.072193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:41.077187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:41.090745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.091285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.092014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.092637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.126087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lazy-loading 'flavor' on Instance uuid 367fe828-cfc4-4b03-926c-063408effc4c {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:43:41.141612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Going to try to live migrate instance to another host {{(pid=136548) live_migrate /opt/stack/nova/nova/compute/api.py:5255}} Dec 25 21:43:41.312753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:41.313308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:41.324815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.325322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.326138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.326590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.352919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:43:41.742543 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-001fcb54-4f4f-46e9-913e-b54bb0f24a04 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 204 len: 0 microversion: 2.1 time: 0.432157 Dec 25 21:43:41.743184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3658/7345] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:43:41 2021] DELETE /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:43:41.748705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a0fb4fff-b2c2-4158-b470-83cfd8b6c67e req-46560b57-ce26-46dc-ba53-ddb969cb055e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:41.756854 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:41.756854 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:43:41.761208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a0fb4fff-b2c2-4158-b470-83cfd8b6c67e req-46560b57-ce26-46dc-ba53-ddb969cb055e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.762046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a0fb4fff-b2c2-4158-b470-83cfd8b6c67e req-46560b57-ce26-46dc-ba53-ddb969cb055e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.779693 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a0fb4fff-b2c2-4158-b470-83cfd8b6c67e req-46560b57-ce26-46dc-ba53-ddb969cb055e service nova] Creating event network-changed:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:43:41.785708 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a0fb4fff-b2c2-4158-b470-83cfd8b6c67e req-46560b57-ce26-46dc-ba53-ddb969cb055e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041008 Dec 25 21:43:41.787064 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3659/7346] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:41.807986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:41.809082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:41.816581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.817557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:41.818774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:41.819481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:42.098634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:42.116008 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a84ad10-ad6a-41cf-a4f4-c783b6b23cf7 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1581 microversion: 2.1 time: 0.323797 Dec 25 21:43:42.117621 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3660/7347] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:41 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1581 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:43.135701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:43.136537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:43.143665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:43.144123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:43.144934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:43.145422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:43.314713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:43.331244 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0f46dce9-db26-46b3-af0e-e44ac5ee37e5 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1463 microversion: 2.1 time: 0.199719 Dec 25 21:43:43.331941 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3661/7348] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:43 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1463 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:43:44.198314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-6ec824d9-c2cd-4bb1-b2a5-d39c80463c51 req-d83b8c9c-0e46-44db-bfad-eefa77951db9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a72df6d-c3ba-4267-a14b-70b16a7532b8", "name": "network-vif-deleted", "tag": "2dfe2ec6-2451-4fcf-853a-381cdc5e4602"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:44.201267 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:44.201267 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:43:44.216786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6ec824d9-c2cd-4bb1-b2a5-d39c80463c51 req-d83b8c9c-0e46-44db-bfad-eefa77951db9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:44.216786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-6ec824d9-c2cd-4bb1-b2a5-d39c80463c51 req-d83b8c9c-0e46-44db-bfad-eefa77951db9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:44.231399 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-6ec824d9-c2cd-4bb1-b2a5-d39c80463c51 req-d83b8c9c-0e46-44db-bfad-eefa77951db9 service nova] Creating event network-vif-deleted:2dfe2ec6-2451-4fcf-853a-381cdc5e4602 for instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 on nch1-master-1 Dec 25 21:43:44.255717 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-6ec824d9-c2cd-4bb1-b2a5-d39c80463c51 req-d83b8c9c-0e46-44db-bfad-eefa77951db9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060832 Dec 25 21:43:44.256476 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3662/7349] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:43:44.349122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:44.349848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:44.356724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:44.357424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:44.358236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:44.358727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:44.462529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:44.470617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-704ba1e1-2030-4457-8dca-52573250163c tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1395 microversion: 2.1 time: 0.125358 Dec 25 21:43:44.471126 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3663/7350] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:44 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1395 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:43:44.622000 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-218da176-8672-4c68-a18b-04a016ce70af tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action" status: 202 len: 0 microversion: 2.1 time: 3.557771 Dec 25 21:43:44.622780 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3688/7351] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:43:41 2021] POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action => generated 0 bytes in 3559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:43:44.630611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:44.631410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:44.637868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:44.638332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:44.639144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:44.639598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:44.869626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:44.879014 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf854e03-8f05-4b76-92e6-9f44b3039301 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.251970 Dec 25 21:43:44.889950 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3664/7352] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:44 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:45.490575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:45.491747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:45.509206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:45.509943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:45.510863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:45.512655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:45.898222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:45.898789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:45.904596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:45.907569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:45.908470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:45.909379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:45.909934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:45.912314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a747f271-92c5-4882-9516-d02572750b61 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1227 microversion: 2.1 time: 0.425746 Dec 25 21:43:45.912908 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3689/7353] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:45 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1227 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:46.224699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:46.231680 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8190249-6af3-4dfd-b79c-9d323549c1f0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.338218 Dec 25 21:43:46.232452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3665/7354] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:45 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:43:46.827852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ccc0cf94-e4ec-46a3-b61b-69041c907e37 req-969b4c3f-8760-4778-a857-0ac26c4bad0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:46.829420 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:46.829420 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:46.839410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ccc0cf94-e4ec-46a3-b61b-69041c907e37 req-969b4c3f-8760-4778-a857-0ac26c4bad0c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:46.839894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ccc0cf94-e4ec-46a3-b61b-69041c907e37 req-969b4c3f-8760-4778-a857-0ac26c4bad0c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:46.850419 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ccc0cf94-e4ec-46a3-b61b-69041c907e37 req-969b4c3f-8760-4778-a857-0ac26c4bad0c service nova] Creating event network-vif-unplugged:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:43:46.855335 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ccc0cf94-e4ec-46a3-b61b-69041c907e37 req-969b4c3f-8760-4778-a857-0ac26c4bad0c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031366 Dec 25 21:43:46.856118 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3690/7355] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:46 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:46.930322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:46.930874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:46.937744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:46.938277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:46.939076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:46.939530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:46.989207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:46.989688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:46.990174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lazy-loading 'fault' on Instance uuid 1a72df6d-c3ba-4267-a14b-70b16a7532b8 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:43:47.134206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8dd3c4dd2344bee986e909d5c45112a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca293d68b8cc44e6b641d477c9a3eb50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:47.148753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12beacf1-acc0-447f-a6eb-fbedd2158997 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 200 len: 1232 microversion: 2.1 time: 0.220933 Dec 25 21:43:47.160106 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3666/7356] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:46 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 1232 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:47.265091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:47.265818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:47.272434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:47.273259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:47.274133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:47.274574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:47.541378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:47.548912 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de866b3f-34c1-453b-8a62-5bc95199c80b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.302850 Dec 25 21:43:47.560380 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3691/7357] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:47 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:48.169007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:48.170949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] [instance: 1a72df6d-c3ba-4267-a14b-70b16a7532b8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:48.182028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:48.182500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:48.183520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:48.184121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:48.202345 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] HTTP exception thrown: Instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 could not be found. Dec 25 21:43:48.203497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Returning 404 to user: Instance 1a72df6d-c3ba-4267-a14b-70b16a7532b8 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:43:48.204497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9de950f1-d408-48f6-b05c-8cdff37f29f3 tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8" status: 404 len: 111 microversion: 2.1 time: 0.041799 Dec 25 21:43:48.205584 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3667/7358] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:48 2021] GET /compute/v2.1/servers/1a72df6d-c3ba-4267-a14b-70b16a7532b8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:43:48.338450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b0f05fe4-7630-4d8c-a2e3-4f17628f3963 req-091299a8-f535-445c-8e05-92c480091e73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "name": "network-vif-plugged", "status": "completed", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:48.342144 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:48.342144 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:48.367071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b0f05fe4-7630-4d8c-a2e3-4f17628f3963 req-091299a8-f535-445c-8e05-92c480091e73 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:48.368820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b0f05fe4-7630-4d8c-a2e3-4f17628f3963 req-091299a8-f535-445c-8e05-92c480091e73 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:48.398331 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b0f05fe4-7630-4d8c-a2e3-4f17628f3963 req-091299a8-f535-445c-8e05-92c480091e73 service nova] Creating event network-vif-plugged:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:43:48.407703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b0f05fe4-7630-4d8c-a2e3-4f17628f3963 req-091299a8-f535-445c-8e05-92c480091e73 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073550 Dec 25 21:43:48.408806 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3692/7359] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:48.588640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:48.588640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:48.597311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a5232e3a-6052-484c-861f-ff76805930cb tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] Calling method '.version_select at 0x7fa4f7037a60>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:48.598108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:48.598587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:48.599548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:48.600160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:48.762638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a5232e3a-6052-484c-861f-ff76805930cb tempest-TestVolumeBackupRestore-1733305645 tempest-TestVolumeBackupRestore-1733305645-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-701105488" status: 202 len: 0 microversion: 2.1 time: 0.165163 Dec 25 21:43:48.762638 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3693/7360] 10.222.0.32 () {58 vars in 1265 bytes} [Sat Dec 25 21:43:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-701105488 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:43:48.821646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:48.838590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6312e14f-e1d2-4263-b47f-7fb84b666012 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.271977 Dec 25 21:43:48.848458 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3668/7361] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:48 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:48.870692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c7e42de4-0374-47ab-b550-4f4dfe88723e req-a2507b5a-99aa-4593-b66d-4ca4d280d19a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:48.872325 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:48.872325 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:48.880023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c7e42de4-0374-47ab-b550-4f4dfe88723e req-a2507b5a-99aa-4593-b66d-4ca4d280d19a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:48.880483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c7e42de4-0374-47ab-b550-4f4dfe88723e req-a2507b5a-99aa-4593-b66d-4ca4d280d19a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:48.893115 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c7e42de4-0374-47ab-b550-4f4dfe88723e req-a2507b5a-99aa-4593-b66d-4ca4d280d19a service nova] Creating event network-changed:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:43:48.899545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c7e42de4-0374-47ab-b550-4f4dfe88723e req-a2507b5a-99aa-4593-b66d-4ca4d280d19a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Dec 25 21:43:48.900565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3694/7362] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:49.859058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:49.859703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:49.868854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:49.869386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:49.870409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:49.870862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:50.351751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:50.361077 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7adf4b06-588e-4624-9978-36ecf0f021a7 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.508752 Dec 25 21:43:50.362206 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3669/7363] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:49 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:51.381247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:51.381989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:51.388443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:51.388911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:51.389961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:51.390406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:51.548151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:51.556421 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9bb00013-fae3-4c5a-a0ea-29ba75a3a8b1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.180520 Dec 25 21:43:51.557032 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3695/7364] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:51 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:52.574947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:52.576170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:52.582752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:52.583514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:52.584825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:52.585491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:52.808648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:52.817001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-953d81dc-85ff-46de-bbbe-218d4adb7033 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.245890 Dec 25 21:43:52.817769 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3670/7365] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:52 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:43:53.117093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-12a1cb87-4fc4-4fe5-85c7-2326cca2e1ea req-247cc6fe-fce2-4aaf-a983-a65ac8054b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "name": "network-vif-unplugged", "status": "completed", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:53.118895 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:53.118895 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:53.134555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-12a1cb87-4fc4-4fe5-85c7-2326cca2e1ea req-247cc6fe-fce2-4aaf-a983-a65ac8054b94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:53.135413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-12a1cb87-4fc4-4fe5-85c7-2326cca2e1ea req-247cc6fe-fce2-4aaf-a983-a65ac8054b94 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:53.148637 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-12a1cb87-4fc4-4fe5-85c7-2326cca2e1ea req-247cc6fe-fce2-4aaf-a983-a65ac8054b94 service nova] Creating event network-vif-unplugged:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch2-master-1 Dec 25 21:43:53.154370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-12a1cb87-4fc4-4fe5-85c7-2326cca2e1ea req-247cc6fe-fce2-4aaf-a983-a65ac8054b94 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044682 Dec 25 21:43:53.155537 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3696/7366] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:53 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:43:53.835667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:53.838060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:53.846315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:53.846869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:53.847787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:53.848309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:54.127275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:54.138561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3bc524b7-55ba-4a86-ac31-ff9161a5519b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1692 microversion: 2.1 time: 0.307057 Dec 25 21:43:54.140370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3671/7367] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:53 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1692 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:55.157411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:55.159096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:55.166996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:55.167421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:55.168230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:55.168721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:55.483030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:55.494074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6571fabb-6b1b-41d0-bbe5-3a727af223b3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1682 microversion: 2.1 time: 0.340894 Dec 25 21:43:55.494827 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3697/7368] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:55 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1682 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:55.511092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:55.511709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:55.519577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:55.520082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:55.521339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:55.521795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:55.755667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d68b7384-87ba-49f4-b3de-54bfa60f4d53 tempest-TestNetworkAdvancedServerOps-1317083038 tempest-TestNetworkAdvancedServerOps-1317083038-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1833 microversion: 2.1 time: 0.248828 Dec 25 21:43:55.763948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3672/7369] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:55 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1833 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:55.771836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:55.772625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:55.780404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:55.780864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:55.781875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:55.784259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:55.987618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:55.998289 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a1b5c6d-11c4-490b-940e-59fe2193a4e3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1682 microversion: 2.1 time: 0.229751 Dec 25 21:43:55.999310 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3698/7370] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:55 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:56.124086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:56.125244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:56.131694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:56.132371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:56.133928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:56.134529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:56.190663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9cbe24b6-f168-4816-922d-146c61c3f04e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action" status: 200 len: 38621 microversion: 2.1 time: 0.070718 Dec 25 21:43:56.191577 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3673/7371] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:43:56 2021] POST /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c/action => generated 38621 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:43:57.624163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:57.624838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:57.636085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:57.636801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:57.638434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:57.638883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:57.683162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:43:57.775410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-8cab98b4-8193-453e-be13-2de40d31b4ea req-8fca4f9c-51b0-4e32-b6c0-80be49c14eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:57.777913 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:57.777913 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:43:57.797147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8cab98b4-8193-453e-be13-2de40d31b4ea req-8fca4f9c-51b0-4e32-b6c0-80be49c14eb7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:57.797946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-8cab98b4-8193-453e-be13-2de40d31b4ea req-8fca4f9c-51b0-4e32-b6c0-80be49c14eb7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:57.823785 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-8cab98b4-8193-453e-be13-2de40d31b4ea req-8fca4f9c-51b0-4e32-b6c0-80be49c14eb7 service nova] Creating event network-changed:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch1-master-1 Dec 25 21:43:57.831515 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-8cab98b4-8193-453e-be13-2de40d31b4ea req-8fca4f9c-51b0-4e32-b6c0-80be49c14eb7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208481 Dec 25 21:43:57.834191 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3674/7372] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:43:58.007192 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c1d3648b-6f63-44bb-9555-91ab5b4ea6c6 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 204 len: 0 microversion: 2.1 time: 0.386905 Dec 25 21:43:58.007820 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3699/7373] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:43:57 2021] DELETE /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:43:58.020385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:58.021358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:58.041925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:58.045730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:58.046324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:58.048334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:58.699189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:58.731824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-42517800-8631-4883-8ac0-2254f517af7b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1688 microversion: 2.1 time: 0.715014 Dec 25 21:43:58.736390 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3675/7374] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:58 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1688 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:43:59.500103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-83091436-69b6-43d8-afab-5c36f2cc2a8b req-eeb309d5-f95d-4ace-bf19-c8e430fd67e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "367fe828-cfc4-4b03-926c-063408effc4c", "name": "network-vif-deleted", "tag": "c262cb63-041e-44fa-b663-5010b7338baf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:43:59.501650 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:43:59.501650 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:43:59.510054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83091436-69b6-43d8-afab-5c36f2cc2a8b req-eeb309d5-f95d-4ace-bf19-c8e430fd67e0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:59.510503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83091436-69b6-43d8-afab-5c36f2cc2a8b req-eeb309d5-f95d-4ace-bf19-c8e430fd67e0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:59.525826 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-83091436-69b6-43d8-afab-5c36f2cc2a8b req-eeb309d5-f95d-4ace-bf19-c8e430fd67e0 service nova] Creating event network-vif-deleted:c262cb63-041e-44fa-b663-5010b7338baf for instance 367fe828-cfc4-4b03-926c-063408effc4c on nch1-master-1 Dec 25 21:43:59.531659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-83091436-69b6-43d8-afab-5c36f2cc2a8b req-eeb309d5-f95d-4ace-bf19-c8e430fd67e0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035558 Dec 25 21:43:59.533379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3700/7375] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:43:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:43:59.754291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:43:59.756940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:43:59.763514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:59.764838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:59.767969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:59.768511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:59.814282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:43:59.814749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:43:59.815219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lazy-loading 'fault' on Instance uuid 367fe828-cfc4-4b03-926c-063408effc4c {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:43:59.861475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:43:59.873410 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5af50777-618d-43f1-a837-3b5119374fe8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 200 len: 1356 microversion: 2.1 time: 0.123059 Dec 25 21:43:59.874006 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3676/7376] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:43:59 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 1356 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:00.893428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:00.894140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 367fe828-cfc4-4b03-926c-063408effc4c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:00.900858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:00.901347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:00.902358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:00.902974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:00.924228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] HTTP exception thrown: Instance 367fe828-cfc4-4b03-926c-063408effc4c could not be found. Dec 25 21:44:00.931835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Returning 404 to user: Instance 367fe828-cfc4-4b03-926c-063408effc4c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:44:00.932939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a681b07-e8d3-425a-b27e-15177e15594c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c" status: 404 len: 111 microversion: 2.1 time: 0.044780 Dec 25 21:44:00.933671 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3701/7377] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:00 2021] GET /compute/v2.1/servers/367fe828-cfc4-4b03-926c-063408effc4c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:44:07.483954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b0f6d16-e69b-4328-81a2-d1ea88ed91e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '.version_select at 0x7fa4f6238dc0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:07.607835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b0f6d16-e69b-4328-81a2-d1ea88ed91e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-632889024" status: 202 len: 0 microversion: 2.1 time: 0.127158 Dec 25 21:44:07.608736 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3677/7378] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 21:44:07 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-632889024 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:44:07.640906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ffbf40a-4b5b-4b23-8d8d-5614251e22cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: .version_select at 0x7fa4f74699d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-521467149"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:07.657429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7ffbf40a-4b5b-4b23-8d8d-5614251e22cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:07.665236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7ffbf40a-4b5b-4b23-8d8d-5614251e22cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:08.019371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7ffbf40a-4b5b-4b23-8d8d-5614251e22cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:08.028175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7ffbf40a-4b5b-4b23-8d8d-5614251e22cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:08.048308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ffbf40a-4b5b-4b23-8d8d-5614251e22cb tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.414788 Dec 25 21:44:08.049801 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3702/7379] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:44:07 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:23.776727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-272e8d74-de13-416d-b31f-5e31e794e512 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'create', calling method: .version_select at 0x7fa4f6205a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1576790326"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:23.810489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-272e8d74-de13-416d-b31f-5e31e794e512 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:23.824255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-272e8d74-de13-416d-b31f-5e31e794e512 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:24.195209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-272e8d74-de13-416d-b31f-5e31e794e512 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:24.208165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-272e8d74-de13-416d-b31f-5e31e794e512 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:24.225920 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-272e8d74-de13-416d-b31f-5e31e794e512 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.453323 Dec 25 21:44:24.226882 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3678/7380] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:44:23 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:31.260862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-815980974", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "060ae95d-b8fc-405f-91a3-56845df2e346"}], "key_name": "tempest-TestNetworkAdvancedServerOps-521467149", "security_groups": [{"name": "tempest-secgroup-smoke-235485744"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:31.538452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-382566819", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "2d1735c0-d6b4-47c5-98a9-07fa68c49bb1"}], "key_name": "tempest-TestNetworkBasicOps-1576790326", "security_groups": [{"name": "tempest-secgroup-smoke-649673767"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:31.716239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] validate_networks() for [('060ae95d-b8fc-405f-91a3-56845df2e346', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:44:32.185313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] validate_networks() for [('2d1735c0-d6b4-47c5-98a9-07fa68c49bb1', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:44:34.608940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:44:34.610122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:44:34.610991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:44:34.613654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:44:34.614348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:44:34.633340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:34.648695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:44:34.650017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:44:34.650983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:44:34.651646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:44:34.652278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:44:34.659657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:34.666949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:34.668077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:34.675808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:34.676518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:34.683399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:34.684521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:34.738250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:34.763667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:34.770179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:34.790272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Getting quotas for user 01a07fc3a154483caea95cbd449f3970 and project 4ff29c23c5844f45826a02b6ae6b65e7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:34.808906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:44:34.812091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:44:34.812354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:44:34.819173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:44:34.944826 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63df4da8-825f-4463-ad7a-1940d59204de tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.692492 Dec 25 21:44:34.952249 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3703/7381] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:44:31 2021] POST /compute/v2.1/servers => generated 405 bytes in 3701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:44:34.957639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb172c6f-d63f-4c45-ab3e-603d5cbbed25 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:34.958591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb172c6f-d63f-4c45-ab3e-603d5cbbed25 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:35.032975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a77ebf4e-1bcf-48f7-a51a-642876c8a0b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.495656 Dec 25 21:44:35.033826 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3679/7382] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:44:31 2021] POST /compute/v2.1/servers => generated 405 bytes in 3501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:44:35.044891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8e5fb664-4c0f-4db1-aabe-3103d7efa391 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:35.048699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8e5fb664-4c0f-4db1-aabe-3103d7efa391 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:35.114236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb172c6f-d63f-4c45-ab3e-603d5cbbed25 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:35.138391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb172c6f-d63f-4c45-ab3e-603d5cbbed25 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1265 microversion: 2.1 time: 0.183983 Dec 25 21:44:35.158535 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3704/7383] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:34 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:35.165994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8e5fb664-4c0f-4db1-aabe-3103d7efa391 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:35.180810 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8e5fb664-4c0f-4db1-aabe-3103d7efa391 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1248 microversion: 2.1 time: 0.140146 Dec 25 21:44:35.185203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3680/7384] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:35 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1248 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:36.169210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfda5ad7-d150-4a27-ae97-b47a1f469ddf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:36.169844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfda5ad7-d150-4a27-ae97-b47a1f469ddf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:36.198252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80708d55-4931-456d-966d-e4643a95206b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:36.199522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80708d55-4931-456d-966d-e4643a95206b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:36.287619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfda5ad7-d150-4a27-ae97-b47a1f469ddf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:36.295951 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfda5ad7-d150-4a27-ae97-b47a1f469ddf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1265 microversion: 2.1 time: 0.131664 Dec 25 21:44:36.297775 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3705/7385] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:36 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:36.327739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-80708d55-4931-456d-966d-e4643a95206b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:36.336619 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80708d55-4931-456d-966d-e4643a95206b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1248 microversion: 2.1 time: 0.142256 Dec 25 21:44:36.339507 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3681/7386] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:36 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1248 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:37.315719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:37.316298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:37.324731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:37.325561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:37.326432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:37.326881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:37.357403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:37.358632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:37.373755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:37.391357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:37.393365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:37.397719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:37.460609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:37.471783 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-84f86243-8581-47e8-bfb0-09f00ad5f08e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1317 microversion: 2.1 time: 0.160624 Dec 25 21:44:37.472707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3706/7387] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:37 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:37.505493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:37.527925 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5576a321-ab2e-436d-9859-a3732188ba9a tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1244 microversion: 2.1 time: 0.174935 Dec 25 21:44:37.540050 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3682/7388] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:37 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1244 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:37.698922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b80c4658-4e25-4b83-8621-835d525b8c2e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:37.699899 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:37.699899 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:44:37.701425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80c4658-4e25-4b83-8621-835d525b8c2e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:37.701882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80c4658-4e25-4b83-8621-835d525b8c2e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:37.702708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80c4658-4e25-4b83-8621-835d525b8c2e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:37.703349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80c4658-4e25-4b83-8621-835d525b8c2e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:37.730140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b80c4658-4e25-4b83-8621-835d525b8c2e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.210215 Dec 25 21:44:37.730747 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3707/7389] 10.222.0.32 () {58 vars in 1184 bytes} [Sat Dec 25 21:44:37 2021] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:37.904060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1970454579", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "8ff80b6e-c966-48fa-b9d8-4e20f6169e52"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:37.979468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] validate_networks() for [('8ff80b6e-c966-48fa-b9d8-4e20f6169e52', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:44:38.489592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:38.490697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:38.510935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:38.511827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:38.513724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:38.515168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:38.721561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:38.730252 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-83a42960-15ad-4f0c-863c-2f139536c4d3 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1323 microversion: 2.1 time: 0.243749 Dec 25 21:44:38.735243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3708/7390] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:38 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1323 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:38.765151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:38.765805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:38.781500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:38.782838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:38.783922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:38.784521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:38.847599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:44:38.848073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:44:38.848512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:44:38.849046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:44:38.853215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:44:38.863037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:38.863514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:38.864391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:38.865475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:38.885619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Getting quotas for project 7111026d02ad417e83bc2f057ded219d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:38.891252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Getting quotas for user 902218fc6f20495da59daa79a21ab451 and project 7111026d02ad417e83bc2f057ded219d. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:38.900696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:38.903961 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:44:38.906804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:44:38.912022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15f765e3-c842-4a32-942d-3f936a63ed44 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1306 microversion: 2.1 time: 0.178428 Dec 25 21:44:38.913703 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3709/7391] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:38 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1306 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:39.082983 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95a6045f-63af-43d7-96d9-5e7de68b3767 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.182371 Dec 25 21:44:39.085632 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3683/7392] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:44:37 2021] POST /compute/v2.1/servers => generated 380 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:44:39.094863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e90b75f2-6af4-4fbe-ba62-1f149238cdc0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:39.095907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e90b75f2-6af4-4fbe-ba62-1f149238cdc0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:39.181009 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e90b75f2-6af4-4fbe-ba62-1f149238cdc0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1329 microversion: 2.1 time: 0.089772 Dec 25 21:44:39.182001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3710/7393] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:39 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1329 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:39.753867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:39.755210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:39.765122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:39.765817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:39.767035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:39.767773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:39.934257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:39.934257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:39.943788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:39.949953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:39.951165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:39.951690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:40.109751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:40.117370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-34314604-b594-48b8-9093-982bdc1f1ec5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1306 microversion: 2.1 time: 0.191981 Dec 25 21:44:40.118042 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3711/7394] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:39 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1306 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:40.254890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6de8d280-2117-48ad-a6ad-04798210f587 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:40.254890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6de8d280-2117-48ad-a6ad-04798210f587 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:40.600744 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6de8d280-2117-48ad-a6ad-04798210f587 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1329 microversion: 2.1 time: 0.350351 Dec 25 21:44:40.601617 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3712/7395] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:40 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1329 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:40.621433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:40.631367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44f53465-8af1-4e7c-af10-e3142ab693f8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.884163 Dec 25 21:44:40.632416 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3684/7396] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:39 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:41.140486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:41.142063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:41.156571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:41.171063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:41.171063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:41.177849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:41.501948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:41.517950 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a05dd48-6707-422d-8f77-bc73d528a349 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.382006 Dec 25 21:44:41.518546 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3713/7397] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:41 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:41.618573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:41.619227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:41.635407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:41.636177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:41.637307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:41.637794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:41.651536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:41.662329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:41.665310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:41.667161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:41.670696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:41.671374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:41.839384 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14226b90-2d13-4d87-a7d5-de4628c2544e tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1416 microversion: 2.1 time: 0.222516 Dec 25 21:44:41.840952 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3685/7398] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:41 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1416 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:42.286274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:42.296093 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24fda15b-483b-4d77-af70-0b3d2d50a8fa tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.651565 Dec 25 21:44:42.297407 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3714/7399] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:41 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:42.535375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:42.538795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:42.542475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:42.542947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:42.543773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:42.544230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:42.858133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:42.858759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:42.865873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:42.866615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:42.867934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:42.867934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:43.039517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05d0c80c-7b36-4f31-af6c-57bdcfeab899 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1422 microversion: 2.1 time: 0.184649 Dec 25 21:44:43.040730 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3715/7400] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:42 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1422 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:43.097048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:43.100441 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9cd82c83-1292-4faa-a5be-9a643ca9dfe7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.568682 Dec 25 21:44:43.102862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3686/7401] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:42 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:43.244204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3e9c7016-d403-4f0f-aa55-aa16a64e54ce req-bcf6e5d0-6519-4536-9143-12a05d4bd704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232caa59-01ee-4a0a-ad80-4a2406c77580", "tag": "22c8730d-1fe0-40bd-b7c2-cd3f15f4b816"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:43.245758 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:43.245758 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:44:43.253791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3e9c7016-d403-4f0f-aa55-aa16a64e54ce req-bcf6e5d0-6519-4536-9143-12a05d4bd704 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:43.254250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3e9c7016-d403-4f0f-aa55-aa16a64e54ce req-bcf6e5d0-6519-4536-9143-12a05d4bd704 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:43.267556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3e9c7016-d403-4f0f-aa55-aa16a64e54ce req-bcf6e5d0-6519-4536-9143-12a05d4bd704 service nova] Creating event network-changed:22c8730d-1fe0-40bd-b7c2-cd3f15f4b816 for instance 232caa59-01ee-4a0a-ad80-4a2406c77580 on nch2-master-1 Dec 25 21:44:43.276288 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3e9c7016-d403-4f0f-aa55-aa16a64e54ce req-bcf6e5d0-6519-4536-9143-12a05d4bd704 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231664 Dec 25 21:44:43.276288 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3716/7402] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:43.316397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:43.317459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:43.325265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:43.326269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:43.327352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:43.328435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:43.790827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:43.804438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c38e245-226c-4c58-a503-b553658646cd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.492863 Dec 25 21:44:43.805422 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3687/7403] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:43 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:44.060050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:44.061485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:44.101821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:44.102283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:44.103108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:44.103639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:44.119162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:44.119807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:44.134951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:44.135586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:44.136735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:44.141844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:45.143959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ca62d0b-23e7-4b4b-a8d6-8e10f3bb87d9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 1.089538 Dec 25 21:44:45.144764 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3717/7404] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:44 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:45.150361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:45.150970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:45.157909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:45.158403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:45.159300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:45.159686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:45.172364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:45.187339 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0588e36-ca19-4ed0-850c-18a38392e55f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 1.071060 Dec 25 21:44:45.189375 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3688/7405] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:44 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:45.349614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a2f20336-7f22-454d-b772-b8168df6f29e req-256031fe-599a-47df-ab40-bd81ceac986f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725062b3-9301-4599-9aba-de15e6198698", "tag": "46007bab-bd9e-4282-97d5-2a4cf51e9186"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:45.351310 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:45.351310 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:44:45.359505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2f20336-7f22-454d-b772-b8168df6f29e req-256031fe-599a-47df-ab40-bd81ceac986f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:45.359969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a2f20336-7f22-454d-b772-b8168df6f29e req-256031fe-599a-47df-ab40-bd81ceac986f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:45.382859 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a2f20336-7f22-454d-b772-b8168df6f29e req-256031fe-599a-47df-ab40-bd81ceac986f service nova] Creating event network-changed:46007bab-bd9e-4282-97d5-2a4cf51e9186 for instance 725062b3-9301-4599-9aba-de15e6198698 on nch2-master-1 Dec 25 21:44:45.394363 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a2f20336-7f22-454d-b772-b8168df6f29e req-256031fe-599a-47df-ab40-bd81ceac986f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049155 Dec 25 21:44:45.395566 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3689/7406] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:44:45.748857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:45.761101 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9daef84-61bc-45a2-9d7e-9a9574b3cfdf tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.614570 Dec 25 21:44:45.762181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3718/7407] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:45 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:46.161386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:46.162303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:46.179587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:46.181050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:46.182105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:46.182718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:46.205878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:46.206503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:46.217351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:46.217805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:46.218617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:46.219056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:46.637660 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d68e863f-3c7b-4a42-8a45-2fa31bf9d8f2 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 0.480644 Dec 25 21:44:46.638313 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3690/7408] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:46 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:46.693409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:46.703181 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42943c48-10cf-4fc7-8a77-54eb397f5da6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.501099 Dec 25 21:44:46.705031 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3719/7409] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:46 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:46.779608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:46.781083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:46.787212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:46.790047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:46.792339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:46.797773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:47.315524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:47.332831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f711b95d-dd47-4307-89cf-3553f3434dec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.557450 Dec 25 21:44:47.333508 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3691/7410] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:46 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:47.426612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-29878d0a-9520-4eaf-9ed6-3cf4cc5d9ff3 req-f95b49bc-6a3c-4a42-88bf-f0174b6b928a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f1c9a4-a882-45a4-8c11-3eaec625deef", "tag": "969022d6-ccf2-4bce-a499-ff0d103d87ae"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:47.430176 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:47.430176 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:44:47.439942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-29878d0a-9520-4eaf-9ed6-3cf4cc5d9ff3 req-f95b49bc-6a3c-4a42-88bf-f0174b6b928a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:47.440706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-29878d0a-9520-4eaf-9ed6-3cf4cc5d9ff3 req-f95b49bc-6a3c-4a42-88bf-f0174b6b928a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:47.461858 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-29878d0a-9520-4eaf-9ed6-3cf4cc5d9ff3 req-f95b49bc-6a3c-4a42-88bf-f0174b6b928a service nova] Creating event network-changed:969022d6-ccf2-4bce-a499-ff0d103d87ae for instance 38f1c9a4-a882-45a4-8c11-3eaec625deef on nch1-master-1 Dec 25 21:44:47.467514 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-29878d0a-9520-4eaf-9ed6-3cf4cc5d9ff3 req-f95b49bc-6a3c-4a42-88bf-f0174b6b928a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051713 Dec 25 21:44:47.468743 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3720/7411] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:47.654805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:47.655434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:47.665234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:47.665742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:47.667185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:47.667871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:47.723810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:47.724562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:47.731839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:47.732299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:47.733332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:47.733783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:47.931426 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e35699f-ec52-4825-bd53-86d44c668aa0 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 0.280277 Dec 25 21:44:47.932933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3692/7412] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:47 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:47.991453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:48.004640 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abc105c7-d33c-41c2-84ee-f9b857afb7bc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.285933 Dec 25 21:44:48.015405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3721/7413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:47 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:48.352390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:48.353106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:48.363521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:48.365401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:48.368990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:48.370036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:48.587463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-efd9975f-1afa-4e95-88ab-a0143594a6a6 req-93ece07b-153f-4f0d-8667-6572a3eb23c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232caa59-01ee-4a0a-ad80-4a2406c77580", "name": "network-vif-plugged", "status": "completed", "tag": "22c8730d-1fe0-40bd-b7c2-cd3f15f4b816"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:48.589062 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:48.589062 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:44:48.597480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-efd9975f-1afa-4e95-88ab-a0143594a6a6 req-93ece07b-153f-4f0d-8667-6572a3eb23c3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:48.598162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-efd9975f-1afa-4e95-88ab-a0143594a6a6 req-93ece07b-153f-4f0d-8667-6572a3eb23c3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:48.616760 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-efd9975f-1afa-4e95-88ab-a0143594a6a6 req-93ece07b-153f-4f0d-8667-6572a3eb23c3 service nova] Creating event network-vif-plugged:22c8730d-1fe0-40bd-b7c2-cd3f15f4b816 for instance 232caa59-01ee-4a0a-ad80-4a2406c77580 on nch2-master-1 Dec 25 21:44:48.622092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-efd9975f-1afa-4e95-88ab-a0143594a6a6 req-93ece07b-153f-4f0d-8667-6572a3eb23c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038554 Dec 25 21:44:48.622813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3722/7414] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:48.711290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:48.718998 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab2d6e59-6e84-4744-ac22-c1ce2c45b588 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.372596 Dec 25 21:44:48.719590 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3693/7415] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:48 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:48.948524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:48.949853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:48.957204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:48.958055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:48.959785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:48.960480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:49.023451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:49.024889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:49.031421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:49.032237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:49.033312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:49.033769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:49.490651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:49.491735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8b02704c-4783-45b1-885a-034d3fc6507a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 0.547566 Dec 25 21:44:49.492560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3723/7416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:48 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:49.499119 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47676001-0089-4fe8-aff1-8ddb5ec2ba7d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.480276 Dec 25 21:44:49.499920 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3694/7417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:49 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:49.736950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:49.740424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:49.750466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:49.750720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:49.751937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:49.751937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:49.908500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:49.919312 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06466d04-92d8-4b4d-aead-aa074faa4109 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1390 microversion: 2.1 time: 0.187013 Dec 25 21:44:49.919907 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3724/7418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:49 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1390 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:50.508434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:50.509112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:50.516737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.519835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:50.519955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:50.520045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.520167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:50.520279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:50.526970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.527857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:50.528862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.529526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:50.751332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fadae60f-f226-468d-b001-2d9ec99bbc3b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 0.247520 Dec 25 21:44:50.751925 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3695/7419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:50 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:50.761481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:50.762998 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c9aa918-23e0-4c77-8a44-3905dfd2cc23 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.249791 Dec 25 21:44:50.764133 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3725/7420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:50 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:50.773933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-f8e8c708-4c18-42ac-b962-1ce9298d4c4f req-2517b260-50d9-405d-87f2-1ccf160b05c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725062b3-9301-4599-9aba-de15e6198698", "name": "network-vif-plugged", "status": "completed", "tag": "46007bab-bd9e-4282-97d5-2a4cf51e9186"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:50.775690 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:50.775690 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:44:50.783069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f8e8c708-4c18-42ac-b962-1ce9298d4c4f req-2517b260-50d9-405d-87f2-1ccf160b05c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.783540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-f8e8c708-4c18-42ac-b962-1ce9298d4c4f req-2517b260-50d9-405d-87f2-1ccf160b05c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:50.804839 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-f8e8c708-4c18-42ac-b962-1ce9298d4c4f req-2517b260-50d9-405d-87f2-1ccf160b05c7 service nova] Creating event network-vif-plugged:46007bab-bd9e-4282-97d5-2a4cf51e9186 for instance 725062b3-9301-4599-9aba-de15e6198698 on nch2-master-1 Dec 25 21:44:50.812092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-f8e8c708-4c18-42ac-b962-1ce9298d4c4f req-2517b260-50d9-405d-87f2-1ccf160b05c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048196 Dec 25 21:44:50.813000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3696/7421] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:50.938484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:50.939142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:50.952542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.953036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:50.954214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:50.954662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:51.093568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:51.101231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d98dbb3b-e881-4108-97d4-396b9c843cec tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1562 microversion: 2.1 time: 0.168138 Dec 25 21:44:51.101813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3726/7422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:50 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:51.118309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:51.119166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:51.125460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:51.125930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:51.126763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:51.127214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:51.272399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:51.279888 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f16e580-365d-47ee-b435-326800173f7c tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1562 microversion: 2.1 time: 0.166323 Dec 25 21:44:51.282057 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3697/7423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:51 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:51.767921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:51.768736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:51.776716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:51.783434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:51.783434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:51.783434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:51.783770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:51.783770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:51.788976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:51.789519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:51.790557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:51.790844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:52.098991 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd3bede4-fbae-44b8-a761-e7b141feaa86 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 0.334451 Dec 25 21:44:52.108657 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3727/7424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:51 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:52.126345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:52.135113 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c2c5e40c-7517-4b50-840b-3a95431bb4a4 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1373 microversion: 2.1 time: 0.358853 Dec 25 21:44:52.140843 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3698/7425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:51 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1373 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:52.846025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-536ed85e-99b3-436f-9233-be62409442ac req-4bdf72c4-84db-42c3-a225-9d565b148adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f1c9a4-a882-45a4-8c11-3eaec625deef", "name": "network-vif-plugged", "status": "completed", "tag": "969022d6-ccf2-4bce-a499-ff0d103d87ae"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:52.847680 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:52.847680 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:44:52.857152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-536ed85e-99b3-436f-9233-be62409442ac req-4bdf72c4-84db-42c3-a225-9d565b148adb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:52.857614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-536ed85e-99b3-436f-9233-be62409442ac req-4bdf72c4-84db-42c3-a225-9d565b148adb service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:52.869999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-536ed85e-99b3-436f-9233-be62409442ac req-4bdf72c4-84db-42c3-a225-9d565b148adb service nova] Creating event network-vif-plugged:969022d6-ccf2-4bce-a499-ff0d103d87ae for instance 38f1c9a4-a882-45a4-8c11-3eaec625deef on nch1-master-1 Dec 25 21:44:52.875228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-536ed85e-99b3-436f-9233-be62409442ac req-4bdf72c4-84db-42c3-a225-9d565b148adb service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032862 Dec 25 21:44:52.875893 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3728/7426] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:53.115517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:53.116266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:53.123003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.123522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.124326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.124769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.157257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:53.157968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:53.164317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.164771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.166122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.166741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.433783 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-670fd3b7-36b0-4c68-a29f-8ebf54c96023 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1464 microversion: 2.1 time: 0.322392 Dec 25 21:44:53.435071 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3699/7427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:53 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:53.467249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:53.476543 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-991e2c3a-7469-4af3-a0f2-9270621ab18f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1545 microversion: 2.1 time: 0.323492 Dec 25 21:44:53.477405 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3729/7428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:53 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1545 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:53.499623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:53.500745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:53.507591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.510772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.510772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.510772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.699344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:53.708130 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b5b72cc4-db2b-469c-bd69-21c0136fcc6f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1545 microversion: 2.1 time: 0.214384 Dec 25 21:44:53.709406 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3700/7429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:53 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1545 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:53.786664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:53.787384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:53.796722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.797266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-926b4bf5-f105-401b-be04-eb18303af278 req-16bda520-6711-48f2-a14b-7ae91aefefed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232caa59-01ee-4a0a-ad80-4a2406c77580", "tag": "22c8730d-1fe0-40bd-b7c2-cd3f15f4b816"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:53.799364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.800588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.804224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.805256 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:53.805256 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:44:53.817289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-926b4bf5-f105-401b-be04-eb18303af278 req-16bda520-6711-48f2-a14b-7ae91aefefed service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:53.818528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-926b4bf5-f105-401b-be04-eb18303af278 req-16bda520-6711-48f2-a14b-7ae91aefefed service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:53.833534 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-926b4bf5-f105-401b-be04-eb18303af278 req-16bda520-6711-48f2-a14b-7ae91aefefed service nova] Creating event network-changed:22c8730d-1fe0-40bd-b7c2-cd3f15f4b816 for instance 232caa59-01ee-4a0a-ad80-4a2406c77580 on nch2-master-1 Dec 25 21:44:53.840686 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-926b4bf5-f105-401b-be04-eb18303af278 req-16bda520-6711-48f2-a14b-7ae91aefefed service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053975 Dec 25 21:44:53.842795 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3701/7430] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:44:54.128732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:44:54.144507 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ea5fc2b-cd9b-4b8d-a23d-c43ed2112890 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1562 microversion: 2.1 time: 0.360439 Dec 25 21:44:54.151279 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3730/7431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:53 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1562 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:54.451992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:54.452717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:54.459375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:54.460447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:54.463439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:54.463439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:55.085671 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-823d38c3-e8e1-4443-943b-5b0a3e6cfae4 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1647 microversion: 2.1 time: 0.638480 Dec 25 21:44:55.086975 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3702/7432] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:54 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1647 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:55.103324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:55.104138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:55.114415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:55.115200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:55.116204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:55.116808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:55.415686 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed80a9ab-7546-4f3a-8785-2624fdfdcc38 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1647 microversion: 2.1 time: 0.316869 Dec 25 21:44:55.416328 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3731/7433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:55 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1647 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:55.432458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:55.434030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:55.439992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:55.440470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:55.441296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:55.441753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:55.721207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb86e7c2-8429-4f5f-b170-8c16e96b8a07 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1647 microversion: 2.1 time: 0.292505 Dec 25 21:44:55.722491 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3703/7434] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:55 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1647 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:55.841050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-521510902", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "8ff80b6e-c966-48fa-b9d8-4e20f6169e52"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:55.910478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] validate_networks() for [('8ff80b6e-c966-48fa-b9d8-4e20f6169e52', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:44:56.597317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:44:56.597877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:44:56.598275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:44:56.600924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:44:56.600924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:44:56.617697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:56.618214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:56.619130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:56.619580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:56.659929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Getting quotas for project 7111026d02ad417e83bc2f057ded219d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:44:56.665910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Getting quotas for user 902218fc6f20495da59daa79a21ab451 and project 7111026d02ad417e83bc2f057ded219d. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:44:56.680655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:44:56.683519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:44:56.840136 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ed8bc5c2-6ab3-4305-9cd8-3f3818911822 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.002758 Dec 25 21:44:56.849202 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3732/7435] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:44:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:44:56.854975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0dc91629-7d9f-422c-951a-5a0a23f3a986 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:56.855637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0dc91629-7d9f-422c-951a-5a0a23f3a986 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:57.043141 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0dc91629-7d9f-422c-951a-5a0a23f3a986 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1328 microversion: 2.1 time: 0.195512 Dec 25 21:44:57.045924 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3704/7436] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:56 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1328 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:44:57.693911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e577ea91-8c9b-4d14-b1fd-8c62e39ba190 req-1fc0dae1-7cfb-4b76-be8d-5268791fe34e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725062b3-9301-4599-9aba-de15e6198698", "tag": "46007bab-bd9e-4282-97d5-2a4cf51e9186"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:44:57.696665 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:44:57.696665 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:44:57.706353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e577ea91-8c9b-4d14-b1fd-8c62e39ba190 req-1fc0dae1-7cfb-4b76-be8d-5268791fe34e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:57.707095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e577ea91-8c9b-4d14-b1fd-8c62e39ba190 req-1fc0dae1-7cfb-4b76-be8d-5268791fe34e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:57.720119 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e577ea91-8c9b-4d14-b1fd-8c62e39ba190 req-1fc0dae1-7cfb-4b76-be8d-5268791fe34e service nova] Creating event network-changed:46007bab-bd9e-4282-97d5-2a4cf51e9186 for instance 725062b3-9301-4599-9aba-de15e6198698 on nch2-master-1 Dec 25 21:44:57.727100 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e577ea91-8c9b-4d14-b1fd-8c62e39ba190 req-1fc0dae1-7cfb-4b76-be8d-5268791fe34e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037863 Dec 25 21:44:57.728774 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3733/7437] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:44:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:44:58.060834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:58.060834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:58.074009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:58.074392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:58.075394 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:58.076038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:58.188354 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e9b7e85-7834-4205-81c5-d90aa601c241 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1345 microversion: 2.1 time: 0.131472 Dec 25 21:44:58.189072 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3705/7438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:58 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1345 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:44:59.205390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:44:59.206102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:44:59.213528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:59.214198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:59.215166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:44:59.215605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:44:59.299856 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a93131a-ad39-475d-b5fe-53eb5b23080a tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1423 microversion: 2.1 time: 0.098551 Dec 25 21:44:59.301111 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3734/7439] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:44:59 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1423 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:00.317411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:00.318266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:00.325332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:00.325880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:00.326713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:00.327170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:00.502160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a2cac3b-cf6a-4ab9-b13a-e4175dfba036 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.188110 Dec 25 21:45:00.503215 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3706/7440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:00 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:00.794619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f6dbe044-1d18-44ef-83f5-d3551e4d29a4 req-6ade5da1-e7a0-42e5-a9f6-bd62e5a0c638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5993418-a92c-4e15-87ac-0f5ef2424768", "tag": "a592d7a8-b1cf-4096-b574-f2447197322e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:00.816286 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:00.816286 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:45:00.816286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f6dbe044-1d18-44ef-83f5-d3551e4d29a4 req-6ade5da1-e7a0-42e5-a9f6-bd62e5a0c638 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:00.816286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f6dbe044-1d18-44ef-83f5-d3551e4d29a4 req-6ade5da1-e7a0-42e5-a9f6-bd62e5a0c638 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:00.818134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f6dbe044-1d18-44ef-83f5-d3551e4d29a4 req-6ade5da1-e7a0-42e5-a9f6-bd62e5a0c638 service nova] Creating event network-changed:a592d7a8-b1cf-4096-b574-f2447197322e for instance a5993418-a92c-4e15-87ac-0f5ef2424768 on nch2-master-1 Dec 25 21:45:00.827959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f6dbe044-1d18-44ef-83f5-d3551e4d29a4 req-6ade5da1-e7a0-42e5-a9f6-bd62e5a0c638 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036918 Dec 25 21:45:00.829086 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3735/7441] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:45:01.519593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:01.521122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:01.528527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:01.529021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:01.530048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:01.530696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:01.931281 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a03672a6-451a-4eaf-a514-0c1f11aa85b9 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.415301 Dec 25 21:45:01.933021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3707/7442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:01 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:02.952479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:02.953362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:02.960453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:02.961156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:02.962109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:02.962550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:03.115212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-260f7b00-f5b4-4926-8d46-91a80a5939b8 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.169868 Dec 25 21:45:03.115845 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3736/7443] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:02 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:45:04.131862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:04.132491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:04.141197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:04.141661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:04.142465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:04.143231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:04.360714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b7c2210-0f6a-43c4-95cc-da1334093a4b tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.232520 Dec 25 21:45:04.361597 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3708/7444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:04 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:05.378351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:05.379094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:05.387249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:05.387791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:05.388601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:05.389392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:05.524672 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-15b51862-dca6-492f-9875-ec24cfe04381 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.149870 Dec 25 21:45:05.525621 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3737/7445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:05 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:06.541755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:06.542387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:06.549635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:06.550004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:06.550818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:06.551272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:06.687041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-19e8adad-6913-4f90-bde2-83c21e730674 req-71797a03-d551-4788-b5fa-6f956e611a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5993418-a92c-4e15-87ac-0f5ef2424768", "name": "network-vif-plugged", "status": "completed", "tag": "a592d7a8-b1cf-4096-b574-f2447197322e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:06.688638 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:06.688638 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:45:06.704673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-19e8adad-6913-4f90-bde2-83c21e730674 req-71797a03-d551-4788-b5fa-6f956e611a36 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:06.705143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-19e8adad-6913-4f90-bde2-83c21e730674 req-71797a03-d551-4788-b5fa-6f956e611a36 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:06.713154 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f595a5a-a19c-45d4-a584-605310f3f69d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.175021 Dec 25 21:45:06.714281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3709/7446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:06 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:06.725429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-19e8adad-6913-4f90-bde2-83c21e730674 req-71797a03-d551-4788-b5fa-6f956e611a36 service nova] Creating event network-vif-plugged:a592d7a8-b1cf-4096-b574-f2447197322e for instance a5993418-a92c-4e15-87ac-0f5ef2424768 on nch2-master-1 Dec 25 21:45:06.731467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-19e8adad-6913-4f90-bde2-83c21e730674 req-71797a03-d551-4788-b5fa-6f956e611a36 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052816 Dec 25 21:45:06.732079 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3738/7447] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:45:07.730681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:07.731321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:07.738212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:07.738678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:07.739496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:07.739950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:07.890527 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f33547c-88c7-4e84-bd01-338082c43ccc tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1463 microversion: 2.1 time: 0.163774 Dec 25 21:45:07.891127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3710/7448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:07 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:08.908151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:08.908859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:08.917198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:08.917655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:08.920751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:08.920751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.177924 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1b3986f-94b1-4682-9c40-8a744ca506ff tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1647 microversion: 2.1 time: 0.273918 Dec 25 21:45:09.178791 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3739/7449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:08 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1647 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:09.196019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:09.196648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:09.204340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.209535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.210445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.210972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.344117 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3614811-ff07-4906-a983-080421e421f1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1647 microversion: 2.1 time: 0.153254 Dec 25 21:45:09.344804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3711/7450] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:09 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1647 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:09.359575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:09.360190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:09.366216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.366673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.367459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.367901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.491785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1a1f28d-7d4d-401a-a1e6-02d29915fa57 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1647 microversion: 2.1 time: 0.135882 Dec 25 21:45:09.492548 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3740/7451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:09 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1647 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:09.508556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:09.509175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:09.515203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.519760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.519760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.519760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.541281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:45:09.724109 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad755d91-361a-4369-9ae2-7f6446a5e2e1 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "DELETE /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 204 len: 0 microversion: 2.1 time: 0.219368 Dec 25 21:45:09.724735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3712/7452] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:45:09 2021] DELETE /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:45:09.732929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:09.733554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:09.740109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.740566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.741374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:09.741823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:09.959094 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-990f302d-d1b0-4655-9265-9916c58a8c55 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1653 microversion: 2.1 time: 0.230044 Dec 25 21:45:09.968622 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3741/7453] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:09 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1653 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:10.976420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:10.977192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:10.983858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:10.984326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:10.985346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:10.985798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:11.115484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dcec13c0-083b-4a85-88d4-8b59243d3de6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1653 microversion: 2.1 time: 0.143563 Dec 25 21:45:11.116062 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3713/7454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:10 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1653 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:11.693965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-63252992-8294-4f34-b087-ddb7ec34b1d9 req-dc8228a5-7498-4801-8e43-c080a4a0ad31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5993418-a92c-4e15-87ac-0f5ef2424768", "name": "network-vif-deleted", "tag": "a592d7a8-b1cf-4096-b574-f2447197322e"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:11.697899 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:11.697899 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:45:11.710223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-63252992-8294-4f34-b087-ddb7ec34b1d9 req-dc8228a5-7498-4801-8e43-c080a4a0ad31 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:11.712185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-63252992-8294-4f34-b087-ddb7ec34b1d9 req-dc8228a5-7498-4801-8e43-c080a4a0ad31 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:11.737172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-63252992-8294-4f34-b087-ddb7ec34b1d9 req-dc8228a5-7498-4801-8e43-c080a4a0ad31 service nova] Creating event network-vif-deleted:a592d7a8-b1cf-4096-b574-f2447197322e for instance a5993418-a92c-4e15-87ac-0f5ef2424768 on nch2-master-1 Dec 25 21:45:11.745212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-63252992-8294-4f34-b087-ddb7ec34b1d9 req-dc8228a5-7498-4801-8e43-c080a4a0ad31 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058052 Dec 25 21:45:11.746664 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3742/7455] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:45:12.136519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:12.137290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:12.147362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:12.147920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:12.149367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:12.149899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:12.204023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:12.204965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:12.210810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lazy-loading 'fault' on Instance uuid a5993418-a92c-4e15-87ac-0f5ef2424768 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:45:12.281094 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9b432781-e45a-4ae4-8259-5d62da25a5a6 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 200 len: 1453 microversion: 2.1 time: 0.151427 Dec 25 21:45:12.282320 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3714/7456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:12 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:13.302688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:13.303388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: a5993418-a92c-4e15-87ac-0f5ef2424768] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:13.309512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:13.309969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:13.310754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:13.311196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:13.325098 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] HTTP exception thrown: Instance a5993418-a92c-4e15-87ac-0f5ef2424768 could not be found. Dec 25 21:45:13.325686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Returning 404 to user: Instance a5993418-a92c-4e15-87ac-0f5ef2424768 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:45:13.326525 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6369e9f0-a747-492b-920b-2606fa446876 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768" status: 404 len: 111 microversion: 2.1 time: 0.029516 Dec 25 21:45:13.327078 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3743/7457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:13 2021] GET /compute/v2.1/servers/a5993418-a92c-4e15-87ac-0f5ef2424768 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:45:13.335282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:13.335803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:13.342754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:13.343243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:13.344018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:13.344473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:13.369132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:45:13.680046 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-202c94c8-d4eb-4091-a31b-476903902a10 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "DELETE /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 204 len: 0 microversion: 2.1 time: 0.348384 Dec 25 21:45:13.680673 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3715/7458] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:45:13 2021] DELETE /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:45:13.688674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:13.689353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:13.695170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:13.695619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:13.696391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:13.696822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:13.824752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ccdcd5a2-917b-425a-a40d-b8f35c77f8f3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1653 microversion: 2.1 time: 0.139635 Dec 25 21:45:13.825483 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3744/7459] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:13 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1653 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:14.842538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:14.843207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:14.850475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:14.850935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:14.851752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:14.852198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:14.995371 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95b8bcd4-4a91-4ed4-bec5-a798d801de5d tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1653 microversion: 2.1 time: 0.156995 Dec 25 21:45:14.995983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3716/7460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:14 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1653 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:15.486347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-29f9003b-2fc3-46a1-9da9-03fb6f495cc4 req-f6cac461-9d3f-4d23-94f7-e1e52480eca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f1c9a4-a882-45a4-8c11-3eaec625deef", "name": "network-vif-deleted", "tag": "969022d6-ccf2-4bce-a499-ff0d103d87ae"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:15.488151 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:15.488151 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:45:15.497569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-29f9003b-2fc3-46a1-9da9-03fb6f495cc4 req-f6cac461-9d3f-4d23-94f7-e1e52480eca5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:15.498018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-29f9003b-2fc3-46a1-9da9-03fb6f495cc4 req-f6cac461-9d3f-4d23-94f7-e1e52480eca5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:15.510307 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-29f9003b-2fc3-46a1-9da9-03fb6f495cc4 req-f6cac461-9d3f-4d23-94f7-e1e52480eca5 service nova] Creating event network-vif-deleted:969022d6-ccf2-4bce-a499-ff0d103d87ae for instance 38f1c9a4-a882-45a4-8c11-3eaec625deef on nch1-master-1 Dec 25 21:45:15.515516 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-29f9003b-2fc3-46a1-9da9-03fb6f495cc4 req-f6cac461-9d3f-4d23-94f7-e1e52480eca5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033349 Dec 25 21:45:15.516204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3745/7461] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:45:16.013447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:16.014103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:16.021784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:16.022248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:16.023668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:16.024123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:16.056007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:16.056480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:16.056979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lazy-loading 'fault' on Instance uuid 38f1c9a4-a882-45a4-8c11-3eaec625deef {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:45:16.103673 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e026f54-57ac-4961-a61a-7f447f9b17a3 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 200 len: 1454 microversion: 2.1 time: 0.094367 Dec 25 21:45:16.104247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3717/7462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:16 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 1454 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:17.121571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:17.122274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] [instance: 38f1c9a4-a882-45a4-8c11-3eaec625deef] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:17.128422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:17.129624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:17.129910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:17.130358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:17.143973 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] HTTP exception thrown: Instance 38f1c9a4-a882-45a4-8c11-3eaec625deef could not be found. Dec 25 21:45:17.144597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] Returning 404 to user: Instance 38f1c9a4-a882-45a4-8c11-3eaec625deef could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:45:17.145979 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6714ddff-35c0-4f6d-a3dd-a6bbf3f4e219 tempest-TestServerMultinode-1634197576 tempest-TestServerMultinode-1634197576-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef" status: 404 len: 111 microversion: 2.1 time: 0.029468 Dec 25 21:45:17.146560 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3746/7463] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:17 2021] GET /compute/v2.1/servers/38f1c9a4-a882-45a4-8c11-3eaec625deef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:45:18.041390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:18.043027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:18.050028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:18.050722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:18.052161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:18.052161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:18.104818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a4c804ba-bca0-42d8-a8a6-7bcb2410eee1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698/action" status: 200 len: 24544 microversion: 2.1 time: 0.067747 Dec 25 21:45:18.106492 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3718/7464] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:45:18 2021] POST /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698/action => generated 24544 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:45:18.695328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:18.696247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:18.704173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:18.704634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:18.705540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:18.705981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:18.760004 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0f9c170-e2af-4f3f-97f1-bfb340a94f45 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580/action" status: 200 len: 24579 microversion: 2.1 time: 0.069250 Dec 25 21:45:18.761462 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3747/7465] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:45:18 2021] POST /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580/action => generated 24579 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:45:25.192757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:25.195565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:25.208779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:25.209266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:25.210078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:25.210521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:25.324528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:45:25.325153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:45:25.325754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:45:25.326445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:45:25.327123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:45:25.641554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:25.662062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:25.662533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:25.663599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:25.664547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:25.700661 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a01cd92-cab1-4902-8ee2-b3a605eebbea tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580/action" status: 202 len: 1137 microversion: 2.1 time: 0.512632 Dec 25 21:45:25.701870 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3719/7466] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:45:25 2021] POST /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580/action => generated 1137 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Dec 25 21:45:25.718791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:25.720504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:25.730134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:25.730598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:25.731416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:25.731853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:26.376902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:26.384892 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e46e9fdd-d19b-4ca1-931f-cc917f57fec9 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.671340 Dec 25 21:45:26.385495 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3748/7467] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:25 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:27.408126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:27.408806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:27.436040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:27.440615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:27.441945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:27.442669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:27.702949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:27.710935 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa38c0d4-ce87-4603-b9d3-26e28b15711e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.308603 Dec 25 21:45:27.711828 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3720/7468] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:27 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:28.730157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:28.730934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:28.739895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:28.740364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:28.741187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:28.741843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:29.026263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:29.041737 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a4206d8-865b-46f8-8683-4a6cd82dfd8b tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.315366 Dec 25 21:45:29.043639 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3749/7469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:28 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:30.059556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:30.060274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:30.067508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:30.067982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:30.069009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:30.069263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:30.270379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:30.278058 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-05bef43a-b3c7-4e60-8e28-89661f0fb261 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.222262 Dec 25 21:45:30.278633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3721/7470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:30 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:45:31.296220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:31.297307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:31.305006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:31.305503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:31.306457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:31.306895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:31.446536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:31.454143 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-145def4f-e2b7-45c2-9e27-56cddb7110b4 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.162457 Dec 25 21:45:31.454741 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3750/7471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:31 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:32.474475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:32.475197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:32.484904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:32.485383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:32.486182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:32.486797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:32.712850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:32.721501 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50a49d3a-6b25-4fec-9c17-18a5d7be3494 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.253791 Dec 25 21:45:32.732000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3722/7472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:32 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:33.569016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7210b91e-49f2-4038-a7f4-27e45a19f3a1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'create', calling method: .version_select at 0x7fa4f6e33700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1752476192"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:33.584171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7210b91e-49f2-4038-a7f4-27e45a19f3a1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:45:33.589255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7210b91e-49f2-4038-a7f4-27e45a19f3a1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:45:33.742122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:33.743910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:33.756148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:33.759044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:33.759044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:33.759564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:33.977414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7210b91e-49f2-4038-a7f4-27e45a19f3a1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:45:33.995580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7210b91e-49f2-4038-a7f4-27e45a19f3a1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:45:34.043014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7210b91e-49f2-4038-a7f4-27e45a19f3a1 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2313 microversion: 2.1 time: 0.477780 Dec 25 21:45:34.044331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3751/7473] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:45:33 2021] POST /compute/v2.1/os-keypairs => generated 2313 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:34.062468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:34.080124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4180ab2b-b232-4b8e-8cbf-da2fc225eb72 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.344768 Dec 25 21:45:34.083203 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3723/7474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:33 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:35.100021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:35.100647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:35.108575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:35.110038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:35.110880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:35.111498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:35.763069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:35.771732 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-67ff5ce4-3737-4a48-8f00-575eba088577 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.676829 Dec 25 21:45:35.776460 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3752/7475] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:35 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:36.634248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-648640501", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "f1a6977d-3def-4e23-a153-6f3c49896da2"}], "key_name": "tempest-TestNetworkBasicOps-1752476192", "security_groups": [{"name": "tempest-secgroup-smoke-1680329694"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:36.751478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] validate_networks() for [('f1a6977d-3def-4e23-a153-6f3c49896da2', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:45:36.790774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:36.791307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:36.798158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:36.798641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:36.799414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:36.799862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:37.102325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:37.110222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e387d4a8-2dfa-444b-ae60-082899137b99 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1690 microversion: 2.1 time: 0.323159 Dec 25 21:45:37.119685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3753/7476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:36 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1690 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:45:37.329190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:45:37.329636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:45:37.330129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:45:37.330558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:45:37.330987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:45:37.340570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:37.341071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:37.341905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:37.342571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:37.359133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:45:37.365127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:45:37.379775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:45:37.382171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:45:37.493866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb0424aa-4082-43b1-b35d-dd86c556d975 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.863544 Dec 25 21:45:37.495395 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3724/7477] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:45:36 2021] POST /compute/v2.1/servers => generated 406 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:45:37.505193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6f462f3-7ba3-441b-a229-5766e99af624 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:37.505809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6f462f3-7ba3-441b-a229-5766e99af624 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:37.565769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6f462f3-7ba3-441b-a229-5766e99af624 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:37.575841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6f462f3-7ba3-441b-a229-5766e99af624 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1248 microversion: 2.1 time: 0.072155 Dec 25 21:45:37.576963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3754/7478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:37 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1248 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:38.128068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:38.128783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:38.135413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:38.136136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:38.136951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:38.137402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:38.337421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:38.345410 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b5d4b90b-0adc-43a0-bfbf-c1620d9512e1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1696 microversion: 2.1 time: 0.221784 Dec 25 21:45:38.346401 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3725/7479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:38 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:38.596467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:38.597261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:38.605521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:38.609664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:38.609664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:38.609664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:38.678519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:38.686396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7b590492-b210-423d-a768-3a417a96ce09 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1244 microversion: 2.1 time: 0.093702 Dec 25 21:45:38.686981 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3755/7480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:38 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1244 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:39.364472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:39.365133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:39.372744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:39.373248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:39.374099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:39.374985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:39.587344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:39.596574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a97c6e5-75a3-4ff5-8446-d1bc21ed2db1 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1696 microversion: 2.1 time: 0.236855 Dec 25 21:45:39.606540 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3726/7481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:39 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:45:39.703384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:39.704592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:39.712901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:39.713511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:39.715022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:39.715819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:39.780564 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:39.788331 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52741804-bf92-47e5-9083-bf1d3f397186 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1306 microversion: 2.1 time: 0.088759 Dec 25 21:45:39.788936 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3756/7482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:39 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:40.616136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:40.619071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:40.628253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:40.630071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:40.631895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:40.632920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:40.808448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:40.809096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:40.816853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:40.817343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:40.818168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:40.818653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:40.935245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:40.943097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-76c2a802-80c7-40a2-acf7-f047c09a408f tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1681 microversion: 2.1 time: 0.332232 Dec 25 21:45:40.945212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3727/7483] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:40 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1681 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:41.145651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:41.145651 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c2404b3-0d9a-402d-b425-6c30991c6d73 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.331093 Dec 25 21:45:41.145651 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3757/7484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:40 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:41.623072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-18afb8de-efbf-4ab2-99b5-354caf8dcda2 req-42ec609f-5752-419b-8e26-12480c9cf079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2", "tag": "66acadc7-3f01-428d-a25b-65c62613059b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:41.625266 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:41.625266 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:45:41.638094 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-18afb8de-efbf-4ab2-99b5-354caf8dcda2 req-42ec609f-5752-419b-8e26-12480c9cf079 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:41.638560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-18afb8de-efbf-4ab2-99b5-354caf8dcda2 req-42ec609f-5752-419b-8e26-12480c9cf079 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:41.659989 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-18afb8de-efbf-4ab2-99b5-354caf8dcda2 req-42ec609f-5752-419b-8e26-12480c9cf079 service nova] Creating event network-changed:66acadc7-3f01-428d-a25b-65c62613059b for instance b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 on nch1-master-1 Dec 25 21:45:41.667169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-18afb8de-efbf-4ab2-99b5-354caf8dcda2 req-42ec609f-5752-419b-8e26-12480c9cf079 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047636 Dec 25 21:45:41.668569 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3728/7485] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:45:42.160865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:42.161729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:42.169875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:42.170331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:42.171372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:42.171819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:42.357184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:42.367796 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00e77086-cbb6-499e-ab50-88cd492dca6d tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.210625 Dec 25 21:45:42.368624 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3758/7486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:42 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:42.474436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-de50bff7-7133-40da-b2f6-2d34accceab2 req-3d8acd9c-7665-4fc3-a99b-8068ca6eabc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232caa59-01ee-4a0a-ad80-4a2406c77580", "name": "network-vif-plugged", "status": "completed", "tag": "22c8730d-1fe0-40bd-b7c2-cd3f15f4b816"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:42.476675 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:42.476675 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:45:42.488915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-de50bff7-7133-40da-b2f6-2d34accceab2 req-3d8acd9c-7665-4fc3-a99b-8068ca6eabc0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:42.489659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-de50bff7-7133-40da-b2f6-2d34accceab2 req-3d8acd9c-7665-4fc3-a99b-8068ca6eabc0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:42.502858 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-de50bff7-7133-40da-b2f6-2d34accceab2 req-3d8acd9c-7665-4fc3-a99b-8068ca6eabc0 service nova] Creating event network-vif-plugged:22c8730d-1fe0-40bd-b7c2-cd3f15f4b816 for instance 232caa59-01ee-4a0a-ad80-4a2406c77580 on nch2-master-1 Dec 25 21:45:42.510117 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-de50bff7-7133-40da-b2f6-2d34accceab2 req-3d8acd9c-7665-4fc3-a99b-8068ca6eabc0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040365 Dec 25 21:45:42.511600 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3729/7487] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:45:43.386020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:43.386477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:43.393179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:43.393625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:43.394451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:43.394889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:43.540529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:43.547981 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04a3448d-110e-4e64-b2b5-476aa2b5b364 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.166396 Dec 25 21:45:43.551942 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3759/7488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:43 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:44.566952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:44.567604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:44.574352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:44.574829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:44.575664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:44.576124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:44.734373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:44.741910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a84c3c52-bc68-4c8f-8360-7ba6b05625c5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.180378 Dec 25 21:45:44.742486 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3730/7489] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:44 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:45.759034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:45.759748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:45.766868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:45.772179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:45.772179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:45.772179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:45.926891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:45.934327 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad18a8a2-c949-4747-8c63-7a39f918ae27 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.179023 Dec 25 21:45:45.934964 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3760/7490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:45 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:46.955841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:46.956846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:46.965541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:46.966042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:46.967379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:46.967946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:47.133840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:47.146166 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe0ca31d-bbc8-4ca1-afa1-abed599d8b72 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.194040 Dec 25 21:45:47.155430 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3731/7491] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:46 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:48.162357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:48.162979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:48.170017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:48.170472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:48.171262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:48.171705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:48.312045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:48.321535 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2f34e0b7-9f3b-46f6-8af3-2213b80487c3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.162851 Dec 25 21:45:48.322308 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3761/7492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:48 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:48.648509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7802b37f-cd0b-46e1-8c51-bf8c6410c9e2 req-e259b4d0-06c5-404e-b780-804f21dcfce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2", "name": "network-vif-plugged", "status": "completed", "tag": "66acadc7-3f01-428d-a25b-65c62613059b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:45:48.650075 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:45:48.650075 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:45:48.657659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7802b37f-cd0b-46e1-8c51-bf8c6410c9e2 req-e259b4d0-06c5-404e-b780-804f21dcfce2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:48.658300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7802b37f-cd0b-46e1-8c51-bf8c6410c9e2 req-e259b4d0-06c5-404e-b780-804f21dcfce2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:48.669330 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7802b37f-cd0b-46e1-8c51-bf8c6410c9e2 req-e259b4d0-06c5-404e-b780-804f21dcfce2 service nova] Creating event network-vif-plugged:66acadc7-3f01-428d-a25b-65c62613059b for instance b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 on nch1-master-1 Dec 25 21:45:48.674307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7802b37f-cd0b-46e1-8c51-bf8c6410c9e2 req-e259b4d0-06c5-404e-b780-804f21dcfce2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029804 Dec 25 21:45:48.674954 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3732/7493] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:45:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:45:49.338142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:49.341524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:49.345867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:49.346314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:49.347097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:49.347594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:49.480979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:49.489140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e732769-d50d-4008-a239-cc3fcdcdbb21 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1374 microversion: 2.1 time: 0.154676 Dec 25 21:45:49.489767 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3762/7494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:49 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:50.507529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:50.508246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:50.514521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:50.514991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:50.515793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:50.516250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:50.657005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:50.664762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ba7f69ad-b564-4759-9e6a-8ceb4bf40eef tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1547 microversion: 2.1 time: 0.162644 Dec 25 21:45:50.665572 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3733/7495] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:50 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:45:50.684044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:45:50.684657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:45:50.691829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:50.692278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:50.693112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:45:50.693598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:45:50.841477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:45:50.850946 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-795bd7ef-69fc-4513-9b7b-ae8741bca798 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1547 microversion: 2.1 time: 0.170511 Dec 25 21:45:50.852527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3763/7496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:45:50 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1547 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:05.170403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:05.171243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:05.177798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:05.178258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:05.179085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:05.179534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:05.230690 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-89b79ee9-6c7b-40da-94c4-0ff5bcce8066 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "POST /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580/action" status: 200 len: 24575 microversion: 2.1 time: 0.064156 Dec 25 21:46:05.231313 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3734/7497] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:46:05 2021] POST /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580/action => generated 24575 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:46:15.037322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:15.039307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:15.044483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:15.045018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:15.045787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:15.046336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:15.086917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:46:15.422217 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c909527f-06e0-42fe-87f0-aa1008cc5fa5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "DELETE /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 204 len: 0 microversion: 2.1 time: 0.388517 Dec 25 21:46:15.426740 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3764/7498] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:46:15 2021] DELETE /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:46:15.438399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:15.438399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:15.450454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:15.450922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:15.451737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:15.452187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:15.610681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:15.619366 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-be2737fa-78f6-4dbd-9671-82b630b126d8 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1553 microversion: 2.1 time: 0.191523 Dec 25 21:46:15.620922 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3735/7499] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:15 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1553 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:46:16.638227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:16.638843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:16.646122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:16.646574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:16.647377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:16.647812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:17.110932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:17.122185 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c8df539b-1580-4369-b131-4ca5ae3a3460 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1553 microversion: 2.1 time: 0.488954 Dec 25 21:46:17.122974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3765/7500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:16 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1553 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:17.807295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3f8514c0-95e4-40f5-b2ff-9af4cb286037 req-747be542-972c-4fa2-bcd1-9f88c6418f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2", "name": "network-vif-deleted", "tag": "66acadc7-3f01-428d-a25b-65c62613059b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:17.810676 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:17.810676 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:46:17.823888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3f8514c0-95e4-40f5-b2ff-9af4cb286037 req-747be542-972c-4fa2-bcd1-9f88c6418f8c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:17.824685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3f8514c0-95e4-40f5-b2ff-9af4cb286037 req-747be542-972c-4fa2-bcd1-9f88c6418f8c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:17.841022 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3f8514c0-95e4-40f5-b2ff-9af4cb286037 req-747be542-972c-4fa2-bcd1-9f88c6418f8c service nova] Creating event network-vif-deleted:66acadc7-3f01-428d-a25b-65c62613059b for instance b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 on nch1-master-1 Dec 25 21:46:17.847097 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3f8514c0-95e4-40f5-b2ff-9af4cb286037 req-747be542-972c-4fa2-bcd1-9f88c6418f8c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043527 Dec 25 21:46:17.847951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3736/7501] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:17.888302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:17.889999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:17.898491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:17.899531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:17.900536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:17.901011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:17.931006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:46:18.142252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:18.150573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:18.156358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:18.157191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:18.160116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:18.160802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:18.205088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:18.205561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:18.206037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lazy-loading 'fault' on Instance uuid b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:46:18.244460 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44ac8fba-eb42-4aa1-8b6d-15b0a0aa53c0 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 204 len: 0 microversion: 2.1 time: 0.361200 Dec 25 21:46:18.249111 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3766/7502] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:46:17 2021] DELETE /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:46:18.251524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:18.255743 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:18.256672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:18.261032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49f7a9dd-d769-46be-9fb9-1f249e82532c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 200 len: 1338 microversion: 2.1 time: 0.123932 Dec 25 21:46:18.262326 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3737/7503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:18 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 1338 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:18.272131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:18.272826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:18.273951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:18.274590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:18.423880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:18.440679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e767689-2619-4b04-b3d3-84663ebfd9dd tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1687 microversion: 2.1 time: 0.190273 Dec 25 21:46:18.441315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3767/7504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:18 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1687 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:19.278777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:19.279438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:19.286165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:19.286632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:19.287433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:19.287885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:19.301977 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] HTTP exception thrown: Instance b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 could not be found. Dec 25 21:46:19.302578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Returning 404 to user: Instance b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:46:19.303412 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-27cbcd65-ea5f-4a7a-8dec-7f2a23c595f9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2" status: 404 len: 111 microversion: 2.1 time: 0.028910 Dec 25 21:46:19.303946 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3738/7505] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:19 2021] GET /compute/v2.1/servers/b654e6c8-61ba-4a1e-bf0b-190bcd6f39c2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:46:19.458651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:19.459834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:19.467446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:19.467904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:19.468699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:19.469166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:19.512625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a2680c7b-a857-4f90-9570-774a3d306f02 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '.version_select at 0x7fa4f458f430>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:19.582372 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a2680c7b-a857-4f90-9570-774a3d306f02 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1752476192" status: 202 len: 0 microversion: 2.1 time: 0.074052 Dec 25 21:46:19.582994 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3739/7506] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:46:19 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1752476192 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:46:19.645255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:19.654878 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e1ceaf7b-ca00-493c-9cf2-7bf92e2c850e tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1687 microversion: 2.1 time: 0.199921 Dec 25 21:46:19.655851 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3768/7507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:19 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:19.881257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a0a05c45-4015-40f3-98ba-ce42904927d2 req-3cc03f38-8221-4a86-a911-3827d71d1272 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "232caa59-01ee-4a0a-ad80-4a2406c77580", "tag": "22c8730d-1fe0-40bd-b7c2-cd3f15f4b816"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:19.883077 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:19.883077 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:46:19.891422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a0a05c45-4015-40f3-98ba-ce42904927d2 req-3cc03f38-8221-4a86-a911-3827d71d1272 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:19.892005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a0a05c45-4015-40f3-98ba-ce42904927d2 req-3cc03f38-8221-4a86-a911-3827d71d1272 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:19.903857 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a0a05c45-4015-40f3-98ba-ce42904927d2 req-3cc03f38-8221-4a86-a911-3827d71d1272 service nova] Creating event network-changed:22c8730d-1fe0-40bd-b7c2-cd3f15f4b816 for instance 232caa59-01ee-4a0a-ad80-4a2406c77580 on nch2-master-1 Dec 25 21:46:19.909158 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a0a05c45-4015-40f3-98ba-ce42904927d2 req-3cc03f38-8221-4a86-a911-3827d71d1272 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031694 Dec 25 21:46:19.910065 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3740/7508] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:20.673963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:20.674655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:20.683075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:20.683689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:20.684736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:20.685215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:20.761413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01a07fc3a154483caea95cbd449f3970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ff29c23c5844f45826a02b6ae6b65e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:20.769214 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-072e2a51-2a92-42d2-a93b-4ec43cf23614 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 200 len: 1350 microversion: 2.1 time: 0.099971 Dec 25 21:46:20.769933 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3769/7509] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:20 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:21.707547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:21.708145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:21.715866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:21.720228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:21.720228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:21.720228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:21.743806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:46:21.787118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:21.787779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] [instance: 232caa59-01ee-4a0a-ad80-4a2406c77580] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:21.794847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:21.800620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:21.800620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:21.800620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:21.814310 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] HTTP exception thrown: Instance 232caa59-01ee-4a0a-ad80-4a2406c77580 could not be found. Dec 25 21:46:21.814998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Returning 404 to user: Instance 232caa59-01ee-4a0a-ad80-4a2406c77580 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:46:21.815907 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-27e58e5e-8fc0-4de8-8afb-bbd77ed10c60 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580" status: 404 len: 111 microversion: 2.1 time: 0.032598 Dec 25 21:46:21.816551 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3770/7510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:21 2021] GET /compute/v2.1/servers/232caa59-01ee-4a0a-ad80-4a2406c77580 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:46:21.931175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f6cb6e1b-5032-4ea7-97d4-31b7fc704f9e req-a81e3eb4-eacf-4742-ad88-d5d2762867dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "232caa59-01ee-4a0a-ad80-4a2406c77580", "name": "network-vif-deleted", "tag": "22c8730d-1fe0-40bd-b7c2-cd3f15f4b816"}, {"name": "network-changed", "server_uuid": "725062b3-9301-4599-9aba-de15e6198698", "tag": "46007bab-bd9e-4282-97d5-2a4cf51e9186"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:21.932935 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:21.932935 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:46:21.941739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f6cb6e1b-5032-4ea7-97d4-31b7fc704f9e req-a81e3eb4-eacf-4742-ad88-d5d2762867dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:21.942428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f6cb6e1b-5032-4ea7-97d4-31b7fc704f9e req-a81e3eb4-eacf-4742-ad88-d5d2762867dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:21.968205 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f6cb6e1b-5032-4ea7-97d4-31b7fc704f9e req-a81e3eb4-eacf-4742-ad88-d5d2762867dc service nova] Creating event network-vif-deleted:22c8730d-1fe0-40bd-b7c2-cd3f15f4b816 for instance 232caa59-01ee-4a0a-ad80-4a2406c77580 on nch2-master-1 Dec 25 21:46:21.968820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f6cb6e1b-5032-4ea7-97d4-31b7fc704f9e req-a81e3eb4-eacf-4742-ad88-d5d2762867dc service nova] Creating event network-changed:46007bab-bd9e-4282-97d5-2a4cf51e9186 for instance 725062b3-9301-4599-9aba-de15e6198698 on nch2-master-1 Dec 25 21:46:21.976058 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f6cb6e1b-5032-4ea7-97d4-31b7fc704f9e req-a81e3eb4-eacf-4742-ad88-d5d2762867dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048776 Dec 25 21:46:21.977480 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3771/7511] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:21 2021] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:46:22.091247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e58ae692-82b3-4ae5-be8e-e8f80d53ac69 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "DELETE /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 204 len: 0 microversion: 2.1 time: 0.387219 Dec 25 21:46:22.095281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3741/7512] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:46:21 2021] DELETE /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:46:22.101217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:22.101931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:22.115124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:22.116198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:22.117216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:22.118144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:22.653320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:22.661427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7caa6bda-fb74-481a-be18-8e838a3a114b tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1670 microversion: 2.1 time: 0.564434 Dec 25 21:46:22.662018 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3772/7513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:22 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1670 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:23.679138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:23.693430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:23.702131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:23.702599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:23.703615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:23.704238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:24.109923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:24.119208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b40d9ac3-37b5-4917-b84a-560333a6b007 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1551 microversion: 2.1 time: 0.443563 Dec 25 21:46:24.120309 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3742/7514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:23 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1551 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:24.427505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-1d045adb-478d-4400-9d63-86c2a908a7b3 req-b314124c-4cbf-451d-b0c7-86da570fe7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725062b3-9301-4599-9aba-de15e6198698", "name": "network-vif-deleted", "tag": "46007bab-bd9e-4282-97d5-2a4cf51e9186"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:24.429908 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:24.429908 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:46:24.438185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1d045adb-478d-4400-9d63-86c2a908a7b3 req-b314124c-4cbf-451d-b0c7-86da570fe7f3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:24.440915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-1d045adb-478d-4400-9d63-86c2a908a7b3 req-b314124c-4cbf-451d-b0c7-86da570fe7f3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:24.450945 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-1d045adb-478d-4400-9d63-86c2a908a7b3 req-b314124c-4cbf-451d-b0c7-86da570fe7f3 service nova] Creating event network-vif-deleted:46007bab-bd9e-4282-97d5-2a4cf51e9186 for instance 725062b3-9301-4599-9aba-de15e6198698 on nch2-master-1 Dec 25 21:46:24.457815 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-1d045adb-478d-4400-9d63-86c2a908a7b3 req-b314124c-4cbf-451d-b0c7-86da570fe7f3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034818 Dec 25 21:46:24.458602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3773/7515] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:25.136548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:25.137564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:25.146508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:25.146993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:25.148044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:25.148927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:25.185564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:25.186032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:25.186499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lazy-loading 'fault' on Instance uuid 725062b3-9301-4599-9aba-de15e6198698 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:46:25.232364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:25.244652 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-872ec886-2d04-406e-96af-dd137a19cfc3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 200 len: 1338 microversion: 2.1 time: 0.112752 Dec 25 21:46:25.245951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3743/7516] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:25 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:26.263775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:26.264667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 725062b3-9301-4599-9aba-de15e6198698] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:26.271809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:26.272270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:26.273198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:26.273648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:26.288730 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] HTTP exception thrown: Instance 725062b3-9301-4599-9aba-de15e6198698 could not be found. Dec 25 21:46:26.289510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Returning 404 to user: Instance 725062b3-9301-4599-9aba-de15e6198698 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:46:26.290529 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd944e62-acff-49a9-ba93-4fd022c712b7 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698" status: 404 len: 111 microversion: 2.1 time: 0.031967 Dec 25 21:46:26.291110 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3774/7517] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:26 2021] GET /compute/v2.1/servers/725062b3-9301-4599-9aba-de15e6198698 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:46:26.538063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0fb6818c-c502-4044-b6f7-efc93e838bb9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '.version_select at 0x7fa4f705fb80>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:26.605902 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0fb6818c-c502-4044-b6f7-efc93e838bb9 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1576790326" status: 202 len: 0 microversion: 2.1 time: 0.073289 Dec 25 21:46:26.606902 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3744/7518] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:46:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1576790326 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:46:26.672427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-106b33ba-4e93-4424-8b8a-a8cd63da14a8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] Calling method '.version_select at 0x7fa4f68f1ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:26.731581 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-106b33ba-4e93-4424-8b8a-a8cd63da14a8 tempest-TestNetworkAdvancedServerOps-363262253 tempest-TestNetworkAdvancedServerOps-363262253-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-521467149" status: 202 len: 0 microversion: 2.1 time: 0.062961 Dec 25 21:46:26.732058 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3775/7519] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 21:46:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-521467149 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:46:38.899161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7dd3cb6e-93d6-4795-9151-02a9667cd6fa tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'create', calling method: .version_select at 0x7fa4f45c9820>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1383172959"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:38.923638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7dd3cb6e-93d6-4795-9151-02a9667cd6fa tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:38.929768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7dd3cb6e-93d6-4795-9151-02a9667cd6fa tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:39.249386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7dd3cb6e-93d6-4795-9151-02a9667cd6fa tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:39.256160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-7dd3cb6e-93d6-4795-9151-02a9667cd6fa tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:39.272995 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7dd3cb6e-93d6-4795-9151-02a9667cd6fa tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.381207 Dec 25 21:46:39.273857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3745/7520] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:46:38 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:46:42.830936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1881914191", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "b86c27f6-7fc3-454a-afbf-75e25c82b4a6"}], "key_name": "tempest-TestNetworkBasicOps-1383172959", "security_groups": [{"name": "tempest-secgroup-smoke-1946809630"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:43.120330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] validate_networks() for [('b86c27f6-7fc3-454a-afbf-75e25c82b4a6', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:46:43.721000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:46:43.721485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:46:43.722434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:46:43.722929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:46:43.723356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:46:43.744014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:43.744517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:43.746093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:43.746831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:43.778995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:43.786976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Getting quotas for user 71846607489941c5a65d9a3648c6c7d9 and project 59ed9da8ed224ce9b429cb4c633a2498. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:43.804298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:46:43.813425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:46:43.959341 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b223edd-db00-40e8-a6bd-d5a8dbc127a3 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.133106 Dec 25 21:46:43.960172 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3776/7521] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:46:42 2021] POST /compute/v2.1/servers => generated 406 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:46:43.976613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-277ecb9f-9d1d-4dda-a0c9-860e717259f2 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:43.977322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-277ecb9f-9d1d-4dda-a0c9-860e717259f2 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:44.105934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-277ecb9f-9d1d-4dda-a0c9-860e717259f2 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:44.115123 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-277ecb9f-9d1d-4dda-a0c9-860e717259f2 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1249 microversion: 2.1 time: 0.147096 Dec 25 21:46:44.127969 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3746/7522] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:43 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1249 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:45.132210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-64236e7c-bddd-4233-be42-2537a845b686 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:45.132831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-64236e7c-bddd-4233-be42-2537a845b686 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:45.210600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-64236e7c-bddd-4233-be42-2537a845b686 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:45.225479 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-64236e7c-bddd-4233-be42-2537a845b686 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1249 microversion: 2.1 time: 0.097371 Dec 25 21:46:45.226083 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3747/7523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:45 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:46:45.259273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-46ab3e04-a181-4acf-baa5-bbc9aac48954 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Action: 'create', calling method: .version_select at 0x7fa4f696a700>, body: {"keypair": {"name": "tempest-TestServerBasicOps-2133928421"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:45.276139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-46ab3e04-a181-4acf-baa5-bbc9aac48954 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for project 64e4751d74674097b87a3ad1c686e9e5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:45.282792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-46ab3e04-a181-4acf-baa5-bbc9aac48954 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for user f61753173a4d493ba1f1f3174c35f83e and project 64e4751d74674097b87a3ad1c686e9e5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:45.632924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-46ab3e04-a181-4acf-baa5-bbc9aac48954 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for project 64e4751d74674097b87a3ad1c686e9e5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:45.639334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-46ab3e04-a181-4acf-baa5-bbc9aac48954 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for user f61753173a4d493ba1f1f3174c35f83e and project 64e4751d74674097b87a3ad1c686e9e5. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:45.655684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-46ab3e04-a181-4acf-baa5-bbc9aac48954 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.623267 Dec 25 21:46:45.656679 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3777/7524] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:46:45 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:46.250528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:46.252589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:46.261472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:46.262492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:46.263564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:46.264901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:46.412688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:46.423311 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c55f43a7-2271-4d5b-b8d8-e94d96e26ccc tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1309 microversion: 2.1 time: 0.183860 Dec 25 21:46:46.425562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3748/7525] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:46 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1309 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:47.442490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:47.443104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:47.464661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:47.465562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:47.472606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:47.472606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:48.100809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:48.109687 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0735425f-2131-4480-9fe9-e049e233d7ad tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.671398 Dec 25 21:46:48.110591 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3778/7526] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:47 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:48.177503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-954390833", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-2133928421", "security_groups": [{"name": "tempest-secgroup-smoke-413136042"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "a4c0b0f2-b6e6-4cd5-b432-998e4080be8f"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:48.281765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] validate_networks() for [('a4c0b0f2-b6e6-4cd5-b432-998e4080be8f', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:46:48.855999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7f87ed76-0b2a-451d-952d-4d2676f830fd req-80f12d31-9d8c-4fc1-b5ef-1b3371e32476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7f03-246c-42e8-a86b-736db9813ce7", "tag": "3fdfb8ce-2c32-49bd-9593-d3fefa5133f4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:48.857718 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:48.857718 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:46:48.877076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7f87ed76-0b2a-451d-952d-4d2676f830fd req-80f12d31-9d8c-4fc1-b5ef-1b3371e32476 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:48.877754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7f87ed76-0b2a-451d-952d-4d2676f830fd req-80f12d31-9d8c-4fc1-b5ef-1b3371e32476 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:48.896093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for project 64e4751d74674097b87a3ad1c686e9e5. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:48.908275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7f87ed76-0b2a-451d-952d-4d2676f830fd req-80f12d31-9d8c-4fc1-b5ef-1b3371e32476 service nova] Creating event network-changed:3fdfb8ce-2c32-49bd-9593-d3fefa5133f4 for instance 574a7f03-246c-42e8-a86b-736db9813ce7 on nch1-master-1 Dec 25 21:46:48.908523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for user f61753173a4d493ba1f1f3174c35f83e and project 64e4751d74674097b87a3ad1c686e9e5. Resources: dict_keys(['metadata_items']) {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:48.914127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7f87ed76-0b2a-451d-952d-4d2676f830fd req-80f12d31-9d8c-4fc1-b5ef-1b3371e32476 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061965 Dec 25 21:46:48.915371 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3779/7527] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:48.926203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:46:48.931411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:46:48.931990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:46:48.932423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:46:48.932863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:46:48.953633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:48.954370 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:48.955421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:48.955880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:48.977852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for project 64e4751d74674097b87a3ad1c686e9e5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:46:48.984351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Getting quotas for user f61753173a4d493ba1f1f3174c35f83e and project 64e4751d74674097b87a3ad1c686e9e5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:46:49.006677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:46:49.010462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:46:49.127460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:49.128370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:49.136448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:49.142502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:49.143794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:49.144466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:49.157297 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c1bc980-7b82-49c6-9580-5c21532a175b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.982934 Dec 25 21:46:49.159448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3749/7528] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:46:48 2021] POST /compute/v2.1/servers => generated 405 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:46:49.185554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c15581f-cd35-443b-a7cb-d0339dadb4ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:49.187600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c15581f-cd35-443b-a7cb-d0339dadb4ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:49.286832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c15581f-cd35-443b-a7cb-d0339dadb4ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:49.297314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c15581f-cd35-443b-a7cb-d0339dadb4ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1302 microversion: 2.1 time: 0.130925 Dec 25 21:46:49.298283 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3750/7529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:49 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1302 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:49.439288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:49.448279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ce5dada-6f0f-42cc-acb8-7874e53f44b5 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.324921 Dec 25 21:46:49.448893 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3780/7530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:49 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:46:50.316536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:50.317301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:50.325640 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:50.326202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:50.327085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:50.327610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:50.391270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:50.398969 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c26ed67-b48f-467a-82ab-769eb7608139 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1306 microversion: 2.1 time: 0.086630 Dec 25 21:46:50.399543 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3751/7531] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:50 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1306 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:50.465449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:50.465985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:50.473309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:50.473769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:50.474700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:50.475146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:50.647879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:50.655962 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b66ff5c-4c56-40ad-803d-e125bb0fa034 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.194611 Dec 25 21:46:50.659300 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3781/7532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:50 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:51.417255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:51.418503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:51.427308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:51.427974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:51.429089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:51.430239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:51.560946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:51.570042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c89c849c-a7a6-42e6-864d-ab184ff1b89f tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1372 microversion: 2.1 time: 0.158073 Dec 25 21:46:51.581234 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3752/7533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:51 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:51.673943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:51.675288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:51.682439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:51.682899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:51.683713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:51.684580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:51.963249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:51.974577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51477d87-818d-4cd6-a31d-60aee24bc8b6 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.304002 Dec 25 21:46:51.984470 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3782/7534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:51 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:52.588061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:52.588699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:52.595843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:52.596319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:52.597196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:52.597649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:52.846767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:52.858029 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c5bdb64-a402-46e5-a902-3c78d5a9a70a tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.273942 Dec 25 21:46:52.864252 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3753/7535] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:52 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:52.991559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:52.992172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:52.999898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:53.000574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:53.001520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:53.002069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:53.243490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:53.255473 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07ddf578-a6c9-40b5-91fd-e37a72d00a37 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.266830 Dec 25 21:46:53.263595 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3783/7536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:52 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:53.481275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3b2dfef0-9790-42d2-87f0-431de9fc53a3 req-06a01262-a17a-434c-8137-da6cab194abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb", "tag": "931bea7a-4cb4-461c-951d-5f999f37574b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:53.486373 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:53.486373 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:46:53.490316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3b2dfef0-9790-42d2-87f0-431de9fc53a3 req-06a01262-a17a-434c-8137-da6cab194abd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:53.490969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3b2dfef0-9790-42d2-87f0-431de9fc53a3 req-06a01262-a17a-434c-8137-da6cab194abd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:53.510765 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3b2dfef0-9790-42d2-87f0-431de9fc53a3 req-06a01262-a17a-434c-8137-da6cab194abd service nova] Creating event network-changed:931bea7a-4cb4-461c-951d-5f999f37574b for instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb on nch2-master-1 Dec 25 21:46:53.516324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3b2dfef0-9790-42d2-87f0-431de9fc53a3 req-06a01262-a17a-434c-8137-da6cab194abd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039417 Dec 25 21:46:53.517677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3754/7537] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:53.878396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:53.879008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:53.886299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:53.886923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:53.887725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:53.888156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:54.090627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:54.101062 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba994b72-51dd-4243-9d99-12382f501459 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.223885 Dec 25 21:46:54.101062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3784/7538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:53 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:54.278914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:54.279668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:54.287134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:54.287604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:54.288414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:54.288899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:54.429642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:54.437792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-38b3090b-3c37-4c9a-88ef-07a736d64b4f tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.163007 Dec 25 21:46:54.438382 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3755/7539] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:54 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:55.030181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a0235224-01ba-4f4a-a31e-5316aec8ea7f req-ee2a6556-263c-4cf7-b896-65e62d684fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a7f03-246c-42e8-a86b-736db9813ce7", "name": "network-vif-plugged", "status": "completed", "tag": "3fdfb8ce-2c32-49bd-9593-d3fefa5133f4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:55.031789 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:55.031789 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:46:55.039346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a0235224-01ba-4f4a-a31e-5316aec8ea7f req-ee2a6556-263c-4cf7-b896-65e62d684fac service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:55.039802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a0235224-01ba-4f4a-a31e-5316aec8ea7f req-ee2a6556-263c-4cf7-b896-65e62d684fac service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:55.052942 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a0235224-01ba-4f4a-a31e-5316aec8ea7f req-ee2a6556-263c-4cf7-b896-65e62d684fac service nova] Creating event network-vif-plugged:3fdfb8ce-2c32-49bd-9593-d3fefa5133f4 for instance 574a7f03-246c-42e8-a86b-736db9813ce7 on nch1-master-1 Dec 25 21:46:55.063662 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a0235224-01ba-4f4a-a31e-5316aec8ea7f req-ee2a6556-263c-4cf7-b896-65e62d684fac service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093858 Dec 25 21:46:55.063662 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3785/7540] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:55.114851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:55.115485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:55.122131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:55.122593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:55.123392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:55.123845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:55.293669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:55.301049 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c05426c7-f942-4f1e-9b5a-65d239389bfd tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.189863 Dec 25 21:46:55.303457 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3756/7541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:55 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:55.455182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:55.455909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:55.462408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:55.462859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:55.463662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:55.464061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:55.598165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:55.606102 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-621059c7-bb28-4adf-930a-1450bb88be60 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1375 microversion: 2.1 time: 0.155134 Dec 25 21:46:55.606704 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3786/7542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:55 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:56.318224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:56.318881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:56.326388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:56.326860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:56.327661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:56.328118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:56.462515 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:56.470160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13f6a031-b699-4ca6-8456-d93d5a8b69c3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.155638 Dec 25 21:46:56.471176 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3757/7543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:56 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:56.622760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:56.623293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:56.630131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:56.630585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:56.631366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:56.631802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:56.770629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:56.778619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26e9855b-02af-4f5a-a9a1-eb32608d1e53 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1546 microversion: 2.1 time: 0.159570 Dec 25 21:46:56.779384 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3787/7544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:56 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:56.794511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:56.797001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:56.801235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:56.801728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:56.802531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:56.802981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:56.940926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:56.949455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6559388-4216-4c31-9e28-59aeba19ea41 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1546 microversion: 2.1 time: 0.158611 Dec 25 21:46:56.950246 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3758/7545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:56 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:57.487054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:57.487590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:57.494203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:57.494677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:57.495441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:57.495880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:57.638927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:57.646321 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0347908e-4759-404c-a32a-63eb8bbe7f4b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.163060 Dec 25 21:46:57.646910 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3788/7546] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:57 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:58.662363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:58.663367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:58.671496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:58.671986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:58.672936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:58.673568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:58.808830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:46:58.816488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2ecb5cd-38ae-48e6-b83e-08b60dd70e23 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.158120 Dec 25 21:46:58.817093 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3759/7547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:58 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:46:58.957969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8bb9578d-226d-4f49-b6b1-05e3c53dd841 req-365ea9cd-fb7e-45bd-8a0a-2b6dd3571c5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb", "name": "network-vif-plugged", "status": "completed", "tag": "931bea7a-4cb4-461c-951d-5f999f37574b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:58.959589 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:58.959589 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:46:58.967831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8bb9578d-226d-4f49-b6b1-05e3c53dd841 req-365ea9cd-fb7e-45bd-8a0a-2b6dd3571c5d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:58.968280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8bb9578d-226d-4f49-b6b1-05e3c53dd841 req-365ea9cd-fb7e-45bd-8a0a-2b6dd3571c5d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:58.982293 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8bb9578d-226d-4f49-b6b1-05e3c53dd841 req-365ea9cd-fb7e-45bd-8a0a-2b6dd3571c5d service nova] Creating event network-vif-plugged:931bea7a-4cb4-461c-951d-5f999f37574b for instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb on nch2-master-1 Dec 25 21:46:58.987450 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8bb9578d-226d-4f49-b6b1-05e3c53dd841 req-365ea9cd-fb7e-45bd-8a0a-2b6dd3571c5d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035762 Dec 25 21:46:58.988757 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3789/7548] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:59.407188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-85818fcb-c7ce-43f8-82bb-704e42fedfe7 req-b9e691f8-ed4a-422e-aa2f-eab1134e1d98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7f03-246c-42e8-a86b-736db9813ce7", "tag": "3fdfb8ce-2c32-49bd-9593-d3fefa5133f4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:46:59.407188 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:46:59.407188 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:46:59.416345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-85818fcb-c7ce-43f8-82bb-704e42fedfe7 req-b9e691f8-ed4a-422e-aa2f-eab1134e1d98 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:59.416914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-85818fcb-c7ce-43f8-82bb-704e42fedfe7 req-b9e691f8-ed4a-422e-aa2f-eab1134e1d98 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:59.428235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-85818fcb-c7ce-43f8-82bb-704e42fedfe7 req-b9e691f8-ed4a-422e-aa2f-eab1134e1d98 service nova] Creating event network-changed:3fdfb8ce-2c32-49bd-9593-d3fefa5133f4 for instance 574a7f03-246c-42e8-a86b-736db9813ce7 on nch1-master-1 Dec 25 21:46:59.434382 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-85818fcb-c7ce-43f8-82bb-704e42fedfe7 req-b9e691f8-ed4a-422e-aa2f-eab1134e1d98 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039274 Dec 25 21:46:59.435317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3760/7549] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:46:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:46:59.835344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:46:59.836453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:46:59.844117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:59.844578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:46:59.845611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:46:59.846073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:00.207366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:00.215080 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39fdbd96-936a-4146-a3d6-2cc72df4620b tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1427 microversion: 2.1 time: 0.384427 Dec 25 21:47:00.215663 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3790/7550] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:46:59 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1427 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:01.232718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:01.233752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:01.240018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:01.240484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:01.241341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:01.241821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:01.380584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:01.388714 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-442d9946-5989-41d2-a623-46a606a221d4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1606 microversion: 2.1 time: 0.160949 Dec 25 21:47:01.389360 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3761/7551] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:01 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1606 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:01.404996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:01.411107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:01.412412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:01.412866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:01.413678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:01.414119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:01.556931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:01.565237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc8b846c-3e8b-43ad-b6ff-169b8596eec5 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1606 microversion: 2.1 time: 0.163924 Dec 25 21:47:01.565808 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3791/7552] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:01 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1606 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:01.581791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:01.582526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:01.588795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:01.589479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:01.590368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:01.590929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:01.732158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:01.740015 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b0e52ae-429c-4c1c-be3a-4b3ce05b8af4 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1606 microversion: 2.1 time: 0.162230 Dec 25 21:47:01.740653 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3762/7553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:01 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1606 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:03.816111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-072422dd-287f-46b8-ad42-2206be1aed16 req-1c8e2e64-8742-453a-9c01-79de0aa15e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb", "tag": "931bea7a-4cb4-461c-951d-5f999f37574b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:03.817667 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:47:03.817667 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:47:03.825950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-072422dd-287f-46b8-ad42-2206be1aed16 req-1c8e2e64-8742-453a-9c01-79de0aa15e54 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:03.826622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-072422dd-287f-46b8-ad42-2206be1aed16 req-1c8e2e64-8742-453a-9c01-79de0aa15e54 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:03.839970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-072422dd-287f-46b8-ad42-2206be1aed16 req-1c8e2e64-8742-453a-9c01-79de0aa15e54 service nova] Creating event network-changed:931bea7a-4cb4-461c-951d-5f999f37574b for instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb on nch2-master-1 Dec 25 21:47:03.845237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-072422dd-287f-46b8-ad42-2206be1aed16 req-1c8e2e64-8742-453a-9c01-79de0aa15e54 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032832 Dec 25 21:47:03.845867 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3792/7554] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:47:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:47:19.729206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:19.734230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:19.737195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:19.737670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:19.738471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:19.738922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:19.791664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e8a7ec1c-4bd5-4df5-8158-e0681d0fe518 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7/action" status: 200 len: 24561 microversion: 2.1 time: 0.066088 Dec 25 21:47:19.792517 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3763/7555] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:47:19 2021] POST /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7/action => generated 24561 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:47:30.755842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:30.756829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:30.763435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:30.763885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:30.764663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:30.765117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:30.814354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-db9e151e-7166-45d8-9379-8e3cb39f995e tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "POST /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7/action" status: 200 len: 32640 microversion: 2.1 time: 0.063414 Dec 25 21:47:30.815001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3793/7556] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:47:30 2021] POST /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7/action => generated 32640 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:47:31.909796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e6ce77bf-8cb8-4801-a24a-6b14dc1efa00 req-fb16d817-9158-4c57-a532-7d73ffaa692c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "574a7f03-246c-42e8-a86b-736db9813ce7", "tag": "3fdfb8ce-2c32-49bd-9593-d3fefa5133f4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:31.911282 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:47:31.911282 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:47:31.916326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:31.916949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:31.926697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:31.926697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:31.926697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:31.926697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:31.929020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e6ce77bf-8cb8-4801-a24a-6b14dc1efa00 req-fb16d817-9158-4c57-a532-7d73ffaa692c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:31.929551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e6ce77bf-8cb8-4801-a24a-6b14dc1efa00 req-fb16d817-9158-4c57-a532-7d73ffaa692c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:31.942198 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e6ce77bf-8cb8-4801-a24a-6b14dc1efa00 req-fb16d817-9158-4c57-a532-7d73ffaa692c service nova] Creating event network-changed:3fdfb8ce-2c32-49bd-9593-d3fefa5133f4 for instance 574a7f03-246c-42e8-a86b-736db9813ce7 on nch1-master-1 Dec 25 21:47:31.948164 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e6ce77bf-8cb8-4801-a24a-6b14dc1efa00 req-fb16d817-9158-4c57-a532-7d73ffaa692c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042310 Dec 25 21:47:31.951542 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3794/7557] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:47:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:47:31.959425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:47:32.192103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ae623cd-8159-4694-8888-8ccffcf2a09c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "DELETE /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 204 len: 0 microversion: 2.1 time: 0.288702 Dec 25 21:47:32.192710 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3764/7558] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:47:31 2021] DELETE /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:47:32.208462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:32.209203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:32.216717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:32.217201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:32.218217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:32.218808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:32.682486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:32.691413 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-009a1302-fdae-4aad-9bae-157f5137e978 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1669 microversion: 2.1 time: 0.487032 Dec 25 21:47:32.691990 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3795/7559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:32 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1669 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:33.710197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:33.711486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:33.719728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:33.720219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:33.721576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:33.721576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:33.949831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:33.958251 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a28462c-e20a-4d77-8bc8-59d74b52017c tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1552 microversion: 2.1 time: 0.251940 Dec 25 21:47:33.958976 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3765/7560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:33 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1552 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:34.123107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d13425c2-f835-47f2-94bd-a42c28f26fee req-10135925-7c30-46fb-ab2e-f0b4496aeaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "574a7f03-246c-42e8-a86b-736db9813ce7", "name": "network-vif-deleted", "tag": "3fdfb8ce-2c32-49bd-9593-d3fefa5133f4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:34.127181 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:47:34.127181 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:47:34.135864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d13425c2-f835-47f2-94bd-a42c28f26fee req-10135925-7c30-46fb-ab2e-f0b4496aeaf5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:34.136337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d13425c2-f835-47f2-94bd-a42c28f26fee req-10135925-7c30-46fb-ab2e-f0b4496aeaf5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:34.147337 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d13425c2-f835-47f2-94bd-a42c28f26fee req-10135925-7c30-46fb-ab2e-f0b4496aeaf5 service nova] Creating event network-vif-deleted:3fdfb8ce-2c32-49bd-9593-d3fefa5133f4 for instance 574a7f03-246c-42e8-a86b-736db9813ce7 on nch1-master-1 Dec 25 21:47:34.152470 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d13425c2-f835-47f2-94bd-a42c28f26fee req-10135925-7c30-46fb-ab2e-f0b4496aeaf5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033679 Dec 25 21:47:34.153121 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3796/7561] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:47:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:47:34.975428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:34.976019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:34.984822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:34.985320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:34.986126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:34.986580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:35.017854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:35.018324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:35.018795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lazy-loading 'fault' on Instance uuid 574a7f03-246c-42e8-a86b-736db9813ce7 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:47:35.061744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71846607489941c5a65d9a3648c6c7d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59ed9da8ed224ce9b429cb4c633a2498', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:35.068390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1a712050-2156-4284-812c-e321b31e1c35 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 200 len: 1339 microversion: 2.1 time: 0.096838 Dec 25 21:47:35.068976 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3766/7562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:34 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 1339 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:36.085054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:36.085750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] [instance: 574a7f03-246c-42e8-a86b-736db9813ce7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:36.092672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:36.093158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:36.093937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:36.094381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:36.107551 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] HTTP exception thrown: Instance 574a7f03-246c-42e8-a86b-736db9813ce7 could not be found. Dec 25 21:47:36.108646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Returning 404 to user: Instance 574a7f03-246c-42e8-a86b-736db9813ce7 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:47:36.115817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-751b17d8-6fbf-4a48-9970-2fac423ea828 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7" status: 404 len: 111 microversion: 2.1 time: 0.028631 Dec 25 21:47:36.115817 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3797/7563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:36 2021] GET /compute/v2.1/servers/574a7f03-246c-42e8-a86b-736db9813ce7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:47:36.345751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-75b046f1-8666-43f8-a09f-269df88af7b2 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] Calling method '.version_select at 0x7fa4f45daca0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:36.427984 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-75b046f1-8666-43f8-a09f-269df88af7b2 tempest-TestNetworkBasicOps-105182929 tempest-TestNetworkBasicOps-105182929-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1383172959" status: 202 len: 0 microversion: 2.1 time: 0.086669 Dec 25 21:47:36.428577 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3767/7564] 10.222.0.32 () {58 vars in 1256 bytes} [Sat Dec 25 21:47:36 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1383172959 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:47:39.611982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:39.612507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:39.619893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:39.620348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:39.621357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:39.623913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:39.648029 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-051679db-b45e-4fc0-89e9-a63a03260263 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.039961 Dec 25 21:47:39.648603 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3798/7565] 10.222.0.32 () {58 vars in 1292 bytes} [Sat Dec 25 21:47:39 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb/os-server-password => generated 116 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:47:44.585837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-099dab8d-0c7d-4c43-862d-53c700632795 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Action: 'create', calling method: .version_select at 0x7fa4f45e34c0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-119680358"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:44.600142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-099dab8d-0c7d-4c43-862d-53c700632795 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for project 444a282fecb241bb84b910063c85139b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:47:44.605135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-099dab8d-0c7d-4c43-862d-53c700632795 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for user 7d33ee320aa6410a8f7a5ce8920a16cb and project 444a282fecb241bb84b910063c85139b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:47:44.917300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-099dab8d-0c7d-4c43-862d-53c700632795 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for project 444a282fecb241bb84b910063c85139b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:47:44.922702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-099dab8d-0c7d-4c43-862d-53c700632795 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for user 7d33ee320aa6410a8f7a5ce8920a16cb and project 444a282fecb241bb84b910063c85139b. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:47:44.937970 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-099dab8d-0c7d-4c43-862d-53c700632795 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.528018 Dec 25 21:47:44.938581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3768/7566] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:47:44 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:47:52.111851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1671212404-access_point-1795814570", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "aa2e4805-accc-4890-bf08-4fbade6dc52f"}], "key_name": "tempest-TestSecurityGroupsBasicOps-119680358", "security_groups": [{"name": "tempest-secgroup_access--1052118817"}, {"name": "tempest-secgroup_general--494921057"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:52.278170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] validate_networks() for [('aa2e4805-accc-4890-bf08-4fbade6dc52f', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:47:52.670575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:47:52.670997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:47:52.671473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:47:52.671881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:47:52.672293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:47:52.681270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:52.681720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:52.682535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:52.682973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:52.700181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for project 444a282fecb241bb84b910063c85139b. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:47:52.705259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for user 7d33ee320aa6410a8f7a5ce8920a16cb and project 444a282fecb241bb84b910063c85139b. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:47:52.717359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:47:52.719449 ncdv-master-1 devstack@n-api.service[136548]: WARNING nova.utils [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1671212404-access_point-1795814570 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1671212404-ac Dec 25 21:47:52.720174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:47:52.838556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e52530c-390e-461a-a703-8c7814ed412d tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.731206 Dec 25 21:47:52.839612 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3799/7567] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:47:52 2021] POST /compute/v2.1/servers => generated 457 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:47:52.852788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-772b2b95-4eda-4a49-98de-0c7cb2bc452e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:52.861063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-772b2b95-4eda-4a49-98de-0c7cb2bc452e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:52.944363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-772b2b95-4eda-4a49-98de-0c7cb2bc452e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:52.953332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-772b2b95-4eda-4a49-98de-0c7cb2bc452e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1294 microversion: 2.1 time: 0.106390 Dec 25 21:47:52.954547 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3769/7568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:52 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:53.972309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aeb606e6-c6b8-4d68-b9d9-d911e7241825 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:53.973510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aeb606e6-c6b8-4d68-b9d9-d911e7241825 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:54.028390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aeb606e6-c6b8-4d68-b9d9-d911e7241825 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:54.035110 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aeb606e6-c6b8-4d68-b9d9-d911e7241825 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1294 microversion: 2.1 time: 0.067921 Dec 25 21:47:54.035676 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3800/7569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:53 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1294 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:55.051531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:55.052114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:55.060093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:55.061113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:55.062022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:55.062702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:55.154964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:55.162437 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86d0ea3c-21a2-4b46-9453-cfdff574499b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1354 microversion: 2.1 time: 0.114709 Dec 25 21:47:55.163219 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3770/7570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:55 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:56.179344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:56.180059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:56.188141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:56.188915 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:56.189876 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:56.190492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:56.437169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:56.444552 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-17bb9ca8-1ecd-4593-b5a6-58514e4d97ab tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.268877 Dec 25 21:47:56.445149 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3801/7571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:56 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:56.893397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0c1891d7-3561-4bb6-9d96-4c7163e87e91 req-e8b39a70-426d-4e99-8680-371e51a67c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc52c35-a324-4ea8-a3bf-a21ee0551467", "tag": "f291accc-c14b-4ebd-9b65-06d16071be79"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:47:56.895834 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:47:56.895834 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:47:56.906584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0c1891d7-3561-4bb6-9d96-4c7163e87e91 req-e8b39a70-426d-4e99-8680-371e51a67c7b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:56.907100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0c1891d7-3561-4bb6-9d96-4c7163e87e91 req-e8b39a70-426d-4e99-8680-371e51a67c7b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:56.918650 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0c1891d7-3561-4bb6-9d96-4c7163e87e91 req-e8b39a70-426d-4e99-8680-371e51a67c7b service nova] Creating event network-changed:f291accc-c14b-4ebd-9b65-06d16071be79 for instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 on nch1-master-1 Dec 25 21:47:56.923683 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0c1891d7-3561-4bb6-9d96-4c7163e87e91 req-e8b39a70-426d-4e99-8680-371e51a67c7b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035206 Dec 25 21:47:56.924953 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3771/7572] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:47:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:47:57.461584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:57.462195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:57.469139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:57.472552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:57.472552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:57.472552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:57.694343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:57.702176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22e9fbdc-f29b-4272-af52-7bc549010ca4 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.244393 Dec 25 21:47:57.702868 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3802/7573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:57 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:58.721140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:58.721852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:58.728077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:58.728543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:58.729361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:58.729811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:58.870771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:47:58.879163 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4b35e239-ca87-4146-be60-a4cdcbce133e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.163415 Dec 25 21:47:58.879785 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3772/7574] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:58 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:47:59.896567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:47:59.897211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:47:59.904594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:59.909559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:47:59.909559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:47:59.909559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:00.052286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:00.059714 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2317ac71-b509-46e2-a331-0c301eaccf86 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.166885 Dec 25 21:48:00.060276 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3803/7575] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:47:59 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:01.075374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:01.076665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:01.082984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:01.083448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:01.084240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:01.084690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:01.232899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:01.241106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b6cae830-6c1a-4fca-aa49-724ec394f553 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.169390 Dec 25 21:48:01.241684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3773/7576] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:01 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:02.258257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:02.258870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:02.266260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:02.266711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:02.267490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:02.267929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:02.411916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:02.419292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52c64788-5e15-44ec-840e-a4ce58f558f0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.164984 Dec 25 21:48:02.419872 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3804/7577] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:02 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:03.272184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9971ff87-fb3e-4e46-9769-e5cdca358baa req-0dddbc47-e5e6-4f6a-b647-6044a3510700 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc52c35-a324-4ea8-a3bf-a21ee0551467", "name": "network-vif-plugged", "status": "completed", "tag": "f291accc-c14b-4ebd-9b65-06d16071be79"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:48:03.273745 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:48:03.273745 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:48:03.281506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9971ff87-fb3e-4e46-9769-e5cdca358baa req-0dddbc47-e5e6-4f6a-b647-6044a3510700 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:03.281962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9971ff87-fb3e-4e46-9769-e5cdca358baa req-0dddbc47-e5e6-4f6a-b647-6044a3510700 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:03.292457 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9971ff87-fb3e-4e46-9769-e5cdca358baa req-0dddbc47-e5e6-4f6a-b647-6044a3510700 service nova] Creating event network-vif-plugged:f291accc-c14b-4ebd-9b65-06d16071be79 for instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 on nch1-master-1 Dec 25 21:48:03.297638 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9971ff87-fb3e-4e46-9769-e5cdca358baa req-0dddbc47-e5e6-4f6a-b647-6044a3510700 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029477 Dec 25 21:48:03.302614 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3774/7578] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:48:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:48:03.436070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:03.436692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:03.443418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:03.443864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:03.444647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:03.445109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:03.585254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:03.592633 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f39829b4-ed44-4c7d-9761-1ed32378e6c9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1471 microversion: 2.1 time: 0.160858 Dec 25 21:48:03.593243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3805/7579] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:03 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:04.609278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:04.609998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:04.616900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:04.617385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:04.618222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:04.618676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:04.766809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:04.774288 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-279b312f-427f-4471-87be-439d0c88de83 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1643 microversion: 2.1 time: 0.169144 Dec 25 21:48:04.774862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3775/7580] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:04 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1643 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:04.789862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:04.790480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:04.797245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:04.797702 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:04.798487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:04.798929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:04.938723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:04.946246 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fab7309-3e4f-4443-b42c-2e771e3ffe94 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1643 microversion: 2.1 time: 0.160031 Dec 25 21:48:04.946824 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3806/7581] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:04 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1643 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:04.962719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:04.963446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:04.969471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:04.969959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:04.970750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:04.971201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:05.269964 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a027cad-a9a7-4539-849f-b9e35f78566f tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1794 microversion: 2.1 time: 0.311035 Dec 25 21:48:05.270534 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3776/7582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:04 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1794 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:07.487025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2e9ed398-a378-4005-b971-334789cdc330 req-1c1e3392-5a2c-449c-bfbb-39a5e414cbcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc52c35-a324-4ea8-a3bf-a21ee0551467", "tag": "f291accc-c14b-4ebd-9b65-06d16071be79"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:48:07.488598 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:48:07.488598 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:48:07.496511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2e9ed398-a378-4005-b971-334789cdc330 req-1c1e3392-5a2c-449c-bfbb-39a5e414cbcc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:07.501204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2e9ed398-a378-4005-b971-334789cdc330 req-1c1e3392-5a2c-449c-bfbb-39a5e414cbcc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:07.509863 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2e9ed398-a378-4005-b971-334789cdc330 req-1c1e3392-5a2c-449c-bfbb-39a5e414cbcc service nova] Creating event network-changed:f291accc-c14b-4ebd-9b65-06d16071be79 for instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 on nch1-master-1 Dec 25 21:48:07.517750 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2e9ed398-a378-4005-b971-334789cdc330 req-1c1e3392-5a2c-449c-bfbb-39a5e414cbcc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034374 Dec 25 21:48:07.522625 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3807/7583] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:48:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:48:48.269905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1824349188", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "18839b65-10bb-48b7-9dc9-ab68c34300d4"}], "key_name": "tempest-TestSecurityGroupsBasicOps-119680358", "security_groups": []}, "os:scheduler_hints": {"different_host": ["6dc52c35-a324-4ea8-a3bf-a21ee0551467"]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:48:48.457815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] validate_networks() for [('18839b65-10bb-48b7-9dc9-ab68c34300d4', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:48:48.868977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:48:48.869452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:48:48.869945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:48:48.870405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:48:48.871032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:48:48.881253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:48.881716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:48.882833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:48.883299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:48.900241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for project 444a282fecb241bb84b910063c85139b. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:48:48.905389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Getting quotas for user 7d33ee320aa6410a8f7a5ce8920a16cb and project 444a282fecb241bb84b910063c85139b. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:48:48.918391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:48:48.920773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:48:49.033089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-60f58f45-01d3-4057-80e4-a397a92d2ae5 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.767688 Dec 25 21:48:49.034174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3777/7584] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:48:48 2021] POST /compute/v2.1/servers => generated 361 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:48:49.055379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94b5e5db-f777-4b70-8d73-464ad7607c12 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:49.056202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94b5e5db-f777-4b70-8d73-464ad7607c12 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:49.219902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-94b5e5db-f777-4b70-8d73-464ad7607c12 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:49.227791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94b5e5db-f777-4b70-8d73-464ad7607c12 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1241 microversion: 2.1 time: 0.177945 Dec 25 21:48:49.228652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3808/7585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:49 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1241 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:50.245899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:50.246529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:50.254438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:50.254851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:50.255768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:50.256226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:50.362488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:50.362488 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a389f114-f5a6-446a-8798-0823aca4932f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1245 microversion: 2.1 time: 0.087360 Dec 25 21:48:50.362488 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3778/7586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:50 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1245 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:51.345066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:51.345685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:51.354161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:51.354623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:51.355427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:51.355864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:51.439669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:51.447505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c886fcfd-932b-4bca-9d4f-4d971a5f48b3 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1301 microversion: 2.1 time: 0.106785 Dec 25 21:48:51.454328 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3809/7587] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:51 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1301 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:52.464437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:52.465120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:52.471920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:52.472587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:52.473540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:52.474027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:52.559968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:52.568052 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9e948af-d404-4e18-8dbc-44646239db4f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1299 microversion: 2.1 time: 0.107280 Dec 25 21:48:52.568630 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3779/7588] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:52 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:52.905319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7137ca6e-71e5-4fda-b8a4-6413a42179ca req-95ad98aa-a439-47f7-bbe4-fb114df48697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da399807-30fb-40c9-8f0b-da4c4f9e8431", "tag": "a650ebf2-7686-4d94-ae9b-422a1e657e9d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:48:52.907479 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:48:52.907479 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:48:52.916336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7137ca6e-71e5-4fda-b8a4-6413a42179ca req-95ad98aa-a439-47f7-bbe4-fb114df48697 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:52.916908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7137ca6e-71e5-4fda-b8a4-6413a42179ca req-95ad98aa-a439-47f7-bbe4-fb114df48697 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:52.931326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7137ca6e-71e5-4fda-b8a4-6413a42179ca req-95ad98aa-a439-47f7-bbe4-fb114df48697 service nova] Creating event network-changed:a650ebf2-7686-4d94-ae9b-422a1e657e9d for instance da399807-30fb-40c9-8f0b-da4c4f9e8431 on nch2-master-1 Dec 25 21:48:52.936545 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7137ca6e-71e5-4fda-b8a4-6413a42179ca req-95ad98aa-a439-47f7-bbe4-fb114df48697 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035591 Dec 25 21:48:52.939116 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3810/7589] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:48:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:48:53.585559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:53.586190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:53.592926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:53.593395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:53.594310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:53.594767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:53.682329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:53.694447 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a43941ff-4926-4a06-9b05-e3f749a87aed tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1299 microversion: 2.1 time: 0.112701 Dec 25 21:48:53.695018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3780/7590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:53 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:54.711691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:54.712416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:54.719118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:54.719579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:54.720372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:54.720809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:54.803806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:54.811127 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ead1df0-babb-45d4-a433-feab66182786 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1299 microversion: 2.1 time: 0.103754 Dec 25 21:48:54.811700 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3811/7591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:54 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:55.827539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:55.828123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:55.835418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:55.835882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:55.836683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:55.837163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:55.923748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:55.935138 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a0ae595b-b177-4259-a71e-ee3aa20608d7 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1299 microversion: 2.1 time: 0.111052 Dec 25 21:48:55.936212 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3781/7592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:55 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:56.955987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:56.956644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:56.963976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:56.964261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:56.965108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:56.965553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:57.052973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:57.060361 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d549dbc4-86fa-4c50-bd01-2914a1b715e0 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1299 microversion: 2.1 time: 0.108754 Dec 25 21:48:57.060987 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3812/7593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:56 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:57.309795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-783cdc1a-98b3-4025-8bec-c6238bbe9905 req-1c98512f-192e-4aa3-bba8-5e535950c046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da399807-30fb-40c9-8f0b-da4c4f9e8431", "name": "network-vif-plugged", "status": "completed", "tag": "a650ebf2-7686-4d94-ae9b-422a1e657e9d"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:48:57.311414 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:48:57.311414 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:48:57.319720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-783cdc1a-98b3-4025-8bec-c6238bbe9905 req-1c98512f-192e-4aa3-bba8-5e535950c046 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:57.320180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-783cdc1a-98b3-4025-8bec-c6238bbe9905 req-1c98512f-192e-4aa3-bba8-5e535950c046 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:57.331561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-783cdc1a-98b3-4025-8bec-c6238bbe9905 req-1c98512f-192e-4aa3-bba8-5e535950c046 service nova] Creating event network-vif-plugged:a650ebf2-7686-4d94-ae9b-422a1e657e9d for instance da399807-30fb-40c9-8f0b-da4c4f9e8431 on nch2-master-1 Dec 25 21:48:57.336578 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-783cdc1a-98b3-4025-8bec-c6238bbe9905 req-1c98512f-192e-4aa3-bba8-5e535950c046 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030726 Dec 25 21:48:57.342738 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3782/7594] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:48:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:48:58.077109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:58.077718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:58.084451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:58.084926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:58.085699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:58.086136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:58.169249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:58.177243 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8606f891-6863-4871-a8e7-533a7517225e tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1299 microversion: 2.1 time: 0.103879 Dec 25 21:48:58.177852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3813/7595] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:58 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:59.196058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:59.196802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:59.203232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.203918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.204728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.205208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.292546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:59.300754 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab9c7ac4-2382-4c0f-a7b3-d886edc2c9f8 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1472 microversion: 2.1 time: 0.109639 Dec 25 21:48:59.301353 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3783/7596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:59 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:59.316943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:59.321651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:59.324182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.324629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.325428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.325865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.408140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:48:59.415557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3915a088-f45f-4597-8bab-ba737c56823f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1472 microversion: 2.1 time: 0.102879 Dec 25 21:48:59.416135 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3814/7597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:59 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1472 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:59.431732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:59.432361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:59.438372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.438846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.439644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.440104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.520010 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e791785d-341e-4993-a24b-93d5d5cd9df1 tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1623 microversion: 2.1 time: 0.091931 Dec 25 21:48:59.520580 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3784/7598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:59 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1623 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:59.535948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:59.536643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:59.542671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.543063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.543842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.544283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.681072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04178b3c-4d1a-4848-92b4-7ff20b1195aa tempest-TestSecurityGroupsBasicOps-1346282691 tempest-TestSecurityGroupsBasicOps-1346282691-project-admin] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1912 microversion: 2.1 time: 0.149207 Dec 25 21:48:59.681648 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3815/7599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:48:59 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1912 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:48:59.741289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:48:59.741807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:48:59.747730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.748202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.749031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:48:59.749488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:48:59.774083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:49:00.056811 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d0645fe-6c19-4524-996f-94d5c63aaec9 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 204 len: 0 microversion: 2.1 time: 0.318928 Dec 25 21:49:00.057440 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3785/7600] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:48:59 2021] DELETE /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:49:00.065446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:00.066060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:00.072250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:00.072709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:00.073512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:00.073954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:00.157713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:00.165287 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eee88df1-977f-41cf-9163-c398ece43053 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1478 microversion: 2.1 time: 0.103605 Dec 25 21:49:00.165859 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3816/7601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:00 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1478 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:01.183346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:01.184066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:01.192673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:01.193199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:01.194034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:01.194500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:01.283054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:01.290467 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a748004-82c2-4f43-9f22-7a4d1341a96f tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1478 microversion: 2.1 time: 0.111351 Dec 25 21:49:01.291036 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3786/7602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:01 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1478 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:01.915300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-75e10fae-1de8-4640-af33-6f7681864414 req-478d4d78-5e69-4779-8df5-654a62784e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da399807-30fb-40c9-8f0b-da4c4f9e8431", "name": "network-vif-deleted", "tag": "a650ebf2-7686-4d94-ae9b-422a1e657e9d"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:01.916962 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:49:01.916962 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:49:01.925817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-75e10fae-1de8-4640-af33-6f7681864414 req-478d4d78-5e69-4779-8df5-654a62784e01 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:01.926267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-75e10fae-1de8-4640-af33-6f7681864414 req-478d4d78-5e69-4779-8df5-654a62784e01 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:01.938364 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-75e10fae-1de8-4640-af33-6f7681864414 req-478d4d78-5e69-4779-8df5-654a62784e01 service nova] Creating event network-vif-deleted:a650ebf2-7686-4d94-ae9b-422a1e657e9d for instance da399807-30fb-40c9-8f0b-da4c4f9e8431 on nch2-master-1 Dec 25 21:49:01.943738 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-75e10fae-1de8-4640-af33-6f7681864414 req-478d4d78-5e69-4779-8df5-654a62784e01 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032552 Dec 25 21:49:01.946678 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3817/7603] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:49:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:49:02.307551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lazy-loading 'fault' on Instance uuid da399807-30fb-40c9-8f0b-da4c4f9e8431 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6d59fb9-fe61-48f8-9b66-c467db03d6ee tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 200 len: 1331 microversion: 2.1 time: 0.092440 Dec 25 21:49:02.445637 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3787/7604] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:02 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 1331 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:03.415225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:03.415918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: da399807-30fb-40c9-8f0b-da4c4f9e8431] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:03.422182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:03.423268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:03.424038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:03.424480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:03.437476 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] HTTP exception thrown: Instance da399807-30fb-40c9-8f0b-da4c4f9e8431 could not be found. Dec 25 21:49:03.438054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Returning 404 to user: Instance da399807-30fb-40c9-8f0b-da4c4f9e8431 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:49:03.438860 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8497809e-dcd6-4132-b832-32daef132032 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431" status: 404 len: 111 microversion: 2.1 time: 0.028625 Dec 25 21:49:03.439385 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3818/7605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:03 2021] GET /compute/v2.1/servers/da399807-30fb-40c9-8f0b-da4c4f9e8431 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:49:08.410783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:08.412376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:08.416720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3e58cf03-4453-4838-ab1b-7af67d806f54 req-3881acb5-507b-4a51-894b-c989caa0d361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc52c35-a324-4ea8-a3bf-a21ee0551467", "tag": "f291accc-c14b-4ebd-9b65-06d16071be79"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:08.419106 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:49:08.419106 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:49:08.419942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:08.420617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:08.421474 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:08.422026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:08.430629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3e58cf03-4453-4838-ab1b-7af67d806f54 req-3881acb5-507b-4a51-894b-c989caa0d361 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:08.431335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3e58cf03-4453-4838-ab1b-7af67d806f54 req-3881acb5-507b-4a51-894b-c989caa0d361 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:08.449202 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3e58cf03-4453-4838-ab1b-7af67d806f54 req-3881acb5-507b-4a51-894b-c989caa0d361 service nova] Creating event network-changed:f291accc-c14b-4ebd-9b65-06d16071be79 for instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 on nch1-master-1 Dec 25 21:49:08.451008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:49:08.457170 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3e58cf03-4453-4838-ab1b-7af67d806f54 req-3881acb5-507b-4a51-894b-c989caa0d361 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045119 Dec 25 21:49:08.458629 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3819/7606] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:49:08 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:49:08.734407 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-585d45c7-d337-4f83-9fc4-3b99c1198b7a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "DELETE /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 204 len: 0 microversion: 2.1 time: 0.327337 Dec 25 21:49:08.735472 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3788/7607] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:49:08 2021] DELETE /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:49:08.747063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:08.748088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:08.758980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:08.759830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:08.761331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:08.762082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:09.020088 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:09.027814 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c94b77b6-3512-49a5-bb18-4d1c774c4696 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1767 microversion: 2.1 time: 0.287339 Dec 25 21:49:09.028602 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3820/7608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:08 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1767 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:10.044797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:10.045557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:10.052253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:10.052744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:10.053568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:10.054016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:10.270041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:10.277432 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-157ace1d-fdef-40a2-b669-b5e92d91c40a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1649 microversion: 2.1 time: 0.236747 Dec 25 21:49:10.278005 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3789/7609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:10 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1649 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:10.670233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-66ee24bd-7ebb-4dea-adc3-b7fa5f6f17c8 req-f615acdc-d818-425f-a961-0c42d62fea72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc52c35-a324-4ea8-a3bf-a21ee0551467", "name": "network-vif-deleted", "tag": "f291accc-c14b-4ebd-9b65-06d16071be79"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:10.671793 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:49:10.671793 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:49:10.682372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-66ee24bd-7ebb-4dea-adc3-b7fa5f6f17c8 req-f615acdc-d818-425f-a961-0c42d62fea72 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:10.683205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-66ee24bd-7ebb-4dea-adc3-b7fa5f6f17c8 req-f615acdc-d818-425f-a961-0c42d62fea72 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:10.699978 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-66ee24bd-7ebb-4dea-adc3-b7fa5f6f17c8 req-f615acdc-d818-425f-a961-0c42d62fea72 service nova] Creating event network-vif-deleted:f291accc-c14b-4ebd-9b65-06d16071be79 for instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 on nch1-master-1 Dec 25 21:49:10.705429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-66ee24bd-7ebb-4dea-adc3-b7fa5f6f17c8 req-f615acdc-d818-425f-a961-0c42d62fea72 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039092 Dec 25 21:49:10.706035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3821/7610] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:49:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:49:11.293646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:11.294276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:11.301091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:11.301562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:11.302358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:11.302811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:11.333152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:11.333621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:11.334088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lazy-loading 'fault' on Instance uuid 6dc52c35-a324-4ea8-a3bf-a21ee0551467 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:49:11.373508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d33ee320aa6410a8f7a5ce8920a16cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '444a282fecb241bb84b910063c85139b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:11.381913 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50765f6f-7f49-430e-997f-f5e79cc1ea18 tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 200 len: 1384 microversion: 2.1 time: 0.091663 Dec 25 21:49:11.382552 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3790/7611] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:11 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 1384 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:12.400798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:12.401570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] [instance: 6dc52c35-a324-4ea8-a3bf-a21ee0551467] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:12.408557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:12.409039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:12.409828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:12.410271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:12.424016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] HTTP exception thrown: Instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 could not be found. Dec 25 21:49:12.424631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Returning 404 to user: Instance 6dc52c35-a324-4ea8-a3bf-a21ee0551467 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:49:12.425483 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-884c3108-db71-4670-a3fb-c1abccc85c3a tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467" status: 404 len: 111 microversion: 2.1 time: 0.029592 Dec 25 21:49:12.426013 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3822/7612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:12 2021] GET /compute/v2.1/servers/6dc52c35-a324-4ea8-a3bf-a21ee0551467 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:49:16.073592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc9872dd-87c3-438a-84ad-ac2bb8939b7b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] Calling method '.version_select at 0x7fa4f45e28b0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:16.154825 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc9872dd-87c3-438a-84ad-ac2bb8939b7b tempest-TestSecurityGroupsBasicOps-1671212404 tempest-TestSecurityGroupsBasicOps-1671212404-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-119680358" status: 202 len: 0 microversion: 2.1 time: 0.084858 Dec 25 21:49:16.155521 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3791/7613] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:49:16 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-119680358 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:49:24.199167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1613555846", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "b01beca0-3129-4e48-b720-4d3f02a7eb65"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:24.250414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] validate_networks() for [('b01beca0-3129-4e48-b720-4d3f02a7eb65', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:49:24.583453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:49:24.583873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:49:24.584346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:49:24.584752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:49:24.585193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:49:24.593878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:24.594325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:24.595751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:24.596186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:24.612303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Getting quotas for project 419382b75cc24e299a2f85f5eea43dbd. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:49:24.617261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Getting quotas for user 5043c601478b46a599ea5d8b4c1c612a and project 419382b75cc24e299a2f85f5eea43dbd. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:49:24.629018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:49:24.631974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:49:24.770016 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-368d915b-d2a2-403c-b1f7-46eb22dd880e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700691 Dec 25 21:49:24.770585 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3823/7614] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:49:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:49:24.781209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b853ae1-237a-4add-9fca-1b256964672c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:24.781842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b853ae1-237a-4add-9fca-1b256964672c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:24.838446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3b853ae1-237a-4add-9fca-1b256964672c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:24.845837 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b853ae1-237a-4add-9fca-1b256964672c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1215 microversion: 2.1 time: 0.069249 Dec 25 21:49:24.846404 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3792/7615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:24 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:25.863587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:25.864208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:25.870956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:25.871415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:25.872805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:25.873284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:25.934532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:25.941896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88fbdf20-6968-42d8-abd3-31fa72a833f5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1219 microversion: 2.1 time: 0.083727 Dec 25 21:49:25.942461 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3824/7616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:25 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:26.958726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:26.959358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:26.967300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:26.967968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:26.968991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:26.969481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:27.042436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:27.050324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5d7c762b-4805-4120-8f30-0f1c073cb7a8 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1285 microversion: 2.1 time: 0.095406 Dec 25 21:49:27.050909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3793/7617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:26 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:49:28.067170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:28.067923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:28.075050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:28.075500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:28.076285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:28.076728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:28.304084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:28.311479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7073959-d030-4d2e-bd9b-5a633b470778 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1315 microversion: 2.1 time: 0.248684 Dec 25 21:49:28.312047 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3825/7618] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:28 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:28.506708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b5570844-12f6-4596-8f99-fe7239b927e4 req-a2953280-ae35-4a70-bbbf-711c377878d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f42d449-ec7a-45cb-a745-341e415a3fe0", "tag": "0278f5f3-763c-48f8-ad9c-1dd7cdbad337"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:28.508267 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:49:28.508267 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:49:28.516071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b5570844-12f6-4596-8f99-fe7239b927e4 req-a2953280-ae35-4a70-bbbf-711c377878d3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:28.516531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b5570844-12f6-4596-8f99-fe7239b927e4 req-a2953280-ae35-4a70-bbbf-711c377878d3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:28.527393 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b5570844-12f6-4596-8f99-fe7239b927e4 req-a2953280-ae35-4a70-bbbf-711c377878d3 service nova] Creating event network-changed:0278f5f3-763c-48f8-ad9c-1dd7cdbad337 for instance 3f42d449-ec7a-45cb-a745-341e415a3fe0 on nch1-master-1 Dec 25 21:49:28.532074 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b5570844-12f6-4596-8f99-fe7239b927e4 req-a2953280-ae35-4a70-bbbf-711c377878d3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029237 Dec 25 21:49:28.532670 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3794/7619] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:49:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:49:29.328406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:29.329046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:29.335824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:29.336273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:29.337075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:29.337511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:29.472291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:29.479558 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a32611c6-6258-408a-81f6-d893dcab91b7 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1315 microversion: 2.1 time: 0.154946 Dec 25 21:49:29.480121 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3826/7620] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:29 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:30.498020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:30.498721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:30.505499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:30.506240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:30.507032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:30.507469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:30.635725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:30.643427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea8ec793-2ea8-4653-a68c-f342bcfd4da2 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1315 microversion: 2.1 time: 0.150332 Dec 25 21:49:30.644097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3795/7621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:30 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:31.659561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:31.660172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:31.666956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:31.667402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:31.668220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:31.668733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:31.807150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:31.811621 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8ec8dd0-c1ae-4384-89d9-0d7aeda69a4c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1315 microversion: 2.1 time: 0.155936 Dec 25 21:49:31.812185 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3827/7622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:31 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:32.828213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:32.828853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:32.835895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:32.836393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:32.837219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:32.837677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:32.965746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:32.973283 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2018196a-4110-4440-9264-cea0bd1cbd15 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1315 microversion: 2.1 time: 0.148754 Dec 25 21:49:32.973851 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3796/7623] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:32 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:33.752812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-8910981a-9c9f-466b-a99f-689684b0904f req-033f7a60-4c51-4123-96d3-cbd2f3ea060e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f42d449-ec7a-45cb-a745-341e415a3fe0", "name": "network-vif-plugged", "status": "completed", "tag": "0278f5f3-763c-48f8-ad9c-1dd7cdbad337"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:33.756202 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:49:33.756202 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:49:33.762555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8910981a-9c9f-466b-a99f-689684b0904f req-033f7a60-4c51-4123-96d3-cbd2f3ea060e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:33.763007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-8910981a-9c9f-466b-a99f-689684b0904f req-033f7a60-4c51-4123-96d3-cbd2f3ea060e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:33.774151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-8910981a-9c9f-466b-a99f-689684b0904f req-033f7a60-4c51-4123-96d3-cbd2f3ea060e service nova] Creating event network-vif-plugged:0278f5f3-763c-48f8-ad9c-1dd7cdbad337 for instance 3f42d449-ec7a-45cb-a745-341e415a3fe0 on nch1-master-1 Dec 25 21:49:33.778980 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-8910981a-9c9f-466b-a99f-689684b0904f req-033f7a60-4c51-4123-96d3-cbd2f3ea060e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029973 Dec 25 21:49:33.779565 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3828/7624] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:49:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:49:33.989920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:33.990558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:33.997467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:33.997881 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:33.998685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:33.999145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:34.128991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:34.136518 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d2e8985-51d6-4268-a8c5-29dc127a3e8c tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1315 microversion: 2.1 time: 0.150357 Dec 25 21:49:34.137121 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3797/7625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:33 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:35.155383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:35.156020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:35.162532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.162983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.163769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.164204 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.298831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:35.306262 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6253610-7630-41ea-b0dc-e95dc2e81711 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1500 microversion: 2.1 time: 0.155956 Dec 25 21:49:35.306852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3829/7626] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:35 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:35.322571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:35.323197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:35.329986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.330452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.331246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.331696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.463381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:35.471270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-349599a5-a6b3-4a71-a4f2-c5246104b3c0 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1500 microversion: 2.1 time: 0.151900 Dec 25 21:49:35.471838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3798/7627] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:35 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:35.487764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:35.488303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:35.494451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.494908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.495697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.496136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.518568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lazy-loading 'flavor' on Instance uuid 3f42d449-ec7a-45cb-a745-341e415a3fe0 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:49:35.773851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a7558a5-96fd-46e1-bc14-21511eaedfe1 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.290364 Dec 25 21:49:35.774520 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3830/7628] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:49:35 2021] POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:49:35.782356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:35.783047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:35.789167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.789638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.790512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:35.790964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:35.921811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:35.929741 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6026b552-0f6e-4354-be52-0bdbeb91f462 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1508 microversion: 2.1 time: 0.151036 Dec 25 21:49:35.930314 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3799/7629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:35 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:36.948212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:36.948971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:36.955415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:36.955868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:36.956656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:36.957116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:37.092333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:37.100375 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a3f5c6f-27cb-4261-821f-aaeae632ef37 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1491 microversion: 2.1 time: 0.157239 Dec 25 21:49:37.101182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3831/7630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:36 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1491 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:37.117485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:37.118048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:37.124892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:37.125383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:37.126185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:37.126645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:37.336782 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b07f7971-a9ab-4e89-8c2e-31c7aeed5b54 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.222840 Dec 25 21:49:37.337471 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3800/7631] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:49:37 2021] POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:49:37.346871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:37.347517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:37.353580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:37.354159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:37.354956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:37.355419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:37.498399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:37.506823 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-920a9f10-2cb3-4d14-afe5-17551b9863f6 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1497 microversion: 2.1 time: 0.164598 Dec 25 21:49:37.507406 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3832/7632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:37 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:38.527272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:38.527981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:38.534837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:38.535293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:38.536120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:38.536560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:38.670921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:38.679570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c01b887-4202-4ad4-bd17-a0f69c149e8e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1497 microversion: 2.1 time: 0.158442 Dec 25 21:49:38.680383 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3801/7633] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:38 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:39.696398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:39.697062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:39.703851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:39.704298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:39.705619 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:39.706060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:39.838556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:39.846628 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-592b4cf1-b293-4056-a2e1-4523fa712202 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1500 microversion: 2.1 time: 0.153949 Dec 25 21:49:39.847226 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3833/7634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:39 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1500 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:39.862567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:39.863117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:39.869884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:39.870353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:39.871147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:39.871602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:39.894953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lazy-loading 'flavor' on Instance uuid 3f42d449-ec7a-45cb-a745-341e415a3fe0 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:49:40.200212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ba49af1-8176-49a7-9d5b-f6628559811b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.341016 Dec 25 21:49:40.200792 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3802/7635] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:49:39 2021] POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:49:40.209397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:40.210265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:40.216271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:40.216866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:40.217731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:40.218163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:40.349475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:40.356807 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c98168c-72a0-47fc-ac3a-92ec9233239a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1508 microversion: 2.1 time: 0.151929 Dec 25 21:49:40.362035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3834/7636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:40 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:41.374799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:41.375572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:41.383312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:41.383782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:41.384581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:41.385066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:41.518710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:41.526180 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a04f2c91-bc8f-467d-9302-3e63f4d65993 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1491 microversion: 2.1 time: 0.155467 Dec 25 21:49:41.526746 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3803/7637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:41 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1491 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:41.547222 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:41.548049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:41.554742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:41.555685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:41.555999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:41.556436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:41.773635 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-06fc783f-9a6f-465b-b03a-b937caae5f8f tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action" status: 202 len: 0 microversion: 2.1 time: 0.229977 Dec 25 21:49:41.774291 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3835/7638] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:49:41 2021] POST /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:49:41.782139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:41.782767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:41.788673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:41.789174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:41.789978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:41.790440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:41.948328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:41.956048 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d5b3965a-b4e8-483a-93c0-e15f136ce7d5 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1497 microversion: 2.1 time: 0.177590 Dec 25 21:49:41.956614 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3804/7639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:41 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:42.974010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:42.974772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:42.980922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:42.981379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:42.982160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:42.982602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:43.119189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:43.127228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2483508-6742-4578-942d-f1cd39d18f90 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1497 microversion: 2.1 time: 0.157608 Dec 25 21:49:43.127969 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3836/7640] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:42 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:44.144241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:44.144863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:44.151587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:44.152043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:44.152827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:44.153298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:44.287556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:44.295012 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54484f93-23d7-476e-8bb6-9b9023252f77 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1500 microversion: 2.1 time: 0.154473 Dec 25 21:49:44.295583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3805/7641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:44 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1500 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:44.311182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:44.311681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:44.318793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:44.319249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:44.320036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:44.320476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:44.344562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:49:44.613979 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ae58c4c-5c7e-468f-b703-c9132f663952 tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 204 len: 0 microversion: 2.1 time: 0.306062 Dec 25 21:49:44.614479 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3837/7642] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:49:44 2021] DELETE /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:49:44.622943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:44.623602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:44.629698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:44.630251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:44.631237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:44.631692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:44.762004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:44.769988 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ea1cd583-c546-44f0-b952-d2b7b4b63dae tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1506 microversion: 2.1 time: 0.151038 Dec 25 21:49:44.770574 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3806/7643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:44 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:45.787391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:45.788106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:45.795378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:45.795834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:45.796608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:45.797198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:45.929814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:45.937294 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1e378dd-d45a-4355-b2d9-850a6a78322a tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1506 microversion: 2.1 time: 0.153965 Dec 25 21:49:45.937876 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3838/7644] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:45 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:49:46.955051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:46.955763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:46.962909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:46.963364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:46.964186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:46.964826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:46.993907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3e1215c0-a80e-4c0f-941b-35ac76165e51 req-ed1ade77-4a6a-4241-bc79-334bcdc7ef6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f42d449-ec7a-45cb-a745-341e415a3fe0", "name": "network-vif-deleted", "tag": "0278f5f3-763c-48f8-ad9c-1dd7cdbad337"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:49:46.997067 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:49:46.997067 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:49:47.004830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3e1215c0-a80e-4c0f-941b-35ac76165e51 req-ed1ade77-4a6a-4241-bc79-334bcdc7ef6b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:47.005316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3e1215c0-a80e-4c0f-941b-35ac76165e51 req-ed1ade77-4a6a-4241-bc79-334bcdc7ef6b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:47.016663 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3e1215c0-a80e-4c0f-941b-35ac76165e51 req-ed1ade77-4a6a-4241-bc79-334bcdc7ef6b service nova] Creating event network-vif-deleted:0278f5f3-763c-48f8-ad9c-1dd7cdbad337 for instance 3f42d449-ec7a-45cb-a745-341e415a3fe0 on nch1-master-1 Dec 25 21:49:47.021585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3e1215c0-a80e-4c0f-941b-35ac76165e51 req-ed1ade77-4a6a-4241-bc79-334bcdc7ef6b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104228 Dec 25 21:49:47.022178 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3807/7645] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:49:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:49:47.031152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:47.038748 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0239856e-a29f-496e-a968-90c063c70a2e tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1464 microversion: 2.1 time: 0.088255 Dec 25 21:49:47.039331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3839/7646] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:46 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1464 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:49:48.056946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:48.057664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:48.064846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:48.065353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:48.066217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:48.066696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:48.099631 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:48.100102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:48.100569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lazy-loading 'fault' on Instance uuid 3f42d449-ec7a-45cb-a745-341e415a3fe0 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:49:48.140612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5043c601478b46a599ea5d8b4c1c612a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '419382b75cc24e299a2f85f5eea43dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:49:48.148055 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b324173c-d5cc-4259-a5f6-621e0469d26b tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 200 len: 1305 microversion: 2.1 time: 0.096074 Dec 25 21:49:48.148635 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3808/7647] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:48 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:49:49.164663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:49:49.165330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] [instance: 3f42d449-ec7a-45cb-a745-341e415a3fe0] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:49:49.172425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:49.172882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:49.174291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:49:49.174736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:49:49.187771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] HTTP exception thrown: Instance 3f42d449-ec7a-45cb-a745-341e415a3fe0 could not be found. Dec 25 21:49:49.188347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] Returning 404 to user: Instance 3f42d449-ec7a-45cb-a745-341e415a3fe0 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:49:49.189187 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02786b8b-65e7-4966-b95a-f074452a274d tempest-TestServerAdvancedOps-112749063 tempest-TestServerAdvancedOps-112749063-project] 10.222.0.32 "GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0" status: 404 len: 111 microversion: 2.1 time: 0.028307 Dec 25 21:49:49.189703 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3840/7648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:49:49 2021] GET /compute/v2.1/servers/3f42d449-ec7a-45cb-a745-341e415a3fe0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:51:43.050003 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0518a7cf-b089-43ee-8b3e-9cd831685db8] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 21:51:43.050945 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 21:51:43.055150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:43.055663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:43.061752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:43.062220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:43.063010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:43.063466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:43.089118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:51:43.343545 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cbddf2ba-2eaa-4030-9958-184da852ced3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 204 len: 0 microversion: 2.1 time: 0.295285 Dec 25 21:51:43.344135 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3809/7649] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:51:43 2021] DELETE /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:51:43.351538 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 21:51:43.352478 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 21:51:43.355957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:43.356575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:43.362555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:43.363558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:43.363814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:43.364214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:43.826091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:51:43.833478 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-491c1701-3b53-4a34-9209-b17acef014d9 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1731 microversion: 2.1 time: 0.484953 Dec 25 21:51:43.834057 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3841/7650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:51:43 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1731 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:51:44.850976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:44.851725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:44.860649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:44.861143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:44.861958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:44.862411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:44.879233 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [0518a7cf-b089-43ee-8b3e-9cd831685db8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 33534. Dec 25 21:51:44.879959 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 33536. Dec 25 21:51:45.176368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:51:45.184033 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8fec2b37-0ecf-4621-9581-aff68089ba92 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1731 microversion: 2.1 time: 0.337753 Dec 25 21:51:45.184657 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3810/7651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:51:44 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1731 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:51:45.693330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e3f99d80-2f74-48ab-bac2-ba91791489fa req-811f9082-b614-4242-af30-41c5e14b949c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb", "name": "network-vif-deleted", "tag": "931bea7a-4cb4-461c-951d-5f999f37574b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:51:45.701161 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:51:45.701161 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:51:45.705053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e3f99d80-2f74-48ab-bac2-ba91791489fa req-811f9082-b614-4242-af30-41c5e14b949c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:45.705511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e3f99d80-2f74-48ab-bac2-ba91791489fa req-811f9082-b614-4242-af30-41c5e14b949c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:45.719987 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 33542. Dec 25 21:51:45.723986 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 33540. Dec 25 21:51:45.723986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e3f99d80-2f74-48ab-bac2-ba91791489fa req-811f9082-b614-4242-af30-41c5e14b949c service nova] Creating event network-vif-deleted:931bea7a-4cb4-461c-951d-5f999f37574b for instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb on nch2-master-1 Dec 25 21:51:45.728550 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e3f99d80-2f74-48ab-bac2-ba91791489fa req-811f9082-b614-4242-af30-41c5e14b949c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039600 Dec 25 21:51:45.729399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3842/7652] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:51:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:51:46.370696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:46.371534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:46.387999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:46.388471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:46.389314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:46.389775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:46.433953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:46.434416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:46.434898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lazy-loading 'fault' on Instance uuid ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:51:46.476480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f61753173a4d493ba1f1f3174c35f83e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e4751d74674097b87a3ad1c686e9e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:51:46.484427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95badbaa-b46a-4f8d-9271-a4b0f60a7732 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 200 len: 1388 microversion: 2.1 time: 0.286904 Dec 25 21:51:46.485037 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3811/7653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:51:46 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 1388 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:51:47.502228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:47.503177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:47.509410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:47.509857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:47.510622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:47.511055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:47.524561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] HTTP exception thrown: Instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb could not be found. Dec 25 21:51:47.525194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Returning 404 to user: Instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:51:47.526007 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1a0f4ba-3980-4433-b23c-d604186e30ca tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 404 len: 111 microversion: 2.1 time: 0.028767 Dec 25 21:51:47.526528 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3843/7654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:51:47 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:51:48.024841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:48.025373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:48.032188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:48.032663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:48.033492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:48.033950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:48.047050 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] HTTP exception thrown: Instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb could not be found. Dec 25 21:51:48.047570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Returning 404 to user: Instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:51:48.048413 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-491cc764-0550-4217-8681-cd3dff694417 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 404 len: 111 microversion: 2.1 time: 0.028028 Dec 25 21:51:48.048966 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3812/7655] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:51:48 2021] DELETE /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:51:48.056864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:48.057542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] [instance: ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:51:48.063652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:48.064120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:48.064929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:51:48.065362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:51:48.079279 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] HTTP exception thrown: Instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb could not be found. Dec 25 21:51:48.079925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Returning 404 to user: Instance ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:51:48.080753 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61fafc33-4e87-47d6-bc74-02fd8eb2fba3 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb" status: 404 len: 111 microversion: 2.1 time: 0.027706 Dec 25 21:51:48.081320 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3844/7656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:51:48 2021] GET /compute/v2.1/servers/ed6a5d6e-fdbb-4612-9c9e-ccba16508aeb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:51:48.308449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-86135342-b761-4aa1-ba9d-2eb585686ce8 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] Calling method '.version_select at 0x7fa4f4560160>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:51:48.390912 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-86135342-b761-4aa1-ba9d-2eb585686ce8 tempest-TestServerBasicOps-1234246955 tempest-TestServerBasicOps-1234246955-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2133928421" status: 202 len: 0 microversion: 2.1 time: 0.086231 Dec 25 21:51:48.391503 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3813/7657] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 21:51:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-2133928421 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:51:58.086047 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:51:58.086706 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 21:51:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:51:59.561697 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:51:59.562295 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:51:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:52:01.454951 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:52:01.455589 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:52:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:52:08.618103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2053562954", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:08.668404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] validate_networks() for None {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:52:08.937610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:52:08.938037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:52:08.938516 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:52:08.938927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:52:08.939342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:52:08.948682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:08.949165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:08.949986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:08.950426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:08.967718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Getting quotas for project 283beb68bf4d4ba8951f370b7b057323. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:52:08.972687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Getting quotas for user 55da14ac01534b83affd4478904fd87f and project 283beb68bf4d4ba8951f370b7b057323. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:52:08.984446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:52:08.986840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:52:09.104395 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-77a79c11-31a7-4c91-bbbc-0bd4610566dd tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.600448 Dec 25 21:52:09.105070 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3845/7658] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:52:08 2021] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:52:09.116889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04004a23-90de-4110-859c-afbc57bb846e tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:09.118696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04004a23-90de-4110-859c-afbc57bb846e tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:09.172281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-04004a23-90de-4110-859c-afbc57bb846e tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:09.179192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04004a23-90de-4110-859c-afbc57bb846e tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1222 microversion: 2.1 time: 0.067675 Dec 25 21:52:09.180270 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3814/7659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:09 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:52:10.197303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:10.197910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:10.204586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:10.205068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:10.205869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:10.206281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:10.268809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:10.277022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01fde018-128a-4859-9256-6732723d8fb6 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1226 microversion: 2.1 time: 0.084262 Dec 25 21:52:10.277593 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3846/7660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:10 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1226 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:11.293222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:11.293875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:11.301130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:11.301644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:11.302453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:11.302902 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:11.367006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:11.374505 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-005f096c-dcd5-4c31-99a6-c39b08331ed8 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1292 microversion: 2.1 time: 0.085228 Dec 25 21:52:11.375066 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3815/7661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:11 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:12.392190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:12.392754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:12.399509 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:12.399964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:12.400751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:12.401212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:12.582877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:12.594306 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-171f78ab-5f0e-45fd-bd41-d0690cead093 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1322 microversion: 2.1 time: 0.202404 Dec 25 21:52:12.594306 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3847/7662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:12 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:12.890494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-07928b4b-408b-4b90-9bf4-bc81a3cc694b req-5ea1eb30-bdbd-442c-921e-31a7dac0de71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce34dc8-6b55-4575-9f10-ed25dee621ae", "tag": "12ff2e6f-e520-4ecb-8160-89926b8e03bf"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:12.892641 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:12.892641 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:52:12.901249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-07928b4b-408b-4b90-9bf4-bc81a3cc694b req-5ea1eb30-bdbd-442c-921e-31a7dac0de71 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:12.901750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-07928b4b-408b-4b90-9bf4-bc81a3cc694b req-5ea1eb30-bdbd-442c-921e-31a7dac0de71 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:13.172585 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-07928b4b-408b-4b90-9bf4-bc81a3cc694b req-5ea1eb30-bdbd-442c-921e-31a7dac0de71 service nova] Creating event network-changed:12ff2e6f-e520-4ecb-8160-89926b8e03bf for instance fce34dc8-6b55-4575-9f10-ed25dee621ae on nch2-master-1 Dec 25 21:52:13.178190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-07928b4b-408b-4b90-9bf4-bc81a3cc694b req-5ea1eb30-bdbd-442c-921e-31a7dac0de71 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.291254 Dec 25 21:52:13.178804 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3816/7663] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:52:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:13.607477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:13.608097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:13.614925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:13.615383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:13.616178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:13.616618 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:13.804699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:13.812761 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82bda7e8-ee7c-4184-8e29-21f84de978bf tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1322 microversion: 2.1 time: 0.209038 Dec 25 21:52:13.813576 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3848/7664] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:13 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:14.831374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:14.832113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:14.838918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:14.839387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:14.840181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:14.840642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:14.974847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:14.983457 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-26399fea-5413-4b91-8797-178d1c9049d9 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1322 microversion: 2.1 time: 0.156768 Dec 25 21:52:14.984334 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3817/7665] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:14 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:15.999704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:16.000317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:16.007086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:16.007926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:16.008441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:16.008868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:16.138572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:16.145984 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c45422cf-af8b-4511-b811-f3a6b00409a4 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1322 microversion: 2.1 time: 0.150040 Dec 25 21:52:16.146542 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3849/7666] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:15 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:17.162901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:17.163543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:17.170933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:17.171406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:17.172211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:17.172674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:17.304644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:17.312597 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01b9a912-fbcc-4a9c-bd5d-ab548b026160 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1322 microversion: 2.1 time: 0.153491 Dec 25 21:52:17.313193 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3818/7667] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:17 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:18.207951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-dc522d1f-3c0a-462f-b01c-ccc95ac71e42 req-431675d3-f38f-4ee5-9f03-33426f887867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce34dc8-6b55-4575-9f10-ed25dee621ae", "name": "network-vif-plugged", "status": "completed", "tag": "12ff2e6f-e520-4ecb-8160-89926b8e03bf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:18.209601 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:18.209601 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:52:18.216649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dc522d1f-3c0a-462f-b01c-ccc95ac71e42 req-431675d3-f38f-4ee5-9f03-33426f887867 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:18.217134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-dc522d1f-3c0a-462f-b01c-ccc95ac71e42 req-431675d3-f38f-4ee5-9f03-33426f887867 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:18.228239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-dc522d1f-3c0a-462f-b01c-ccc95ac71e42 req-431675d3-f38f-4ee5-9f03-33426f887867 service nova] Creating event network-vif-plugged:12ff2e6f-e520-4ecb-8160-89926b8e03bf for instance fce34dc8-6b55-4575-9f10-ed25dee621ae on nch2-master-1 Dec 25 21:52:18.233253 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-dc522d1f-3c0a-462f-b01c-ccc95ac71e42 req-431675d3-f38f-4ee5-9f03-33426f887867 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091817 Dec 25 21:52:18.234057 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3850/7668] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:52:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:18.329069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:18.329691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:18.337057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:18.337057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:18.338056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:18.338508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:18.482287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:18.489641 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-310511a6-f3c1-4b3f-ae78-dae21d180db3 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1322 microversion: 2.1 time: 0.164355 Dec 25 21:52:18.490207 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3819/7669] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:18 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:19.507524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:19.508227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:19.518188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:19.518645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:19.519439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:19.519880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:19.655102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:19.662389 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b12b5ebf-5a98-4d84-a03a-289435b3bdda tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1471 microversion: 2.1 time: 0.159731 Dec 25 21:52:19.662968 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3851/7670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:19 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:19.733816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af14cec0-9bf1-4473-8361-4e8aa5661913 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Calling method '.version_select at 0x7fa4f6d55f70>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:19.798041 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af14cec0-9bf1-4473-8361-4e8aa5661913 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/d2d9ec07b6154cd5a9ede3e238760682" status: 200 len: 371 microversion: 2.1 time: 0.120747 Dec 25 21:52:19.798784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3820/7671] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:52:19 2021] GET /compute/v2.1/os-quota-sets/d2d9ec07b6154cd5a9ede3e238760682 => generated 371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:19.808541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5162c847-a549-49fb-9679-998a36e2345a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-309527341", "id": 1997392385, "os-flavor-access:is_public": "True"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:19.810163 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:19.810163 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:52:19.879711 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5162c847-a549-49fb-9679-998a36e2345a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.074765 Dec 25 21:52:19.880298 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3852/7672] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:52:19 2021] POST /compute/v2.1/flavors => generated 437 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:19.890901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1997392385"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:19.891927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:19.898048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:19.898523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:19.899327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:19.901997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.093957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b83f18d8638945e5a0d1410199846a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d9ec07b6154cd5a9ede3e238760682', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:20.100332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-309527341 {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:52:20.101468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.101938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.102797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.103245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.122824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Getting quotas for project 283beb68bf4d4ba8951f370b7b057323. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:52:20.127812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Getting quotas for user 55da14ac01534b83affd4478904fd87f and project 283beb68bf4d4ba8951f370b7b057323. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:52:20.139763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] ram quota exceeded for d2d9ec07b6154cd5a9ede3e238760682, tried to resize instance. Dec 25 21:52:20.140318 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Dec 25 21:52:20.140965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:52:20.141815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c847e508-8a03-482b-94f1-914f36ad1b69 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae/action" status: 403 len: 118 microversion: 2.1 time: 0.254775 Dec 25 21:52:20.142382 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3821/7673] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:52:19 2021] POST /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae/action => generated 118 bytes in 256 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:52:20.151715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3db461d0-a49e-41d6-92cb-0a87ac387172 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:20.152490 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:20.152490 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:52:20.217086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3db461d0-a49e-41d6-92cb-0a87ac387172 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/1997392385" status: 202 len: 0 microversion: 2.1 time: 0.069606 Dec 25 21:52:20.217661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3853/7674] 10.222.0.32 () {58 vars in 1160 bytes} [Sat Dec 25 21:52:20 2021] DELETE /compute/v2.1/flavors/1997392385 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 21:52:20.225863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a503848e-48ad-42b8-9796-9f5c6a459b40 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:20.243903 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a503848e-48ad-42b8-9796-9f5c6a459b40 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022077 Dec 25 21:52:20.244444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3822/7675] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:52:20 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:20.260825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42a21e48-4499-4557-a99b-743b1e689062 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Calling method '.version_select at 0x7fa5006f30d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:20.329505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42a21e48-4499-4557-a99b-743b1e689062 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "GET /compute/v2.1/os-quota-sets/d2d9ec07b6154cd5a9ede3e238760682" status: 200 len: 371 microversion: 2.1 time: 0.072892 Dec 25 21:52:20.330079 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3854/7676] 10.222.0.32 () {58 vars in 1241 bytes} [Sat Dec 25 21:52:20 2021] GET /compute/v2.1/os-quota-sets/d2d9ec07b6154cd5a9ede3e238760682 => generated 371 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:20.340687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b1abe989-7594-467e-ac69-c68f437d8a9a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1419303608", "id": 888549003, "os-flavor-access:is_public": "True"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:20.342314 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:20.342314 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:52:20.444212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b1abe989-7594-467e-ac69-c68f437d8a9a tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.107852 Dec 25 21:52:20.444791 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3823/7677] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:52:20 2021] POST /compute/v2.1/flavors => generated 434 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:20.455875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "888549003"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:20.456890 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:20.462972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.463419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.464218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.464651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.598768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'b83f18d8638945e5a0d1410199846a68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2d9ec07b6154cd5a9ede3e238760682', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:20.605246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1419303608 {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:52:20.606308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.606759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.607570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.608005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.633397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Getting quotas for project 283beb68bf4d4ba8951f370b7b057323. Resources: {'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:52:20.638927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Getting quotas for user 55da14ac01534b83affd4478904fd87f and project 283beb68bf4d4ba8951f370b7b057323. Resources: {'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:52:20.650671 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.compute.api [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] cores quota exceeded for d2d9ec07b6154cd5a9ede3e238760682, tried to resize instance. Dec 25 21:52:20.651208 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Dec 25 21:52:20.651804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:52:20.652644 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-26efb9be-c8a7-4306-bbc3-d3dd2a87199c tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "POST /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae/action" status: 403 len: 113 microversion: 2.1 time: 0.200671 Dec 25 21:52:20.653264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3855/7678] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:52:20 2021] POST /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae/action => generated 113 bytes in 202 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:52:20.661381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-842f4ceb-17d1-4ee4-bfa2-ac9db08a9180 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:20.662150 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:20.662150 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:52:20.770971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-842f4ceb-17d1-4ee4-bfa2-ac9db08a9180 tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "DELETE /compute/v2.1/flavors/888549003" status: 202 len: 0 microversion: 2.1 time: 0.113182 Dec 25 21:52:20.771645 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3824/7679] 10.222.0.32 () {58 vars in 1157 bytes} [Sat Dec 25 21:52:20 2021] DELETE /compute/v2.1/flavors/888549003 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:52:20.785335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7001026-e0d9-4fa1-bf6b-5648a8e51daf tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:20.804263 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7001026-e0d9-4fa1-bf6b-5648a8e51daf tempest-ServersAdminNegativeTestJSON-554857935 tempest-ServersAdminNegativeTestJSON-554857935-project-admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022539 Dec 25 21:52:20.804830 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3856/7680] 10.222.0.32 () {58 vars in 1145 bytes} [Sat Dec 25 21:52:20 2021] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:52:20.822849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:20.823314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:20.829878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.830350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.831158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:20.831617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:20.855709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:52:21.211817 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fcc4d3d4-3faa-4bd4-9779-8d4bfd78810f tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 204 len: 0 microversion: 2.1 time: 0.392463 Dec 25 21:52:21.212362 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3825/7681] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:52:20 2021] DELETE /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:52:21.220775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:21.222391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:21.227621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:21.228075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:21.229518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:21.229955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:21.357936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:21.365520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d0aedaf-c24f-491a-a7a4-5572e6102048 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1477 microversion: 2.1 time: 0.148360 Dec 25 21:52:21.366083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3857/7682] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:21 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1477 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:22.383037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:22.383758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:22.391170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:22.391646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:22.392462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:22.392941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:22.528001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:22.535640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-88add765-e62c-4311-b2a0-85c1fb51e6cc tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1477 microversion: 2.1 time: 0.156770 Dec 25 21:52:22.536208 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3826/7683] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:22 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:23.048050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f31a1a06-6b66-46f9-ba46-d461be4b531c req-e501ee36-6e50-4a3b-8d1b-d0e6c41ea111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce34dc8-6b55-4575-9f10-ed25dee621ae", "name": "network-vif-deleted", "tag": "12ff2e6f-e520-4ecb-8160-89926b8e03bf"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:23.050223 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:23.050223 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:52:23.059988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f31a1a06-6b66-46f9-ba46-d461be4b531c req-e501ee36-6e50-4a3b-8d1b-d0e6c41ea111 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:23.060437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f31a1a06-6b66-46f9-ba46-d461be4b531c req-e501ee36-6e50-4a3b-8d1b-d0e6c41ea111 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:23.072904 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f31a1a06-6b66-46f9-ba46-d461be4b531c req-e501ee36-6e50-4a3b-8d1b-d0e6c41ea111 service nova] Creating event network-vif-deleted:12ff2e6f-e520-4ecb-8160-89926b8e03bf for instance fce34dc8-6b55-4575-9f10-ed25dee621ae on nch2-master-1 Dec 25 21:52:23.079541 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f31a1a06-6b66-46f9-ba46-d461be4b531c req-e501ee36-6e50-4a3b-8d1b-d0e6c41ea111 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035065 Dec 25 21:52:23.080620 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3858/7684] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:52:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:23.551991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:23.552625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:23.560409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:23.560907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:23.561716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:23.562178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:23.596114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:23.596592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:23.597096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lazy-loading 'fault' on Instance uuid fce34dc8-6b55-4575-9f10-ed25dee621ae {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:52:23.641404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55da14ac01534b83affd4478904fd87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '283beb68bf4d4ba8951f370b7b057323', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:23.649256 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf49a8df-05fc-49f1-8a48-8de8fcdfafae tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 200 len: 1312 microversion: 2.1 time: 0.100976 Dec 25 21:52:23.649829 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3827/7685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:23 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:24.667211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:24.667903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] [instance: fce34dc8-6b55-4575-9f10-ed25dee621ae] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:24.674155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:24.674614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:24.675392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:24.675829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:24.688940 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] HTTP exception thrown: Instance fce34dc8-6b55-4575-9f10-ed25dee621ae could not be found. Dec 25 21:52:24.689523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] Returning 404 to user: Instance fce34dc8-6b55-4575-9f10-ed25dee621ae could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:52:24.690339 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e4f6d805-3864-4cea-a2f0-e427acce3942 tempest-ServersAdminNegativeTestJSON-1717074468 tempest-ServersAdminNegativeTestJSON-1717074468-project] 10.222.0.32 "GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae" status: 404 len: 111 microversion: 2.1 time: 0.028171 Dec 25 21:52:24.690860 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3859/7686] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:24 2021] GET /compute/v2.1/servers/fce34dc8-6b55-4575-9f10-ed25dee621ae => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:52:28.911200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1296145163", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "416476a2-4ce9-439c-aafe-69d198cebd4e"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:28.961789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] validate_networks() for [('416476a2-4ce9-439c-aafe-69d198cebd4e', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:52:29.305411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:52:29.305887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:52:29.306392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:52:29.306823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:52:29.307283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:52:29.316206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:29.316678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:29.317569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:29.318031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:29.336159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Getting quotas for project 90d2eddaaa684a86a317f70bb44fdde5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:52:29.342032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Getting quotas for user 5d6c5eaab6ba43418a4a0e05312f53bf and project 90d2eddaaa684a86a317f70bb44fdde5. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:52:29.354563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:52:29.357014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:52:29.493961 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1bb930a-ff87-4515-ac4f-98204fb1ca38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695616 Dec 25 21:52:29.494685 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3828/7687] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:52:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:52:29.505465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5837f3c6-9b33-447e-af97-ce812e429b4a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:29.512376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5837f3c6-9b33-447e-af97-ce812e429b4a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:29.563151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5837f3c6-9b33-447e-af97-ce812e429b4a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:29.573267 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5837f3c6-9b33-447e-af97-ce812e429b4a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1215 microversion: 2.1 time: 0.071861 Dec 25 21:52:29.574557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3860/7688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:29 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:30.590604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:30.591275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:30.598291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:30.600113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:30.600113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:30.600113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:30.668911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:30.676349 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4780703-6480-4aed-9175-3d351031d302 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1219 microversion: 2.1 time: 0.089513 Dec 25 21:52:30.676927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3829/7689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:30 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:31.693546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:31.694121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:31.701787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:31.702248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:31.703048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:31.703530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:31.774659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:31.782175 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2888b444-a120-4b20-9b94-bffdadd7b0b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1273 microversion: 2.1 time: 0.092355 Dec 25 21:52:31.782760 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3861/7690] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:31 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:32.799481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:32.800108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:32.807110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:32.807565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:32.808365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:32.808814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:32.950040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:32.957636 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ed3d9661-8814-4e9e-bab9-7435dd32ea70 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1315 microversion: 2.1 time: 0.161994 Dec 25 21:52:32.958559 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3830/7691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:32 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:32.991648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ad566868-e58a-47df-9149-5e5174564968 req-dbdc4572-5b7b-4cb3-88f5-36a2cb05f198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0baf43f-690c-4bca-b179-527dcf8bbd94", "tag": "a5da8977-b2e2-4530-ac17-04bf60ab35a2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:32.993298 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:32.993298 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:52:33.002017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ad566868-e58a-47df-9149-5e5174564968 req-dbdc4572-5b7b-4cb3-88f5-36a2cb05f198 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:33.002757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ad566868-e58a-47df-9149-5e5174564968 req-dbdc4572-5b7b-4cb3-88f5-36a2cb05f198 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:33.013762 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ad566868-e58a-47df-9149-5e5174564968 req-dbdc4572-5b7b-4cb3-88f5-36a2cb05f198 service nova] Creating event network-changed:a5da8977-b2e2-4530-ac17-04bf60ab35a2 for instance d0baf43f-690c-4bca-b179-527dcf8bbd94 on nch2-master-1 Dec 25 21:52:33.018414 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ad566868-e58a-47df-9149-5e5174564968 req-dbdc4572-5b7b-4cb3-88f5-36a2cb05f198 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030728 Dec 25 21:52:33.019016 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3862/7692] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:52:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:33.975080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:33.975815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:33.983324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:33.983873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:33.984747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:33.985361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:34.119958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:34.127757 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-901ad77e-a691-41a1-833d-51a5ca773b45 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1315 microversion: 2.1 time: 0.157079 Dec 25 21:52:34.128333 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3831/7693] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:33 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:52:35.145911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:35.146526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:35.152777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:35.153262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:35.154042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:35.154480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:35.281936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:35.289189 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-186aaf16-baa3-437c-8779-91bb0f8107b1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1315 microversion: 2.1 time: 0.148279 Dec 25 21:52:35.289759 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3863/7694] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:35 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:36.307492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:36.308302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:36.316423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:36.316904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:36.317975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:36.318533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:36.460295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:36.467763 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83c6bb49-84db-4b95-ac0b-1636118ed998 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1315 microversion: 2.1 time: 0.165132 Dec 25 21:52:36.468337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3832/7695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:36 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:37.484439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:37.485089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:37.491817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:37.492270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:37.493075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:37.493519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:37.623353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:37.630987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eb4cc690-80ba-4acb-b7f4-82108fcf8df7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1315 microversion: 2.1 time: 0.150297 Dec 25 21:52:37.631588 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3864/7696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:37 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:52:38.312187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b46117ed-260b-471e-8103-798e337b7206 req-e4a87916-cee4-406c-b78c-677811d99236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0baf43f-690c-4bca-b179-527dcf8bbd94", "name": "network-vif-plugged", "status": "completed", "tag": "a5da8977-b2e2-4530-ac17-04bf60ab35a2"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:38.317124 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:52:38.317124 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:52:38.322101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b46117ed-260b-471e-8103-798e337b7206 req-e4a87916-cee4-406c-b78c-677811d99236 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:38.322564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b46117ed-260b-471e-8103-798e337b7206 req-e4a87916-cee4-406c-b78c-677811d99236 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:38.333837 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b46117ed-260b-471e-8103-798e337b7206 req-e4a87916-cee4-406c-b78c-677811d99236 service nova] Creating event network-vif-plugged:a5da8977-b2e2-4530-ac17-04bf60ab35a2 for instance d0baf43f-690c-4bca-b179-527dcf8bbd94 on nch2-master-1 Dec 25 21:52:38.338878 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b46117ed-260b-471e-8103-798e337b7206 req-e4a87916-cee4-406c-b78c-677811d99236 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030872 Dec 25 21:52:38.339701 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3833/7697] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:52:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:52:38.647386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:38.647996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:38.655284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:38.655735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:38.656508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:38.656967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:38.793607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:38.800955 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aae764f5-e009-4e71-919f-a2d4a2312932 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1315 microversion: 2.1 time: 0.157239 Dec 25 21:52:38.801661 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3865/7698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:38 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:39.818964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:39.819595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:39.825966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:39.826442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:39.827241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:39.827697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:39.956356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:39.964131 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c221e56-2ee8-4250-89b7-e198f7843d83 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1501 microversion: 2.1 time: 0.150275 Dec 25 21:52:39.964718 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3834/7699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:39 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1501 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:39.980541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:52:39.982248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:39.988968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:39.994716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:39.994716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:39.994716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:40.017268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:40.023006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Old instance type m1.heat2, new instance type m1.heat {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:52:40.029485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:52:40.029910 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:52:40.030384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:52:40.030793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:52:40.031202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:52:40.213979 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37db4541-4749-4be9-aa19-19d0a3a8b183 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "POST /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94/action" status: 202 len: 0 microversion: 2.1 time: 0.237214 Dec 25 21:52:40.214599 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3866/7700] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:52:39 2021] POST /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:52:40.223226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:40.224057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:40.230074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:40.230542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:40.231339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:40.231978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:40.367557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:40.375151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d756573-7ceb-43e8-846c-0408bb28a21f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1510 microversion: 2.1 time: 0.155680 Dec 25 21:52:40.375716 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3835/7701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:40 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:41.392791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:41.393293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:41.399302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:41.399757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:41.400552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:41.401014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:41.532850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:41.540475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07b6b3ac-241a-4b01-8a13-24c5cc2617b2 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1510 microversion: 2.1 time: 0.152427 Dec 25 21:52:41.541083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3867/7702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:41 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:42.557933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:42.558685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:42.566160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:42.566628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:42.567429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:42.567880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:42.797294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:42.804764 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a285217c-5aa0-4100-962a-721721735e1e tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1510 microversion: 2.1 time: 0.250533 Dec 25 21:52:42.805374 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3836/7703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:42 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1510 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:43.821839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:43.822440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:43.829186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:43.829626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:43.830399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:43.830831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:43.964713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:43.973231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bb1b23ba-eade-4464-825f-6163be1eb3b7 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.155035 Dec 25 21:52:43.973812 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3868/7704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:43 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:44.990208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:44.990845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:44.997178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:44.997678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:44.998476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:44.998928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:45.127044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:45.134421 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98534fa0-1c97-4ad5-923a-a3ac8e617d47 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.147931 Dec 25 21:52:45.134987 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3837/7705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:44 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:46.150992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:46.151598 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:46.158361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:46.158809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:46.159579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:46.160013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:46.292567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:46.300104 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f501728-7242-4c34-8ec4-0fca6c682449 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.152788 Dec 25 21:52:46.300685 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3869/7706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:46 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:47.316658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:47.317320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:47.324428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:47.324911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:47.325702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:47.326149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:47.456348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:47.463737 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-574c8040-9c34-49e9-b201-e902b5af1433 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.150841 Dec 25 21:52:47.464305 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3838/7707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:47 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:48.480428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:48.481726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:48.489460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:48.489913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:48.490697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:48.491139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:48.630922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:48.638406 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-046ff8f3-5fd9-41e8-8efc-11154b16ef1a tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.161655 Dec 25 21:52:48.638973 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3870/7708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:48 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:49.655008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:49.655663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:49.662415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:49.662878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:49.663671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:49.664121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:49.795702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:49.803071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b36f8bb-54c1-4a03-aa8c-754879baac17 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.151868 Dec 25 21:52:49.803659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3839/7709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:49 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:50.819360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:50.819997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:50.826834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:50.827282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:50.828052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:50.828484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:50.962089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:50.969497 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-451d6a8d-24cb-4092-85be-fb8b4732706f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.153837 Dec 25 21:52:50.970085 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3871/7710] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:50 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:51.986299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:51.986976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:51.993849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:51.994319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:51.995118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:51.995576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:52.131386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:52.139549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06c43ee6-fe57-4f3b-bff2-b11b68597cef tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.156990 Dec 25 21:52:52.140130 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3840/7711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:51 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:53.155950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:53.156569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:53.163349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:53.163810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:53.164592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:53.165067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:53.295323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:53.302752 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88e2ffd7-983e-4922-abcc-4ac63fae8afc tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.151145 Dec 25 21:52:53.303330 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3872/7712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:53 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:54.319866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:54.320619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:54.327342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:54.327808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:54.328609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:54.329090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:54.468324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:54.475829 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fb36aa82-3819-4508-ac16-354e52f01949 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.159774 Dec 25 21:52:54.476440 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3841/7713] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:54 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:55.493094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:55.493726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:55.500463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:55.501197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:55.501983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:55.502415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:55.633640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:55.641627 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f772e089-5570-4293-8a97-454aaf745843 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.152280 Dec 25 21:52:55.642210 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3873/7714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:55 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:56.658214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:56.658843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:56.665662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:56.666125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:56.666917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:56.667372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:56.804140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:56.811584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b1ea57e-8243-4f25-bdee-268dfcb0a9c1 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.157114 Dec 25 21:52:56.812169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3842/7715] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:56 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:57.828096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:57.828686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:57.835429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:57.835875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:57.836648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:57.837109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:57.967586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:57.975022 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23336ba8-82a4-477b-a685-2d54c0e6d574 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.150642 Dec 25 21:52:57.975590 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3874/7716] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:57 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:52:58.992360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:52:58.993020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:52:59.000399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:59.001142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:59.001965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:52:59.002402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:52:59.132129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:52:59.139455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51c2ebb4-2b9d-41e6-afa8-26de25096022 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.150897 Dec 25 21:52:59.140023 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3843/7717] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:52:58 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:00.156160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:00.156776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:00.163589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:00.164049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:00.164839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:00.165308 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:00.297205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:00.304519 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b7c4e8a4-2eed-4c8d-b656-fd3b3fd416af tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.152150 Dec 25 21:53:00.305123 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3875/7718] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:00 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:01.321932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:01.322564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:01.330451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:01.330926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:01.331751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:01.332229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:01.465014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:01.473046 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1403451-1baa-4290-8435-5f97cb626f38 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.154891 Dec 25 21:53:01.473623 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3844/7719] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:01 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:53:02.489676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:02.490359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:02.497178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:02.497636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:02.498418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:02.498860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:02.631358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:02.638792 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d416e2da-9c8a-42f3-89b9-a507457c5d7f tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.152848 Dec 25 21:53:02.639364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3876/7720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:02 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:03.656205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:03.656837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:03.663630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:03.664100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:03.664921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:03.665381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:03.797479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:03.805007 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-547d8dcf-37d7-4e72-8a34-db4bd09e1827 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.153271 Dec 25 21:53:03.805581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3845/7721] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:03 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:04.822122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:04.825117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:04.830074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:04.830524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:04.831295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:04.831736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:04.967524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:04.974874 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2e089708-f701-4196-ba94-cd946eb9b793 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.156446 Dec 25 21:53:04.975443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3877/7722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:04 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:05.992022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:05.992661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:05.999564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:06.003309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:06.003309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:06.003309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:06.132243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:06.140290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-993ca7df-1c00-4785-a690-ada3a93f20bf tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.152000 Dec 25 21:53:06.140862 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3846/7723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:05 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:07.156593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:07.157237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:07.164097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:07.164556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:07.165370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:07.165817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:07.294368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:07.301785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1650b7c-870b-4f07-a7de-42bb6873c350 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.149408 Dec 25 21:53:07.302362 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3878/7724] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:07 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:08.318412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:08.319051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:08.326045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:08.326513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:08.327315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:08.327772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:08.461442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:08.469409 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-97cb8ebe-0f9c-482a-b95e-c24c23ebc6b0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.154728 Dec 25 21:53:08.469980 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3847/7725] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:08 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:09.486706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:09.487320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:09.494304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:09.494762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:09.495551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:09.495992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:09.629964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:09.637287 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-004324bf-24f1-4dd2-8fba-9cc94f93b1a0 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1515 microversion: 2.1 time: 0.154416 Dec 25 21:53:09.638035 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3879/7726] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:09 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:10.654740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:10.655987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:10.664465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:10.665229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:10.666878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:10.667320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:11.059617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:11.066025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-73cb5c2b-f29a-4bf0-8452-3b16f8ee3426 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1514 microversion: 2.1 time: 0.416243 Dec 25 21:53:11.066635 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3848/7727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:10 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:11.427126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-18f1bb41-6195-42bd-b1b4-02786c104054 req-ab438ee3-31c3-42ee-832d-285bb774b7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0baf43f-690c-4bca-b179-527dcf8bbd94", "name": "network-vif-unplugged", "status": "completed", "tag": "a5da8977-b2e2-4530-ac17-04bf60ab35a2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:11.431542 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:53:11.431542 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:53:11.436363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-18f1bb41-6195-42bd-b1b4-02786c104054 req-ab438ee3-31c3-42ee-832d-285bb774b7aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:11.436804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-18f1bb41-6195-42bd-b1b4-02786c104054 req-ab438ee3-31c3-42ee-832d-285bb774b7aa service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:11.448013 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-18f1bb41-6195-42bd-b1b4-02786c104054 req-ab438ee3-31c3-42ee-832d-285bb774b7aa service nova] Creating event network-vif-unplugged:a5da8977-b2e2-4530-ac17-04bf60ab35a2 for instance d0baf43f-690c-4bca-b179-527dcf8bbd94 on nch1-master-1 Dec 25 21:53:11.453691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-18f1bb41-6195-42bd-b1b4-02786c104054 req-ab438ee3-31c3-42ee-832d-285bb774b7aa service nova] Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:53:11.464244 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-18f1bb41-6195-42bd-b1b4-02786c104054 req-ab438ee3-31c3-42ee-832d-285bb774b7aa service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040886 Dec 25 21:53:11.465437 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3880/7728] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:53:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:53:12.083832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:12.084686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:12.091849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:12.092325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:12.093207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:12.093651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:12.313925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:12.321584 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-81a55935-dd3a-49e7-9407-bde7b0244845 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1514 microversion: 2.1 time: 0.241846 Dec 25 21:53:12.322184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3849/7729] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:12 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:13.339545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:13.340284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:13.346591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:13.347045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:13.347830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:13.348271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:13.483137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2999692c-242e-429c-af5f-24286c0953c2 req-55aacbcd-a240-4958-8fa6-14f36b617524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0baf43f-690c-4bca-b179-527dcf8bbd94", "tag": "a5da8977-b2e2-4530-ac17-04bf60ab35a2"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:13.484641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:13.484803 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:53:13.484803 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:53:13.492210 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bd29792b-3987-4add-95fe-7bcc5e43b9b6 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1512 microversion: 2.1 time: 0.157573 Dec 25 21:53:13.492399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2999692c-242e-429c-af5f-24286c0953c2 req-55aacbcd-a240-4958-8fa6-14f36b617524 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:13.492787 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3881/7730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:13 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:13.492962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2999692c-242e-429c-af5f-24286c0953c2 req-55aacbcd-a240-4958-8fa6-14f36b617524 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:13.505530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2999692c-242e-429c-af5f-24286c0953c2 req-55aacbcd-a240-4958-8fa6-14f36b617524 service nova] Creating event network-changed:a5da8977-b2e2-4530-ac17-04bf60ab35a2 for instance d0baf43f-690c-4bca-b179-527dcf8bbd94 on nch1-master-1 Dec 25 21:53:13.510936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-2999692c-242e-429c-af5f-24286c0953c2 req-55aacbcd-a240-4958-8fa6-14f36b617524 service nova] Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:53:13.522136 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2999692c-242e-429c-af5f-24286c0953c2 req-55aacbcd-a240-4958-8fa6-14f36b617524 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043515 Dec 25 21:53:13.522723 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3850/7731] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:53:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:53:14.510565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:14.511927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:14.518997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:14.519767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:14.521348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:14.522024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:14.752252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:14.759696 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ecde90e0-49b4-4983-aba7-b78e123ba073 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1509 microversion: 2.1 time: 0.252798 Dec 25 21:53:14.761338 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3882/7732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:14 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1509 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:14.777305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:14.777835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:14.784232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:14.784729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:14.785565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:14.786025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:14.811572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:53:14.904821 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Found an unconfirmed migration during delete, id: 16, status: finished Dec 25 21:53:16.635508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-410a82aa-2812-4a5b-8696-7298421c0e89 req-23a3e130-6dbe-4d91-b899-b220a1800515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0baf43f-690c-4bca-b179-527dcf8bbd94", "name": "network-vif-plugged", "status": "completed", "tag": "a5da8977-b2e2-4530-ac17-04bf60ab35a2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:16.637395 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:53:16.637395 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:53:16.645057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-410a82aa-2812-4a5b-8696-7298421c0e89 req-23a3e130-6dbe-4d91-b899-b220a1800515 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:16.645713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-410a82aa-2812-4a5b-8696-7298421c0e89 req-23a3e130-6dbe-4d91-b899-b220a1800515 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:16.656553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-410a82aa-2812-4a5b-8696-7298421c0e89 req-23a3e130-6dbe-4d91-b899-b220a1800515 service nova] Creating event network-vif-plugged:a5da8977-b2e2-4530-ac17-04bf60ab35a2 for instance d0baf43f-690c-4bca-b179-527dcf8bbd94 on nch1-master-1 Dec 25 21:53:16.661486 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-410a82aa-2812-4a5b-8696-7298421c0e89 req-23a3e130-6dbe-4d91-b899-b220a1800515 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029792 Dec 25 21:53:16.665881 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3883/7733] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:53:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:53:16.936655 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d58b37c-105a-4ee5-89bc-c1ef96fbb543 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 204 len: 0 microversion: 2.1 time: 2.163948 Dec 25 21:53:16.937269 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3851/7734] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:53:14 2021] DELETE /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 0 bytes in 2166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:53:16.945590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:16.946427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:16.952834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:16.953314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:16.954102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:16.954535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:17.085353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:17.093247 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c6bb9b4e-9cb7-4676-a9d0-ad10af922740 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1501 microversion: 2.1 time: 0.151658 Dec 25 21:53:17.093818 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3884/7735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:16 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1501 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:18.110738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:18.111448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:18.118398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:18.118861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:18.119655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:18.120108 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:18.279401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d6c5eaab6ba43418a4a0e05312f53bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90d2eddaaa684a86a317f70bb44fdde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:18.287071 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f950d4c-38b1-4c66-aa80-d58022308900 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 200 len: 1501 microversion: 2.1 time: 0.180490 Dec 25 21:53:18.293303 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3852/7736] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:18 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:18.760988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d1789a47-06bd-4d1c-81a0-b4d2b35bc5f5 req-7b34c199-a193-4803-b74d-c39b805b310e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0baf43f-690c-4bca-b179-527dcf8bbd94", "name": "network-vif-deleted", "tag": "a5da8977-b2e2-4530-ac17-04bf60ab35a2"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:18.762490 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:53:18.762490 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:53:18.770450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d1789a47-06bd-4d1c-81a0-b4d2b35bc5f5 req-7b34c199-a193-4803-b74d-c39b805b310e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:18.770896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d1789a47-06bd-4d1c-81a0-b4d2b35bc5f5 req-7b34c199-a193-4803-b74d-c39b805b310e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:18.782087 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d1789a47-06bd-4d1c-81a0-b4d2b35bc5f5 req-7b34c199-a193-4803-b74d-c39b805b310e service nova] Creating event network-vif-deleted:a5da8977-b2e2-4530-ac17-04bf60ab35a2 for instance d0baf43f-690c-4bca-b179-527dcf8bbd94 on nch1-master-1 Dec 25 21:53:18.786892 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d1789a47-06bd-4d1c-81a0-b4d2b35bc5f5 req-7b34c199-a193-4803-b74d-c39b805b310e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030126 Dec 25 21:53:18.789771 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3885/7737] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:53:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:53:19.303542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:19.304172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:19.311052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:19.312450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:19.312450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:19.312749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:19.325866 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] HTTP exception thrown: Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 could not be found. Dec 25 21:53:19.326478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Returning 404 to user: Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:53:19.327315 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dc95a478-5a11-44b2-a7bc-639fa67c1408 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 404 len: 111 microversion: 2.1 time: 0.027675 Dec 25 21:53:19.327857 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3853/7738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:19 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:53:19.343287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:19.343917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:19.350501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:19.351041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:19.351823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:19.352264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:19.366062 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] HTTP exception thrown: Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 could not be found. Dec 25 21:53:19.369891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Returning 404 to user: Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:53:19.369891 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5d99f5e6-0231-42c2-a830-307509a0b788 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 404 len: 111 microversion: 2.1 time: 0.028989 Dec 25 21:53:19.369891 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3886/7739] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:53:19 2021] DELETE /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:53:19.376118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:19.376748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] [instance: d0baf43f-690c-4bca-b179-527dcf8bbd94] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:19.382777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:19.383248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:19.384048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:19.384501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:19.400462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] HTTP exception thrown: Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 could not be found. Dec 25 21:53:19.401105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] Returning 404 to user: Instance d0baf43f-690c-4bca-b179-527dcf8bbd94 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:53:19.402448 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3765b29c-a636-4bce-852d-cfbf57924067 tempest-DeleteServersTestJSON-1651578316 tempest-DeleteServersTestJSON-1651578316-project] 10.222.0.32 "GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94" status: 404 len: 111 microversion: 2.1 time: 0.029828 Dec 25 21:53:19.402978 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3854/7740] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:19 2021] GET /compute/v2.1/servers/d0baf43f-690c-4bca-b179-527dcf8bbd94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:53:23.167070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1930726859", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "c7d9ee7c-a398-4322-a4d1-20e2155d0262"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:23.219779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] validate_networks() for [('c7d9ee7c-a398-4322-a4d1-20e2155d0262', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:53:23.569765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:53:23.570186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:53:23.570659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:53:23.571066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:53:23.571474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:53:23.580858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:23.581329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:23.582141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:23.582569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:23.599333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Getting quotas for project 9320712a3a5e434d84414d98bfe55244. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:53:23.604302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Getting quotas for user 36a0bcb4058b470094465b56095ee02c and project 9320712a3a5e434d84414d98bfe55244. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:53:23.616282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:53:23.618677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:53:23.753957 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7618cc33-c985-4255-ab2e-3a59d0456c36 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708699 Dec 25 21:53:23.754673 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3887/7741] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:53:23 2021] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:53:23.765324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fdda66a6-7f1e-4859-8a2e-b2cdc66859e1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:23.765988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fdda66a6-7f1e-4859-8a2e-b2cdc66859e1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:23.825438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fdda66a6-7f1e-4859-8a2e-b2cdc66859e1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:23.832160 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fdda66a6-7f1e-4859-8a2e-b2cdc66859e1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1218 microversion: 2.1 time: 0.071333 Dec 25 21:53:23.832731 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3855/7742] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:23 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:24.848853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:24.849505 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:24.857342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:24.857800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:24.858604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:24.859053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:24.919758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:24.927615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e18968e9-ec9f-45cd-a6b1-15f40c991197 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1222 microversion: 2.1 time: 0.082640 Dec 25 21:53:24.928246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3888/7743] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:24 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:25.944575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:25.945228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:25.954939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:25.955414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:25.956234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:25.956758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:26.033585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:26.041120 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc607457-14a9-4d02-8bfd-6a154239de31 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1288 microversion: 2.1 time: 0.100200 Dec 25 21:53:26.041701 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3856/7744] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:25 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1288 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:27.058532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:27.059179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:27.066388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:27.066852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:27.067694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:27.068150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:27.231342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:27.238805 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfae2169-87f4-4adb-b973-bd9149377770 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1318 microversion: 2.1 time: 0.184653 Dec 25 21:53:27.239374 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3889/7745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:27 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:27.285172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ea59a2cf-a7e0-453b-b003-adf10357f133 req-4d218e71-0ea3-4522-a2f8-928ac6f54e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1aa2a03-16ee-48f5-84a4-6b1051bcac02", "tag": "722925ec-4e88-4149-a9ac-d5736c56e3e5"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:27.287034 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:53:27.287034 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:53:27.295400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ea59a2cf-a7e0-453b-b003-adf10357f133 req-4d218e71-0ea3-4522-a2f8-928ac6f54e2e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:27.296012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ea59a2cf-a7e0-453b-b003-adf10357f133 req-4d218e71-0ea3-4522-a2f8-928ac6f54e2e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:27.307600 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ea59a2cf-a7e0-453b-b003-adf10357f133 req-4d218e71-0ea3-4522-a2f8-928ac6f54e2e service nova] Creating event network-changed:722925ec-4e88-4149-a9ac-d5736c56e3e5 for instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 on nch2-master-1 Dec 25 21:53:27.313179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ea59a2cf-a7e0-453b-b003-adf10357f133 req-4d218e71-0ea3-4522-a2f8-928ac6f54e2e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031752 Dec 25 21:53:27.317407 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3857/7746] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:53:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:53:28.261763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:28.262390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:28.269217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:28.271947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:28.271947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:28.271947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:28.404804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:28.412341 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48f10062-7a65-4e2f-9b21-36eafb5103eb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1318 microversion: 2.1 time: 0.154931 Dec 25 21:53:28.412940 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3890/7747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:28 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:29.430379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:29.431113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:29.437592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:29.438058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:29.438843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:29.439293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:29.568243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:29.576123 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc5665fc-c353-4959-ad46-0967e6a6d35c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1318 microversion: 2.1 time: 0.150680 Dec 25 21:53:29.576692 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3858/7748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:29 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:30.592456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:30.593012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:30.599843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:30.600294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:30.601121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:30.601559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:30.740676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:30.748079 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ccdbc274-9c74-4426-9a53-9d42c22a003f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1318 microversion: 2.1 time: 0.159985 Dec 25 21:53:30.748652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3891/7749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:30 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:31.765165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:31.766823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:31.772755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:31.773248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:31.774079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:31.774528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:31.904563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:31.911837 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-725e9106-bcfb-4be0-a9d2-f2d5ef1f4c71 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1318 microversion: 2.1 time: 0.150459 Dec 25 21:53:31.912409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3859/7750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:31 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:32.570119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-20229b11-8af7-4f7e-a51b-711f191793db req-60029664-3328-4626-bd50-374e63bfa02f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1aa2a03-16ee-48f5-84a4-6b1051bcac02", "name": "network-vif-plugged", "status": "completed", "tag": "722925ec-4e88-4149-a9ac-d5736c56e3e5"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:32.571714 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:53:32.571714 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:53:32.580294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-20229b11-8af7-4f7e-a51b-711f191793db req-60029664-3328-4626-bd50-374e63bfa02f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:32.580746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-20229b11-8af7-4f7e-a51b-711f191793db req-60029664-3328-4626-bd50-374e63bfa02f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:32.592167 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-20229b11-8af7-4f7e-a51b-711f191793db req-60029664-3328-4626-bd50-374e63bfa02f service nova] Creating event network-vif-plugged:722925ec-4e88-4149-a9ac-d5736c56e3e5 for instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 on nch2-master-1 Dec 25 21:53:32.597239 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-20229b11-8af7-4f7e-a51b-711f191793db req-60029664-3328-4626-bd50-374e63bfa02f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030854 Dec 25 21:53:32.597831 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3892/7751] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:53:32 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:53:32.928499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:32.929154 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:32.936439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:32.936932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:32.937739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:32.938193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:33.069919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:33.077622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b2cdf89-7a2e-40bc-99d2-917f0c7857f1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1318 microversion: 2.1 time: 0.152900 Dec 25 21:53:33.078188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3860/7752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:32 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:34.095587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:34.096284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:34.103034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.103478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.104249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.105315 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.233298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:34.240610 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-87ba758a-fc4b-4447-9bb3-17ade2863fc1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1507 microversion: 2.1 time: 0.150100 Dec 25 21:53:34.241207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3893/7753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:34 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:34.256399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:34.257063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:34.263854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.264317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.265140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.265594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.397288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:34.409860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-849dd708-1a98-4f2f-a3e7-adcd28dd75fb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1507 microversion: 2.1 time: 0.157155 Dec 25 21:53:34.410448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3861/7754] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:34 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:34.425775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:34.426880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:34.432810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.433302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.434089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.434526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.586384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ada5ed01-0579-466f-a80c-d6cbf8301441 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "PUT /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1079 microversion: 2.1 time: 0.164095 Dec 25 21:53:34.587124 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3894/7755] 10.222.0.32 () {60 vars in 1255 bytes} [Sat Dec 25 21:53:34 2021] PUT /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1079 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:34.601167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:34.601828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:34.608153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.608620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.609445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.609903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.742676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:34.750487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd093954-5197-4bc7-b52a-cc7b231bb88b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1505 microversion: 2.1 time: 0.152834 Dec 25 21:53:34.751079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3862/7756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:34 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:34.766475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:34.772344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:34.773059 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.773514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.774281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.774715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.908225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:34.915578 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c9110b27-dddb-4059-b3ec-0435b60dead4 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1505 microversion: 2.1 time: 0.152797 Dec 25 21:53:34.916141 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3895/7757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:34 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:53:34.931982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:53:34.933618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:34.939790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.940262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.941133 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:34.941598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:34.970322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:34.976654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Old instance type m1.heat2, new instance type m1.heat {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:53:34.983276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:53:34.983705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:53:34.984205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:53:34.984632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:53:34.985100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:53:35.171670 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ef9244c8-479c-408d-ac24-b9274c900704 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "POST /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02/action" status: 202 len: 0 microversion: 2.1 time: 0.243394 Dec 25 21:53:35.172425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3863/7758] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:53:34 2021] POST /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:53:35.180275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:35.180923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:35.188155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:35.188612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:35.189447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:35.189892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:35.321370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:35.329401 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20d6a97f-57af-46fe-a55d-98300a338f49 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1516 microversion: 2.1 time: 0.152962 Dec 25 21:53:35.329973 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3896/7759] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:35 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:36.347082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:36.347723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:36.353950 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:36.354428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:36.355251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:36.355706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:36.498645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:36.506493 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9e3cadd5-fa70-40b2-9ffa-e8a32d3930b2 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1516 microversion: 2.1 time: 0.164239 Dec 25 21:53:36.507154 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3864/7760] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:36 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:37.523901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:37.524515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:37.531967 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:37.532413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:37.533227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:37.533662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:37.745473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:37.753302 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7aa62019-7f5c-499a-b489-0cb6155e7716 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1516 microversion: 2.1 time: 0.233053 Dec 25 21:53:37.756137 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3897/7761] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:37 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:38.770699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:38.771369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:38.778717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:38.779189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:38.779992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:38.780447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:38.913673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:38.921688 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85c7af7d-6081-4200-ab14-7bab273469c1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.154751 Dec 25 21:53:38.922266 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3865/7762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:38 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:39.938697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:39.939231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:39.946124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:39.946575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:39.947447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:39.948278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:40.085380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:40.093674 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a307565f-921b-4611-80df-62bbdbdb1d00 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.158906 Dec 25 21:53:40.094246 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3898/7763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:39 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:41.110240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:41.110818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:41.117674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:41.118143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:41.118931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:41.119382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:41.247757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:41.255587 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f71aa38b-ca39-4fdd-a2d0-fe23729ce467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.149870 Dec 25 21:53:41.256157 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3866/7764] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:41 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:42.271918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:42.272526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:42.279323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:42.279774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:42.280542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:42.280997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:42.412917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:42.420922 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0fa19265-5164-4348-a92f-07b4fc663965 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.152670 Dec 25 21:53:42.421493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3899/7765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:42 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:43.438022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:43.438654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:43.445591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:43.446061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:43.446858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:43.447312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:43.576540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:43.583974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7741caba-199a-4fa5-ab8b-7f52ffea1a56 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.150313 Dec 25 21:53:43.584544 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3867/7766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:43 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:44.600673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:44.601300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:44.607998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:44.608448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:44.609258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:44.609689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:44.742786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:44.750988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8aa6e729-a8a0-4c81-b5c2-6e1c0cf64923 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.154103 Dec 25 21:53:44.751557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3900/7767] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:44 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:45.767914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:45.768539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:45.775347 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:45.775815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:45.776611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:45.777102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:45.908995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:45.916845 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9284cbe-7dbe-4a72-98f4-c4336d2102b0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.152646 Dec 25 21:53:45.917438 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3868/7768] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:45 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:46.932899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:46.933520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:46.939752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:46.940209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:46.941015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:46.941461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:47.068549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:47.075934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d98dda7-08e0-4c9f-b04f-c36597894eb9 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.146919 Dec 25 21:53:47.076501 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3901/7769] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:46 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:48.092555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:48.093216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:48.100038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:48.100507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:48.101353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:48.101805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:48.295621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:48.303443 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afe0dff5-9ec2-4f3e-b5b3-b803fbc2cd01 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.214655 Dec 25 21:53:48.304032 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3869/7770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:48 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:49.320794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:49.321462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:49.328886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:49.329341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:49.330136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:49.330572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:49.514242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:49.521599 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b9dc29d-03bd-4f0c-a819-65b144be00de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.204600 Dec 25 21:53:49.522173 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3902/7771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:49 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:50.538079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:50.538707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:50.546089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:50.546550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:50.547386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:50.547834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:51.021929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:51.029462 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c79fc16c-7bd9-442f-9b6f-28e587fe5081 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.495129 Dec 25 21:53:51.030036 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3870/7772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:50 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:52.046292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:52.046909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:52.054458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:52.054908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:52.055683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:52.056118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:52.184745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:52.192420 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a14a2de-b0c6-4ae5-a5d6-d0c821099740 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.150374 Dec 25 21:53:52.193025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3903/7773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:52 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:53.210423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:53.211067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:53.218646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:53.219060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:53.219869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:53.220319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:53.353613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:53.361230 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49617b47-dfac-4097-af7a-e05ee6efb964 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.154619 Dec 25 21:53:53.361813 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3871/7774] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:53 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:54.378684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:54.379330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:54.386134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:54.386586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:54.387384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:54.387816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:54.515481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:54.522803 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-71ce5a69-326e-48ca-bbe9-7d8b72ce856e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.148135 Dec 25 21:53:54.523369 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3904/7775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:54 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:55.539493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:55.540153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:55.547524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:55.547992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:55.548790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:55.549272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:55.679899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:55.687406 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3add5f09-2e4a-41fd-ac5e-9a83c1de33bb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.151739 Dec 25 21:53:55.687984 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3872/7776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:55 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:56.703898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:56.704502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:56.711338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:56.711782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:56.712588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:56.713061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:56.843579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:56.850839 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43d5f51f-baa6-4d90-af19-8096867bffa6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.150690 Dec 25 21:53:56.851406 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3905/7777] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:56 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:57.871727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:57.872372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:57.879439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:57.879903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:57.880726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:57.881200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:58.009598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:58.017042 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8fd4385-c51b-4559-ab5f-db743c79cbb3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.149600 Dec 25 21:53:58.017608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3873/7778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:57 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:53:59.033622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:53:59.034236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:53:59.041016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:59.041467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:59.042239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:53:59.042677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:53:59.184276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:53:59.184276 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2702052-cdbb-44a2-8d5d-15eca0125467 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.152764 Dec 25 21:53:59.184276 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3906/7779] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:53:59 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:00.199619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:00.200279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:00.207070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:00.207534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:00.208330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:00.208785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:00.339441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:00.347557 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7887ac86-0314-444b-bc58-12b9d4c82d38 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.152180 Dec 25 21:54:00.348149 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3874/7780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:00 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:01.363493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:01.364118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:01.370905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:01.371351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:01.372119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:01.372551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:01.503748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:01.511044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f219fef-1e77-4d36-a388-74335c0b1d1e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.151382 Dec 25 21:54:01.512129 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3907/7781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:01 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:02.595981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:02.595981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:02.595981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:02.595981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:02.595981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:02.595981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:02.670541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:02.678004 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f605dea2-2713-4b4f-be02-322f0d755cbb tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.153668 Dec 25 21:54:02.678582 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3875/7782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:02 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:03.694811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:03.695429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:03.702786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:03.703242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:03.704029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:03.704471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:03.833267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:03.840786 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58baa41b-b810-4c68-932c-3dee4f0c563b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.150316 Dec 25 21:54:03.841478 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3908/7783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:03 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:04.858812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:04.859414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:04.866276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:04.866741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:04.867536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:04.867985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:05.003981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:05.011721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e99dbff7-5150-4e7c-9e6a-00d95e4f5475 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1521 microversion: 2.1 time: 0.157241 Dec 25 21:54:05.012298 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3876/7784] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:04 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:05.762076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-76cfe06b-64b1-46b4-9021-45a1b6ee2ffd req-d9ceafad-8fa5-46ed-bd47-b0c6ae2591c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1aa2a03-16ee-48f5-84a4-6b1051bcac02", "name": "network-vif-unplugged", "status": "completed", "tag": "722925ec-4e88-4149-a9ac-d5736c56e3e5"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:05.768630 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:05.768630 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:54:05.771627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-76cfe06b-64b1-46b4-9021-45a1b6ee2ffd req-d9ceafad-8fa5-46ed-bd47-b0c6ae2591c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:05.772075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-76cfe06b-64b1-46b4-9021-45a1b6ee2ffd req-d9ceafad-8fa5-46ed-bd47-b0c6ae2591c7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:05.783889 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-76cfe06b-64b1-46b4-9021-45a1b6ee2ffd req-d9ceafad-8fa5-46ed-bd47-b0c6ae2591c7 service nova] Creating event network-vif-unplugged:722925ec-4e88-4149-a9ac-d5736c56e3e5 for instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 on nch1-master-1 Dec 25 21:54:05.789131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-76cfe06b-64b1-46b4-9021-45a1b6ee2ffd req-d9ceafad-8fa5-46ed-bd47-b0c6ae2591c7 service nova] Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:54:05.800754 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-76cfe06b-64b1-46b4-9021-45a1b6ee2ffd req-d9ceafad-8fa5-46ed-bd47-b0c6ae2591c7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042955 Dec 25 21:54:05.801382 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3909/7785] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:05 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:06.031535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:06.032164 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:06.039101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:06.039565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:06.040365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:06.040812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:06.270603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:06.278594 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66360d20-ce7e-40c6-b62e-94362b7cfb43 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1520 microversion: 2.1 time: 0.250857 Dec 25 21:54:06.279181 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3877/7786] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:06 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:07.296437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:07.297158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:07.304356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:07.304820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:07.305680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:07.306127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:07.438410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:07.445845 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-17c4f9f9-73c0-40f4-a1f7-92ee598689cd tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1518 microversion: 2.1 time: 0.154042 Dec 25 21:54:07.446423 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3910/7787] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:07 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:07.816279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1fedb221-44fd-4acb-9526-5b96dc068d7a req-3b7dd074-36ee-401e-9bf5-94f75d36c5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1aa2a03-16ee-48f5-84a4-6b1051bcac02", "tag": "722925ec-4e88-4149-a9ac-d5736c56e3e5"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:07.817896 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:07.817896 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:54:07.826218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1fedb221-44fd-4acb-9526-5b96dc068d7a req-3b7dd074-36ee-401e-9bf5-94f75d36c5d1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:07.826682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1fedb221-44fd-4acb-9526-5b96dc068d7a req-3b7dd074-36ee-401e-9bf5-94f75d36c5d1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:07.838019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1fedb221-44fd-4acb-9526-5b96dc068d7a req-3b7dd074-36ee-401e-9bf5-94f75d36c5d1 service nova] Creating event network-changed:722925ec-4e88-4149-a9ac-d5736c56e3e5 for instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 on nch1-master-1 Dec 25 21:54:07.843922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-1fedb221-44fd-4acb-9526-5b96dc068d7a req-3b7dd074-36ee-401e-9bf5-94f75d36c5d1 service nova] Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:54:07.854796 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1fedb221-44fd-4acb-9526-5b96dc068d7a req-3b7dd074-36ee-401e-9bf5-94f75d36c5d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042238 Dec 25 21:54:07.855490 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3878/7788] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:08.466681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:08.467269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:08.474422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:08.474877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:08.475671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:08.476111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:08.730968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:08.738663 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-125b90b2-1510-4789-b0af-3d0f052f6e83 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1518 microversion: 2.1 time: 0.275960 Dec 25 21:54:08.739439 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3911/7789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:08 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1518 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:09.757200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:09.757928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:09.764710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:09.765211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:09.766012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:09.766468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:09.898767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:09.906915 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46d0db9d-cd98-43b6-b649-ca6f2e7f414d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1515 microversion: 2.1 time: 0.154762 Dec 25 21:54:09.907480 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3879/7790] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:09 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:09.922868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:09.923436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:09.930262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:09.930716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:09.931512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:09.931943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:10.121488 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8ff6b678-47b6-47fa-8a7f-802db8010b8f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "POST /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02/action" status: 204 len: 0 microversion: 2.1 time: 0.201601 Dec 25 21:54:10.122154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3912/7791] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:54:09 2021] POST /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02/action => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:54:10.130598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:10.131228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:10.137612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:10.138080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:10.138887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:10.139336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:10.306213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:10.313809 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5b66a86-1de9-4cd7-b472-1337f0b7f031 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1515 microversion: 2.1 time: 0.187126 Dec 25 21:54:10.314386 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3880/7792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:10 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:10.994275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-149d1a53-f1a8-45f9-942b-175df35c3e2d req-98c21d2c-490c-436d-9caf-d56119200113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1aa2a03-16ee-48f5-84a4-6b1051bcac02", "name": "network-vif-plugged", "status": "completed", "tag": "722925ec-4e88-4149-a9ac-d5736c56e3e5"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:10.995570 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:10.995570 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:54:11.003899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-149d1a53-f1a8-45f9-942b-175df35c3e2d req-98c21d2c-490c-436d-9caf-d56119200113 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:11.004341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-149d1a53-f1a8-45f9-942b-175df35c3e2d req-98c21d2c-490c-436d-9caf-d56119200113 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:11.016573 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-149d1a53-f1a8-45f9-942b-175df35c3e2d req-98c21d2c-490c-436d-9caf-d56119200113 service nova] Creating event network-vif-plugged:722925ec-4e88-4149-a9ac-d5736c56e3e5 for instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 on nch1-master-1 Dec 25 21:54:11.022448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-149d1a53-f1a8-45f9-942b-175df35c3e2d req-98c21d2c-490c-436d-9caf-d56119200113 service nova] Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:54:11.035110 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-149d1a53-f1a8-45f9-942b-175df35c3e2d req-98c21d2c-490c-436d-9caf-d56119200113 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047798 Dec 25 21:54:11.035720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3913/7793] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:11.330606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:11.331246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:11.339008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:11.339484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:11.340352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:11.341022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:11.489918 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:11.498230 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa551f27-7e5c-40ed-95b8-82391110b0de tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1515 microversion: 2.1 time: 0.171450 Dec 25 21:54:11.504332 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3881/7794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:11 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:12.515933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:12.517255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:12.524176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:12.524642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:12.525418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:12.525856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:12.660634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:12.668505 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b2b34c7c-6a60-482e-9bf7-1ef61b52a142 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1507 microversion: 2.1 time: 0.156598 Dec 25 21:54:12.669137 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3914/7795] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:12 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:12.684741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:12.685438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:12.692221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:12.692697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:12.693533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:12.693992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:12.822387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:12.829837 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18f57fe2-cef9-4d35-b5ea-f55b3ec34b08 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1507 microversion: 2.1 time: 0.149434 Dec 25 21:54:12.830414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3882/7796] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:12 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:12.845158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:12.845778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:12.851609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:12.852064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:12.852843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:12.853312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:12.984974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:12.992454 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-442fac32-1661-4586-ad67-9ea26777a21e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 200 len: 1507 microversion: 2.1 time: 0.151008 Dec 25 21:54:12.993050 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3915/7797] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:12 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:13.008727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:13.009275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:13.015176 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:13.015660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:13.016428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:13.016892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:13.040666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:54:13.361145 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d4ca399b-3948-4e82-a5bb-e2f196fcfbd8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 204 len: 0 microversion: 2.1 time: 0.355785 Dec 25 21:54:13.361684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3883/7798] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:54:13 2021] DELETE /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:54:13.418148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1608046671", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "c7d9ee7c-a398-4322-a4d1-20e2155d0262"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:13.467940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] validate_networks() for [('c7d9ee7c-a398-4322-a4d1-20e2155d0262', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:54:13.821342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:54:13.821941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:54:13.822236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:54:13.822628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:54:13.823037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:54:13.832213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:13.832658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:13.833484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:13.833913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:13.850581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Getting quotas for project 9320712a3a5e434d84414d98bfe55244. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:54:13.855583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Getting quotas for user 36a0bcb4058b470094465b56095ee02c and project 9320712a3a5e434d84414d98bfe55244. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:54:13.867280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:54:13.869606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:54:14.012517 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-338381af-cb9d-43b5-9565-273c6f3bcd5a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598770 Dec 25 21:54:14.013208 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3916/7799] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:54:13 2021] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:54:14.023468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4022bf50-f48d-40c3-b609-2ccc0c4276ee tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:14.024186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4022bf50-f48d-40c3-b609-2ccc0c4276ee tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:14.079377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4022bf50-f48d-40c3-b609-2ccc0c4276ee tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:14.087317 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4022bf50-f48d-40c3-b609-2ccc0c4276ee tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1218 microversion: 2.1 time: 0.067937 Dec 25 21:54:14.087869 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3884/7800] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:14 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:15.104416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:15.105557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:15.111608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:15.112057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:15.112868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:15.113332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:15.211628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:15.221107 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a90f651-6106-47f7-98ab-8f3cc03bc4a7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1222 microversion: 2.1 time: 0.121225 Dec 25 21:54:15.230231 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3917/7801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:15 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1222 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:15.248801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-ba3c0635-2851-44f1-a02d-f007c48faed4 req-2065aa42-cad0-4bd1-957f-08b449849763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1aa2a03-16ee-48f5-84a4-6b1051bcac02", "name": "network-vif-deleted", "tag": "722925ec-4e88-4149-a9ac-d5736c56e3e5"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:15.250610 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:15.250610 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:54:15.257888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ba3c0635-2851-44f1-a02d-f007c48faed4 req-2065aa42-cad0-4bd1-957f-08b449849763 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:15.258348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-ba3c0635-2851-44f1-a02d-f007c48faed4 req-2065aa42-cad0-4bd1-957f-08b449849763 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:15.270245 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-ba3c0635-2851-44f1-a02d-f007c48faed4 req-2065aa42-cad0-4bd1-957f-08b449849763 service nova] Creating event network-vif-deleted:722925ec-4e88-4149-a9ac-d5736c56e3e5 for instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 on nch1-master-1 Dec 25 21:54:15.275162 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-ba3c0635-2851-44f1-a02d-f007c48faed4 req-2065aa42-cad0-4bd1-957f-08b449849763 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030169 Dec 25 21:54:15.275847 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3885/7802] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:16.237966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:16.238576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:16.244766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:16.245279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:16.246286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:16.246721 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:16.314780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:16.322775 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3bd9408-9015-4bb4-a692-5db854db7e94 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1278 microversion: 2.1 time: 0.088710 Dec 25 21:54:16.323370 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3918/7803] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:16 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:17.341972 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:17.342686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:17.350021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:17.350533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:17.351324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:17.351773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:17.565562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:17.573057 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99689124-a775-40e9-a6aa-0555b3aec1f0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1318 microversion: 2.1 time: 0.235284 Dec 25 21:54:17.574571 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3886/7804] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:17 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:18.174849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e55f422f-0a0b-4292-9a10-f0e17210bcaa req-1ceb2eab-4982-45c4-a6f3-d78492a70e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9367d0d7-731a-4d85-bb19-ebcc80584c08", "tag": "9146dffc-9aa4-4215-a1d1-9bf9a7031545"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:18.179839 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:18.179839 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:54:18.188096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e55f422f-0a0b-4292-9a10-f0e17210bcaa req-1ceb2eab-4982-45c4-a6f3-d78492a70e51 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:18.188750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e55f422f-0a0b-4292-9a10-f0e17210bcaa req-1ceb2eab-4982-45c4-a6f3-d78492a70e51 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:18.201639 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e55f422f-0a0b-4292-9a10-f0e17210bcaa req-1ceb2eab-4982-45c4-a6f3-d78492a70e51 service nova] Creating event network-changed:9146dffc-9aa4-4215-a1d1-9bf9a7031545 for instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 on nch1-master-1 Dec 25 21:54:18.206591 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e55f422f-0a0b-4292-9a10-f0e17210bcaa req-1ceb2eab-4982-45c4-a6f3-d78492a70e51 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036552 Dec 25 21:54:18.208105 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3919/7805] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:18.591165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:18.591836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:18.598778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:18.599251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:18.600439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:18.600565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:18.822791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:18.830782 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d2e2478-a15c-4353-82b8-238da83475b1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1318 microversion: 2.1 time: 0.243928 Dec 25 21:54:18.831397 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3887/7806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:18 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:19.849175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:19.849880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:19.856539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:19.857013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:19.858049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:19.858489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:19.999740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:20.007272 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44ac916c-e4af-4fa7-b64c-47a9ed5ee24c tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1318 microversion: 2.1 time: 0.163443 Dec 25 21:54:20.007846 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3920/7807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:19 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:21.023254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:21.023974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:21.030784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:21.031250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:21.032048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:21.032496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:21.166345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:21.174414 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ff6ad2b1-344e-4eb6-8317-5df6c58cfc3e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1318 microversion: 2.1 time: 0.154912 Dec 25 21:54:21.174996 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3888/7808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:21 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:22.191433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:22.192074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:22.198614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:22.199065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:22.200452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:22.200909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:22.327247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:22.334621 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-547c7de2-4a6e-4bcf-bcea-f3e9511ffb3b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1318 microversion: 2.1 time: 0.146921 Dec 25 21:54:22.335215 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3921/7809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:22 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:23.059429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-759ba788-7344-4165-bad7-b46d919c65e1 req-e13e9df9-896c-4011-b81f-90c9dace5173 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9367d0d7-731a-4d85-bb19-ebcc80584c08", "name": "network-vif-plugged", "status": "completed", "tag": "9146dffc-9aa4-4215-a1d1-9bf9a7031545"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:23.061015 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:23.061015 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:54:23.068681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-759ba788-7344-4165-bad7-b46d919c65e1 req-e13e9df9-896c-4011-b81f-90c9dace5173 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:23.069312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-759ba788-7344-4165-bad7-b46d919c65e1 req-e13e9df9-896c-4011-b81f-90c9dace5173 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:23.080065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-759ba788-7344-4165-bad7-b46d919c65e1 req-e13e9df9-896c-4011-b81f-90c9dace5173 service nova] Creating event network-vif-plugged:9146dffc-9aa4-4215-a1d1-9bf9a7031545 for instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 on nch1-master-1 Dec 25 21:54:23.085059 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-759ba788-7344-4165-bad7-b46d919c65e1 req-e13e9df9-896c-4011-b81f-90c9dace5173 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029501 Dec 25 21:54:23.085634 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3889/7810] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:23.350106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:23.350715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:23.357595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:23.358039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:23.358853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:23.359289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:23.490898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:23.498213 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9aaefd81-ce01-43da-853c-5a19883c945f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1318 microversion: 2.1 time: 0.151875 Dec 25 21:54:23.499058 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3922/7811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:23 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:24.516362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:24.524214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:24.524214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:24.524214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:24.524586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:24.525068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:24.660056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:24.667441 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fed85da3-7661-4781-9c53-2b6a4fe337a5 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1507 microversion: 2.1 time: 0.156146 Dec 25 21:54:24.668005 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3890/7812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:24 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:24.683023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:24.684281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:24.691024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:24.691485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:24.692266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:24.692706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:24.821418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:24.828806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-baae6f64-5b63-4bb4-bc41-e2c770140f28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1507 microversion: 2.1 time: 0.149570 Dec 25 21:54:24.829408 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3923/7813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:24 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:24.844186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:24.845194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:24.851090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:24.851555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:24.852337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:24.852929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:24.880563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:24.886219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Old instance type m1.heat2, new instance type m1.heat {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:54:24.892603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:54:24.893080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:54:24.893576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:54:24.893995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:54:24.894416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:54:25.115628 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13dd44c8-0728-4071-b99f-580faa6214a0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "POST /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08/action" status: 202 len: 0 microversion: 2.1 time: 0.275008 Dec 25 21:54:25.116169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3891/7814] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:54:24 2021] POST /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:54:25.124945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:25.126329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:25.131422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:25.131879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:25.132664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:25.133138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:25.264966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:25.272453 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-878dd6ca-fab9-46d9-8e6c-8608912af416 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1514 microversion: 2.1 time: 0.152126 Dec 25 21:54:25.273062 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3924/7815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:25 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:26.290842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:26.292139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:26.298855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:26.299776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:26.300175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:26.300614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:26.436486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:26.444330 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0fc7cbed-d305-4b26-ab34-7c423d0c3b33 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1514 microversion: 2.1 time: 0.158181 Dec 25 21:54:26.444929 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3892/7816] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:26 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:27.460803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:27.461579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:27.469161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:27.469616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:27.470423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:27.470871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:27.712765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:27.720758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-096751e9-7c4c-43e1-9a94-bd0618cfd864 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1514 microversion: 2.1 time: 0.263870 Dec 25 21:54:27.721366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3925/7817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:27 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1514 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:54:28.737262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:28.737892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:28.744694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:28.745196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:28.746595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:28.747051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:28.880199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:28.887743 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf4ed477-1288-451d-9aa0-c520c31af3d6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.154227 Dec 25 21:54:28.888348 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3893/7818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:28 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:29.904668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:29.905348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:29.911938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:29.912385 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:29.913197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:29.913627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:30.043573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:30.051003 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4158fd50-e115-4218-b09d-39b3ce835841 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.150548 Dec 25 21:54:30.051577 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3926/7819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:29 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:31.067660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:31.068294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:31.075331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:31.075802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:31.076601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:31.077086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:31.210490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:31.218598 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4ce0b3ca-9021-4389-91ce-a462942ed53e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.154653 Dec 25 21:54:31.219104 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3894/7820] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:31 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:32.234553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:32.235198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:32.241968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:32.242421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:32.243199 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:32.243659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:32.375755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:32.383114 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5beb8456-3248-493e-a147-5932c96bf32b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.152756 Dec 25 21:54:32.383686 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3927/7821] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:32 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:33.399869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:33.400492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:33.407343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:33.407803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:33.408591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:33.409137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:33.538041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:33.545565 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-04cebe87-2f62-402c-9767-181cfcf88f03 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.149506 Dec 25 21:54:33.546162 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3895/7822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:33 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:34.562079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:34.562723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:34.569501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:34.569950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:34.570725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:34.571156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:34.707330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:34.715464 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23163b26-34b2-433a-95b1-ff3e0f310238 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.156605 Dec 25 21:54:34.716055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3928/7823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:34 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:35.732614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:35.733281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:35.740166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:35.740637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:35.741525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:35.741983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:35.873765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:35.881133 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c175ab66-c2dc-431c-998d-529c10387195 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.153004 Dec 25 21:54:35.881721 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3896/7824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:35 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:36.897636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:36.898248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:36.904993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:36.905443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:36.906216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:36.906644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:37.037274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:37.045559 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c81258a4-3200-464c-954b-6be05574bcaa tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.151608 Dec 25 21:54:37.046136 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3929/7825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:36 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:38.061921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:38.062594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:38.069562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:38.070036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:38.070845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:38.071305 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:38.205250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:38.212934 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2923c2e-472b-48a1-a171-8853161913ff tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.155232 Dec 25 21:54:38.213524 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3897/7826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:38 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:39.229536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:39.230696 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:39.237425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:39.237873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:39.238641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:39.239078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:39.370412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:39.379546 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f476328-9cbc-4e91-9370-90062a66587f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.153735 Dec 25 21:54:39.380139 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3930/7827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:39 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:40.396432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:40.397089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:40.404374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:40.404839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:40.405656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:40.406105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:40.539170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:40.547181 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2e7916a3-9b3b-4e14-accc-86eca0dcc40b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.154539 Dec 25 21:54:40.547761 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3898/7828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:40 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:41.563410 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:41.564000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:41.570766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:41.571210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:41.571982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:41.572415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:41.705662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:41.713828 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abc2992a-b503-463c-b68a-b82bc2ec7e60 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.154154 Dec 25 21:54:41.714411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3931/7829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:41 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:42.731365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:42.732001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:42.739006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:42.739484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:42.740286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:42.740745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:42.872289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:42.880031 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc74a864-add4-4d72-87db-1ccce53c1b41 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.153125 Dec 25 21:54:42.880612 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3899/7830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:42 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:43.897228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:43.897854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:43.904637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:43.905141 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:43.905937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:43.906380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:44.037244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:44.044595 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-96410f3b-b3a3-4439-9541-293a6b23bd48 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.151137 Dec 25 21:54:44.045204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3932/7831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:43 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:45.060433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:45.061088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:45.067494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:45.067962 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:45.068751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:45.069230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:45.200131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:45.207596 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19b009e8-7131-421a-a2d4-744e08d378b3 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.150856 Dec 25 21:54:45.208175 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3900/7832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:45 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:46.225051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:46.225697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:46.232470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:46.232953 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:46.233730 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:46.234172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:46.364811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:46.372314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80805001-7dc5-489a-942f-d14559c2998f tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.151338 Dec 25 21:54:46.372906 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3933/7833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:46 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:47.389448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:47.390072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:47.396782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:47.397279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:47.398072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:47.398521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:47.527539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:47.535025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53df6fea-88e1-4a6e-974b-9b689ba9c5ac tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.149355 Dec 25 21:54:47.535576 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3901/7834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:47 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:54:48.552805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:48.553436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:48.560710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:48.561186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:48.561968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:48.562398 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:48.695475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:48.703560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-891e662b-39f3-4cd9-8586-f64667a35177 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.154614 Dec 25 21:54:48.704137 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3934/7835] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:48 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:49.720853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:49.721532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:49.728252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:49.728717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:49.729533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:49.729985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:49.858956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:49.866382 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3b0c22f-f231-4c88-8a1d-95e918ad7ec0 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.149321 Dec 25 21:54:49.866961 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3902/7836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:49 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:50.883742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:50.884363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:50.891826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:50.892285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:50.893120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:50.893569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:51.024845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:51.032314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2769eb69-2783-45e4-8b34-a93290e00574 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.152371 Dec 25 21:54:51.032925 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3935/7837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:50 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:52.048914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:52.049542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:52.056326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:52.056794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:52.057613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:52.058065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:52.196126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:52.204391 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8470e08e-fe11-4345-9c68-0f0026d746d8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.159180 Dec 25 21:54:52.205000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3903/7838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:52 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:53.221646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:53.222268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:53.229086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:53.229542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:53.230347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:53.230772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:53.358485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:53.365872 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f65c2d7-3c0a-4efc-bc62-342ec0058e28 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.148032 Dec 25 21:54:53.366443 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3936/7839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:53 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:54.382949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:54.383582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:54.390593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:54.391062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:54.391860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:54.392311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:54.533435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:54.541739 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d905eaf4-0b17-4e98-8cb8-c004099a4bf1 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1519 microversion: 2.1 time: 0.162493 Dec 25 21:54:54.542421 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3904/7840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:54 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:55.604225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:55.605062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:55.612818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:55.613307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:55.614109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:55.614643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:55.879016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:55.886523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22fb5001-435b-4008-9a1c-07a57e756314 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1518 microversion: 2.1 time: 0.286114 Dec 25 21:54:55.887132 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3937/7841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:55 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1518 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:56.052234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-160b90e5-3b0f-46a4-b81b-8d09e498a24b req-ffcabad1-e2b0-4d5b-ba36-8f71648cb1ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9367d0d7-731a-4d85-bb19-ebcc80584c08", "name": "network-vif-unplugged", "status": "completed", "tag": "9146dffc-9aa4-4215-a1d1-9bf9a7031545"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:56.053869 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:56.053869 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:54:56.061283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-160b90e5-3b0f-46a4-b81b-8d09e498a24b req-ffcabad1-e2b0-4d5b-ba36-8f71648cb1ab service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:56.061747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-160b90e5-3b0f-46a4-b81b-8d09e498a24b req-ffcabad1-e2b0-4d5b-ba36-8f71648cb1ab service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:56.073832 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-160b90e5-3b0f-46a4-b81b-8d09e498a24b req-ffcabad1-e2b0-4d5b-ba36-8f71648cb1ab service nova] Creating event network-vif-unplugged:9146dffc-9aa4-4215-a1d1-9bf9a7031545 for instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 on nch2-master-1 Dec 25 21:54:56.079864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-160b90e5-3b0f-46a4-b81b-8d09e498a24b req-ffcabad1-e2b0-4d5b-ba36-8f71648cb1ab service nova] Instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:54:56.091069 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-160b90e5-3b0f-46a4-b81b-8d09e498a24b req-ffcabad1-e2b0-4d5b-ba36-8f71648cb1ab service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107739 Dec 25 21:54:56.091873 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3905/7842] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:55 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:54:56.910299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:56.910846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:56.917531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:56.917988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:56.918763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:56.919197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:57.052674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:57.060359 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b085c056-a89e-47bb-b4a2-67798ae67c80 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1518 microversion: 2.1 time: 0.153806 Dec 25 21:54:57.062526 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3938/7843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:56 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:58.078635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:58.079353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:58.085647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:58.086123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:58.086921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:58.087377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:58.111292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-62c916b3-ded3-42ba-ba8d-9b1c4ac7e55e req-d2117f37-aa29-4412-bb75-95b933eda4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9367d0d7-731a-4d85-bb19-ebcc80584c08", "tag": "9146dffc-9aa4-4215-a1d1-9bf9a7031545"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:58.112980 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:54:58.112980 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:54:58.120896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-62c916b3-ded3-42ba-ba8d-9b1c4ac7e55e req-d2117f37-aa29-4412-bb75-95b933eda4d3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:58.121347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-62c916b3-ded3-42ba-ba8d-9b1c4ac7e55e req-d2117f37-aa29-4412-bb75-95b933eda4d3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:58.133838 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-62c916b3-ded3-42ba-ba8d-9b1c4ac7e55e req-d2117f37-aa29-4412-bb75-95b933eda4d3 service nova] Creating event network-changed:9146dffc-9aa4-4215-a1d1-9bf9a7031545 for instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 on nch2-master-1 Dec 25 21:54:58.139813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-62c916b3-ded3-42ba-ba8d-9b1c4ac7e55e req-d2117f37-aa29-4412-bb75-95b933eda4d3 service nova] Instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:54:58.151057 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-62c916b3-ded3-42ba-ba8d-9b1c4ac7e55e req-d2117f37-aa29-4412-bb75-95b933eda4d3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043335 Dec 25 21:54:58.151688 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3939/7844] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:54:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:54:58.297647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:58.306367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-462bc8d6-3a08-45ef-b51e-917ff4b221f8 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1516 microversion: 2.1 time: 0.232617 Dec 25 21:54:58.306985 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3906/7845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:58 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:59.324970 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:59.325781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:59.332489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:59.333001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:59.333789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:59.334220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:59.468855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:59.476777 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3acf16c-c7e2-40b7-9f84-11e6544a6103 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1513 microversion: 2.1 time: 0.156743 Dec 25 21:54:59.477397 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3940/7846] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:59 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:54:59.493500 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:54:59.494044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:59.501811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:59.502301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:59.503100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:59.503554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:59.690216 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2e1861d-1074-476c-8793-55a18b90804b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "POST /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08/action" status: 204 len: 0 microversion: 2.1 time: 0.200475 Dec 25 21:54:59.690865 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3907/7847] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:54:59 2021] POST /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08/action => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:54:59.699651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:54:59.700379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:54:59.706653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:59.707104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:59.707888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:54:59.708325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:54:59.873038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:54:59.880489 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8dd54908-4d45-4988-a75e-962755a63dcf tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1513 microversion: 2.1 time: 0.185181 Dec 25 21:54:59.881162 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3941/7848] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:54:59 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:00.897927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:00.898711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:00.906449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:00.906915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:00.908667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:00.909574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:01.046941 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:01.054869 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ca808dc3-361f-4900-88a1-e8ac3b82e54e tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1513 microversion: 2.1 time: 0.161027 Dec 25 21:55:01.055456 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3908/7849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:00 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:01.136300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-ce8c1193-3a3a-46ca-a562-c355784f0f2d req-ba20b7c8-0fe8-471e-8e57-db90a09ecb67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9367d0d7-731a-4d85-bb19-ebcc80584c08", "name": "network-vif-plugged", "status": "completed", "tag": "9146dffc-9aa4-4215-a1d1-9bf9a7031545"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:01.138718 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:55:01.138718 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:55:01.147164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ce8c1193-3a3a-46ca-a562-c355784f0f2d req-ba20b7c8-0fe8-471e-8e57-db90a09ecb67 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:01.147604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-ce8c1193-3a3a-46ca-a562-c355784f0f2d req-ba20b7c8-0fe8-471e-8e57-db90a09ecb67 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:01.158958 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-ce8c1193-3a3a-46ca-a562-c355784f0f2d req-ba20b7c8-0fe8-471e-8e57-db90a09ecb67 service nova] Creating event network-vif-plugged:9146dffc-9aa4-4215-a1d1-9bf9a7031545 for instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 on nch2-master-1 Dec 25 21:55:01.163759 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-ce8c1193-3a3a-46ca-a562-c355784f0f2d req-ba20b7c8-0fe8-471e-8e57-db90a09ecb67 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031634 Dec 25 21:55:01.164354 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3942/7850] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:55:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:55:02.071576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:02.072268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:02.080648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.081166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.082013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.082471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.224168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:02.231803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a48fa9c8-b726-4c45-b412-a58e40253d2a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1505 microversion: 2.1 time: 0.163974 Dec 25 21:55:02.232380 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3909/7851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:02 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1505 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:02.249924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:02.250628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:02.256893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.257357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.258137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.258577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.396299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:02.404475 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f3f5f9d2-e945-40ae-af8f-a544909dc45b tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1505 microversion: 2.1 time: 0.160525 Dec 25 21:55:02.405076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3943/7852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:02 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:02.419884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:02.420564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:02.426767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.427232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.431541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.431541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.559849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:02.567379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eeae31a9-b9b5-4bd9-80b2-fcb4f1ee1ef6 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1505 microversion: 2.1 time: 0.151268 Dec 25 21:55:02.567957 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3910/7853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:02 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:02.583611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:02.584152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:02.590614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.591126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.591918 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.592362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.616296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:55:02.874652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01311700-f42d-4230-8d87-f1cfebd7b9ae tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 204 len: 0 microversion: 2.1 time: 0.294403 Dec 25 21:55:02.875148 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3944/7854] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:55:02 2021] DELETE /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:55:02.895053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:02.895576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:02.902009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.902702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.903353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.903805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.928574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:55:02.972629 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.compute.api [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Instance is already in deleting state, ignoring this request Dec 25 21:55:02.973515 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d6307e9-a55a-47b0-a825-4501279c7c7a tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "DELETE /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 204 len: 0 microversion: 2.1 time: 0.082322 Dec 25 21:55:02.974083 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3911/7855] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:55:02 2021] DELETE /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:55:02.983048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:02.983813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:02.989779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.990242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:02.991025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:02.991469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:03.125954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:03.133323 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3310fdb8-d0e3-41d2-b137-d5bc55d158d7 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1511 microversion: 2.1 time: 0.154914 Dec 25 21:55:03.133905 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3945/7856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:02 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:04.149890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:04.150553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:04.157479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:04.157951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:04.158781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:04.159236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:04.362482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a0bcb4058b470094465b56095ee02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9320712a3a5e434d84414d98bfe55244', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:04.370450 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-842b120e-1150-49e8-a6f5-be48e2de1b18 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 200 len: 1511 microversion: 2.1 time: 0.224291 Dec 25 21:55:04.371873 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3912/7857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:04 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:04.779388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f3d38336-100d-4d29-9cab-b5e51ad94457 req-a7903974-b811-478b-a022-17997b74f0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9367d0d7-731a-4d85-bb19-ebcc80584c08", "name": "network-vif-deleted", "tag": "9146dffc-9aa4-4215-a1d1-9bf9a7031545"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:04.780991 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:55:04.780991 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:55:04.788540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f3d38336-100d-4d29-9cab-b5e51ad94457 req-a7903974-b811-478b-a022-17997b74f0b8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:04.789015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f3d38336-100d-4d29-9cab-b5e51ad94457 req-a7903974-b811-478b-a022-17997b74f0b8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:04.800680 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f3d38336-100d-4d29-9cab-b5e51ad94457 req-a7903974-b811-478b-a022-17997b74f0b8 service nova] Creating event network-vif-deleted:9146dffc-9aa4-4215-a1d1-9bf9a7031545 for instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 on nch2-master-1 Dec 25 21:55:04.805576 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f3d38336-100d-4d29-9cab-b5e51ad94457 req-a7903974-b811-478b-a022-17997b74f0b8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Dec 25 21:55:04.806173 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3946/7858] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:55:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:55:05.388146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:05.388865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: 9367d0d7-731a-4d85-bb19-ebcc80584c08] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:05.395861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:05.396322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:05.397160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:05.397621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:05.411797 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] HTTP exception thrown: Instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 could not be found. Dec 25 21:55:05.412408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Returning 404 to user: Instance 9367d0d7-731a-4d85-bb19-ebcc80584c08 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:55:05.413289 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b2eb0d19-a1e1-45d3-b17a-e3447777bf54 tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08" status: 404 len: 111 microversion: 2.1 time: 0.029503 Dec 25 21:55:05.413842 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3913/7859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:05 2021] GET /compute/v2.1/servers/9367d0d7-731a-4d85-bb19-ebcc80584c08 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:55:05.422320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:05.422923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:05.429124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:05.429940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:05.430718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:05.431197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:05.444576 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] HTTP exception thrown: Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 could not be found. Dec 25 21:55:05.445183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Returning 404 to user: Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:55:05.445994 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c105a6ed-bb46-4bea-baac-01c4bdcef9df tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 404 len: 111 microversion: 2.1 time: 0.027816 Dec 25 21:55:05.446521 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3947/7860] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:55:05 2021] DELETE /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:55:05.454689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:05.455309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] [instance: d1aa2a03-16ee-48f5-84a4-6b1051bcac02] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:05.461287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:05.461752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:05.462542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:05.462991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:05.479124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] HTTP exception thrown: Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 could not be found. Dec 25 21:55:05.479746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] Returning 404 to user: Instance d1aa2a03-16ee-48f5-84a4-6b1051bcac02 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:55:05.480576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3605aae-f068-40ac-bc87-40d01cd3699d tempest-ServerDiskConfigTestJSON-667614809 tempest-ServerDiskConfigTestJSON-667614809-project] 10.222.0.32 "GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02" status: 404 len: 111 microversion: 2.1 time: 0.029598 Dec 25 21:55:05.481127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3914/7861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:05 2021] GET /compute/v2.1/servers/d1aa2a03-16ee-48f5-84a4-6b1051bcac02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:55:13.392031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'create', calling method: .version_select at 0x7fa4f61fbdc0>, body: {"keypair": {"name": "tempest-keypair-1650957824"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:13.405939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:55:13.412034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:55:13.425427 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [cd39e735-cf46-4220-ba01-52898881cf27] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 21:55:14.431626 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [cd39e735-cf46-4220-ba01-52898881cf27] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 34420. Dec 25 21:55:14.908980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:55:14.915299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:55:14.934147 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fde4b1c0-76bb-42a4-8b11-64df3a40a88f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.660656 Dec 25 21:55:14.935531 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3948/7862] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 21:55:13 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:17.064767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2088181551", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "544249cb-4293-4a78-9ba3-8f386deae100"}], "security_groups": [{"name": "tempest-securitygroup--685716593"}], "key_name": "tempest-keypair-1650957824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:17.165476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] validate_networks() for [('544249cb-4293-4a78-9ba3-8f386deae100', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:55:17.540776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:55:17.541264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:55:17.541755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:55:17.542177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:55:17.542602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:55:17.551272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:17.554368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:17.554368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:17.554368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:17.570086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:55:17.575655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:55:17.587463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:55:17.590492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:55:17.708623 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c3db22d-9b0a-4720-a2dc-23c465cf7c73 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.647795 Dec 25 21:55:17.709335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3915/7863] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:55:17 2021] POST /compute/v2.1/servers => generated 408 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:55:17.719878 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-62da04a1-030d-4b1e-adbf-4807012e9d69 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:17.720521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-62da04a1-030d-4b1e-adbf-4807012e9d69 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:17.780215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-62da04a1-030d-4b1e-adbf-4807012e9d69 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:17.787684 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-62da04a1-030d-4b1e-adbf-4807012e9d69 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1239 microversion: 2.1 time: 0.072396 Dec 25 21:55:17.794367 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3949/7864] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:17 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1239 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:18.806349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:18.806986 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:18.813210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:18.813710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:18.814496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:18.814944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:18.875935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:18.883816 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb03be08-ebcb-4fc7-9fe2-74dafa88a492 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1243 microversion: 2.1 time: 0.082594 Dec 25 21:55:18.884415 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3916/7865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:18 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:19.899947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:19.900602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:19.907962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:19.908425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:19.909295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:19.909747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:19.991716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:20.000123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-288fff32-4751-4c39-a6f1-08c7262b16e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1299 microversion: 2.1 time: 0.103871 Dec 25 21:55:20.001289 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3950/7866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:19 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:21.017361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:21.018155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:21.025512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:21.025678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:21.026518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:21.026976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:21.200181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:21.216523 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84263989-d4de-4342-bddb-a2e01ac9f2a2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.202784 Dec 25 21:55:21.218085 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3917/7867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:21 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:21.507481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3273fac7-ef75-4159-8f2a-ea51c80cb760 req-666bd3f0-be77-4d2b-9066-31c1a20e3ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:21.513122 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:55:21.513122 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:55:21.518051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3273fac7-ef75-4159-8f2a-ea51c80cb760 req-666bd3f0-be77-4d2b-9066-31c1a20e3ce5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:21.518833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3273fac7-ef75-4159-8f2a-ea51c80cb760 req-666bd3f0-be77-4d2b-9066-31c1a20e3ce5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:21.532354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3273fac7-ef75-4159-8f2a-ea51c80cb760 req-666bd3f0-be77-4d2b-9066-31c1a20e3ce5 service nova] Creating event network-changed:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch2-master-1 Dec 25 21:55:21.537786 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3273fac7-ef75-4159-8f2a-ea51c80cb760 req-666bd3f0-be77-4d2b-9066-31c1a20e3ce5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034281 Dec 25 21:55:21.538674 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3951/7868] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:55:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:55:22.234046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:22.234723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:22.241799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:22.242271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:22.243075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:22.243532 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:22.382201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:22.390392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b3d4dc62-6ef9-4ae8-923d-4f3952657cff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.160888 Dec 25 21:55:22.390960 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3918/7869] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:22 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:55:23.408631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:23.409358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:23.415675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:23.416131 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:23.416942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:23.417381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:23.554596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:23.562609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae9b5388-8432-41c3-aac5-713efd1a1ddb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.158885 Dec 25 21:55:23.563174 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3952/7870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:23 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:24.579057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:24.579718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:24.586583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:24.587047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:24.587841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:24.588293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:24.717775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:24.725214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ddc519ef-6bd7-4d90-9e65-6f697b1c097c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.149952 Dec 25 21:55:24.725779 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3919/7871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:24 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:25.741748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:25.742360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:25.750024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:25.750472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:25.751245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:25.751686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:25.895729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:25.903437 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc52e70e-b237-4a4f-980c-521cc985c337 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.165366 Dec 25 21:55:25.904755 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3953/7872] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:25 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:26.920438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:26.921031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:26.929364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:26.929843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:26.930657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:26.931124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:27.062596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:27.070089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f49a394-60e3-4b1c-9ebb-e93033c532d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.154183 Dec 25 21:55:27.070588 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3920/7873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:26 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:27.277109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e4b1cb13-55ca-4113-bc8b-177c8b8b4301 req-608536d3-d922-4613-9dea-685f142dc869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "name": "network-vif-plugged", "status": "completed", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:27.283632 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:55:27.283632 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:55:27.286379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e4b1cb13-55ca-4113-bc8b-177c8b8b4301 req-608536d3-d922-4613-9dea-685f142dc869 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:27.286824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e4b1cb13-55ca-4113-bc8b-177c8b8b4301 req-608536d3-d922-4613-9dea-685f142dc869 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:27.297901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e4b1cb13-55ca-4113-bc8b-177c8b8b4301 req-608536d3-d922-4613-9dea-685f142dc869 service nova] Creating event network-vif-plugged:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch2-master-1 Dec 25 21:55:27.302967 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e4b1cb13-55ca-4113-bc8b-177c8b8b4301 req-608536d3-d922-4613-9dea-685f142dc869 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029543 Dec 25 21:55:27.303579 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3954/7874] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:55:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:55:28.087196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:28.087821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:28.094686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:28.095150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:28.095946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:28.096398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:28.233627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:28.241151 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e0228fa-1782-4f09-b2e9-672e9fe6664a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1364 microversion: 2.1 time: 0.157701 Dec 25 21:55:28.241746 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3921/7875] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:28 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:29.259706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:29.260396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:29.267077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:29.267525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:29.268301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:29.268735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:29.398767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:55:29.406825 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e27a835-2d8c-4364-bc11-efc6e3a17640 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1551 microversion: 2.1 time: 0.152037 Dec 25 21:55:29.407391 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3955/7876] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:55:29 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:29.422581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:55:29.423117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:29.430248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:29.430705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:29.431516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:29.431973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:29.516841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7d7286e-7a97-46ae-9d5c-c7154db09563 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098007 Dec 25 21:55:29.519529 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3922/7877] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:55:29 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:55:30.507412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:30.508344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:30.509776 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-a89f87e3-e845-4fa4-9ca5-6b6eedaa5dfe req-cfc83276-8163-4d60-a9d7-fe081a071fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:30.511759 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:55:30.511759 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:55:30.515916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:30.516434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:30.517251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:30.517690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:30.521332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a89f87e3-e845-4fa4-9ca5-6b6eedaa5dfe req-cfc83276-8163-4d60-a9d7-fe081a071fe2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:30.522072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-a89f87e3-e845-4fa4-9ca5-6b6eedaa5dfe req-cfc83276-8163-4d60-a9d7-fe081a071fe2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:30.533859 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-a89f87e3-e845-4fa4-9ca5-6b6eedaa5dfe req-cfc83276-8163-4d60-a9d7-fe081a071fe2 service nova] Creating event network-changed:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch2-master-1 Dec 25 21:55:30.539727 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-a89f87e3-e845-4fa4-9ca5-6b6eedaa5dfe req-cfc83276-8163-4d60-a9d7-fe081a071fe2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Dec 25 21:55:30.540346 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3923/7878] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:55:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:55:30.556712 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc75ade5-8fd2-488c-93f7-a4f0699e222a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.053036 Dec 25 21:55:30.557515 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3956/7879] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:30 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:31.568286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:31.569564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:31.576973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:31.577437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:31.578230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:31.578680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:31.616031 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2f89bd7-b8c0-44da-88fd-ccb2d92ba1ca tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.051641 Dec 25 21:55:31.616900 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3924/7880] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:31 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:32.628256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:32.629274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:32.636567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:32.637612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:32.638387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:32.638823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:32.679014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c485787-5604-4581-9e1f-4fdc7d6436f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.054698 Dec 25 21:55:32.679797 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3957/7881] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:32 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:33.691400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:33.692445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:33.699969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:33.700441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:33.701268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:33.701722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:33.737323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21dc72a7-eaf0-42d3-8b5c-e4c0295e65e1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.049938 Dec 25 21:55:33.737948 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3925/7882] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:33 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:34.748770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:34.749803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:34.757213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:34.757670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:34.758451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:34.758889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:34.796560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-764813a5-e14d-4c86-9925-675a7a54df54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.052001 Dec 25 21:55:34.797282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3958/7883] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:34 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:35.807980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:35.809013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:35.816378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:35.816846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:35.817672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:35.818130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:35.854554 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06148270-99e9-4c45-b311-bdb5108b7ffe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.050573 Dec 25 21:55:35.855950 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3926/7884] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:35 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:36.866441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:36.867447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:36.875568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:36.876024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:36.876813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:36.877301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:36.914586 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-489ba8a5-766a-476c-bb7f-beb871a29a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.052111 Dec 25 21:55:36.915390 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3959/7885] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:36 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:37.925959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:37.926894 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:37.934920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:37.935390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:37.936192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:37.936647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:37.974693 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2ffa37d3-8435-4fe3-ba97-5f2f1b0de1a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.052835 Dec 25 21:55:37.975324 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3927/7886] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:37 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:38.985976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:38.986979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:38.994323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:38.994826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:38.995617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:38.996060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:39.033681 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1bb8d0db-9e7b-488e-afbf-9ae1256b2add tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.051691 Dec 25 21:55:39.034324 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3960/7887] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:38 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:40.045653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:40.046665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:40.054241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:40.059263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:40.059263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:40.059263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:40.096379 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14890d9f-2135-4757-8518-cf00549901b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 14 microversion: 2.1 time: 0.055331 Dec 25 21:55:40.097052 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3928/7888] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:40 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:55:41.107867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:41.108891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:41.116227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:41.116687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:41.134695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:41.134695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:41.166896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fda284a6-7f60-4d34-b03d-e24aa9dab5be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 8208 microversion: 2.1 time: 0.063015 Dec 25 21:55:41.168099 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3961/7889] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:41 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 8208 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:55:42.179677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:42.180702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:42.189072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:42.189539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:42.190339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:42.190791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:42.239392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fbf27790-dda5-4a5d-bcc1-54c25e12475b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 16397 microversion: 2.1 time: 0.063656 Dec 25 21:55:42.240269 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3929/7890] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:42 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 16397 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:43.251788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:43.252788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:43.260157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:43.260605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:43.262068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:43.262538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:43.300651 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-935b14f8-0d54-41ac-b090-c4662b753669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 16397 microversion: 2.1 time: 0.052841 Dec 25 21:55:43.301315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3962/7891] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:43 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 16397 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:44.312300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:44.313349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:44.320769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:44.321271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:44.322080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:44.322539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:44.368032 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-832351fd-ca96-4893-bd43-e41bb27b9cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 16397 microversion: 2.1 time: 0.059658 Dec 25 21:55:44.368693 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3930/7892] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:44 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 16397 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:45.380029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:45.381064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:45.388928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:45.389377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:45.390174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:45.390605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:45.431333 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eef40786-d9b8-47b5-92ac-0030cdf426ef tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 16397 microversion: 2.1 time: 0.055240 Dec 25 21:55:45.431993 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3963/7893] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:45 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 16397 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:46.443629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:46.444674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:46.452340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:46.452809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:46.453660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:46.454115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:46.501991 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bbe8a865-9ed5-4dde-8b45-1b22e9948527 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.062279 Dec 25 21:55:46.502653 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3931/7894] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:46 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:47.513523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:47.514554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:47.521677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:47.522126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:47.522914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:47.523348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:47.562577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df24c31d-3af5-4837-b694-41b40f305b87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.053233 Dec 25 21:55:47.563450 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3964/7895] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:47 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:48.575289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:48.576335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:48.583814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:48.584289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:48.585145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:48.585609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:48.624555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4eb8627a-020c-4eb4-a11b-043fbe574597 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.053966 Dec 25 21:55:48.625214 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3932/7896] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:48 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:55:49.635755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:49.637294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:49.644393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:49.644844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:49.645652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:49.646087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:49.685195 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb5db209-2a5d-48ce-9259-f91090039688 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.053340 Dec 25 21:55:49.685823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3965/7897] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:49 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:50.696638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:50.697702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:50.705254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:50.705728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:50.706544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:50.707001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:50.747928 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6903734-5c3d-4386-87a5-9a2d77533623 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.055350 Dec 25 21:55:50.748574 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3933/7898] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:50 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:51.759185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:51.760197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:51.768032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:51.768491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:51.769310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:51.769754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:51.808533 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e4a2340-ae6f-458b-891c-bfa7775934cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.053395 Dec 25 21:55:51.809205 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3966/7899] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:51 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:52.820628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:52.821704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:52.829798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:52.830275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:52.831083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:52.831547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:52.873335 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19330418-9692-4488-9d73-15fe6df603a0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.056778 Dec 25 21:55:52.873985 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3934/7900] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:52 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:53.885197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:53.886194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:53.893478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:53.893927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:53.894707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:53.895142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:53.935808 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a57cfa9-2ae4-443e-9f3d-ee80f0511f3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.054502 Dec 25 21:55:53.937353 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3967/7901] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:53 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:54.948821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:54.949867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:54.957342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:54.957818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:54.958634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:54.959098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:54.999229 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-560d3aef-6345-44bb-b9ef-040d65c298cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.055101 Dec 25 21:55:55.000089 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3935/7902] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:54 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:56.010436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:56.012012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:56.019403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:56.019857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:56.020641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:56.021117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:56.060119 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1bbf9a5a-d61a-40b8-806a-63850553c59e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.053681 Dec 25 21:55:56.060751 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3968/7903] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:56 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:57.072487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:57.074071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:57.081603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:57.082080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:57.082886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:57.083348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:57.122750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18ea7af3-b39a-4545-9e68-3747750e3542 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.054331 Dec 25 21:55:57.123667 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3936/7904] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:57 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:58.134745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:58.135844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:58.143524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:58.143979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:58.144767 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:58.145303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:58.189086 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c13d760-67b8-44fa-9527-66e16b677517 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 24571 microversion: 2.1 time: 0.058303 Dec 25 21:55:58.189732 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3969/7905] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:58 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 24571 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:55:59.201096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:55:59.202103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:55:59.209562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:59.212615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:59.212615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:55:59.212615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:55:59.268512 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-089405ed-6a34-4058-8698-7c9437122c15 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.071415 Dec 25 21:55:59.269186 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3937/7906] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:55:59 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:00.280079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:00.281121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:00.288526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:00.288996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:00.289780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:00.290221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:00.329932 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-993a4919-433e-4a0d-948d-e4be86dea973 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053849 Dec 25 21:56:00.330572 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3970/7907] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:00 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:01.342040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:01.343061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:01.350551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:01.351020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:01.351822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:01.352277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:01.392031 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83f8a4e1-6594-4084-9595-754f4037d09d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053958 Dec 25 21:56:01.392683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3938/7908] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:01 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:02.404712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:02.405734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:02.413067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:02.413512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:02.414280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:02.414712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:02.453888 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-994e4dad-97f5-47f7-a2c0-d24b8240b964 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053748 Dec 25 21:56:02.454540 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3971/7909] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:02 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:03.466557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:03.467597 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:03.474964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:03.475426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:03.476220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:03.476672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:03.517724 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b969fa28-146b-4200-94a2-8cc63adffc47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055675 Dec 25 21:56:03.518629 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3939/7910] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:03 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:04.529962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:04.530978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:04.538404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:04.538857 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:04.539650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:04.540086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:04.579743 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ae3286bc-0420-41ff-b1e0-262254e58856 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053870 Dec 25 21:56:04.580707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3972/7911] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:04 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:05.593821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:05.595134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:05.607061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:05.607536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:05.608354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:05.608810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:05.651284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bce251cc-e992-4c31-8c49-d990ce501108 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.063293 Dec 25 21:56:05.651967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3940/7912] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:05 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:06.664050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:06.665083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:06.673046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:06.673502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:06.674346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:06.674792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:06.714326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0e85141-a066-4fb4-8bc3-ab537ff1a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054353 Dec 25 21:56:06.714997 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3973/7913] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:06 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:07.726213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:07.727227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:07.735117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:07.735589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:07.736392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:07.736848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:07.778780 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2a72400f-d602-46ce-b7ca-097b6bd458a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056733 Dec 25 21:56:07.779411 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3941/7914] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:07 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:56:08.791089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:08.792085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:08.800028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:08.800476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:08.801272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:08.801709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:08.841272 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eddf3338-619a-4941-bd28-c9d79e2bb9db tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053613 Dec 25 21:56:08.841895 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3974/7915] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:08 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:09.853834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:09.854745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:09.862112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:09.862579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:09.863371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:09.863821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:09.903706 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06d5a431-9e19-4612-9212-b4190c671193 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053401 Dec 25 21:56:09.904586 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3942/7916] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:09 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:10.915993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:10.917063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:10.925172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:10.925827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:10.926627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:10.927072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:10.973362 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-56b44414-a842-42c6-b8d7-afaa97b7f7c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.061320 Dec 25 21:56:10.974082 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3975/7917] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:10 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:56:11.986153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:11.987182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:11.994622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:11.995095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:11.996168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:11.997307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:12.035762 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6cf60e04-599b-4888-affb-3635f7059e6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053638 Dec 25 21:56:12.036396 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3943/7918] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:11 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:13.053604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:13.054606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:13.062393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:13.062847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:13.063635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:13.064073 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:13.103257 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bc50cb3-953e-4c63-856f-593fec286fe6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053525 Dec 25 21:56:13.103898 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3976/7919] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:13 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:14.115661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:14.116674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:14.124762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:14.125252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:14.126046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:14.126492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:14.167745 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-60dcbb9f-415f-4e70-a772-37805a7b877a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056174 Dec 25 21:56:14.168915 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3944/7920] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:14 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:15.180389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:15.181424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:15.188769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:15.189243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:15.190025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:15.190461 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:15.234110 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-145c8a6f-dff8-4574-9617-76c77142c0eb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.057704 Dec 25 21:56:15.235205 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3977/7921] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:15 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:16.246887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:16.247912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:16.254967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:16.255437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:16.256237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:16.256689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:16.296738 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-69ac3afc-a640-43e2-b0e7-98eca82e420a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054401 Dec 25 21:56:16.297436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3945/7922] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:16 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:17.309486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:17.310487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:17.317390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:17.317838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:17.318615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:17.319054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:17.358263 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a8533ea6-3d4a-4958-92a6-c0e116de1489 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053449 Dec 25 21:56:17.369596 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3978/7923] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:17 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:18.370788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:18.372399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:18.379903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:18.380373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:18.381205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:18.381662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:18.423960 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-744b5864-78f3-4ec2-b7d5-7f265651d16a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.057556 Dec 25 21:56:18.424634 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3946/7924] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:18 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:19.435893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:19.436904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:19.444188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:19.444644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:19.445446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:19.445883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:19.485403 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d97a0b72-d7a7-4e94-8005-4efc88a3ad58 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053424 Dec 25 21:56:19.486037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3979/7925] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:19 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:20.498761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:20.499812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:20.507413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:20.507888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:20.508708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:20.509207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:20.548333 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5740501a-0ce8-4d17-8c59-d7a5a6012429 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054466 Dec 25 21:56:20.549011 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3947/7926] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:20 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:21.560188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:21.561203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:21.568569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:21.569053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:21.569828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:21.570259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:21.609488 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6964ee70-a25f-44a0-ab56-e99c74f0c847 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053288 Dec 25 21:56:21.610102 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3980/7927] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:21 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:22.621966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:22.623577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:22.631019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:22.631483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:22.632273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:22.632723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:22.670929 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a5563bc5-47b3-4b38-89a7-7e44ab2ede1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053270 Dec 25 21:56:22.671557 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3948/7928] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:22 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:23.684318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:23.685893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:23.693289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:23.693749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:23.694535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:23.694978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:23.736593 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd1571d6-b6ce-4359-837e-2e64481ef712 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056419 Dec 25 21:56:23.737277 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3981/7929] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:23 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:24.749023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:24.750033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:24.757440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:24.757906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:24.758704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:24.759160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:24.798586 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d6643f9-f2fe-4c4e-b83e-bce71d8584c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053880 Dec 25 21:56:24.799216 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3949/7930] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:24 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:25.811360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:25.812362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:25.819750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:25.820211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:25.821024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:25.821541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:25.862804 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-de088dac-020f-41e9-889f-72c1fac2f4e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056113 Dec 25 21:56:25.863454 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3982/7931] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:25 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:26.875581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:26.876598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:26.884082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:26.884553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:26.885382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:26.885842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:26.925750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85e51aff-8dd9-41ae-b819-b9e415f44b50 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054400 Dec 25 21:56:26.926639 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3950/7932] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:26 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:27.937274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:27.938266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:27.945700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:27.946150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:27.946930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:27.947364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:27.988518 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e4437053-1a60-4298-9a4e-62c4d3fe03a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055336 Dec 25 21:56:27.989202 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3983/7933] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:27 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:29.002135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:29.004698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:29.013788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:29.014791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:29.015608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:29.016078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:29.067065 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe6bb0b0-5e61-4c16-b894-118d920cb923 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.070533 Dec 25 21:56:29.067741 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3951/7934] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:28 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:30.079811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:30.080863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:30.088258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:30.088715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:30.089531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:30.089975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:30.129768 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f094dde9-a4df-449a-88e2-afc5372891d5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054419 Dec 25 21:56:30.130410 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3984/7935] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:30 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:31.142453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:31.143471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:31.151027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:31.151491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:31.152286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:31.152772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:31.198921 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec733d5b-261d-4fd3-ae23-09e21210de6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.061029 Dec 25 21:56:31.200162 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3952/7936] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:31 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:32.211795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:32.212805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:32.221121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:32.221579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:32.222359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:32.222796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:32.261939 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e7e68e35-5a61-4f3e-81b8-17b5c745f4c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054151 Dec 25 21:56:32.262801 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3985/7937] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:32 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:33.274667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:33.275666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:33.283027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:33.283491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:33.284288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:33.284739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:33.325300 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c3fd7ba-2f85-4acb-92db-6022fa3503d2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054622 Dec 25 21:56:33.326802 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3953/7938] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:33 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:34.337922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:34.338927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:34.346248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:34.346735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:34.347517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:34.347959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:34.388238 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a633cec-b5df-406e-8cd2-647017a00ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054277 Dec 25 21:56:34.388917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3986/7939] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:34 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:35.400706 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:35.401735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:35.409400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:35.409863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:35.410659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:35.411109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:35.451416 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c21fa292-69a2-4c8d-93f8-363ce0ed6fb1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054215 Dec 25 21:56:35.452048 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3954/7940] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:35 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:36.463384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:36.464387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:36.472198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:36.472651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:36.473458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:36.473895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:36.516556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09e5465a-ac2b-4ef9-b6bb-cb24cf87a690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.057095 Dec 25 21:56:36.517253 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3987/7941] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:36 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:37.528367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:37.530040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:37.537548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:37.538024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:37.538835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:37.539304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:37.579867 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7ff24f14-37c0-413c-8045-98d8d586067c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055577 Dec 25 21:56:37.580537 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3955/7942] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:37 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:38.592627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:38.593827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:38.601548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:38.601993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:38.602798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:38.603232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:38.643370 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cd5d94bc-bc2d-4114-9e17-f51a31189ae5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055231 Dec 25 21:56:38.644277 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3988/7943] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:38 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:39.655250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:39.656451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:39.663807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:39.664343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:39.665174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:39.665628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:39.705928 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c92ec949-9508-43e7-9afe-1cd75a92667c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054658 Dec 25 21:56:39.706585 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3956/7944] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:39 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:40.718451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:40.719566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:40.727200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:40.727769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:40.728557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:40.729027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:40.769768 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52a1a8f8-0540-4dab-9160-f6076485fed8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055697 Dec 25 21:56:40.770419 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3989/7945] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:40 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:41.782800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:41.783819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:41.791277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:41.791747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:41.792551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:41.793038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:41.832147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afcd27c4-2ef0-4519-9762-4613e227bd2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053933 Dec 25 21:56:41.832783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3957/7946] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:41 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:42.844184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:42.845211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:42.852549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:42.853033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:42.853817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:42.854256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:42.893843 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-42bf1f35-9007-410d-b9a5-b853db40a740 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053691 Dec 25 21:56:42.894468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3990/7947] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:42 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:43.907140 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:43.908150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:43.915449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:43.915915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:43.916708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:43.917183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:43.962975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10c1186d-13e3-4618-a3af-5e3981469b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.060324 Dec 25 21:56:43.963876 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3958/7948] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:43 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:56:44.974609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:44.975667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:44.982959 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:44.983943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:44.984719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:44.985183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:45.026722 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43a80a0d-914d-47b2-b77c-a5ed9bd836f3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056097 Dec 25 21:56:45.027343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3991/7949] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:44 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:46.039072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:46.040090 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:46.047824 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:46.048294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:46.049130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:46.049587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:46.089572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0053300b-567a-4d36-903c-35807d1decd5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054713 Dec 25 21:56:46.090219 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3959/7950] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:46 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:47.101510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:47.102520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:47.110110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:47.110572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:47.111358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:47.111801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:47.153157 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e7e6047-8b55-45d2-a09e-aa81726b9203 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055816 Dec 25 21:56:47.153794 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3992/7951] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:47 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:48.165418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:48.166436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:48.174516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:48.174996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:48.175793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:48.176251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:48.216124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f5cd6e6-ecd9-4c35-bf2b-62a1e279c76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054694 Dec 25 21:56:48.216710 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3960/7952] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:48 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:49.228577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:49.229602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:49.236971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:49.237425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:49.238200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:49.238634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:49.280954 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8bac66d9-7f8e-4db8-b01a-677aec24abd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056316 Dec 25 21:56:49.281599 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3993/7953] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:49 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:50.293028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:50.294042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:50.302016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:50.302490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:50.303324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:50.303783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:50.344324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b7418769-9522-4805-bdfe-85ca7e60f5af tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055292 Dec 25 21:56:50.345294 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3961/7954] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:50 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:51.356155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:51.357176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:51.364899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:51.365370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:51.366142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:51.366576 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:51.407841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30eaa188-8314-4d8f-8a8b-14c216dce9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055672 Dec 25 21:56:51.408493 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3994/7955] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:51 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:52.420002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:52.421101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:52.428498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:52.428999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:52.429806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:52.430263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:52.470019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-277d9b1e-280e-41d9-9f8d-41ad9f4c85d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054034 Dec 25 21:56:52.470684 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3962/7956] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:52 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:53.482143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:53.484077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:53.491338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:53.491789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:53.492563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:53.493054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:53.532963 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef125d42-133b-4d67-8c85-b00001fed4a4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054748 Dec 25 21:56:53.533641 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3995/7957] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:53 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:54.545106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:54.546728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:54.554184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:54.554654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:54.555453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:54.555909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:54.604189 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8652ceb4-8434-4e03-87a6-9efd8e65840d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.063172 Dec 25 21:56:54.604838 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3963/7958] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:54 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:55.616399 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:55.617546 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:55.625825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:55.626283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:55.627065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:55.627510 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:55.667019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c09bb20c-914c-46f2-a7ca-2f8249114abb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054659 Dec 25 21:56:55.667650 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3996/7959] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:55 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:56.680033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:56.681081 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:56.688659 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:56.689155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:56.689997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:56.690448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:56.732558 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-961ba475-82b8-436b-b950-916d891c7524 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056766 Dec 25 21:56:56.734116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3964/7960] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:56 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:57.745680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:57.746689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:57.756334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:57.757177 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:57.758200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:57.758817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:57.814945 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3716fb9c-af86-495f-8e1d-666136f861ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.073498 Dec 25 21:56:57.815622 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3997/7961] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:57 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:57.930616 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:56:57.931138 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 21:56:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:56:58.827970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:58.829005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:58.836456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:58.836940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:58.837738 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:58.838188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:58.877555 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a290f793-8664-4dbb-8089-8c00c3aad2ad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054184 Dec 25 21:56:58.878173 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3965/7962] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:58 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:56:59.889021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:56:59.890061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:56:59.897459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:59.897945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:59.898734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:56:59.899176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:56:59.938747 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0424572e-1e5e-4698-9bc0-82eb65d75b2e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053141 Dec 25 21:56:59.939385 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3998/7963] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:56:59 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:00.951113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:00.952129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:00.960318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:00.960792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:00.961693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:00.962153 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:01.001571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d6635091-9402-4417-a6d2-a0c7823a3206 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054468 Dec 25 21:57:01.002200 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3966/7964] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:00 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:01.464198 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 21:57:01.464755 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 21:57:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 21:57:02.013595 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:02.014683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:02.025883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:02.026364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:02.027153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:02.027590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:02.066457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e399ab9-91ec-4147-940e-a03157494123 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.056938 Dec 25 21:57:02.067085 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 3999/7965] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:02 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:03.078701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:03.080209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:03.087655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:03.088130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:03.088956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:03.089415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:03.128087 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bace77d5-e2fe-48dc-85bc-c7e6359f0ab2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.053456 Dec 25 21:57:03.128708 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3967/7966] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:03 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:04.140269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:04.141296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:04.149265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:04.149725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:04.150507 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:04.150947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:04.189132 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7500cba-bf2b-47af-9256-5840eaf84690 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.052325 Dec 25 21:57:04.189763 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4000/7967] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:04 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:05.201538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:05.202563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:05.210852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:05.211328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:05.212144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:05.212606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:05.253278 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-63f88a81-64c2-484b-adff-ed80075759bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.055803 Dec 25 21:57:05.253937 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3968/7968] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:05 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:06.265626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:06.266643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:06.274098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:06.274545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:06.275326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:06.275761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:06.316540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9fdfeb5-7e6d-4234-adea-9fdd9f8b8abf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 32639 microversion: 2.1 time: 0.054924 Dec 25 21:57:06.317196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4001/7969] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:06 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 32639 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:07.329844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:07.330854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:07.338282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.338754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.339561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.340015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.394570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02e2c0a1-5edd-4192-86d9-25b13b9a9125 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 200 len: 40794 microversion: 2.1 time: 0.069311 Dec 25 21:57:07.395233 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3969/7970] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:07 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 40794 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:57:07.405849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:07.406557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:07.414537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.414990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.415774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.416212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.545194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:07.553131 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-316d55f4-4b26-4cfc-bc1e-da063feeaefb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1669 microversion: 2.1 time: 0.151299 Dec 25 21:57:07.577379 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4002/7971] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:07 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:07.577546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:07.577546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:07.577758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.578199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.579531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.580032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.611740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:07.617401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Old instance type m1.heat2, new instance type m1.heat {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:57:07.623868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:57:07.624303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:57:07.624792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:57:07.625236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:57:07.625661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:57:07.793114 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d955384a-8807-4b2b-93ad-83ecf0c22e00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 202 len: 0 microversion: 2.1 time: 0.227711 Dec 25 21:57:07.793772 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3970/7972] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:07 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:57:07.801939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:07.802808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:07.809498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.809793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.810593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:07.811035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:07.945981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:07.953754 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e04961a9-07f5-4656-b53a-51e40eb509c5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1678 microversion: 2.1 time: 0.155632 Dec 25 21:57:07.954934 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4003/7973] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:07 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:08.971990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:08.972632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:08.980604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:08.981103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:08.982021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:08.982479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:09.113560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:09.121400 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c358343d-b460-4655-94ba-78dcfade90b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1678 microversion: 2.1 time: 0.153773 Dec 25 21:57:09.121968 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3971/7974] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:08 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:10.139013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:10.139677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:10.147054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:10.147538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:10.148327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:10.148764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:10.284635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:10.292170 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52b19b52-ef38-41eb-9279-edad8899cbae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1678 microversion: 2.1 time: 0.157245 Dec 25 21:57:10.292753 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4004/7975] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:10 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:11.310042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:11.310592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:11.317525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:11.317999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:11.318934 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:11.319267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:11.504088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:11.511544 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c7aaefac-6a43-4bda-9ceb-b086bab720a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1678 microversion: 2.1 time: 0.205427 Dec 25 21:57:11.512109 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3972/7976] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:11 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:12.529231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:12.529841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:12.537248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:12.537706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:12.538517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:12.538945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:12.784484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:12.792363 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2677a38c-72b9-4f88-b347-3a72a2c742d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.266823 Dec 25 21:57:12.792975 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4005/7977] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:12 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:13.809729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:13.810365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:13.817632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:13.818833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:13.818971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:13.819530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:13.954542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:13.962323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cc3fffc4-5ce4-469c-8211-ff961442e4f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.156372 Dec 25 21:57:13.962906 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3973/7978] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:13 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:14.979861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:14.980471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:14.987799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:14.988244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:14.989045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:14.989484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:15.125432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:15.132735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc8a3571-d8ab-4f07-83a7-be71da106832 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.156591 Dec 25 21:57:15.133345 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4006/7979] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:14 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:16.149587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:16.150221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:16.157534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:16.158044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:16.158882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:16.159340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:16.293033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:16.300480 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2582e5df-6be0-4d8b-bb5b-d5e1e31796ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.154675 Dec 25 21:57:16.301093 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3974/7980] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:16 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:17.317631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:17.318426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:17.325009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:17.325471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:17.326257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:17.326707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:17.456537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:17.463776 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-20a2a1c6-2eec-4ae8-a78c-57ad8a958620 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.150565 Dec 25 21:57:17.464343 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4007/7981] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:17 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:18.481004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:18.481635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:18.488486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:18.489000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:18.489814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:18.490275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:18.621182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:18.628521 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e4c5392-aa65-454a-8bd8-3e069cebfaed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.151481 Dec 25 21:57:18.629116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3975/7982] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:18 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:19.645176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:19.645778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:19.652503 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:19.652988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:19.653774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:19.654220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:19.786446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:19.793821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f553be9f-6d13-4147-8bf3-3e289447b2a5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.152345 Dec 25 21:57:19.794388 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4008/7983] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:19 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:20.811311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:20.811937 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:20.819444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:20.819908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:20.820703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:20.821196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:20.948657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:20.956170 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f52aebfa-3d6d-471c-bc58-83e3c0add855 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.148571 Dec 25 21:57:20.956735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3976/7984] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:20 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:21.973189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:21.973807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:21.980588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:21.981093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:21.981877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:21.982341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:22.117105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:22.124835 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f112b33f-dcd6-407c-b32f-c560f5570387 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.155873 Dec 25 21:57:22.125426 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4009/7985] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:21 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:23.141103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:23.141735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:23.148594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:23.149103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:23.149909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:23.150367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:23.280110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:23.287511 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7b8ffbcf-fa0b-4a3f-8cec-7752407fbab5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1683 microversion: 2.1 time: 0.150290 Dec 25 21:57:23.288084 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3977/7986] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:23 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:24.262123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c7087f4b-0956-4e63-8e24-4c5eaae20056 req-86556ec7-174a-47ea-926e-fccfaa48d16b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "name": "network-vif-unplugged", "status": "completed", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:24.263690 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:24.263690 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:57:24.272043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c7087f4b-0956-4e63-8e24-4c5eaae20056 req-86556ec7-174a-47ea-926e-fccfaa48d16b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:24.272493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c7087f4b-0956-4e63-8e24-4c5eaae20056 req-86556ec7-174a-47ea-926e-fccfaa48d16b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:24.283906 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c7087f4b-0956-4e63-8e24-4c5eaae20056 req-86556ec7-174a-47ea-926e-fccfaa48d16b service nova] Creating event network-vif-unplugged:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch1-master-1 Dec 25 21:57:24.289168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-c7087f4b-0956-4e63-8e24-4c5eaae20056 req-86556ec7-174a-47ea-926e-fccfaa48d16b service nova] Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:57:24.300177 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c7087f4b-0956-4e63-8e24-4c5eaae20056 req-86556ec7-174a-47ea-926e-fccfaa48d16b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041696 Dec 25 21:57:24.300936 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4010/7987] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:24 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:57:24.303562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:24.304043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:24.311005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:24.311483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:24.312293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:24.312752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:24.655454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:24.663037 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bebc9d71-1901-4964-8740-9695d3046e02 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1682 microversion: 2.1 time: 0.363327 Dec 25 21:57:24.663696 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3978/7988] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:24 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1682 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:57:25.681425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:25.682027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:25.688099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:25.688548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:25.689409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:25.689847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:25.820711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:25.828046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8325fa2-046d-47ed-9895-27931068f781 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1680 microversion: 2.1 time: 0.151617 Dec 25 21:57:25.828608 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4011/7989] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:25 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:26.314927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e1ffc54f-cdca-401e-96d4-a7b755e5fc96 req-154f848d-2620-4a1a-bf51-2cadf2c29833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:26.316487 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:26.316487 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:57:26.324315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e1ffc54f-cdca-401e-96d4-a7b755e5fc96 req-154f848d-2620-4a1a-bf51-2cadf2c29833 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:26.324778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e1ffc54f-cdca-401e-96d4-a7b755e5fc96 req-154f848d-2620-4a1a-bf51-2cadf2c29833 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:26.337103 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e1ffc54f-cdca-401e-96d4-a7b755e5fc96 req-154f848d-2620-4a1a-bf51-2cadf2c29833 service nova] Creating event network-changed:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch1-master-1 Dec 25 21:57:26.342384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-e1ffc54f-cdca-401e-96d4-a7b755e5fc96 req-154f848d-2620-4a1a-bf51-2cadf2c29833 service nova] Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:57:26.353183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e1ffc54f-cdca-401e-96d4-a7b755e5fc96 req-154f848d-2620-4a1a-bf51-2cadf2c29833 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042497 Dec 25 21:57:26.353779 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3979/7990] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:57:26.844626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:26.845272 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:26.852144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:26.852599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:26.853405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:26.853843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:27.167900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:27.176010 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-770536bb-3444-4d5e-8429-3019de97f2f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1680 microversion: 2.1 time: 0.335058 Dec 25 21:57:27.176600 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4012/7991] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:26 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1680 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:28.194810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:28.195531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:28.201800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:28.202271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:28.203071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:28.203526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:28.340980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:28.348681 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ecd98668-14c8-4d1b-9afb-04ddf717aa79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1677 microversion: 2.1 time: 0.158884 Dec 25 21:57:28.349286 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3980/7992] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:28 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:28.365504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:28.366166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:28.373196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:28.373648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:28.374433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:28.375028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:28.576836 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f625bc76-b37e-417a-b4eb-b9f9cb04dc1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action" status: 204 len: 0 microversion: 2.1 time: 0.214960 Dec 25 21:57:28.577523 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4013/7993] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:28 2021] POST /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8/action => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:57:28.585505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:28.586146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:28.592244 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:28.592717 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:28.593568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:28.594053 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:28.732415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:28.740890 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9a5da47f-3580-4094-805a-39fb8b7df4e7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1677 microversion: 2.1 time: 0.159019 Dec 25 21:57:28.741593 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3981/7994] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:28 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:29.761071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:29.761778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:29.768422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:29.768884 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:29.769729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:29.770168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:30.278530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-cc1b7b79-faf3-4db3-b8ec-96ce1e89c27f req-12516a5f-418f-44fe-9a4d-f589c313c017 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "name": "network-vif-plugged", "status": "completed", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:30.283540 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:30.283540 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:57:30.298581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:30.299202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cc1b7b79-faf3-4db3-b8ec-96ce1e89c27f req-12516a5f-418f-44fe-9a4d-f589c313c017 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:30.300482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-cc1b7b79-faf3-4db3-b8ec-96ce1e89c27f req-12516a5f-418f-44fe-9a4d-f589c313c017 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:30.307611 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1127199f-a8e7-4ba4-8906-cff144b4650d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1677 microversion: 2.1 time: 0.552368 Dec 25 21:57:30.313481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4014/7995] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:29 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1677 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:30.315273 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-cc1b7b79-faf3-4db3-b8ec-96ce1e89c27f req-12516a5f-418f-44fe-9a4d-f589c313c017 service nova] Creating event network-vif-plugged:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch1-master-1 Dec 25 21:57:30.320788 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-cc1b7b79-faf3-4db3-b8ec-96ce1e89c27f req-12516a5f-418f-44fe-9a4d-f589c313c017 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195442 Dec 25 21:57:30.321624 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3982/7996] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:57:31.324513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:31.325200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:31.331929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.332387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.333203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.333646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.469681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:31.477872 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0f29ac9-c9d9-49b3-8701-58ba55d5478a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1669 microversion: 2.1 time: 0.157042 Dec 25 21:57:31.478579 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4015/7997] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:31 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:31.497669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:31.502439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:31.505276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.505746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.506537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.506985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.639981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:31.647514 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2ab22fb8-8c32-4346-bc3a-ab322d4f1644 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1669 microversion: 2.1 time: 0.155179 Dec 25 21:57:31.648097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3983/7998] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:31 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:31.663744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:31.664360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:31.670263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.670717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.671492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.671931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.806523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:31.813915 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-594a2861-4a03-45b6-a873-fb267fc04c9d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1669 microversion: 2.1 time: 0.154084 Dec 25 21:57:31.814481 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4016/7999] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:31 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:31.829517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:31.830034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:31.835879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.836344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.837234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:31.837681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:31.862702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:57:32.149832 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-22425341-d088-43d6-9d14-8597998d8ecd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 204 len: 0 microversion: 2.1 time: 0.323686 Dec 25 21:57:32.150352 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3984/8000] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:57:31 2021] DELETE /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:57:32.158980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:32.159599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:32.165822 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:32.166268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:32.167043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:32.167593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:32.298472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:32.305873 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5f1ddd20-d7a7-4ab8-a435-d531d672e58c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1675 microversion: 2.1 time: 0.151179 Dec 25 21:57:32.306447 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4017/8001] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:32 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:33.323735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:33.324446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:33.331219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:33.331682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:33.332484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:33.332960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:33.464189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:33.472260 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0805c1b9-0ee8-49e2-90c9-30066ee4f2b9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1675 microversion: 2.1 time: 0.152684 Dec 25 21:57:33.472837 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3985/8002] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:33 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:34.387345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f3642c21-4550-49e7-9e3f-53ff08a7a482 req-dc5aa543-3556-43b3-8dcf-30b1c50986ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e87bad1d-44d6-4e94-a7c2-1c20ca33eba8", "name": "network-vif-deleted", "tag": "095e12a0-6bab-4f25-9cd8-73008268ccf4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:34.389180 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:34.389180 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:57:34.397215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f3642c21-4550-49e7-9e3f-53ff08a7a482 req-dc5aa543-3556-43b3-8dcf-30b1c50986ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:34.397673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f3642c21-4550-49e7-9e3f-53ff08a7a482 req-dc5aa543-3556-43b3-8dcf-30b1c50986ad service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:34.409270 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f3642c21-4550-49e7-9e3f-53ff08a7a482 req-dc5aa543-3556-43b3-8dcf-30b1c50986ad service nova] Creating event network-vif-deleted:095e12a0-6bab-4f25-9cd8-73008268ccf4 for instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 on nch1-master-1 Dec 25 21:57:34.414554 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f3642c21-4550-49e7-9e3f-53ff08a7a482 req-dc5aa543-3556-43b3-8dcf-30b1c50986ad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030786 Dec 25 21:57:34.415278 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4018/8003] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:57:34.489755 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:34.491121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:34.498289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:34.498767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:34.499581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:34.500036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:34.567145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:34.575025 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e89a1a8c-df0e-44bb-b711-d54bafd096b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 200 len: 1608 microversion: 2.1 time: 0.089585 Dec 25 21:57:34.575827 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3986/8004] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:34 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 1608 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:35.591843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:35.592558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:35.599466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:35.599916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:35.600685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:35.601145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:35.613971 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. Dec 25 21:57:35.614549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:57:35.615356 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6b569a97-97ab-4ebc-a811-b2093c9a7a86 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 404 len: 111 microversion: 2.1 time: 0.027604 Dec 25 21:57:35.615872 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4019/8005] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:35 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:57:35.628721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:35.629374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:35.636195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:35.636661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:35.637488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:35.637938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:35.651625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. Dec 25 21:57:35.652221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:57:35.653107 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30bee2a1-2476-431b-9c02-e49e3d183800 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 404 len: 111 microversion: 2.1 time: 0.028616 Dec 25 21:57:35.653627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3987/8006] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:35 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:57:35.699288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1675453223", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "544249cb-4293-4a78-9ba3-8f386deae100"}], "security_groups": [{"name": "tempest-securitygroup--685716593"}], "key_name": "tempest-keypair-1650957824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:35.805379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] validate_networks() for [('544249cb-4293-4a78-9ba3-8f386deae100', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:57:36.225360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:57:36.225791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:57:36.226271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:57:36.226762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:57:36.227180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:57:36.236514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:36.237008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:36.237831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:36.238275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:36.254833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:57:36.259877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:57:36.271826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:57:36.274182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:57:36.428977 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-388b11b1-68d7-4ac2-8797-af5de44a02d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.733342 Dec 25 21:57:36.429949 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4020/8007] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:57:35 2021] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:57:36.440035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b4a3bb3f-6b5d-4c7e-bb16-0ea3fc122336 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:36.440677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b4a3bb3f-6b5d-4c7e-bb16-0ea3fc122336 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:36.494953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b4a3bb3f-6b5d-4c7e-bb16-0ea3fc122336 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:36.506285 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b4a3bb3f-6b5d-4c7e-bb16-0ea3fc122336 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1239 microversion: 2.1 time: 0.066718 Dec 25 21:57:36.506285 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3988/8008] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:36 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:37.521568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:37.522359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:37.528548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:37.529035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:37.529860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:37.530300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:37.591165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:37.599078 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12d0f40a-4709-4415-a42c-3d29cbb1e4ea tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1243 microversion: 2.1 time: 0.083077 Dec 25 21:57:37.599642 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4021/8009] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:37 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:38.616126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:38.618652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:38.624796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:38.625286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:38.626591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:38.627040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:38.695287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:38.702723 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d56cad28-a82f-47fc-92ff-26cdf6569227 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1297 microversion: 2.1 time: 0.090560 Dec 25 21:57:38.703300 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3989/8010] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:38 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1297 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:39.720076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:39.720689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:39.727947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:39.728408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:39.729239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:39.729871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:39.884211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:39.892604 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e120b7a3-15ad-4ce6-87c9-879ba9c30a68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.176778 Dec 25 21:57:39.896077 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4022/8011] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:39 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:39.941852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c1f28f8c-e8c7-40d2-825a-4dc3392e2a03 req-764c2503-95ec-4899-b9b9-a61d04960ec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:39.945973 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:39.945973 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:57:39.956572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c1f28f8c-e8c7-40d2-825a-4dc3392e2a03 req-764c2503-95ec-4899-b9b9-a61d04960ec3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:39.957071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c1f28f8c-e8c7-40d2-825a-4dc3392e2a03 req-764c2503-95ec-4899-b9b9-a61d04960ec3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:39.981214 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c1f28f8c-e8c7-40d2-825a-4dc3392e2a03 req-764c2503-95ec-4899-b9b9-a61d04960ec3 service nova] Creating event network-changed:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch2-master-1 Dec 25 21:57:39.986333 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c1f28f8c-e8c7-40d2-825a-4dc3392e2a03 req-764c2503-95ec-4899-b9b9-a61d04960ec3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048896 Dec 25 21:57:39.986955 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3990/8012] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:57:40.909683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:40.910350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:40.917231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:40.917689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:40.918468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:40.918907 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:41.048118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:41.055524 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-664f59e6-ca43-4e17-ac91-08f61ad30f6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.150049 Dec 25 21:57:41.056100 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4023/8013] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:40 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:42.073978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:42.074714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:42.080953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:42.081430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:42.082228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:42.082684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:42.213482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:42.221552 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-783b3103-ea63-4447-80b0-1788d742f21c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.152605 Dec 25 21:57:42.222125 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3991/8014] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:42 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:43.238926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:43.239545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:43.246734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:43.247191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:43.247976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:43.248414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:43.379995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:43.387363 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-50ec056a-2ca0-4c36-92cd-424e5df187cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.152651 Dec 25 21:57:43.387888 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4024/8015] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:43 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:44.403716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:44.404339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:44.411702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:44.412186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:44.413005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:44.413461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:44.544049 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:44.552034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8eaa85a3-72df-4874-b328-33882f625dfd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.152180 Dec 25 21:57:44.552607 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3992/8016] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:44 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:45.569395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:45.570037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:45.576817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:45.577307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:45.578094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:45.578542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:45.712428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:45.720018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70c1bc9d-e1dd-4dfb-88b4-181f85492b49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.154315 Dec 25 21:57:45.720970 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4025/8017] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:45 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:57:45.949196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-da042350-62df-4c1b-a3d7-60522ef88fa6 req-9733c9bd-00da-40b3-af55-7270fe298e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "name": "network-vif-plugged", "status": "completed", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:45.950733 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:45.950733 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:57:45.958046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-da042350-62df-4c1b-a3d7-60522ef88fa6 req-9733c9bd-00da-40b3-af55-7270fe298e00 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:45.958512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-da042350-62df-4c1b-a3d7-60522ef88fa6 req-9733c9bd-00da-40b3-af55-7270fe298e00 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:45.969931 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-da042350-62df-4c1b-a3d7-60522ef88fa6 req-9733c9bd-00da-40b3-af55-7270fe298e00 service nova] Creating event network-vif-plugged:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch2-master-1 Dec 25 21:57:45.975966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-da042350-62df-4c1b-a3d7-60522ef88fa6 req-9733c9bd-00da-40b3-af55-7270fe298e00 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030710 Dec 25 21:57:45.976551 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3993/8018] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 21:57:46.737017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:46.737650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:46.744142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:46.744591 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:46.745396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:46.745829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:46.875548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:46.883352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-abac364f-0153-42bb-87fc-3c5c0da959c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1364 microversion: 2.1 time: 0.150133 Dec 25 21:57:46.883918 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4026/8019] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:46 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:47.901234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:47.901952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:47.909027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:47.909502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:47.910303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:47.910762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:48.041184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:57:48.049014 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c34dcbf-4489-448e-bf63-1bb1e5c486e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1551 microversion: 2.1 time: 0.151383 Dec 25 21:57:48.049583 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3994/8020] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:57:47 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:57:48.065664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:57:48.066192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:48.072861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:48.073347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:48.074129 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:48.074577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:48.154417 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2de0a5e2-cf10-4ad0-b9a9-9d3c527cc576 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093117 Dec 25 21:57:48.155040 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4027/8021] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 21:57:48 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:57:49.114829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:49.116398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:49.118276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-55c4d5a7-9b67-40f0-96f6-a59604694f61 req-072d4fe4-a1c1-4b71-acf7-426aaace73a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:49.120344 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:57:49.120344 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:57:49.125125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:49.125600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:49.126926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:49.127382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:49.128409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-55c4d5a7-9b67-40f0-96f6-a59604694f61 req-072d4fe4-a1c1-4b71-acf7-426aaace73a4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:49.128856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-55c4d5a7-9b67-40f0-96f6-a59604694f61 req-072d4fe4-a1c1-4b71-acf7-426aaace73a4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:49.140829 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-55c4d5a7-9b67-40f0-96f6-a59604694f61 req-072d4fe4-a1c1-4b71-acf7-426aaace73a4 service nova] Creating event network-changed:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch2-master-1 Dec 25 21:57:49.146699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-55c4d5a7-9b67-40f0-96f6-a59604694f61 req-072d4fe4-a1c1-4b71-acf7-426aaace73a4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033474 Dec 25 21:57:49.147946 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4028/8022] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:57:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:57:49.167453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-401613b1-8676-4ed9-ae66-04f0d5ecbc56 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.056274 Dec 25 21:57:49.168243 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3995/8023] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:49 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:50.178411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:50.179555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:50.186532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:50.187021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:50.187803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:50.188238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:50.226308 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-97dd43c7-215c-4887-b08c-be9549b44559 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.051826 Dec 25 21:57:50.229421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4029/8024] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:50 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:51.237685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:51.238722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:51.246542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:51.247011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:51.247813 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:51.248263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:51.285422 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eee7f0f8-3a69-457b-94d4-b15c3179f634 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.052372 Dec 25 21:57:51.286029 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3996/8025] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:51 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:52.296542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:52.297560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:52.304802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:52.305275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:52.306049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:52.306481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:52.343093 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-301cbde5-9ba0-4f72-a2ec-303aef261684 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.050464 Dec 25 21:57:52.343707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4030/8026] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:52 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:53.355328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:53.356340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:53.363841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:53.364303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:53.365125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:53.365862 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:53.405617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4cb1ad59-460b-41b3-8232-b46d8fd45d3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.054320 Dec 25 21:57:53.406276 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3997/8027] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:53 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:54.417063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:54.418064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:54.426000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:54.426445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:54.427227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:54.427663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:54.464860 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b51cffab-38b1-4a0f-951a-bab33e555b7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.051810 Dec 25 21:57:54.465503 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4031/8028] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:54 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:55.477365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:55.478381 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:55.485785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:55.486256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:55.487055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:55.487513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:55.526572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-121ccadb-eb37-4711-82a4-4c659891b546 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.053306 Dec 25 21:57:55.527188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3998/8029] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:55 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:56.537791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:56.538724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:56.546449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:56.546714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:56.547508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:56.547946 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:56.585642 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-116fce1b-9a41-4f35-8cd0-36d076526149 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.052071 Dec 25 21:57:56.586252 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4032/8030] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:56 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:57.596976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:57.597979 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:57.605313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:57.605781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:57.606568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:57.607022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:57.643865 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b30a06ef-830e-4cef-bdad-f661ae403a47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.051010 Dec 25 21:57:57.644627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 3999/8031] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:57 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:58.655363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:58.656270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:58.664196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:58.664646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:58.665471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:58.665908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:58.702556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f43cb90f-5c3e-4b49-a4d7-8782112636f7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 14 microversion: 2.1 time: 0.051241 Dec 25 21:57:58.703323 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4033/8032] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:58 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 21:57:59.714021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:57:59.715530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:57:59.723572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:59.724040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:59.724838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:57:59.725317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:57:59.774021 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f1a682f0-23e5-4a62-933e-4ec5060fbbfa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 8208 microversion: 2.1 time: 0.064195 Dec 25 21:57:59.774681 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4000/8033] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:57:59 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 8208 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:58:00.786669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:00.787722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:00.795449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:00.795901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:00.796748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:00.797211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:00.853206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c54d8abb-ea6b-429a-842c-4eac21082687 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 16402 microversion: 2.1 time: 0.071311 Dec 25 21:58:00.856928 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4034/8034] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:00 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 16402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:01.864773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:01.865810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:01.873436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:01.873900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:01.874693 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:01.875141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:01.912920 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5dada8e-1bc0-45c1-8e07-94d25bf2d41c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 16402 microversion: 2.1 time: 0.052152 Dec 25 21:58:01.913549 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4001/8035] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:01 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 16402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:02.925225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:02.926260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:02.933866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:02.934332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:02.935124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:02.935565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:02.974988 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-41e89041-59c9-4d69-8e18-85d2c3491347 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 16402 microversion: 2.1 time: 0.054144 Dec 25 21:58:02.975632 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4035/8036] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:02 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 16402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:03.987618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:03.988637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:03.996478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:03.996975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:04.001970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:04.001970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:04.037212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f77e71df-5d18-4f87-a389-4ce5ce87b90b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 16402 microversion: 2.1 time: 0.054088 Dec 25 21:58:04.042644 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4002/8037] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:03 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 16402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:05.049737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:05.050746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:05.058300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:05.058762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:05.059621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:05.060065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:05.111968 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d1773225-19c2-48e1-a3f5-9a50f14e3709 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.066067 Dec 25 21:58:05.112633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4036/8038] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:05 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:06.125254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:06.126270 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:06.134238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:06.134708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:06.135508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:06.135963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:06.176753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cd069cef-18ae-47c1-b95f-2b6c2ab0d2a3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.055561 Dec 25 21:58:06.177426 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4003/8039] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:06 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:07.188832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:07.189886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:07.197322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:07.197783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:07.198572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:07.199020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:07.238544 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a616326-217d-4fe1-9790-a7b90546265d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.053704 Dec 25 21:58:07.239178 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4037/8040] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:07 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:08.250954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:08.252594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:08.260036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:08.260510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:08.261342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:08.261798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:08.303290 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afc1b08f-080b-47c2-8cec-3cebfcdc9d0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.056437 Dec 25 21:58:08.304145 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4004/8041] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:08 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:09.315316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:09.316320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:09.323692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:09.324142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:09.324942 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:09.325386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:09.365703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-25692015-35c5-4143-a9d5-221805a6245f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.054338 Dec 25 21:58:09.366357 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4038/8042] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:09 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:10.378675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:10.379673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:10.387028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:10.387492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:10.388285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:10.388736 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:10.428006 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ac705f7c-5dac-4876-bf7d-e550fdd36cb3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.053958 Dec 25 21:58:10.428628 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4005/8043] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:10 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:11.440423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:11.441476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:11.448751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:11.449220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:11.450019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:11.450459 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:11.490035 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-82abdc85-8a65-4202-8d35-755208fe0ea8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.053993 Dec 25 21:58:11.490667 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4039/8044] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:11 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:12.503072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:12.503990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:12.511388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:12.511851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:12.512637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:12.513113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:12.551392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f8f5ba5-ada2-4baa-b45d-0ad7a2b5d290 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.053067 Dec 25 21:58:12.552183 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4006/8045] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:12 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:13.563523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:13.565067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:13.572415 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:13.573042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:13.573674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:13.574116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:13.615617 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8a4f74c4-5d90-4f28-a816-2fabe92abafe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.056129 Dec 25 21:58:13.616541 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4040/8046] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:13 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:14.628674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:14.629721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:14.637272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:14.637721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:14.638546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:14.639006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:14.678482 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-00800a9c-b896-4619-ad54-fe54115c83e5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.054450 Dec 25 21:58:14.679115 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4007/8047] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:14 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:15.689571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:15.690710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:15.698207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:15.698734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:15.699620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:15.700132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:15.742467 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-678a4cca-fa29-4a9d-90db-819f241bdf3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 24572 microversion: 2.1 time: 0.056620 Dec 25 21:58:15.743963 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4041/8048] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:15 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 24572 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:16.759218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:16.760235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:16.768041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:16.768513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:16.769341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:16.769796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:16.824113 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b935ff44-ae77-4a7a-94da-966c0afb6a99 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.069164 Dec 25 21:58:16.824747 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4008/8049] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:16 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:17.836667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:17.837687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:17.844898 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:17.845997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:17.846775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:17.847209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:17.887275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa4edf52-de5d-4e8c-b608-9044d2f8ef23 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054488 Dec 25 21:58:17.887903 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4042/8050] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:17 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:18.899232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:18.900280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:18.908222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:18.910691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:18.911953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:18.912421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:18.963027 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6390586a-174b-44f2-a079-af5e7c3d442e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.067726 Dec 25 21:58:18.963906 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4009/8051] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:18 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:19.975255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:19.976261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:19.983803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:19.984259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:19.985109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:19.985556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:20.027597 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-31739230-b45b-45cd-82c9-16effcbe45ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.056322 Dec 25 21:58:20.028235 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4043/8052] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:19 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:21.040267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:21.041317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:21.049446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:21.049913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:21.050712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:21.051166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:21.092096 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-261969ed-e8f9-499e-bb90-088ae0dff4f5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055969 Dec 25 21:58:21.092739 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4010/8053] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:21 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:22.104745 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:22.105777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:22.113085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:22.117336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:22.117336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:22.117336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:22.155702 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-854f584b-5a60-40b7-a688-0a94cc03af4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055064 Dec 25 21:58:22.156527 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4044/8054] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:22 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:23.167967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:23.169076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:23.177078 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:23.177550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:23.178349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:23.178805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:23.218073 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d3bf27b-5d5f-48a6-ba30-68fa2bbc3d8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054074 Dec 25 21:58:23.218628 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4011/8055] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:23 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:24.230230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:24.231263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:24.239914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:24.240371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:24.241182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:24.241624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:24.280931 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f2cd57e0-4b9a-4247-852b-321b9e54fa88 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054691 Dec 25 21:58:24.281557 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4045/8056] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:24 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:25.293668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:25.294674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:25.302571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:25.303036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:25.303827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:25.304278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:25.344356 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2426455c-a9d0-4edc-94a0-1d75fb136112 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054722 Dec 25 21:58:25.345015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4012/8057] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:25 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:26.355682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:26.356674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:26.364008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:26.365178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:26.365434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:26.365882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:26.408670 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b490b8f-767d-4d9b-94ff-d16db27045fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.056942 Dec 25 21:58:26.409377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4046/8058] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:26 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:27.421175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:27.422192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:27.429735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:27.430209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:27.431018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:27.431475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:27.471463 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43d7b3b9-d4ac-47a1-965d-92632bbfd419 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054399 Dec 25 21:58:27.472359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4013/8059] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:27 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:28.484026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:28.485055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:28.492614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:28.493065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:28.493840 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:28.494277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:28.533386 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-825bce8c-e164-4b7a-84a2-037fdaf61d6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.052924 Dec 25 21:58:28.534042 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4047/8060] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:28 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:29.545772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:29.546782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:29.555086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:29.555558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:29.556360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:29.556844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:29.596231 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ceb8312c-64e5-4a82-b0a1-a803b1e02a85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054456 Dec 25 21:58:29.596888 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4014/8061] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:29 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:30.608140 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:30.609097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:30.616334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:30.617090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:30.617860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:30.618292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:30.657237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e271ff69-c334-49a6-a0f4-cfa3191f83d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053087 Dec 25 21:58:30.658530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4048/8062] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:30 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:31.669804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:31.670822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:31.678584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:31.679052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:31.679857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:31.680352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:31.721759 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1f99afcc-7821-4424-aeb6-0555191715d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055875 Dec 25 21:58:31.722530 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4015/8063] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:31 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:32.734391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:32.735895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:32.743789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:32.744276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:32.745113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:32.745551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:32.784383 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-12acf9e5-5069-4ffc-9f9b-83af9ea8d707 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053998 Dec 25 21:58:32.785170 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4049/8064] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:32 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:33.796886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:33.798555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:33.806043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:33.806503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:33.807297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:33.807745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:33.849972 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8536870f-e2b5-4599-bb48-8a57a742e338 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.057140 Dec 25 21:58:33.850615 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4016/8065] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:33 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:34.862304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:34.863305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:34.870940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:34.871402 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:34.872207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:34.872644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:34.911429 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-988a2109-7279-4d54-85c3-b65f931f171f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053059 Dec 25 21:58:34.912229 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4050/8066] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:34 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:35.923724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:35.924752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:35.932213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:35.932686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:35.933524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:35.933983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:35.974719 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c0f80c44-cc26-4a5a-998a-c907813fdc38 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055047 Dec 25 21:58:35.975371 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4017/8067] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:35 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:36.986807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:36.987804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:36.995714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:36.996178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:36.997007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:36.997450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:37.036799 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-416197b2-44b6-489f-9aa3-1fb33d863223 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054604 Dec 25 21:58:37.037479 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4051/8068] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:36 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:38.050599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:38.052257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:38.061292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:38.061760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:38.062605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:38.063180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:38.103860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fa2fe532-9e6d-4d04-94f4-65f3b41b8dbb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.057996 Dec 25 21:58:38.104733 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4018/8069] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:38 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:39.116143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:39.117463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:39.124725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:39.125207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:39.126513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:39.126950 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:39.168396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-36349c70-ec97-4808-a3b6-7f617ddfef3e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.056271 Dec 25 21:58:39.169113 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4052/8070] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:39 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:40.180183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:40.181214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:40.188510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:40.189037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:40.189868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:40.190319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:40.230307 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b45a78da-94c7-42d4-bf4a-8c52eb9f6f11 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054105 Dec 25 21:58:40.230939 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4019/8071] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:40 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 21:58:41.243103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:41.244147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:41.252175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:41.252627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:41.253438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:41.253880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:41.294189 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e94d88b5-d8a6-45d8-a13d-226892bf07c8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055368 Dec 25 21:58:41.294815 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4053/8072] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:41 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:42.307453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:42.308464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:42.316124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:42.316598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:42.317431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:42.317889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:42.357576 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c968821-fad3-4b1b-be86-731a62fbcbbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054116 Dec 25 21:58:42.358214 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4020/8073] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:42 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:43.370319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:43.371345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:43.379403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:43.381244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:43.381244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:43.381244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:43.420819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7a38048c-604b-4c43-a90f-5815e9d73cd8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054869 Dec 25 21:58:43.421479 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4054/8074] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:43 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:44.434086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:44.435026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:44.443203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:44.443670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:44.444477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:44.444947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:44.485825 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6113c6c-ff61-4a55-b87b-ca008ae3edc8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.056636 Dec 25 21:58:44.486536 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4021/8075] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:44 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:45.498277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:45.499281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:45.506748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:45.507213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:45.507980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:45.508419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:45.548806 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94d6fa26-ad89-42ba-ba24-21bfe837f76b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054564 Dec 25 21:58:45.549458 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4055/8076] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:45 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:46.561182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:46.562157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:46.569833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:46.570294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:46.571091 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:46.571537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:46.617244 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-760438e5-ad27-42c6-993f-acd61011ebe0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.060198 Dec 25 21:58:46.617929 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4022/8077] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:46 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:47.629666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:47.630741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:47.637866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:47.638320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:47.639108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:47.639544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:47.680825 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-792b6738-013b-4635-8ac3-4f2e3151bc04 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055206 Dec 25 21:58:47.681491 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4056/8078] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:47 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:48.692277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:48.693229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:48.700547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:48.701039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:48.701829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:48.702304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:48.741698 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84205373-3bab-4665-a596-8b2cadba07ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053141 Dec 25 21:58:48.742582 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4023/8079] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:48 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:49.753883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:49.754880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:49.762157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:49.762605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:49.763375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:49.763808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:49.802485 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-319df505-b63d-4222-9544-4573bae7db6a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.052582 Dec 25 21:58:49.803395 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4057/8080] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:49 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:50.814786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:50.815792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:50.823253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:50.823723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:50.824529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:50.825012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:50.869458 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c88549aa-524d-476c-b5b3-64c81e3eaf63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.058670 Dec 25 21:58:50.870099 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4024/8081] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:50 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:51.881602 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:51.882596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:51.889832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:51.890280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:51.891048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:51.891482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:51.933698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a7add0c-adfa-4a18-836c-44e03b4beec6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.056018 Dec 25 21:58:51.934365 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4058/8082] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:51 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:52.945860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:52.946919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:52.954341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:52.954814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:52.955625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:52.956084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:52.995840 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db8eca27-fe9d-4e00-8ad2-24a4b8522c93 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054012 Dec 25 21:58:52.996518 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4025/8083] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:52 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:54.008469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:54.009515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:54.017372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:54.018921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:54.018921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:54.019179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:54.058773 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-65d77641-562b-453a-a581-4c3883b53975 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054246 Dec 25 21:58:54.059733 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4059/8084] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:54 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:55.071351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:55.072354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:55.079985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:55.080407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:55.081250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:55.081703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:55.121079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f164c430-7fc7-4d0b-a2ad-8b2597acf5ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053731 Dec 25 21:58:55.121693 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4026/8085] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:55 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:56.134036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:56.135031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:56.142406 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:56.142866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:56.143678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:56.144118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:56.184741 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b9a98f2-74fc-4e05-be91-fb5695aa8325 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054713 Dec 25 21:58:56.185408 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4060/8086] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:56 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:57.197831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:57.198865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:57.206971 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:57.207448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:57.208246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:57.208697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:57.248020 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e065300a-3f25-4ada-914f-b80e16fe8b79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054214 Dec 25 21:58:57.248899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4027/8087] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:57 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:58.260221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:58.261255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:58.269122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:58.269572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:58.270342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:58.270777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:58.309999 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-227682d2-ce83-4276-979f-925f5e680c1f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053842 Dec 25 21:58:58.310619 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4061/8088] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:58 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:58:59.322190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:58:59.323193 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:58:59.330639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:59.331099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:59.331893 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:58:59.332345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:58:59.374490 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ebff6b3f-2222-4c4e-aa68-b384c68e21e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.056321 Dec 25 21:58:59.375126 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4028/8089] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:58:59 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:00.386858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:00.387855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:00.395768 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:00.396214 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:00.397036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:00.397475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:00.437791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd27ec8e-9489-4167-af21-e3f17e40be8c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054962 Dec 25 21:59:00.438428 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4062/8090] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:00 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:01.450249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:01.451268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:01.458688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:01.459163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:01.459965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:01.460425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:01.500472 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aadd9b63-2104-42fe-b9e9-4a577ea8fac7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054324 Dec 25 21:59:01.501146 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4029/8091] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:01 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:02.513615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:02.514545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:02.522270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:02.522615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:02.523389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:02.523818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:02.562046 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a172464-7cf8-4e24-b293-9752b1288e0b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.052497 Dec 25 21:59:02.562702 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4063/8092] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:02 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:03.574890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:03.575897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:03.583830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:03.584294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:03.585112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:03.585565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:03.623351 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-21abcb88-4643-44d4-b983-e8b69ca107ac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.052427 Dec 25 21:59:03.624317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4030/8093] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:03 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:04.636429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:04.637624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:04.651497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:04.652070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:04.653062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:04.653567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:04.699480 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c47ae1ae-d97d-4c3d-827b-6a53386e8d66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.067401 Dec 25 21:59:04.705534 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4064/8094] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:04 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:05.711622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:05.712682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:05.722942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:05.723745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:05.725069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:05.725809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:05.777061 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0040ba3d-1ba8-4d4d-b1e8-79ec444a5e0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.069580 Dec 25 21:59:05.777722 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4031/8095] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:05 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:06.789608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:06.790661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:06.797992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:06.807811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:06.807811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:06.807811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:06.840548 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02ffd07f-0585-448f-96b7-12abb6b3f512 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054929 Dec 25 21:59:06.841243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4065/8096] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:06 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:07.853174 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:07.854177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:07.861775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:07.862286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:07.863080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:07.863530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:07.903245 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3559204-cb1e-415b-9168-ab5acd9d6d67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054085 Dec 25 21:59:07.903894 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4032/8097] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:07 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:08.916164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:08.917104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:08.924496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:08.924975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:08.925846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:08.926322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:08.965423 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a53cf671-100c-4e45-970c-fc42c5bd4520 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053250 Dec 25 21:59:08.966076 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4066/8098] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:08 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:09.978310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:09.979332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:09.987530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:09.988000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:09.988811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:09.989292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:10.029019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b5ebb8b-705a-489c-9292-f6b1286fc31e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054755 Dec 25 21:59:10.029899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4033/8099] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:09 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:11.041569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:11.042499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:11.050322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:11.050776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:11.051553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:11.051988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:11.091047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-508dd012-d3e1-4023-b6ec-23e673f4c4d7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053582 Dec 25 21:59:11.091955 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4067/8100] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:11 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:12.103295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:12.104309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:12.111743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:12.112211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:12.113067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:12.113523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:12.156940 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1c771a3f-014a-4921-a299-bef79fe58bb9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.057589 Dec 25 21:59:12.157620 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4034/8101] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:12 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:13.169421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:13.170416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:13.177849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:13.178300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:13.179076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:13.179511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:13.218354 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-43e1a8de-592b-42c9-b812-d0b15dc3952c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.052912 Dec 25 21:59:13.218950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4068/8102] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:13 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:14.231061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:14.232079 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:14.240299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:14.241080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:14.241892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:14.242355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:14.281718 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3495652e-b7c2-48b5-8a36-9846c7d9af8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054903 Dec 25 21:59:14.282401 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4035/8103] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:14 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:15.294550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:15.295551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:15.302975 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:15.303421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:15.304200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:15.304636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:15.344396 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-00549fa9-cf55-4685-80fe-5685eda8a19e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.053810 Dec 25 21:59:15.345043 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4069/8104] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:15 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:16.356775 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:16.357809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:16.365037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:16.371182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:16.371182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:16.371182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:16.407144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0ec92ee-ef56-49d7-b7da-80527d4a36bb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054524 Dec 25 21:59:16.407788 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4036/8105] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:16 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:17.419318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:17.420320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:17.432658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:17.433657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:17.434083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:17.435050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:17.479563 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7c97efa1-b53c-42f2-9beb-cddc8d911361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.064327 Dec 25 21:59:17.480464 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4070/8106] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:17 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:18.492733 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:18.493798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:18.501352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:18.502462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:18.503274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:18.503735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:18.542796 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b221fc99-d8b8-4cb8-b918-4af282f74699 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054295 Dec 25 21:59:18.543354 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4037/8107] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:18 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:19.555715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:19.556713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:19.564094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:19.564548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:19.565352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:19.565792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:19.604434 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b470062-6cca-45c8-b68b-e6470ad07d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.052698 Dec 25 21:59:19.605081 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4071/8108] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:19 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:20.616585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:20.617553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:20.624967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:20.625462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:20.626257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:20.626718 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:20.666792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d0644ab-68b2-4517-954b-cb680ddf2415 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054614 Dec 25 21:59:20.667427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4038/8109] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:20 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:21.679553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:21.680566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:21.687839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:21.688290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:21.689109 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:21.689560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:21.729875 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3109523a-b60f-496d-9623-ddf2656ecb37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.054374 Dec 25 21:59:21.730609 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4072/8110] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:21 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:22.741633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:22.742645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:22.750063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:22.750529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:22.751321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:22.751772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:22.792664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9032750-d7a5-47e4-82fd-90ead6375901 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055325 Dec 25 21:59:22.793320 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4039/8111] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:22 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:23.804720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:23.805752 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:23.813150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:23.813607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:23.814389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:23.815001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:23.855896 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-925ad1b0-71c6-45f8-ae9c-2b1345ef6adc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 32646 microversion: 2.1 time: 0.055155 Dec 25 21:59:23.856524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4073/8112] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:23 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 32646 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:24.870200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:24.871460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:24.879699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:24.880166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:24.880997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:24.881458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:24.936812 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3709ed7a-49cf-490b-b646-8f30bde9d2f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 200 len: 40795 microversion: 2.1 time: 0.070641 Dec 25 21:59:24.937513 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4040/8113] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:24 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 40795 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 21:59:24.948661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4944a1d5-4b21-4adf-b463-909eded3079a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:24.956845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4944a1d5-4b21-4adf-b463-909eded3079a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:24.957336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4944a1d5-4b21-4adf-b463-909eded3079a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:24.979978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4944a1d5-4b21-4adf-b463-909eded3079a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 21:59:25.193762 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4944a1d5-4b21-4adf-b463-909eded3079a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 202 len: 0 microversion: 2.1 time: 0.249021 Dec 25 21:59:25.194292 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4074/8114] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:24 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:59:25.202811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:25.203531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:25.210845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:25.213418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:25.213418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:25.213418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:25.442929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:25.450513 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a70e0d81-7c11-4610-92e4-4a7b3d060dba tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.251702 Dec 25 21:59:25.451025 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4041/8115] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:25 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:26.469042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:26.469739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:26.477154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:26.477610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:26.478389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:26.478825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:26.670356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:26.677698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-212a595d-000f-4e9f-ab7e-7e58939c344e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.213536 Dec 25 21:59:26.678280 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4075/8116] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:26 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:27.694863 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:27.695487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:27.702374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:27.702836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:27.703624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:27.704069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:27.837507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:27.845007 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a6f51baa-db5d-43f7-93de-0a0efa800cd0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.154459 Dec 25 21:59:27.845577 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4042/8117] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:27 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:28.861504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:28.862097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:28.869651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:28.870105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:28.870871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:28.871300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:28.999719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:29.007677 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c2bf802a-5421-40cb-ba2c-e827455f306a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.149819 Dec 25 21:59:29.008248 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4076/8118] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:28 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:30.023492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:30.024061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:30.030859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:30.031345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:30.032162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:30.032614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:30.167704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:30.175860 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-99de2abc-2ba8-4960-bf59-7466bd5538bf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.155588 Dec 25 21:59:30.176436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4043/8119] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:30 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:31.193289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:31.193875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:31.200586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:31.201069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:31.201836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:31.202269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:31.333969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:31.341407 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aaae41b6-6795-42c4-9bee-591b04f74f78 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.152510 Dec 25 21:59:31.341989 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4077/8120] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:31 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:32.358451 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:32.359111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:32.366341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:32.366809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:32.367610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:32.368065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:32.501643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:32.510855 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8514a74-48e9-467b-889d-e49adb96e484 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.156243 Dec 25 21:59:32.511458 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4044/8121] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:32 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:33.527335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:33.527938 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:33.535344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:33.535835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:33.536609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:33.537080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:33.671310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:33.678841 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a900c098-0a67-42de-947c-52906fb9aa6d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.155283 Dec 25 21:59:33.679420 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4078/8122] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:33 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:34.695042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:34.695677 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:34.702719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:34.703254 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:34.704060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:34.704521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:34.840030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:34.848178 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-165fee5a-7057-4441-9d3f-b6f48233c20c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.156960 Dec 25 21:59:34.848745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4045/8123] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:34 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:35.865694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:35.866289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:35.873076 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:35.873514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:35.874292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:35.874728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:36.010355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:36.017702 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0f9117a9-fcce-4ba5-a204-d9ec3af1ea66 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1656 microversion: 2.1 time: 0.156637 Dec 25 21:59:36.018272 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4079/8124] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:35 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:36.033647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:36.035132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:36.041975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:36.042453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:36.043262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:36.043723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:36.073670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:36.079384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Old instance type m1.heat2, new instance type m1.heat {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 21:59:36.085455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:59:36.085895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:59:36.086392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:59:36.086821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:59:36.087246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:59:36.256215 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-029a50e0-feb0-4fb1-ab61-a53be18ba2df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 202 len: 0 microversion: 2.1 time: 0.226279 Dec 25 21:59:36.256983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4046/8125] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:36 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:59:36.264683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:36.265330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:36.272013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:36.273962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:36.273962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:36.273962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:36.406992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:36.415051 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0cd3539b-afff-4a88-be79-ee0c60baea00 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.154004 Dec 25 21:59:36.415630 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4080/8126] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:36 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:37.432148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:37.432784 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:37.439658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:37.440126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:37.440954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:37.441415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:37.576131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:37.584378 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a191140d-1083-4333-8b08-85afc4ee4c5f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.156068 Dec 25 21:59:37.584976 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4047/8127] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:37 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:38.601943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:38.602504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:38.609269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:38.609726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:38.610566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:38.611007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:38.814870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:38.822443 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-536367df-27ab-4c74-9540-78ca88062e68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1679 microversion: 2.1 time: 0.224281 Dec 25 21:59:38.823019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4081/8128] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:38 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1679 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:39.839758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:39.840293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:39.848071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:39.848550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:39.849426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:39.849882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:39.982590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:39.990279 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-37d909b3-c50d-439b-910e-f88bf2b5fd82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1684 microversion: 2.1 time: 0.154248 Dec 25 21:59:39.990853 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4048/8129] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:39 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:41.007084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:41.007708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:41.014550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:41.015009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:41.015793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:41.016263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:41.171477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:41.178911 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33d6fac5-b158-4386-bdee-c8efff7864c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1684 microversion: 2.1 time: 0.175553 Dec 25 21:59:41.179504 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4082/8130] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:41 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:42.108420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-828f73a5-79cc-429e-88a9-3e52d62c117e req-43ee1fe0-6421-4694-9b48-45a90b3b0f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "name": "network-vif-unplugged", "status": "completed", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:42.109996 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:59:42.109996 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 21:59:42.118170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-828f73a5-79cc-429e-88a9-3e52d62c117e req-43ee1fe0-6421-4694-9b48-45a90b3b0f05 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:42.118667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-828f73a5-79cc-429e-88a9-3e52d62c117e req-43ee1fe0-6421-4694-9b48-45a90b3b0f05 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:42.130776 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-828f73a5-79cc-429e-88a9-3e52d62c117e req-43ee1fe0-6421-4694-9b48-45a90b3b0f05 service nova] Creating event network-vif-unplugged:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch1-master-1 Dec 25 21:59:42.136043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-828f73a5-79cc-429e-88a9-3e52d62c117e req-43ee1fe0-6421-4694-9b48-45a90b3b0f05 service nova] Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:59:42.147504 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-828f73a5-79cc-429e-88a9-3e52d62c117e req-43ee1fe0-6421-4694-9b48-45a90b3b0f05 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042750 Dec 25 21:59:42.148113 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4049/8131] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:59:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:59:42.196293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:42.196960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:42.203796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:42.204247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:42.205057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:42.205497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:42.485827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:42.494638 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b8d1832-7d43-4ea3-8ccb-6ca0095f0652 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1683 microversion: 2.1 time: 0.302092 Dec 25 21:59:42.495296 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4083/8132] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:42 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1683 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:43.512895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:43.513620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:43.519944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:43.520408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:43.521503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:43.522045 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:43.653314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:43.661261 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-153d358a-ad73-4e50-8760-7251a6bd499b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1681 microversion: 2.1 time: 0.153417 Dec 25 21:59:43.661868 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4050/8133] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:43 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:44.162143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-098fa925-ab07-49fd-97f6-36423ac86c0d req-d5b399e4-0590-4401-8851-3876b1f03449 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:44.163665 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:59:44.163665 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:59:44.171347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-098fa925-ab07-49fd-97f6-36423ac86c0d req-d5b399e4-0590-4401-8851-3876b1f03449 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:44.171802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-098fa925-ab07-49fd-97f6-36423ac86c0d req-d5b399e4-0590-4401-8851-3876b1f03449 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:44.183097 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-098fa925-ab07-49fd-97f6-36423ac86c0d req-d5b399e4-0590-4401-8851-3876b1f03449 service nova] Creating event network-changed:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch1-master-1 Dec 25 21:59:44.188428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-098fa925-ab07-49fd-97f6-36423ac86c0d req-d5b399e4-0590-4401-8851-3876b1f03449 service nova] Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 21:59:44.199355 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-098fa925-ab07-49fd-97f6-36423ac86c0d req-d5b399e4-0590-4401-8851-3876b1f03449 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041497 Dec 25 21:59:44.199950 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4084/8134] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:59:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:59:44.678909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:44.679643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:44.686825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:44.687304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:44.688115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:44.688576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:45.369571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:45.377600 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ec94d4c-47fb-4928-a0ed-ae63fe0a1868 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1681 microversion: 2.1 time: 0.703079 Dec 25 21:59:45.378370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4051/8135] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:44 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1681 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:46.396855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:46.397568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:46.403781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:46.404228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:46.405030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:46.405464 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:46.545317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:46.552808 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-916679a5-e0a6-468c-9640-d4c91f0a8282 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1677 microversion: 2.1 time: 0.162134 Dec 25 21:59:46.553446 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4085/8136] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:46 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:46.572313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:46.572782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:46.579526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:46.579993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:46.580826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:46.582048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:46.737367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-01ce2cc6-414e-46a9-be6d-288561c93ee0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 204 len: 0 microversion: 2.1 time: 0.168954 Dec 25 21:59:46.738022 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4052/8137] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:46 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 21:59:46.745995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:46.746906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:46.754296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:46.754823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:46.759627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:46.760079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:46.945063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:46.954036 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9372a612-5073-41ea-98a4-e864e1b609b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1677 microversion: 2.1 time: 0.211587 Dec 25 21:59:46.955291 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4086/8138] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:46 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:47.972472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:47.973231 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:47.979536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:47.980010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:47.980846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:47.981334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:48.118247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:48.125749 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a375dcbc-214f-4674-88fe-a11a677aad8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1677 microversion: 2.1 time: 0.158225 Dec 25 21:59:48.126317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4053/8139] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:47 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:48.681609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a78744bd-0d54-4754-b531-d20e56e4bfba req-db6f1140-0715-4731-ad36-e9b93531e497 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "name": "network-vif-plugged", "status": "completed", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:48.687312 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:59:48.687312 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:59:48.692188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a78744bd-0d54-4754-b531-d20e56e4bfba req-db6f1140-0715-4731-ad36-e9b93531e497 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:48.692655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a78744bd-0d54-4754-b531-d20e56e4bfba req-db6f1140-0715-4731-ad36-e9b93531e497 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:48.704012 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a78744bd-0d54-4754-b531-d20e56e4bfba req-db6f1140-0715-4731-ad36-e9b93531e497 service nova] Creating event network-vif-plugged:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch1-master-1 Dec 25 21:59:48.709540 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a78744bd-0d54-4754-b531-d20e56e4bfba req-db6f1140-0715-4731-ad36-e9b93531e497 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031639 Dec 25 21:59:48.710131 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4087/8140] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:59:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:59:49.142654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:49.143201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:49.150512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.150976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.151767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.152212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.282722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:49.290771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-48fba650-c8e3-4e65-a6b0-f6f33677e94f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1656 microversion: 2.1 time: 0.151973 Dec 25 21:59:49.291349 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4054/8141] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:49 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:49.306891 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:49.307584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:49.313733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.314182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.314947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.315377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.447860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:49.455387 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfc9fc49-f6b9-4b3f-9b39-ac638b74e4f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1656 microversion: 2.1 time: 0.152505 Dec 25 21:59:49.455955 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4088/8142] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:49 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1656 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:49.471694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4df19a95-3e0b-4eee-abbb-1d2832d9ff47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:49.477793 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4df19a95-3e0b-4eee-abbb-1d2832d9ff47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.478263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4df19a95-3e0b-4eee-abbb-1d2832d9ff47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.500535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4df19a95-3e0b-4eee-abbb-1d2832d9ff47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Going to try to start instance {{(pid=136547) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 21:59:49.693427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4df19a95-3e0b-4eee-abbb-1d2832d9ff47 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action" status: 202 len: 0 microversion: 2.1 time: 0.225144 Dec 25 21:59:49.694116 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4055/8143] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 21:59:49 2021] POST /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 21:59:49.702117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:49.702739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:49.711609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.712070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.712864 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:49.713337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:49.858244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:49.866501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-37456097-8e59-4ff6-b92d-d8e9c64a2952 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1665 microversion: 2.1 time: 0.168080 Dec 25 21:59:49.867271 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4089/8144] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:49 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:50.885408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:50.886204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:50.892413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:50.892892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:50.893690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:50.894768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:51.027246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:51.034779 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f53f94f-4de2-4ddb-8be3-3e6eff732bfe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1665 microversion: 2.1 time: 0.154502 Dec 25 21:59:51.035348 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4056/8145] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:50 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1665 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:52.052226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:52.052830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:52.059560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:52.060008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:52.060775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:52.061227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:52.196529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:52.204069 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86547bb7-fc41-4f82-b321-3c91ad15c828 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1669 microversion: 2.1 time: 0.156025 Dec 25 21:59:52.204641 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4090/8146] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:52 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:52.219832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:52.220495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:52.227466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:52.227938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:52.228741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:52.229220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:52.255524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 21:59:52.508864 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8ac975a1-18ed-4449-ac03-26eddc838c5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 204 len: 0 microversion: 2.1 time: 0.292398 Dec 25 21:59:52.509448 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4057/8147] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 21:59:52 2021] DELETE /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 21:59:52.517484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:52.519993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:52.524027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:52.524481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:52.525290 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:52.525725 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:52.654119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:52.662032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-80523d03-008a-4129-9841-00fb1cb85011 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1675 microversion: 2.1 time: 0.148242 Dec 25 21:59:52.662610 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4091/8148] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:52 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:53.679778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:53.680512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:53.687519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:53.687978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:53.688774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:53.689249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:53.857456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:53.865753 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c2b1e095-207b-43a4-b5aa-04729161ad7d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1675 microversion: 2.1 time: 0.190618 Dec 25 21:59:53.866337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4058/8149] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:53 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:54.692341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-e6986e01-4b4c-4622-8802-f1b8ba01c6a3 req-b1e78769-d0aa-494c-a794-f9d99c6e7fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d4eb99-8e5d-4037-9001-8cee89aae129", "name": "network-vif-deleted", "tag": "d99b343d-58f2-459f-95b1-2f08bb18e0ab"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:54.694044 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 21:59:54.694044 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 21:59:54.702603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e6986e01-4b4c-4622-8802-f1b8ba01c6a3 req-b1e78769-d0aa-494c-a794-f9d99c6e7fea service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:54.704213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-e6986e01-4b4c-4622-8802-f1b8ba01c6a3 req-b1e78769-d0aa-494c-a794-f9d99c6e7fea service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:54.714966 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-e6986e01-4b4c-4622-8802-f1b8ba01c6a3 req-b1e78769-d0aa-494c-a794-f9d99c6e7fea service nova] Creating event network-vif-deleted:d99b343d-58f2-459f-95b1-2f08bb18e0ab for instance d4d4eb99-8e5d-4037-9001-8cee89aae129 on nch1-master-1 Dec 25 21:59:54.720074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-e6986e01-4b4c-4622-8802-f1b8ba01c6a3 req-b1e78769-d0aa-494c-a794-f9d99c6e7fea service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Dec 25 21:59:54.720689 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4092/8150] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 21:59:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 21:59:54.883250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:54.883909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:54.890785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:54.891288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:54.892058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:54.892507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:54.926427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:54.926757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:54.927136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lazy-loading 'fault' on Instance uuid d4d4eb99-8e5d-4037-9001-8cee89aae129 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 21:59:54.968696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:54.976345 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4f4b62ce-11f4-4fe8-9114-60bc59d8ee42 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 200 len: 1329 microversion: 2.1 time: 0.096833 Dec 25 21:59:54.977081 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4059/8151] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:54 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 21:59:55.995599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:55.996323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:56.002565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:56.007666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:56.007666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:56.007666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:56.018030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. Dec 25 21:59:56.018616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:59:56.019465 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-64c296d5-4fb6-4462-b00a-04f52bb72ae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 404 len: 111 microversion: 2.1 time: 0.028717 Dec 25 21:59:56.019994 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4093/8152] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:55 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 21:59:56.072275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:56.072978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:56.079764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:56.080235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:56.081070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:56.081567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:56.096309 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. Dec 25 21:59:56.097152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 21:59:56.102270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1adc9d7b-3ea1-47ce-97b0-6b536785f50c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 404 len: 111 microversion: 2.1 time: 0.029382 Dec 25 21:59:56.102270 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4060/8153] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:56 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 21:59:56.150451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-635587398", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "544249cb-4293-4a78-9ba3-8f386deae100"}], "security_groups": [{"name": "tempest-securitygroup--685716593"}], "key_name": "tempest-keypair-1650957824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 21:59:56.253102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] validate_networks() for [('544249cb-4293-4a78-9ba3-8f386deae100', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 21:59:56.623236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 21:59:56.623691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 21:59:56.624171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 21:59:56.624583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 21:59:56.625028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 21:59:56.633732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:56.634190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:56.635011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:56.635453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:56.652299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 21:59:56.657376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 21:59:56.669921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 21:59:56.672273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 21:59:56.779862 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5abfd980-b977-4f2e-9aeb-4268778b4b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.633060 Dec 25 21:59:56.780688 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4094/8154] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 21:59:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 21:59:56.791199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13706b8b-7627-4af9-98df-1f2da5ea4103 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:56.799895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13706b8b-7627-4af9-98df-1f2da5ea4103 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:56.848686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-13706b8b-7627-4af9-98df-1f2da5ea4103 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:56.855286 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13706b8b-7627-4af9-98df-1f2da5ea4103 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1238 microversion: 2.1 time: 0.067934 Dec 25 21:59:56.855864 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4061/8155] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:56 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:57.873030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:57.873693 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:57.881916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:57.882390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:57.883184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:57.883631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:57.943411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:57.950986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-406173ef-17eb-4810-a701-fd1c32aa6ddf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1234 microversion: 2.1 time: 0.082455 Dec 25 21:59:57.951554 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4095/8156] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:57 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 21:59:58.969297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 21:59:58.970479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 21:59:58.978759 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:58.979215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:58.980019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 21:59:58.980476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 21:59:59.050975 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 21:59:59.058304 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-daed1d09-435d-4baf-b2e9-280d99cc23cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1296 microversion: 2.1 time: 0.092793 Dec 25 21:59:59.058874 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4062/8157] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 21:59:58 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:00.075356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:00.076233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:00.083480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:00.083932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:00.084723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:00.085207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:00.201073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-64e7305a-d6e2-4433-abbc-0638f6e181c8 req-9be421b1-c0c4-4a14-9d9d-0765cbab001a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:00.202680 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:00:00.202680 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:00:00.210909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-64e7305a-d6e2-4433-abbc-0638f6e181c8 req-9be421b1-c0c4-4a14-9d9d-0765cbab001a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:00.211308 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-64e7305a-d6e2-4433-abbc-0638f6e181c8 req-9be421b1-c0c4-4a14-9d9d-0765cbab001a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:00.223203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-64e7305a-d6e2-4433-abbc-0638f6e181c8 req-9be421b1-c0c4-4a14-9d9d-0765cbab001a service nova] Creating event network-changed:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch2-master-1 Dec 25 22:00:00.228803 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-64e7305a-d6e2-4433-abbc-0638f6e181c8 req-9be421b1-c0c4-4a14-9d9d-0765cbab001a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110759 Dec 25 22:00:00.229983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4063/8158] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:00:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:00:00.286998 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:00.295424 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b8320e51-7407-485e-821c-23634aca12b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.223565 Dec 25 22:00:00.296327 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4096/8159] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:00 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:01.313896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:01.314608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:01.321678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:01.322207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:01.323017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:01.323479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:01.453764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:01.461231 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-96dc2efe-7fb7-44b0-875a-bf948f5be929 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.152391 Dec 25 22:00:01.461983 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4064/8160] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:01 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:02.479314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:02.479931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:02.486711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:02.487167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:02.488463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:02.489185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:02.968219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:02.976141 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6a5317dd-85f0-44ba-b7ad-82b31412ebe3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.500531 Dec 25 22:00:02.976720 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4097/8161] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:02 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:03.993891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:03.994559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:04.001419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:04.001889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:04.002684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:04.003132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:04.144622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:04.151974 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-afe96477-882e-43a9-92c3-0e17967ae6e8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.161813 Dec 25 22:00:04.152562 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4065/8162] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:03 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:05.169186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:05.169742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:05.176436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:05.176924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:05.177711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:05.178151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:05.555375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:05.562643 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5b97fa63-bfe3-4df7-969a-9c6ea24d0d17 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.397335 Dec 25 22:00:05.563209 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4098/8163] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:05 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:06.580146 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:06.580931 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:06.588144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:06.588645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:06.589476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:06.589925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:06.617127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-21dfd82d-76e5-457a-9139-af8f6f75f992 req-96307e12-30d2-4c98-94b9-7bd4d15b5f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "name": "network-vif-plugged", "status": "completed", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:06.619112 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:00:06.619112 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:00:06.626573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-21dfd82d-76e5-457a-9139-af8f6f75f992 req-96307e12-30d2-4c98-94b9-7bd4d15b5f6e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:06.627025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-21dfd82d-76e5-457a-9139-af8f6f75f992 req-96307e12-30d2-4c98-94b9-7bd4d15b5f6e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:06.638661 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-21dfd82d-76e5-457a-9139-af8f6f75f992 req-96307e12-30d2-4c98-94b9-7bd4d15b5f6e service nova] Creating event network-vif-plugged:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch2-master-1 Dec 25 22:00:06.643596 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-21dfd82d-76e5-457a-9139-af8f6f75f992 req-96307e12-30d2-4c98-94b9-7bd4d15b5f6e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030526 Dec 25 22:00:06.645037 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4099/8164] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:00:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:00:06.750413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:06.758487 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1404a311-b44b-4fb5-acbf-6fad0683236d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.182135 Dec 25 22:00:06.764969 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4066/8165] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:06 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:07.777720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:07.778435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:07.785999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:07.786462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:07.787255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:07.787695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:07.927746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:07.935535 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-909691a6-39c7-4d27-ac80-da74ed4780d3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1363 microversion: 2.1 time: 0.162997 Dec 25 22:00:07.936503 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4100/8166] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:07 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:08.952588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:08.953162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:08.960102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:08.960574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:08.961414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:08.961873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:09.090493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:00:09.098590 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-42e2ac24-8b0c-4ca7-8ca4-64cf91547cbe tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1550 microversion: 2.1 time: 0.149807 Dec 25 22:00:09.099166 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4067/8167] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:00:08 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:09.115396 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:00:09.115886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:09.122607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:09.123066 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:09.123851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:09.124344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:09.201557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04d1a6a1-5434-428a-8116-3cf4a94240f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090610 Dec 25 22:00:09.202166 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4101/8168] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 22:00:09 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:00:10.195938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:10.202139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-87b6712c-28dc-499d-ac4e-667202b79160 req-a108c74c-fea2-43d8-9c2c-58cb7bd5ad16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:10.203642 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:00:10.203642 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:00:10.205563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:10.214904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:10.215704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-87b6712c-28dc-499d-ac4e-667202b79160 req-a108c74c-fea2-43d8-9c2c-58cb7bd5ad16 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:10.216117 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:10.216256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-87b6712c-28dc-499d-ac4e-667202b79160 req-a108c74c-fea2-43d8-9c2c-58cb7bd5ad16 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:10.217269 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:10.217467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:10.228044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-87b6712c-28dc-499d-ac4e-667202b79160 req-a108c74c-fea2-43d8-9c2c-58cb7bd5ad16 service nova] Creating event network-changed:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch2-master-1 Dec 25 22:00:10.233050 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-87b6712c-28dc-499d-ac4e-667202b79160 req-a108c74c-fea2-43d8-9c2c-58cb7bd5ad16 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035264 Dec 25 22:00:10.236395 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4102/8169] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:00:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:00:10.257562 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ed07df2-d7ae-4f9c-8a26-46e4bf1970cc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.065402 Dec 25 22:00:10.260806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4068/8170] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:10 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:11.269689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:11.270594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:11.276929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:11.277391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:11.278174 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:11.278607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:11.315560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c1e2b75-dfe5-41f6-9108-1c1d5869e56a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.050808 Dec 25 22:00:11.316154 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4103/8171] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:11 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:12.328052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:12.329198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:12.336580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:12.337071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:12.337865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:12.338320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:12.376148 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66caf94a-1705-4b5a-849a-221b6203cc49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.052143 Dec 25 22:00:12.377678 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4069/8172] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:12 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:13.437636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:13.441326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:13.445380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:13.445831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:13.446606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:13.447041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:13.482735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a67785a3-0501-4736-804f-c23f3dbfaad4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.098516 Dec 25 22:00:13.483316 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4104/8173] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:13 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:14.494580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:14.495598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:14.503216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:14.504292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:14.505138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:14.505606 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:14.543362 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40c6da48-c922-432d-b00d-bd83b5b76bce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.052782 Dec 25 22:00:14.543930 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4070/8174] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:14 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:15.555143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:15.556143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:15.563450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:15.563904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:15.564687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:15.565152 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:15.603121 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ee8691b3-c940-4a89-ba19-77cbac49f324 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.052500 Dec 25 22:00:15.603738 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4105/8175] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:15 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:16.615943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:16.616891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:16.624114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:16.624588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:16.625420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:16.625871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:16.662438 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aa281776-7c24-43d5-b08c-9e07a36b9956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.051494 Dec 25 22:00:16.663088 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4071/8176] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:16 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:17.674239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:17.675760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:17.682944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:17.683407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:17.684231 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:17.684673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:17.721385 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cec5de06-3c83-4050-9c77-99c9042065bc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.051467 Dec 25 22:00:17.722025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4106/8177] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:17 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:17.938311 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:00:17.938886 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:00:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:00:18.732828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:18.733891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:18.744510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:18.745099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:18.745789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:18.746239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:18.783430 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee73f1a1-95be-4447-814e-7db5eec30593 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.054673 Dec 25 22:00:18.784202 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4072/8178] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:18 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:19.575211 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:00:19.575771 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:00:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:00:19.794977 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:19.796007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:19.804144 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:19.808030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:19.808030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:19.808030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:19.844536 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c6c9ffb-bcfb-427f-b565-805c0abe533b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 14 microversion: 2.1 time: 0.053487 Dec 25 22:00:19.845091 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4107/8179] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:19 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 14 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:00:20.855812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:20.856828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:20.864444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:20.864929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:20.865725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:20.866181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:20.915848 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de9d0112-4e64-45e8-a853-8330e0619a6b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 8204 microversion: 2.1 time: 0.063983 Dec 25 22:00:20.916719 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4073/8180] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:20 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 8204 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:00:21.927227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:21.928250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:21.935547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:21.936006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:21.936785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:21.937249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:21.985054 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-176aafeb-96db-425d-a9c3-b365758dc1f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 16396 microversion: 2.1 time: 0.061730 Dec 25 22:00:21.985897 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4108/8181] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:21 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 16396 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:22.997806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:22.998842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:23.006264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:23.006726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:23.007517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:23.007966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:23.046485 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-87bd38da-741c-42dc-8dff-89bae3fe1f21 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 16396 microversion: 2.1 time: 0.052702 Dec 25 22:00:23.047115 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4074/8182] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:22 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 16396 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:24.057943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:24.058957 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:24.066421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:24.067429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:24.068209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:24.068648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:24.107997 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e34f958c-fc76-499a-b7bb-bda8f9710adb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 16396 microversion: 2.1 time: 0.054117 Dec 25 22:00:24.108607 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4109/8183] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:24 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 16396 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:25.120445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:25.121543 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:25.128955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:25.129976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:25.130768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:25.131219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:25.170005 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aae424b0-efa9-4102-a14e-b6206e222863 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 16396 microversion: 2.1 time: 0.053576 Dec 25 22:00:25.170647 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4075/8184] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:25 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 16396 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:26.181824 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:26.182844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:26.190172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:26.190611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:26.191379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:26.192323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:26.242778 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8697a39-71ae-4ddd-8bf3-84974d51b2f6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.064779 Dec 25 22:00:26.243401 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4110/8185] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:26 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:27.255453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:27.256485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:27.263919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:27.264386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:27.265206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:27.265699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:27.305050 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9fbc8e1-14f5-4750-a5f0-c02e87229e89 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.054257 Dec 25 22:00:27.305681 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4076/8186] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:27 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:28.315985 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:28.317625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:28.324936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:28.325386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:28.326159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:28.326590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:28.367821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4b4533cd-ef27-46be-a4de-3023997fc19c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.055807 Dec 25 22:00:28.368449 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4111/8187] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:28 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:29.379904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:29.381182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:29.388405 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:29.388897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:29.389701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:29.390162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:29.429659 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9265d9d-7662-4eac-8c65-77b5668fbd61 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.053810 Dec 25 22:00:29.430294 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4077/8188] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:29 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:30.441701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:30.442750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:30.450089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:30.450542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:30.451320 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:30.451760 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:30.499155 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9deb4022-8b3a-4a20-8ad9-6fe8fcef2b0c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.061422 Dec 25 22:00:30.500012 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4112/8189] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:30 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:31.510947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:31.511976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:31.519309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:31.519768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:31.521294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:31.521749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:31.563124 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1273c69b-9805-46a3-aa8c-dc894ec94b5b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.056221 Dec 25 22:00:31.563768 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4078/8190] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:31 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:32.576039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:32.577035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:32.584455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:32.584936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:32.585732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:32.586176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:32.625644 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bce906df-f67e-4947-b60a-8a5c46ad9669 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.053639 Dec 25 22:00:32.626509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4113/8191] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:32 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:33.637782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:33.638817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:33.646792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:33.647255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:33.648168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:33.648625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:33.687951 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0dbf2bcb-3e31-4d02-b106-85d896ccb1ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.054195 Dec 25 22:00:33.688618 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4079/8192] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:33 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:34.700040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:34.701067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:34.708376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:34.709887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:34.710156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:34.710585 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:34.750882 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-586c2219-6550-4876-89d3-225a28b7be40 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.054812 Dec 25 22:00:34.751531 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4114/8193] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:34 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:00:35.764462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:35.765561 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:35.773478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:35.773951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:35.774752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:35.775207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:35.815217 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b2e669d-ed4f-49c6-9076-a56454764d95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.055755 Dec 25 22:00:35.819481 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4080/8194] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:35 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:36.827726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:36.828732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:36.836757 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:36.837236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:36.838017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:36.838463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:36.876074 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7bae814-5ecf-4710-a5cf-fa8818b74955 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 24565 microversion: 2.1 time: 0.052390 Dec 25 22:00:36.876744 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4115/8195] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:36 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 24565 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:37.888151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:37.889229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:37.897300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:37.897770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:37.898567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:37.899020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:37.960034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a84bd400-3435-4c74-b5d0-af0bd3d3dd46 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.075287 Dec 25 22:00:37.960936 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4081/8196] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:37 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:38.972210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:38.973259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:38.981434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:38.981881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:38.982679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:38.983118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:39.023770 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bcc84a18-0157-45db-ac41-412fff24be3f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055596 Dec 25 22:00:39.024399 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4116/8197] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:38 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:40.036506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:40.037552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:40.045646 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:40.048008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:40.048008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:40.048008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:40.088667 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7798fc0d-118e-4495-886d-3cedac6bea0f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.056298 Dec 25 22:00:40.089351 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4082/8198] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:40 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:41.101079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:41.102169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:41.109575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:41.110022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:41.110794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:41.111225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:41.154352 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-47f4986b-500e-4e99-bdcd-5cc523a36283 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057438 Dec 25 22:00:41.155299 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4117/8199] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:41 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:42.167431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:42.168584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:42.176056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:42.176524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:42.177360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:42.177815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:42.219901 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d407aedd-ff2a-4164-9dc8-68153288b9b2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057124 Dec 25 22:00:42.220647 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4083/8200] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:42 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:43.232736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:43.233798 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:43.241522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:43.242027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:43.242809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:43.243254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:43.283958 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60ac4528-9511-49ed-ae2a-452c6bbce4d6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055198 Dec 25 22:00:43.284593 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4118/8201] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:43 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:44.296467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:44.297544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:44.305553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:44.306130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:44.306816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:44.307277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:44.348971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-115b0e04-a515-44b6-aea4-ab42bb7cdc9f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.056505 Dec 25 22:00:44.349633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4084/8202] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:44 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:45.361663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:45.362933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:45.370834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:45.371298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:45.372081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:45.372532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:45.412044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-024cf153-4bfb-4d1b-8bd2-08bd00479339 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054335 Dec 25 22:00:45.413018 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4119/8203] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:45 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:46.424256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:46.425331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:46.433074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:46.433541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:46.434330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:46.434783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:46.477986 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0c522894-59e5-4f32-894e-3220d61efc5c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057640 Dec 25 22:00:46.478641 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4085/8204] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:46 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:47.490523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:47.492181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:47.499380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:47.499837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:47.500629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:47.501099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:47.541731 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a0031536-05b3-4028-802f-8122bbdbd6f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055491 Dec 25 22:00:47.542366 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4120/8205] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:47 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:48.554620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:48.555707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:48.563009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:48.563471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:48.564263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:48.564711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:48.603980 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-111a4fb6-42cb-429e-b887-a5b227f3a1f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053920 Dec 25 22:00:48.604860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4086/8206] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:48 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:00:49.617006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:49.618002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:49.625332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:49.625769 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:49.626539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:49.626973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:49.666267 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4300e901-49da-461c-80d3-6487fda4d81b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054166 Dec 25 22:00:49.667134 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4121/8207] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:49 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:50.679041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:50.679967 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:50.687438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:50.687908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:50.688716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:50.689199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:50.751122 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fda83ee6-0d9a-4ace-9f82-fd79d4d396d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.076688 Dec 25 22:00:50.751771 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4087/8208] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:50 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:51.763663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:51.764661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:51.772549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:51.773032 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:51.773811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:51.774249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:51.814455 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8abc378d-da59-46d6-9976-30e1ca74c7df tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054809 Dec 25 22:00:51.815324 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4122/8209] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:51 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:52.826936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:52.827983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:52.835414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:52.835887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:52.836688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:52.837167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:52.876536 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-07faa985-e224-48ce-b522-70bff2c13630 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053684 Dec 25 22:00:52.877198 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4088/8210] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:52 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:53.888825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:53.889870 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:53.897115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:53.897568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:53.898344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:53.898805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:53.940397 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d41c007e-bb71-4ff0-997d-6cedc8882b18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055570 Dec 25 22:00:53.942754 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4123/8211] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:53 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:54.952180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:54.953243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:54.960891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:54.961407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:54.962222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:54.962681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:55.002695 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fca55ffd-8d6a-46b8-9e7c-e8338c6ea29d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054517 Dec 25 22:00:55.003337 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4089/8212] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:54 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:56.015534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:56.016567 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:56.024016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:56.024521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:56.025341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:56.025782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:56.065237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c3dfed23-b701-48ed-b707-422f13666c87 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053708 Dec 25 22:00:56.065886 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4124/8213] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:56 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:57.077253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:57.078272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:57.085808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:57.086282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:57.087080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:57.087539 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:57.131014 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c74324c-a912-40ac-8d29-ab8e2e3f267d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057840 Dec 25 22:00:57.131884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4090/8214] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:57 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:58.143653 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:58.144708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:58.152146 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:58.152606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:58.153428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:58.153873 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:58.200658 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-48cba11b-e53d-4f93-b6fe-261f27e07ae0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.061088 Dec 25 22:00:58.201564 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4125/8215] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:58 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:00:59.213207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:00:59.214139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:00:59.221600 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:59.222070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:59.222871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:00:59.223327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:00:59.264531 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e5064896-c184-4783-8d31-37a51e69db18 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055474 Dec 25 22:00:59.265210 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4091/8216] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:00:59 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:00.276612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:00.277667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:00.285029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:00.285493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:00.286263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:00.286709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:00.326394 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4d558e50-9e7d-4565-8eff-711c478ceace tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053751 Dec 25 22:01:00.327038 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4126/8217] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:00 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:01.339303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:01.340343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:01.347767 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:01.348232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:01.349064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:01.349521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:01.387924 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-67dbb6f8-a13f-41e6-b816-da7a4f0d9425 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053302 Dec 25 22:01:01.388566 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4092/8218] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:01 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:01:02.400661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:02.401823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:02.409149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:02.409603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:02.410378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:02.410833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:02.449553 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-946d07f1-1154-4634-9e1e-47c17c40e837 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053340 Dec 25 22:01:02.450175 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4127/8219] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:02 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:03.462453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:03.463456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:03.470849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:03.471312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:03.472107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:03.472553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:03.512392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb13ee6b-4a3f-422a-88fe-d9fd8f9cbc82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054049 Dec 25 22:01:03.513048 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4093/8220] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:03 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:04.524740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:04.525783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:04.532952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:04.533409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:04.534201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:04.534642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:04.575035 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9923cd35-6076-4188-81fe-994bf8766a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054795 Dec 25 22:01:04.575856 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4128/8221] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:04 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:05.587358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:05.588368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:05.595797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:05.596263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:05.597097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:05.597553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:05.637549 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43398528-f27e-4b31-9abc-5385154d9bc9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054229 Dec 25 22:01:05.638420 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4094/8222] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:05 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:06.650552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:06.651476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:06.658846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:06.659302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:06.660083 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:06.660522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:06.701228 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ce9bd19-1585-406c-97b7-5e19c41131dc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055408 Dec 25 22:01:06.701862 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4129/8223] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:06 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:07.714223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:07.715263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:07.722905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:07.723384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:07.724175 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:07.724626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:07.764851 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12bd31cd-0d4b-43b0-8333-e61fb062b475 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055155 Dec 25 22:01:07.765536 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4095/8224] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:07 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:08.776221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:08.777261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:08.784498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:08.784980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:08.785764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:08.786208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:08.826124 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a4797d8-ccb8-4d43-bba6-08203eed48fa tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053859 Dec 25 22:01:08.828772 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4130/8225] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:08 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:09.838634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:09.839652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:09.848201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:09.848581 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:09.849440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:09.849924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:09.895182 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-db7e76ad-2601-446f-81e6-319a53d6219e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.060593 Dec 25 22:01:09.895856 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4096/8226] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:09 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:01:10.907832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:10.908807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:10.916794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:10.917267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:10.918052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:10.918485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:10.962140 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54917292-66c0-45f8-9200-e8c8e6942d1b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.058281 Dec 25 22:01:10.963546 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4131/8227] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:10 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:11.974456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:11.976030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:11.983418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:11.983880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:11.984687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:11.985181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:12.025437 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40f30e3d-07ea-4674-a7bf-21d5be0c70f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054998 Dec 25 22:01:12.026338 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4097/8228] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:11 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:13.037741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:13.038685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:13.046016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:13.046471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:13.047244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:13.047681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:13.087826 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f557ba2c-350e-469d-b3e4-5c0b01dbaae6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054141 Dec 25 22:01:13.088713 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4132/8229] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:13 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:14.100138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:14.101213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:14.108720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:14.109217 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:14.110016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:14.110473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:14.151030 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a70a28b7-5e79-4a21-8dd6-747ca1ba15f8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054945 Dec 25 22:01:14.151672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4098/8230] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:14 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:15.163738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:15.164737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:15.172218 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:15.172669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:15.173482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:15.173927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:15.212713 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e2ee076c-ffe4-4942-9c3c-9a525d4bac9a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053566 Dec 25 22:01:15.213421 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4133/8231] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:15 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:16.224732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:16.226293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:16.233578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:16.234054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:16.234858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:16.235320 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:16.275626 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f0d023cc-a93d-4080-9822-a47e2f69e956 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054967 Dec 25 22:01:16.276267 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4099/8232] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:16 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:17.287169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:17.288161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:17.295287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:17.295735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:17.296502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:17.296972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:17.336293 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7f7cebf-d528-4f10-b864-5de152e73a70 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053152 Dec 25 22:01:17.336929 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4134/8233] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:17 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:01:18.348158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:18.349240 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:18.357466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:18.357939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:18.358747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:18.359216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:18.399567 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec566f42-bc63-4304-902f-41e6531892a6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055412 Dec 25 22:01:18.400219 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4100/8234] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:18 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:19.411943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:19.413499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:19.421078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:19.421533 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:19.422317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:19.422750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:19.465402 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0089d8d3-e6e2-4b72-9d28-40695937bc26 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057357 Dec 25 22:01:19.469394 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4135/8235] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:19 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:20.478475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:20.479541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:20.487412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:20.487912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:20.488860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:20.489355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:20.530592 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fbf71c6f-f67b-4ebc-b20d-d5f1c4a6af55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.056838 Dec 25 22:01:20.531259 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4101/8236] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:20 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:21.543538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:21.544535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:21.551932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:21.552389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:21.553851 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:21.554294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:21.592828 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f728bf8-5825-4af4-b7a8-ffda82029fc1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053255 Dec 25 22:01:21.593471 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4136/8237] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:21 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:22.605348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:22.606278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:22.613970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:22.614434 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:22.615228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:22.616196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:22.659614 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f9a79189-45cc-46e1-978c-088d5f753ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.058296 Dec 25 22:01:22.660289 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4102/8238] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:22 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:23.672245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:23.673327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:23.681163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:23.681620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:23.682404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:23.682842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:23.722197 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ceb4827d-348a-4ab1-a02a-cf432271e4d1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053984 Dec 25 22:01:23.723065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4137/8239] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:23 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:24.734611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:24.735665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:24.743649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:24.744148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:24.745038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:24.745501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:24.784172 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-de6ef491-3ac2-4e7f-9d8a-39a37aeb4820 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053607 Dec 25 22:01:24.785118 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4103/8240] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:24 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:25.795987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:25.797013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:25.804475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:25.804955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:25.805782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:25.806225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:25.846532 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7585706a-0f86-4cab-8c9b-aa2f9958e8b6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054516 Dec 25 22:01:25.847184 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4138/8241] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:25 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:01:26.864924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:26.866510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:26.873891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:26.874361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:26.875160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:26.875614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:26.913754 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e28e4dc9-c406-4837-8d60-bc00135e3b82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053205 Dec 25 22:01:26.914633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4104/8242] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:26 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:27.926558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:27.927560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:27.937413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:27.937868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:27.938665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:27.939106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:27.996404 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-207a4b7a-6397-401c-b2e9-7d3391f3f9d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.074241 Dec 25 22:01:27.997104 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4139/8243] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:27 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:29.008996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:29.010018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:29.017450 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:29.017922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:29.018722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:29.019178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:29.059793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b9d3bdbd-9783-45c1-aae3-2be4f3d92dad tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054930 Dec 25 22:01:29.060441 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4105/8244] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:29 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:30.071612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:30.072612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:30.079924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:30.080379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:30.081175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:30.081703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:30.123829 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5fae2c22-5a9a-44f5-958e-eaab49e2048d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.056314 Dec 25 22:01:30.124709 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4140/8245] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:30 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:31.135678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:31.136682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:31.144131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:31.144593 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:31.145422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:31.145871 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:31.190291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd7e2dda-9d4c-43bb-81a5-fe43ecc7dbd4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.058552 Dec 25 22:01:31.190978 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4106/8246] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:31 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:32.202665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:32.203654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:32.211018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:32.211475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:32.212246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:32.212681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:32.256391 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-61bfed34-c9b3-49d7-83f6-e9b25def75cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057790 Dec 25 22:01:32.257301 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4141/8247] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:32 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:33.268577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:33.269619 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:33.277574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:33.278043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:33.278846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:33.279299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:33.319203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c42d67f-deab-4929-9260-9be73f58ba5e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054635 Dec 25 22:01:33.319844 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4107/8248] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:33 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:34.331493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:34.332481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:34.340584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:34.341090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:34.341862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:34.342297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:34.379694 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24b811e1-7e5f-4b9a-a074-e99a51b8f039 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.052153 Dec 25 22:01:34.380315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4142/8249] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:34 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:35.392734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:35.393980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:35.401752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:35.402221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:35.403298 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:35.403758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:35.448793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ffd1a91c-b747-4a4c-8163-3884c4877ef6 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.060344 Dec 25 22:01:35.449505 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4108/8250] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:35 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:36.462990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:36.464010 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:36.473429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:36.473893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:36.475372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:36.475749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:36.518891 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-29deb437-c036-4f4b-aec7-3a7f927b6622 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.061214 Dec 25 22:01:36.520464 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4143/8251] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:36 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:37.532471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:37.533506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:37.541392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:37.541880 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:37.542671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:37.543126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:37.582456 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-359557f5-9793-410d-9244-ec9ccaa31cfc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054149 Dec 25 22:01:37.583079 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4109/8252] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:37 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:38.595329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:38.596276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:38.604068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:38.606321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:38.606321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:38.606321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:38.645849 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9662ebe4-578b-4bc5-a508-af5c4f02159a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054868 Dec 25 22:01:38.647233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4144/8253] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:38 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:39.658021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:39.659070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:39.666711 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:39.667213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:39.668014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:39.668463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:39.707187 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5c70264c-f1ae-47bd-b282-f7c9a6c12ad9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.053219 Dec 25 22:01:39.707830 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4110/8254] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:39 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:40.720248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:40.721371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:40.736212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:40.736681 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:40.737512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:40.738013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:40.780945 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1876435c-f97c-4a2e-9ec8-047a1644e7ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.064696 Dec 25 22:01:40.781722 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4145/8255] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:40 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:41.793697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:41.794722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:41.802243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:41.803343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:41.804141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:41.804626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:41.844561 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f37b35c6-0083-4087-a171-0a8ad46037c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.054845 Dec 25 22:01:41.845240 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4111/8256] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:41 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:42.856900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:42.857933 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:42.866035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:42.866489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:42.867267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:42.867707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:42.908211 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4a412548-bb7a-46c5-b818-332b9234ec3d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.055354 Dec 25 22:01:42.908835 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4146/8257] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:42 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:43.920159 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:43.921212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:43.929363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:43.929840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:43.930673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:43.931155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:43.972333 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-271c9ac5-9986-4350-90bf-372552c01b37 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.056089 Dec 25 22:01:43.973019 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4112/8258] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:43 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:44.985092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:44.986353 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:44.994038 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:44.994493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:44.995278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:44.995719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:45.038504 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bfe18425-ba30-4156-bf92-9570c4a134fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 32638 microversion: 2.1 time: 0.057496 Dec 25 22:01:45.039179 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4147/8259] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:44 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 32638 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:46.050744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:46.051760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:46.059362 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:46.059836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:46.060634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:46.061129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:46.112111 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1db4d72c-7548-45b5-b0f1-3deb6c15bc63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 200 len: 40793 microversion: 2.1 time: 0.065565 Dec 25 22:01:46.112751 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4113/8260] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:46 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 40793 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:01:46.124051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:01:46.125093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:46.132617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:46.133104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:46.133879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:46.134338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:46.161427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:46.167162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Old instance type m1.heat2, new instance type m1.heat {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 22:01:46.173230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:01:46.174418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:01:46.174418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:01:46.174714 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:01:46.174889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:01:46.308379 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0a072841-663e-45a5-b182-ae0f50409721 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.188528 Dec 25 22:01:46.309019 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4148/8261] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:01:46 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:01:46.317732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:46.318477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:46.325569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:46.326039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:46.326856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:46.327314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:46.465310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:46.472966 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2fb59fd-8b05-47a8-83d1-4ecf8ae4b4f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1677 microversion: 2.1 time: 0.159469 Dec 25 22:01:46.475985 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4114/8262] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:46 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:47.492826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:47.493492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:47.501346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:47.501801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:47.502623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:47.503057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:47.635578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:47.643859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea3e3f79-180f-4359-97a8-aeefbeeda663 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1677 microversion: 2.1 time: 0.155831 Dec 25 22:01:47.644529 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4149/8263] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:47 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:48.661604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:48.662271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:48.669054 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:48.669528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:48.670328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:48.670790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:48.896564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:48.904337 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5b231b1b-f9bf-490e-a6f1-f3ef8251a09e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1677 microversion: 2.1 time: 0.246569 Dec 25 22:01:48.904947 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4115/8264] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:48 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1677 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:49.921264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:49.921961 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:49.929293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:49.929749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:49.930526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:49.930964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:50.066111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:50.073699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9f3f2989-09c0-4622-aa4c-32b88f6355c3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.156267 Dec 25 22:01:50.074311 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4150/8265] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:49 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:51.094953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:51.095587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:51.103042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:51.103508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:51.104299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:51.104752 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:51.237135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:51.244610 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-144af243-320e-4618-93f8-d5526eb20887 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.153694 Dec 25 22:01:51.245579 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4116/8266] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:51 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:52.261497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:52.262111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:52.269102 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:52.269569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:52.270366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:52.270848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:52.407121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:52.415504 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f919e589-746c-41e9-9b70-05bc5239ef90 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.157668 Dec 25 22:01:52.416073 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4151/8267] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:52 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:53.433998 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:53.434621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:53.441471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:53.441935 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:53.443395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:53.443859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:53.573311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:53.580685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7df7f73-aff1-4c56-a79f-e1e99485b493 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.150703 Dec 25 22:01:53.581295 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4117/8268] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:53 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:54.597633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:54.598168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:54.605202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:54.605660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:54.606448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:54.606895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:54.739077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:54.746498 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ad0c73a7-82df-4dfa-beba-2101383c2c91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.152754 Dec 25 22:01:54.747084 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4152/8269] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:54 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:55.765992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:55.766657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:55.774237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:55.774709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:55.775550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:55.776006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:55.910229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:55.918273 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2bf5f958-e63d-4c56-9b2f-880979f575b0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.156137 Dec 25 22:01:55.918848 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4118/8270] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:55 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:01:56.934969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:56.935580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:56.942363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:56.942817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:56.943597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:56.944070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:57.073149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:57.080668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1f36c3a5-b921-43aa-b144-e83ebb85836b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.149451 Dec 25 22:01:57.081276 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4153/8271] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:56 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:58.097888 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:58.098522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:58.101709 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:01:58.103397 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:01:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 (ip 10.222.0.32) !!! Dec 25 22:01:58.107157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:58.108535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:58.109940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:58.111425 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:58.246295 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:58.253846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f14f9d53-dacc-4598-a5af-a9a1b985e6b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.159705 Dec 25 22:01:58.254460 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4119/8272] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:58 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:01:59.270647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:01:59.271852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:01:59.279002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:59.279456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:59.280254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:01:59.280688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:01:59.408184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:01:59.415546 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b61b89ae-2ff3-484d-b408-fc11b2c9ee91 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.148716 Dec 25 22:01:59.416117 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4154/8273] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:01:59 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:00.432010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:00.432636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:00.439482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:00.439948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:00.440735 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:00.441214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:00.574955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:00.582291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baef3cca-70c8-4dac-81b3-f3c6b7a9043c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1682 microversion: 2.1 time: 0.154044 Dec 25 22:02:00.582874 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4120/8274] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:00 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:01.600133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:01.600713 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:01.607376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:01.608162 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:01.608599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:01.609065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:01.715197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-109fc9b5-9a33-42fe-bf34-107d2956c02d req-9629ddd4-93c2-48d5-9dea-5ab189a0c290 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "name": "network-vif-unplugged", "status": "completed", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:01.716866 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:01.716866 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:02:01.725216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-109fc9b5-9a33-42fe-bf34-107d2956c02d req-9629ddd4-93c2-48d5-9dea-5ab189a0c290 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:01.729266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-109fc9b5-9a33-42fe-bf34-107d2956c02d req-9629ddd4-93c2-48d5-9dea-5ab189a0c290 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:01.737792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-109fc9b5-9a33-42fe-bf34-107d2956c02d req-9629ddd4-93c2-48d5-9dea-5ab189a0c290 service nova] Creating event network-vif-unplugged:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch1-master-1 Dec 25 22:02:01.743548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-109fc9b5-9a33-42fe-bf34-107d2956c02d req-9629ddd4-93c2-48d5-9dea-5ab189a0c290 service nova] Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:02:01.755344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-109fc9b5-9a33-42fe-bf34-107d2956c02d req-9629ddd4-93c2-48d5-9dea-5ab189a0c290 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043613 Dec 25 22:02:01.757884 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4121/8275] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:01 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:02:01.793225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:01.800659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f90efd6-be50-4d16-894f-cfc470a7e391 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1681 microversion: 2.1 time: 0.204917 Dec 25 22:02:01.801293 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4155/8276] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:01 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1681 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:02.819390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:02.820235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:02.826559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:02.827027 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:02.827825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:02.828278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:02.962865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:02.970563 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-edbc75bb-0faf-4323-b564-b9e994d9c7be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1681 microversion: 2.1 time: 0.156188 Dec 25 22:02:02.971196 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4122/8277] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:02 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:03.772448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a3e07b38-cc56-40c0-a144-ef4beacad1ee req-2c74d3ca-13ba-4571-a671-eb8dae480131 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:03.774098 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:03.774098 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:02:03.781820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a3e07b38-cc56-40c0-a144-ef4beacad1ee req-2c74d3ca-13ba-4571-a671-eb8dae480131 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:03.782266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a3e07b38-cc56-40c0-a144-ef4beacad1ee req-2c74d3ca-13ba-4571-a671-eb8dae480131 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:03.793479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a3e07b38-cc56-40c0-a144-ef4beacad1ee req-2c74d3ca-13ba-4571-a671-eb8dae480131 service nova] Creating event network-changed:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch1-master-1 Dec 25 22:02:03.798610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-a3e07b38-cc56-40c0-a144-ef4beacad1ee req-2c74d3ca-13ba-4571-a671-eb8dae480131 service nova] Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:02:03.809115 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a3e07b38-cc56-40c0-a144-ef4beacad1ee req-2c74d3ca-13ba-4571-a671-eb8dae480131 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040991 Dec 25 22:02:03.809687 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4156/8278] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:03.989158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:03.990329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:03.997758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:03.998238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:03.999109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:03.999540 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:04.491688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:04.501171 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d92e5d1f-4363-411c-8d97-9de7afe7ac0e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1679 microversion: 2.1 time: 0.515975 Dec 25 22:02:04.511671 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4123/8279] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:03 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1679 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:05.520215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:05.521041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:05.527345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:05.527802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:05.528597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:05.529105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:05.669932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:05.677846 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-520b02c2-3edd-4034-ae62-fcca55f0c0d0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1676 microversion: 2.1 time: 0.161950 Dec 25 22:02:05.678717 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4157/8280] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:05 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:05.700038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:05.700623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:05.707414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:05.707875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:05.708727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:05.709212 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:05.741914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:05.742375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:05.743197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:05.743643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:05.762952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:02:05.767861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:02:06.176493 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c7d322b-93ef-4e19-9ace-f79dcdd41f28 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action" status: 202 len: 0 microversion: 2.1 time: 0.480131 Dec 25 22:02:06.177149 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4124/8281] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:05 2021] POST /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:02:06.185233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:06.185956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:06.192246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:06.192784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:06.193612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:06.194054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:06.372155 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:06.376851 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4bc262d0-b972-4840-a416-88d6978e5a6e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1675 microversion: 2.1 time: 0.195352 Dec 25 22:02:06.377445 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4158/8282] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:06 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:07.334012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-eebc1fe1-5d2c-45d4-aa1e-b259ced2c506 req-f90f04ab-f35a-40aa-a941-b5ed550a3239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "name": "network-vif-plugged", "status": "completed", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:07.335512 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:07.335512 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:02:07.343703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-eebc1fe1-5d2c-45d4-aa1e-b259ced2c506 req-f90f04ab-f35a-40aa-a941-b5ed550a3239 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:07.344167 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-eebc1fe1-5d2c-45d4-aa1e-b259ced2c506 req-f90f04ab-f35a-40aa-a941-b5ed550a3239 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:07.355505 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-eebc1fe1-5d2c-45d4-aa1e-b259ced2c506 req-f90f04ab-f35a-40aa-a941-b5ed550a3239 service nova] Creating event network-vif-plugged:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch1-master-1 Dec 25 22:02:07.361097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-eebc1fe1-5d2c-45d4-aa1e-b259ced2c506 req-f90f04ab-f35a-40aa-a941-b5ed550a3239 service nova] Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:02:07.372089 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-eebc1fe1-5d2c-45d4-aa1e-b259ced2c506 req-f90f04ab-f35a-40aa-a941-b5ed550a3239 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043033 Dec 25 22:02:07.372680 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4125/8283] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:07.392962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:07.393669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:07.400578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:07.400955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:07.402379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:07.402858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:07.542627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:07.553819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2b20c6cc-a8f6-4ca3-8d23-61f58b611d75 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1675 microversion: 2.1 time: 0.160873 Dec 25 22:02:07.553819 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4159/8284] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:07 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1675 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:08.569179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:08.569890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:08.576354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:08.576827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:08.577661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:08.578119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:08.725512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:08.734417 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-815a8519-5803-4f82-8287-9a1e3b5c0e7c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1675 microversion: 2.1 time: 0.170105 Dec 25 22:02:08.735650 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4126/8285] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:08 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:09.721512 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-d9c0c52a-2b30-48ab-b81a-8e9ead9fadc1 req-62d24ecc-c11d-414b-b21c-10788a8daefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "name": "network-vif-unplugged", "status": "completed", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:09.723054 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:09.723054 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:02:09.733610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d9c0c52a-2b30-48ab-b81a-8e9ead9fadc1 req-62d24ecc-c11d-414b-b21c-10788a8daefe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:09.734101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-d9c0c52a-2b30-48ab-b81a-8e9ead9fadc1 req-62d24ecc-c11d-414b-b21c-10788a8daefe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:09.748556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-d9c0c52a-2b30-48ab-b81a-8e9ead9fadc1 req-62d24ecc-c11d-414b-b21c-10788a8daefe service nova] Creating event network-vif-unplugged:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch2-master-1 Dec 25 22:02:09.751506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:09.752818 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:09.757103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-d9c0c52a-2b30-48ab-b81a-8e9ead9fadc1 req-62d24ecc-c11d-414b-b21c-10788a8daefe service nova] Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:02:09.760329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:09.760820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:09.762796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:09.763883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:09.768479 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-d9c0c52a-2b30-48ab-b81a-8e9ead9fadc1 req-62d24ecc-c11d-414b-b21c-10788a8daefe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053895 Dec 25 22:02:09.769136 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4160/8286] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:09 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:10.060636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:10.070090 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5070b6ea-df2c-4724-a466-f2889541263d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1675 microversion: 2.1 time: 0.322313 Dec 25 22:02:10.079597 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4127/8287] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:09 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1675 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:02:11.088356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:11.089167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:11.095336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:11.095786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:11.096580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:11.097050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:11.230085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:11.237955 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7859cdf4-f317-4676-a20c-0b877c481fe4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1675 microversion: 2.1 time: 0.154578 Dec 25 22:02:11.238547 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4161/8288] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:11 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:11.782566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-5895a6aa-41f0-458f-b938-1d6feb626cb3 req-563a0cdc-843c-4f9c-a6e1-7c7bfe876b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:11.784073 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:11.784073 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:02:11.792209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5895a6aa-41f0-458f-b938-1d6feb626cb3 req-563a0cdc-843c-4f9c-a6e1-7c7bfe876b0b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:11.792664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-5895a6aa-41f0-458f-b938-1d6feb626cb3 req-563a0cdc-843c-4f9c-a6e1-7c7bfe876b0b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:11.804314 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-5895a6aa-41f0-458f-b938-1d6feb626cb3 req-563a0cdc-843c-4f9c-a6e1-7c7bfe876b0b service nova] Creating event network-changed:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch2-master-1 Dec 25 22:02:11.809554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-5895a6aa-41f0-458f-b938-1d6feb626cb3 req-563a0cdc-843c-4f9c-a6e1-7c7bfe876b0b service nova] Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:02:11.820262 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-5895a6aa-41f0-458f-b938-1d6feb626cb3 req-563a0cdc-843c-4f9c-a6e1-7c7bfe876b0b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041459 Dec 25 22:02:11.820839 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4128/8289] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:12.257501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:12.258270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:12.267637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:12.268921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:12.270183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:12.270818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:12.915340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:12.922848 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-895a3445-6aa3-40b1-92b4-88aa342182c2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1675 microversion: 2.1 time: 0.671323 Dec 25 22:02:12.923433 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4162/8290] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:12 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1675 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:13.940910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:13.941627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:13.948564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:13.949068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:13.950035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:13.950424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.081187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:14.088752 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e20d2810-5332-454b-9401-c39d12466a82 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1668 microversion: 2.1 time: 0.152885 Dec 25 22:02:14.089345 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4129/8291] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:13 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:14.105047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:14.105704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:14.112575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.113085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.113869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.114899 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.250855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:14.258442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8db153a-59f8-4997-b1bf-f70802ca3ef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1668 microversion: 2.1 time: 0.157181 Dec 25 22:02:14.259032 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4163/8292] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:14 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1668 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:14.274098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:14.274732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:14.280627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.281145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.281948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.282403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.410326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:14.418332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d3c3f93-47e1-4135-8306-458bad0876f0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1668 microversion: 2.1 time: 0.148025 Dec 25 22:02:14.418903 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4130/8293] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:14 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:14.433729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:14.434256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:14.440142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.440604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.441419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.441861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.466126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:02:14.767274 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d94943aa-699e-4f84-a699-0b6b944ced2f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 204 len: 0 microversion: 2.1 time: 0.336937 Dec 25 22:02:14.767885 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4164/8294] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:02:14 2021] DELETE /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Dec 25 22:02:14.776939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:14.778369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:14.784608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.785118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.785911 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:14.786359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:14.928195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:14.935716 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b0a45385-0876-48c6-8a77-3a9678b36265 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1674 microversion: 2.1 time: 0.162644 Dec 25 22:02:14.936322 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4131/8295] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:14 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:02:15.953090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:15.953732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:15.960310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:15.960759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:15.961572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:15.962007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:16.115115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:16.122757 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-60ebce07-e0f8-4d7f-b869-3d7cf59fee4a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1674 microversion: 2.1 time: 0.174020 Dec 25 22:02:16.123339 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4165/8296] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:15 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:17.023633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-169aada4-4a4e-4874-808b-fea69ccdf29e req-3d3d48da-202d-4afb-8a16-c1870e39b689 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859e5e6f-804e-4c63-a56b-3a32652bb6f4", "name": "network-vif-deleted", "tag": "d7c32045-1ccf-49c2-8582-5aa6a3230025"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:17.025188 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:17.025188 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:02:17.032678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-169aada4-4a4e-4874-808b-fea69ccdf29e req-3d3d48da-202d-4afb-8a16-c1870e39b689 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:17.033166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-169aada4-4a4e-4874-808b-fea69ccdf29e req-3d3d48da-202d-4afb-8a16-c1870e39b689 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:17.045446 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-169aada4-4a4e-4874-808b-fea69ccdf29e req-3d3d48da-202d-4afb-8a16-c1870e39b689 service nova] Creating event network-vif-deleted:d7c32045-1ccf-49c2-8582-5aa6a3230025 for instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 on nch2-master-1 Dec 25 22:02:17.050613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-169aada4-4a4e-4874-808b-fea69ccdf29e req-3d3d48da-202d-4afb-8a16-c1870e39b689 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030680 Dec 25 22:02:17.053869 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4132/8297] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:17.139647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:17.140371 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:17.146892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:17.147411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:17.148209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:17.148660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:17.214051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:17.222264 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1ca3a091-8766-4f09-af9e-2c664d21280e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 200 len: 1323 microversion: 2.1 time: 0.086387 Dec 25 22:02:17.226077 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4166/8298] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:17 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 1323 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:18.242252 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:18.243002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:18.250022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:18.250487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:18.251278 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:18.251730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:18.265497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. Dec 25 22:02:18.266089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:02:18.266924 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-15faa33b-c717-425e-86bd-78fa571c1996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 404 len: 111 microversion: 2.1 time: 0.029387 Dec 25 22:02:18.267449 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4133/8299] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:18 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:02:18.318927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:18.319550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:18.326344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:18.326809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:18.327601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:18.328052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:18.341123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. Dec 25 22:02:18.341716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:02:18.342539 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dc72ab43-90d8-4d74-af69-2c6210a30212 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 404 len: 111 microversion: 2.1 time: 0.028016 Dec 25 22:02:18.343069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4167/8300] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:18 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:02:18.389630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1879993652", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "544249cb-4293-4a78-9ba3-8f386deae100"}], "security_groups": [{"name": "tempest-securitygroup--685716593"}], "key_name": "tempest-keypair-1650957824", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:18.491399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] validate_networks() for [('544249cb-4293-4a78-9ba3-8f386deae100', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:02:18.907430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:02:18.907953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:02:18.908456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:02:18.908906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:02:18.909345 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:02:18.918626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:18.922802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:18.922802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:18.922802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:18.936992 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:02:18.942069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:02:18.954461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:02:18.956842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:02:19.072044 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a24f7ffa-cdac-4c67-8993-a73dbf2cbe63 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.686084 Dec 25 22:02:19.072784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4134/8301] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:02:18 2021] POST /compute/v2.1/servers => generated 405 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:02:19.083528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d328455a-2ea5-4326-ae32-d910bbb090be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:19.084157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d328455a-2ea5-4326-ae32-d910bbb090be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:19.136574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d328455a-2ea5-4326-ae32-d910bbb090be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:19.143414 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d328455a-2ea5-4326-ae32-d910bbb090be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1239 microversion: 2.1 time: 0.064198 Dec 25 22:02:19.144000 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4168/8302] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:19 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1239 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:20.163621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:20.164262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:20.170757 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:20.173901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:20.173901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:20.173901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:20.236900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:20.245175 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c81b717c-bf2e-4491-b6ad-56972f587416 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1235 microversion: 2.1 time: 0.088190 Dec 25 22:02:20.246461 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4135/8303] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:20 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:21.262164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:21.262773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:21.271068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:21.271522 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:21.272301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:21.272744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:21.509040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:21.517161 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22c29555-9f8d-46cb-be73-92352847875a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.258657 Dec 25 22:02:21.517854 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4169/8304] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:21 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:22.325023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-487619bc-ab9c-484d-a8f6-fb78c8f4050a req-b43b867d-c302-45dc-95f4-4d375f9c124e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "tag": "b86a5c2d-f2aa-45cb-ab04-5b2177b2a483"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:22.326736 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:22.326736 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:02:22.337052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-487619bc-ab9c-484d-a8f6-fb78c8f4050a req-b43b867d-c302-45dc-95f4-4d375f9c124e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:22.337662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-487619bc-ab9c-484d-a8f6-fb78c8f4050a req-b43b867d-c302-45dc-95f4-4d375f9c124e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:22.355138 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-487619bc-ab9c-484d-a8f6-fb78c8f4050a req-b43b867d-c302-45dc-95f4-4d375f9c124e service nova] Creating event network-changed:b86a5c2d-f2aa-45cb-ab04-5b2177b2a483 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch2-master-1 Dec 25 22:02:22.362057 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-487619bc-ab9c-484d-a8f6-fb78c8f4050a req-b43b867d-c302-45dc-95f4-4d375f9c124e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043252 Dec 25 22:02:22.363339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4136/8305] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:02:22.538811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:22.539432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:22.546257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:22.546718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:22.548018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:22.548472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:22.755156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:22.763203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a758f37-7804-4b73-8d71-e10dfeb78db5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.228703 Dec 25 22:02:22.763913 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4170/8306] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:22 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:02:23.780958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:23.781681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:23.788513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:23.789008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:23.789815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:23.790268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:23.957261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:23.964961 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-98884189-9e86-4acd-ba0a-09a764d00c30 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1308 microversion: 2.1 time: 0.189011 Dec 25 22:02:23.965534 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4137/8307] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:23 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:24.377866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-866e19de-7377-47de-804a-f4e23b2e8e30 req-de917900-e43e-4a38-a895-8dd420babb2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-deleted", "tag": "b86a5c2d-f2aa-45cb-ab04-5b2177b2a483"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:24.379469 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:24.379469 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:02:24.387285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-866e19de-7377-47de-804a-f4e23b2e8e30 req-de917900-e43e-4a38-a895-8dd420babb2d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:24.387735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-866e19de-7377-47de-804a-f4e23b2e8e30 req-de917900-e43e-4a38-a895-8dd420babb2d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:24.399389 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_external_events [req-866e19de-7377-47de-804a-f4e23b2e8e30 req-de917900-e43e-4a38-a895-8dd420babb2d service nova] Unable to find a host for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d. Dropping event network-vif-deleted {{(pid=136548) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 22:02:24.400266 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-866e19de-7377-47de-804a-f4e23b2e8e30 req-de917900-e43e-4a38-a895-8dd420babb2d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026308 Dec 25 22:02:24.400855 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4171/8308] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:24 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 25 22:02:24.981823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:24.987358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:24.990199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:24.990676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:24.991488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:24.991949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:25.055542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:25.063384 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e112a4e8-ef82-41da-8cb3-ecc4a01c30de tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1239 microversion: 2.1 time: 0.085290 Dec 25 22:02:25.063961 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4138/8309] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:24 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1239 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:26.080447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:26.081328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:26.088334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:26.088889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:26.089777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:26.090365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:26.155657 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:26.163560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e392b1e3-20a4-49c9-bdb6-bd815e67d0a8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1299 microversion: 2.1 time: 0.086844 Dec 25 22:02:26.164735 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4172/8310] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:26 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:27.181533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:27.182333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:27.189368 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:27.189839 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:27.190643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:27.191099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:27.362481 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:27.370291 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d629f97d-9eaf-4496-881c-366e7e0e2505 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.192637 Dec 25 22:02:27.370860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4139/8311] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:27 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:27.718044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7584bb58-532a-493f-94cc-c1cd4269c01f req-17fcb0ff-a19d-4da3-a993-7641f1072d9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:27.719581 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:27.719581 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:02:27.727792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7584bb58-532a-493f-94cc-c1cd4269c01f req-17fcb0ff-a19d-4da3-a993-7641f1072d9a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:27.728238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7584bb58-532a-493f-94cc-c1cd4269c01f req-17fcb0ff-a19d-4da3-a993-7641f1072d9a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:27.741387 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7584bb58-532a-493f-94cc-c1cd4269c01f req-17fcb0ff-a19d-4da3-a993-7641f1072d9a service nova] Creating event network-changed:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:02:27.746453 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7584bb58-532a-493f-94cc-c1cd4269c01f req-17fcb0ff-a19d-4da3-a993-7641f1072d9a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031979 Dec 25 22:02:27.747279 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4173/8312] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:28.391491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:28.392285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:28.400233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:28.400800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:28.401657 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:28.402119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:28.664866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:28.672207 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ba4276c9-1134-468e-91b2-5ef07668e5e9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.284636 Dec 25 22:02:28.672783 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4140/8313] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:28 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:29.690417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:29.691112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:29.698006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:29.698457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:29.699228 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:29.699664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:29.835305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:29.842623 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ca31aa73-ad28-4c55-8a12-25c9d21999c1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.157106 Dec 25 22:02:29.843243 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4174/8314] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:29 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:30.860126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:30.860769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:30.867742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:30.868218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:30.869063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:30.869524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:31.002635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:31.010666 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fff2dc89-51ab-469e-b40c-8a7d6873fc2c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.154536 Dec 25 22:02:31.011239 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4141/8315] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:30 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:32.027407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:32.028026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:32.034866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:32.035324 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:32.036656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:32.037127 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:32.166655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:32.174030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d2d0bb3-317d-440b-be3c-989938748ac1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.150331 Dec 25 22:02:32.174610 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4175/8316] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:32 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:33.191422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:33.192055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:33.198954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:33.199420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:33.200215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:33.200668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:33.335264 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:33.342798 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-43c3fbe5-b1f2-41f2-9ce5-0454d442f205 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.155144 Dec 25 22:02:33.343397 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4142/8317] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:33 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:33.490364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a020a127-a202-43e4-a4cc-5c73fcee54d2 req-a9682bf6-a3e1-46e1-95ca-16b3cf6e9d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-plugged", "status": "completed", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:33.491890 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:33.491890 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:02:33.498853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a020a127-a202-43e4-a4cc-5c73fcee54d2 req-a9682bf6-a3e1-46e1-95ca-16b3cf6e9d0b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:33.499303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a020a127-a202-43e4-a4cc-5c73fcee54d2 req-a9682bf6-a3e1-46e1-95ca-16b3cf6e9d0b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:33.511064 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a020a127-a202-43e4-a4cc-5c73fcee54d2 req-a9682bf6-a3e1-46e1-95ca-16b3cf6e9d0b service nova] Creating event network-vif-plugged:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:02:33.516270 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a020a127-a202-43e4-a4cc-5c73fcee54d2 req-a9682bf6-a3e1-46e1-95ca-16b3cf6e9d0b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088006 Dec 25 22:02:33.516904 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4176/8318] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:34.360251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:34.360774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:34.367647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:34.368142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:34.369069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:34.369528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:34.497507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:34.505348 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14a9a05b-b687-4212-8f4f-79147ec6dc6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1364 microversion: 2.1 time: 0.148672 Dec 25 22:02:34.505914 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4143/8319] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:34 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:35.523456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:35.524185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:35.530885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:35.531335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:35.532153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:35.532590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:35.666372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:02:35.673809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2976c5b5-492d-49c7-b05f-ceb1ecc7c444 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1550 microversion: 2.1 time: 0.155322 Dec 25 22:02:35.674385 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4177/8320] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:02:35 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1550 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:35.690352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:02:35.690875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:35.698129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:35.698602 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:35.699404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:35.699859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:35.779114 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3e009da-1cbb-4c56-83b2-0af0861f10c7 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092413 Dec 25 22:02:35.779731 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4144/8321] 10.222.0.32 () {58 vars in 1274 bytes} [Sat Dec 25 22:02:35 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:02:36.785103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:36.786575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:36.789037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-9bace339-0a81-48a1-9397-c8520135d944 req-f0125c6f-b517-47c8-8ff8-c51b5199faa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:36.790965 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:02:36.790965 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:02:36.793536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:36.793992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:36.795064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:36.795683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:36.798985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9bace339-0a81-48a1-9397-c8520135d944 req-f0125c6f-b517-47c8-8ff8-c51b5199faa3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:36.799544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-9bace339-0a81-48a1-9397-c8520135d944 req-f0125c6f-b517-47c8-8ff8-c51b5199faa3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:36.812542 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-9bace339-0a81-48a1-9397-c8520135d944 req-f0125c6f-b517-47c8-8ff8-c51b5199faa3 service nova] Creating event network-changed:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:02:36.817920 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-9bace339-0a81-48a1-9397-c8520135d944 req-f0125c6f-b517-47c8-8ff8-c51b5199faa3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034126 Dec 25 22:02:36.818943 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4145/8322] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:02:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:02:36.836789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2aab2977-ee28-405d-9f6e-19c11f4bbc3c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.055060 Dec 25 22:02:36.837535 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4178/8323] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:36 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Dec 25 22:02:37.854258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:37.855949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:37.862575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:37.863599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:37.864418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:37.864865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:37.902274 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7c8e50ec-5e5e-4d51-af55-c2b86fde45c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.054000 Dec 25 22:02:37.903119 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4146/8324] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:37 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:38.913249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:38.914179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:38.921627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:38.922149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:38.922948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:38.923392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:38.961050 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51592ac1-daf9-4dcb-9bf9-1b4ad6eb92be tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.051898 Dec 25 22:02:38.962024 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4179/8325] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:38 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:39.972147 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:39.973207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:39.981256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:39.981732 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:39.982531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:39.982989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:40.019859 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-391cc02d-21d1-440a-af1c-4633c78f7084 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.051696 Dec 25 22:02:40.020482 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4147/8326] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:39 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:41.031227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:41.032220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:41.039722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:41.040136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:41.040941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:41.041379 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:41.077013 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fe6536bb-6a06-45b6-a898-739a46cd82ee tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.049876 Dec 25 22:02:41.077771 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4180/8327] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:41 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:42.088318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:42.089359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:42.096707 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:42.097203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:42.098007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:42.098470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:42.134837 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2507af8-3410-4aed-b329-e71e0c14a592 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.050521 Dec 25 22:02:42.135474 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4148/8328] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:42 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:43.146326 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:43.147921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:43.155514 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:43.155971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:43.156766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:43.157237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:43.196636 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-138b13c7-7348-4969-bafe-8e4351decfc0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.054391 Dec 25 22:02:43.197309 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4181/8329] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:43 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:44.207905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:44.208860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:44.216861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:44.217349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:44.218143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:44.218596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:44.259873 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50224a14-211b-4688-a180-6038b433cc55 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.056073 Dec 25 22:02:44.260716 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4149/8330] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:44 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:45.271492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:45.272513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:45.279923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:45.280377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:45.281173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:45.281620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:45.318853 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e6d82e1d-c1d6-4ec1-8ea3-e0bfd0b84e2a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.051329 Dec 25 22:02:45.320118 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4182/8331] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:45 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:46.331107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:46.332151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:46.339958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:46.340429 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:46.341261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:46.341719 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:46.378932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61bea0f5-062a-47f9-b830-8e2e77f389cb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 14 microversion: 2.1 time: 0.052026 Dec 25 22:02:46.379703 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4150/8332] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:46 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 14 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:02:47.391071 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:47.392069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:47.399697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:47.400150 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:47.400952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:47.401392 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:47.449442 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94dbbb50-4055-4687-9683-dc454e6ef0cd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 8207 microversion: 2.1 time: 0.062437 Dec 25 22:02:47.450087 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4183/8333] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:47 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 8207 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:02:48.460620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:48.461649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:48.469040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:48.469505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:48.470296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:48.470744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:48.527270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a938e188-2f70-4d7a-9a38-da44d9b6d880 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 16398 microversion: 2.1 time: 0.070609 Dec 25 22:02:48.527920 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4151/8334] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:48 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 16398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:49.539417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:49.540424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:49.547881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:49.548333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:49.549139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:49.549586 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:49.588642 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b578496-df72-4a17-9f33-e6757c6710a1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 16398 microversion: 2.1 time: 0.053240 Dec 25 22:02:49.589326 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4184/8335] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:49 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:50.601084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:50.602134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:50.609875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:50.610349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:50.611149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:50.611605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:50.649230 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-628d834f-5a19-4ffc-81dc-81e600108ee4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 16398 microversion: 2.1 time: 0.052795 Dec 25 22:02:50.649781 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4152/8336] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:50 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:51.660202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:51.661251 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:51.669139 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:51.669616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:51.670378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:51.670818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:51.709706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-88d5bae9-b417-49c1-8e27-8f945f031d85 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 16398 microversion: 2.1 time: 0.053532 Dec 25 22:02:51.710428 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4185/8337] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:51 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 16398 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:52.721676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:52.722688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:52.730653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:52.731124 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:52.731930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:52.732387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:52.781371 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0edf5e4f-5f96-480a-9dc2-8577109a019f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.063622 Dec 25 22:02:52.782028 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4153/8338] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:52 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:53.794157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:53.795167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:53.802545 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:53.802999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:53.804362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:53.804809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:53.847866 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab8770d0-3208-4644-8d6e-bef08e13f86c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.057773 Dec 25 22:02:53.848778 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4186/8339] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:53 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:54.860816 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:54.861872 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:54.869598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:54.870069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:54.870904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:54.871358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:54.910841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0b5826fe-8c1f-4243-80a3-a17faa64ab8f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.054386 Dec 25 22:02:54.911471 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4154/8340] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:54 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:55.923645 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:55.924652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:55.932614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:55.933105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:55.933896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:55.934340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:55.977328 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c039075-75e3-4152-82ef-2d057fb803ec tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.057743 Dec 25 22:02:55.978225 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4187/8341] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:55 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:56.989722 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:56.991385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:56.998857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:56.999328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:57.000127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:57.000584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:57.042801 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51a62183-c235-4c5c-8053-890fae840300 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.057182 Dec 25 22:02:57.043452 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4155/8342] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:56 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:58.055474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:58.056419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:58.063751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:58.064206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:58.065019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:58.065465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:58.106343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f631a692-4e7b-4229-bcb8-ecca9f6684fd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.055412 Dec 25 22:02:58.107011 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4188/8343] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:58 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:02:59.120136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:02:59.121178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:02:59.128586 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:59.129101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:59.129913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:02:59.130378 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:02:59.169640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ee93b7eb-87f3-4a90-96dc-1c1ad445887f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.054577 Dec 25 22:02:59.170493 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4156/8344] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:02:59 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:00.181031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:00.182161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:00.189589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:00.190054 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:00.190846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:00.191321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:00.229781 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d855bca6-accf-4c63-8c6b-0c8b39cf68cf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.052845 Dec 25 22:03:00.230417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4189/8345] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:00 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:01.241883 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:01.242896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:01.250287 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:01.250747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:01.251534 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:01.251984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:01.291210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bd449e61-9e0a-4f78-90ee-60fb6417c724 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.053340 Dec 25 22:03:01.291856 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4157/8346] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:01 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:02.303103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:02.304123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:02.311481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:02.311929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:02.312703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:02.313157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:02.354042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c509037-bc8a-44d9-93cb-ae4f88f1ac10 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.054929 Dec 25 22:03:02.354690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4190/8347] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:02 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:03.366750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:03.367726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:03.375172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:03.375647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:03.376452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:03.376927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:03.416752 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36962b00-8328-4a2d-a368-dd4256432032 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 24565 microversion: 2.1 time: 0.054598 Dec 25 22:03:03.417426 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4158/8348] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:03 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 24565 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:04.428172 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:04.429230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:04.436523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:04.437004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:04.437799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:04.438241 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:04.487458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b316b319-384e-4152-bc10-5f46ae3a7fb5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.063306 Dec 25 22:03:04.488087 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4191/8349] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:04 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:05.499878 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:05.500973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:05.508375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:05.508847 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:05.509672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:05.510131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:05.550135 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-06f90822-353d-4473-9365-ff91c57625b5 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054192 Dec 25 22:03:05.550799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4159/8350] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:05 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:06.562599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:06.563738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:06.571105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:06.571558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:06.572339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:06.572775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:06.613609 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9387e7b-7454-415e-afe9-86e5c9cbed5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054914 Dec 25 22:03:06.614285 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4192/8351] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:06 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:07.626866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:07.627877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:07.635608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:07.636072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:07.636867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:07.637338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:07.676434 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fcd8f95f-4214-46e5-b3b0-96b5f5997440 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053613 Dec 25 22:03:07.677365 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4160/8352] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:07 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:08.689274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:08.690305 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:08.697676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:08.698130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:08.698951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:08.699355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:08.743138 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a8e692aa-55f9-491a-9c13-dd230780eaf1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057904 Dec 25 22:03:08.744707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4193/8353] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:08 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:09.755041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:09.756056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:09.763573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:09.764048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:09.764849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:09.765327 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:09.808451 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d273de06-4d09-47f7-b5f2-989240112cae tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057461 Dec 25 22:03:09.809132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4161/8354] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:09 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:10.821166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:10.822187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:10.829542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:10.829996 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:10.830791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:10.831237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:10.869899 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-51583bed-4249-41f9-8804-7c4c3407a7b3 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053816 Dec 25 22:03:10.870545 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4194/8355] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:10 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:11.882445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:11.883457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:11.891207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:11.891678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:11.892482 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:11.892948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:11.933310 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4c0eda39-7764-4049-a812-bba5f926c0f9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054864 Dec 25 22:03:11.933991 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4162/8356] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:11 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:12.946223 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:12.947250 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:12.954719 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:12.955180 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:12.955978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:12.956426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:12.995072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d3a9e4c7-ec1c-465b-8159-0dbc87166e67 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053522 Dec 25 22:03:12.995712 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4195/8357] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:12 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:14.007127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:14.008134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:14.015463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:14.015926 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:14.016716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:14.017195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:14.057169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31505ddd-143e-4b77-a52a-83c1a68b675e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054128 Dec 25 22:03:14.057831 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4163/8358] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:14 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:15.070345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:15.071360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:15.078909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:15.079369 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:15.080334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:15.080780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:15.121038 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6f7620d7-bec9-463a-92d4-bdf43d21a0fb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055344 Dec 25 22:03:15.121708 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4196/8359] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:15 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:16.133535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:16.134551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:16.141595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:16.142062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:16.142852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:16.143301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:16.183624 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1325d6a6-c857-4ebf-b9f8-9ec7aace578d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054933 Dec 25 22:03:16.184270 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4164/8360] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:16 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:03:17.196555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:17.197597 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:17.204793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:17.205278 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:17.206063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:17.206502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:17.245758 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d22220c7-cbf7-4c3b-a0f9-befef27e22e0 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053931 Dec 25 22:03:17.246392 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4197/8361] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:17 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:18.258189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:18.259204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:18.266629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:18.267097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:18.267897 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:18.268354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:18.307253 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-39c25d84-823f-42e4-9488-9fe1c65aea68 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053801 Dec 25 22:03:18.307890 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4165/8362] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:18 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:19.319478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:19.320482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:19.327813 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:19.328262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:19.329068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:19.329504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:19.369427 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5a6b4143-e43c-4d16-954b-44ff780b9904 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053890 Dec 25 22:03:19.370065 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4198/8363] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:19 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:20.381477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:20.382486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:20.390015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:20.390479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:20.391273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:20.391751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:20.432213 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e5e46677-4476-4d55-8eb6-9ebf84f9705f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054677 Dec 25 22:03:20.432859 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4166/8364] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:20 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:21.444107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:21.445149 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:21.452548 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:21.453025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:21.453806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:21.454253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:21.497057 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-44f67e85-b214-4eae-abaa-429768481a7a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.056878 Dec 25 22:03:21.497700 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4199/8365] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:21 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:22.510571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:22.511577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:22.519314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:22.519805 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:22.520592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:22.521743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:22.564212 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b18ccf8e-d99e-4cf6-a9ed-0d526ecc910b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057765 Dec 25 22:03:22.564926 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4167/8366] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:22 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:23.576351 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:23.577386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:23.586045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:23.586499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:23.587288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:23.587982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:23.628789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b37700c8-73f7-4678-911b-1fce0323459c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.056388 Dec 25 22:03:23.629463 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4200/8367] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:23 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:24.641983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:24.642915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:24.650467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:24.650938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:24.651745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:24.652203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:24.693367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce037750-ff18-48ac-8297-736b230a1238 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055464 Dec 25 22:03:24.693993 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4168/8368] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:24 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:03:25.705663 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:25.706673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:25.714078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:25.714541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:25.715334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:25.715783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:25.756076 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-05dea480-d4e5-4d06-8962-61d166bd4a35 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053838 Dec 25 22:03:25.756974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4201/8369] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:25 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:26.768179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:26.769251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:26.776614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:26.777116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:26.777917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:26.778375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:26.818548 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a34fb7ef-eb8b-44ff-ab32-ce16e34150c9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054388 Dec 25 22:03:26.819177 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4169/8370] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:26 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:27.829976 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:27.830987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:27.838979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:27.839470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:27.840260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:27.840706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:27.880918 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5774f41a-0d7b-4de2-acc0-fcc32b65e613 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054327 Dec 25 22:03:27.881562 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4202/8371] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:27 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:28.893036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:28.894048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:28.902106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:28.902579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:28.903382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:28.903837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:28.941910 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f448d922-3c8e-4497-bf7c-4760fc26ffdc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.052924 Dec 25 22:03:28.943101 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4170/8372] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:28 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:29.954962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:29.956005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:29.964191 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:29.964652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:29.965479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:29.965930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:30.006955 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e1549c4-7a4b-47ce-bf1a-5be829fb5a5a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.056004 Dec 25 22:03:30.007588 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4203/8373] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:29 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:31.019387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:31.020417 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:31.027919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:31.028389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:31.029227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:31.029690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:31.069574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e830cee9-2153-4a0d-88bb-580141cd2569 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054258 Dec 25 22:03:31.070564 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4171/8374] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:31 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:32.081456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:32.082490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:32.089872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:32.090328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:32.091115 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:32.091557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:32.132993 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-507caad8-358a-4f8c-964d-c7b786c7014f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055554 Dec 25 22:03:32.133633 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4204/8375] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:32 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:33.145276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:33.146292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:33.153655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:33.154116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:33.154905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:33.155353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:33.198183 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46be5883-a11b-4c60-ad52-5902aaad9f81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.056994 Dec 25 22:03:33.198820 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4172/8376] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:33 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:34.209939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:34.210987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:34.218311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:34.218699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:34.219478 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:34.219912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:34.263594 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5bd1e09-d4d0-4131-bd6e-5d05cf95fb16 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057573 Dec 25 22:03:34.264273 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4205/8377] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:34 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:35.275947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:35.277004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:35.284361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:35.284840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:35.285695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:35.286151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:35.329003 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1b1a217f-7e1a-49b8-bcd0-13e3e6a197d9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057109 Dec 25 22:03:35.329642 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4173/8378] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:35 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:36.340765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:36.341791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:36.349148 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:36.350120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:36.350911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:36.351352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:36.393850 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9b2b28f8-2a85-4985-8009-9556b3563990 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057097 Dec 25 22:03:36.394504 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4206/8379] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:36 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:37.406286 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:37.407304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:37.414857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:37.415330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:37.416132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:37.416592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:37.457060 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-08493cd5-a6af-409f-b6ba-015e19432dbd tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054764 Dec 25 22:03:37.457694 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4174/8380] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:37 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:03:37.947306 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:03:37.947563 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:03:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:03:38.469980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:38.470991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:38.478337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:38.478793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:38.479574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:38.480018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:38.521318 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07133446-1333-4b5d-a8da-fd7c872f7b4c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055284 Dec 25 22:03:38.521958 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4207/8381] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:38 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:39.533683 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:39.534745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:39.542204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:39.542674 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:39.543490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:39.543944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:39.583355 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:03:39.585251 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:03:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:03:39.588063 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d2d3dd8-d2b5-41df-809d-66ed40ce7017 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.058225 Dec 25 22:03:39.592784 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4175/8382] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:39 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:40.600104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:40.601192 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:40.608727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:40.609265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:40.610043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:40.610482 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:40.650321 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6346e3be-06ea-40c2-b6d7-8a7c1df64b81 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054104 Dec 25 22:03:40.651163 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4208/8383] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:40 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:41.662790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:41.663809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:41.671276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:41.671746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:41.672549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:41.673034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:41.713260 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-23f85d6d-2108-44bd-931e-63555f4edbe1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054917 Dec 25 22:03:41.713910 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4176/8384] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:41 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:42.742377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:42.742377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:42.742377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:42.742377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:42.742377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:42.742377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:42.776083 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab183192-976f-48e9-b68f-8e7f0711cc84 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055207 Dec 25 22:03:42.776724 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4209/8385] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:42 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:03:43.789016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:43.790026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:43.797374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:43.797837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:43.798626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:43.799082 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:43.839404 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3c2d8429-37d3-40aa-956f-90896d08c710 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054995 Dec 25 22:03:43.840043 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4177/8386] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:43 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:44.852197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:44.853234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:44.860833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:44.861319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:44.862098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:44.862538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:44.901773 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-009c6b92-b7f2-4754-978a-c87385d7ebe9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054090 Dec 25 22:03:44.902402 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4210/8387] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:44 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:45.914330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:45.915342 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:45.922223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:45.922692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:45.923485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:45.923933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:45.965605 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b09734c3-8b4a-4b26-b6dc-c435462b6c95 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055362 Dec 25 22:03:45.966398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4178/8388] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:45 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:46.978581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:46.979599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:46.987137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:46.987581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:46.988373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:46.988818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:47.032170 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fad023a-546c-49e5-bb46-1a55e4416b05 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.058115 Dec 25 22:03:47.032815 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4211/8389] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:46 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:48.044591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:48.045662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:48.053119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:48.053590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:48.054391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:48.054846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:48.097679 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f87a7056-9166-4a68-a375-f7483d820bac tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.057125 Dec 25 22:03:48.098339 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4179/8390] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:48 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:49.109913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:49.110920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:49.118254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:49.118712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:49.119499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:49.119936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:49.159779 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-134d76ac-e792-48d5-a1f7-f65acb21a004 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054086 Dec 25 22:03:49.160412 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4212/8391] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:49 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:50.172103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:50.173143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:50.180680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:50.185389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:50.185389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:50.185389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:50.223045 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6a4abed9-ced5-4175-a670-56c1f41b821a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054955 Dec 25 22:03:50.223975 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4180/8392] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:50 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:51.235654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:51.236750 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:51.244357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:51.244819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:51.245641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:51.246084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:51.286060 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3485ef35-85f6-4e6f-ab62-4d224118bc22 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054823 Dec 25 22:03:51.287354 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4213/8393] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:51 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:52.299162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:52.300170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:52.308259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:52.308724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:52.309550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:52.310002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:52.350916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5f6a5188-a5c9-48ed-b4bf-936fc7873bbf tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055720 Dec 25 22:03:52.351608 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4181/8394] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:52 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:53.363615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:53.365161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:53.372593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:53.374405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:53.374405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:53.374405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:53.414305 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1922220a-46cd-4f76-b4db-273473154522 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054512 Dec 25 22:03:53.414840 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4214/8395] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:53 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:54.426648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:54.428261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:54.435635 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:54.436098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:54.436908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:54.437361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:54.476930 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-704ac6e7-6605-43d9-a505-890f7fa684f4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054308 Dec 25 22:03:54.477793 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4182/8396] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:54 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:55.489317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:55.490339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:55.497701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:55.498153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:55.498934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:55.499393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:55.539573 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0feec24-182f-4a56-b784-db8c585c093a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054437 Dec 25 22:03:55.540218 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4215/8397] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:55 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:56.553021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:56.554032 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:56.561300 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:56.566518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:56.566518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:56.566518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:56.602991 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c3727063-f98d-4c01-9963-b0ac2bd32910 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054018 Dec 25 22:03:56.603905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4183/8398] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:56 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:57.616170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:57.617200 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:57.624541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:57.625019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:57.625835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:57.626274 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:57.666447 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-456a1613-46a9-41fa-b892-24de3e794209 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054886 Dec 25 22:03:57.667268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4216/8399] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:57 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:58.678591 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:58.679573 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:58.687003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:58.687475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:58.688272 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:58.688725 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:58.727524 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-780591bc-5388-4329-99f1-19aad19523ff tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053051 Dec 25 22:03:58.728151 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4184/8400] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:58 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:03:59.741350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:03:59.742386 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:03:59.749789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:59.750247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:59.751033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:03:59.751476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:03:59.792771 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3aeaa85d-527a-49ef-bd07-b5e59599e797 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.056031 Dec 25 22:03:59.793453 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4217/8401] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:03:59 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:00.805208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:00.806227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:00.813629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:00.814099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:00.814899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:00.815354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:00.857232 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19459b09-f9cd-4e13-b72f-0d3a7715ad8b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055808 Dec 25 22:04:00.857891 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4185/8402] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:00 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:01.869062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:01.870070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:01.877456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:01.881331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:01.881331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:01.881331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:01.920177 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5fb34e29-a9fb-4f53-b835-2add63336a9b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055192 Dec 25 22:04:01.920809 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4218/8403] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:01 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:02.932811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:02.966068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:02.966068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:02.966068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:02.966068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:02.966068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:02.984976 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-847ce6a6-30c4-493c-ab42-5a160db371ce tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.056083 Dec 25 22:04:02.985620 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4186/8404] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:02 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:03.997738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:03.998737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:04.006827 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:04.007277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:04.008067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:04.008501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:04.048149 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-17c48aea-650a-4a33-baf0-edce25eaf5b1 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054610 Dec 25 22:04:04.048781 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4219/8405] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:03 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:05.060256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:05.061412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:05.069418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:05.069886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:05.070688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:05.071166 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:05.111367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d260195c-50a0-4cbf-bd02-6126be91fef8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055080 Dec 25 22:04:05.112279 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4187/8406] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:05 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:06.123668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:06.124665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:06.132035 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:06.132487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:06.133302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:06.133744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:06.179176 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3b38bd82-68b7-4ce9-b0f7-f9c8c27c856c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.059485 Dec 25 22:04:06.179813 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4220/8407] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:06 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:04:07.191623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:07.192684 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:07.200650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:07.201152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:07.201955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:07.202414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:07.241697 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84b9cb54-bb2a-4d07-a4b4-f224fb357b34 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.054213 Dec 25 22:04:07.242341 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4188/8408] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:07 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:08.253862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:08.254939 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:08.263312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:08.263776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:08.264630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:08.265171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:08.305535 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c85a220e-e55a-439d-b41d-6137a0990a0d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.055651 Dec 25 22:04:08.306169 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4221/8409] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:08 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:09.317307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:09.320613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:09.329837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:09.330306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:09.331114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:09.331571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:09.372235 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d08dc4d5-8b7d-4f0c-8fe1-4a201f58a583 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.058931 Dec 25 22:04:09.372898 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4189/8410] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:09 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:10.384439 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:10.385474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:10.392783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:10.393260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:10.394044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:10.394490 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:10.434327 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-daf2ecc0-319a-4dd2-9fd0-f89cc78e937f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 32636 microversion: 2.1 time: 0.053941 Dec 25 22:04:10.434964 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4222/8411] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:10 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 32636 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:11.446712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:11.447745 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:11.455219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:11.455670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:11.456467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:11.456942 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:11.512696 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd5e4c78-dd4f-4c1f-b80b-f27a1f1a2ce8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 200 len: 40793 microversion: 2.1 time: 0.070084 Dec 25 22:04:11.513367 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4190/8412] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:11 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 40793 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:04:13.245049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:13.245762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:13.253289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:13.253754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:13.254550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:13.255060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:13.394960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:13.403520 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-faee6ce3-bd8a-40e6-9a14-f196bf77e256 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1668 microversion: 2.1 time: 0.162240 Dec 25 22:04:13.404282 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4223/8413] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:13 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:13.421771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "790def48-8e2e-49ed-a6c3-8d0acad43e91"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:13.422929 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:13.431377 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:13.431854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:13.432655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:13.433141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:14.111772 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31d3d16d-2280-4018-8419-b2361a47bb92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.694173 Dec 25 22:04:14.112325 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4191/8414] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 22:04:13 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/os-volume_attachments => generated 194 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:04:17.378113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:17.380002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:17.387493 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:17.387943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:17.388755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:17.389265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:17.536734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:17.542325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Old instance type m1.heat2, new instance type m1.heat {{(pid=136548) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 22:04:17.548962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:04:17.549382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:04:17.549856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:04:17.550264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:04:17.550674 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:04:17.737171 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e2bc979-abe8-4038-88b6-4c5405f14ca9 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 202 len: 0 microversion: 2.1 time: 0.362805 Dec 25 22:04:17.737795 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4224/8415] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:17 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 22:04:17.747634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:17.748363 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:17.754769 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:17.755250 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:17.756664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:17.757150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:17.889716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:17.898508 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b23d306e-5b69-43eb-9c77-a1035000d23e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1723 microversion: 2.1 time: 0.156083 Dec 25 22:04:17.899083 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4192/8416] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:17 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:18.917201 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:18.917758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:18.924668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:18.925426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:18.930158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:18.930158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:19.060773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:19.069416 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-93b715bc-548e-43df-91cf-30afd551187a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1723 microversion: 2.1 time: 0.157665 Dec 25 22:04:19.069996 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4225/8417] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:18 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:20.087101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:20.087945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:20.097610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:20.101401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:20.101401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:20.101401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:20.317431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:20.326167 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ae58c8b4-2a21-44b4-928c-f2158521b1d8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1723 microversion: 2.1 time: 0.243445 Dec 25 22:04:20.326752 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4193/8418] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:20 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:21.342629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:21.343243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:21.350550 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:21.351006 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:21.351785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:21.352227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:21.486648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:21.495233 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d76df037-c7ff-4a96-9beb-68e5a0930674 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.156388 Dec 25 22:04:21.495810 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4226/8419] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:21 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:22.512912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:22.513536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:22.520367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:22.520832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:22.521662 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:22.522112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:22.660638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:22.668923 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1740fe79-b396-4210-950f-c1ece1364518 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.159735 Dec 25 22:04:22.669444 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4194/8420] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:22 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:23.686549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:23.687166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:23.694020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:23.694471 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:23.695248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:23.695686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:23.823349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:23.831212 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8db105a8-a470-438c-8267-2418b42235f2 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.148720 Dec 25 22:04:23.831793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4227/8421] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:23 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:24.848031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:24.848663 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:24.855781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:24.856592 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:24.857427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:24.858471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:24.991974 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:25.000030 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2718e50-6324-4ae5-b552-6f14baa47b6f tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.155879 Dec 25 22:04:25.000598 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4195/8422] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:24 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:26.017498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:26.018113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:26.025093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:26.025554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:26.026340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:26.026786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:26.153935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:26.161759 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a84fb37c-bc2f-4ba1-bff6-21e40f413372 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.148052 Dec 25 22:04:26.162850 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4228/8423] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:26 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:27.178210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:27.178833 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:27.185884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:27.186349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:27.187135 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:27.187585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:27.379525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:27.387550 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7a059dc0-2fbb-4ffe-9693-3ba7c9254890 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.213048 Dec 25 22:04:27.388326 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4196/8424] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:27 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:28.404812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:28.405475 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:28.412164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:28.412615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:28.413450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:28.414352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:28.605593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:28.614001 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-898ee864-578a-4d1e-99c0-921b432d568c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.212881 Dec 25 22:04:28.614597 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4229/8425] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:28 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:29.631797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:29.632444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:29.639556 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:29.640018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:29.640806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:29.641283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:29.769412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:29.777884 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-850b4315-5cd6-4db0-ba09-8da87e217d92 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.150298 Dec 25 22:04:29.778456 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4197/8426] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:29 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:30.794453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:30.795067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:30.801843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:30.802794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:30.803612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:30.804046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:30.936500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:30.945093 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3c21f8b8-1871-4205-9874-92bedb8822ed tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.154282 Dec 25 22:04:30.945668 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4230/8427] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:30 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:31.962524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:31.963158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:31.970102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:31.970579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:31.971385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:31.971850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:32.099973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:32.108175 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af72e92e-6091-43a6-a996-96e324df03e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.150019 Dec 25 22:04:32.108743 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4198/8428] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:31 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:33.125643 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:33.126263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:33.133160 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:33.133616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:33.134404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:33.134843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:33.311692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:33.320248 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6c7cb138-8a47-4133-9103-93d37311486e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1728 microversion: 2.1 time: 0.198326 Dec 25 22:04:33.320828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4231/8429] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:33 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1728 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:34.337151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:34.337783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:34.344563 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:34.345085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:34.345890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:34.346346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:34.484051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:34.493190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65eabff4-c548-429b-ace6-6597b28dec97 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1727 microversion: 2.1 time: 0.158730 Dec 25 22:04:34.494227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4199/8430] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:34 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:35.509968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:35.510532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:35.517309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:35.517764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:35.518540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:35.519030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:35.652282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:35.660232 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-707bafc6-06e8-466a-8c47-b17f7d78be8a tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1725 microversion: 2.1 time: 0.154634 Dec 25 22:04:35.660809 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4232/8431] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:35 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:35.780531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-2f33c1f6-62dd-4444-921c-0e5cdf19b0b7 req-f912035b-3a6d-4f78-921d-c62176b3e7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-unplugged", "status": "completed", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:35.782299 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:04:35.782299 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:04:35.790618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2f33c1f6-62dd-4444-921c-0e5cdf19b0b7 req-f912035b-3a6d-4f78-921d-c62176b3e7ae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:35.791080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-2f33c1f6-62dd-4444-921c-0e5cdf19b0b7 req-f912035b-3a6d-4f78-921d-c62176b3e7ae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:35.803435 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-2f33c1f6-62dd-4444-921c-0e5cdf19b0b7 req-f912035b-3a6d-4f78-921d-c62176b3e7ae service nova] Creating event network-vif-unplugged:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:04:35.808959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [req-2f33c1f6-62dd-4444-921c-0e5cdf19b0b7 req-f912035b-3a6d-4f78-921d-c62176b3e7ae service nova] Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=136547) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:04:35.815427 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-2f33c1f6-62dd-4444-921c-0e5cdf19b0b7 req-f912035b-3a6d-4f78-921d-c62176b3e7ae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038559 Dec 25 22:04:35.816044 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4200/8432] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:04:35 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:04:36.680416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:36.681030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:36.689535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:36.690101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:36.691017 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:36.691582 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:36.826124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:36.834664 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7e0bcf4-6e82-449c-a6a0-261e9a8cdcc4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1725 microversion: 2.1 time: 0.160424 Dec 25 22:04:36.835239 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4233/8433] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:36 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:37.852598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:37.853340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:37.860554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:37.861122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:37.861984 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:37.862443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:38.364328 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:38.373378 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f3cc3fb0-414b-48b1-9247-3da91319389c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1725 microversion: 2.1 time: 0.525475 Dec 25 22:04:38.373959 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4201/8434] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:37 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1725 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:39.390450 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:39.391033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:39.398105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:39.402105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:39.402105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:39.402105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:39.627981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:39.636271 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef70fb69-b2fe-450c-9a77-1741487c88c4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1722 microversion: 2.1 time: 0.249714 Dec 25 22:04:39.636852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4234/8435] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:39 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:39.656644 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:39.657245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:39.664638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:39.665161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:39.665982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:39.666442 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:39.701919 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:39.702385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:39.703204 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:39.703651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:39.727109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:04:39.732562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Getting quotas for user 119465233440460aba79a1ff63865c6c and project 1e594b8d48e948b8ae34d96bebfc2a36. Resources: {'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:04:40.122236 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-80958bc7-5d34-45e9-bd12-30e5e87b5c7b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action" status: 202 len: 0 microversion: 2.1 time: 0.469124 Dec 25 22:04:40.122881 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4202/8436] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:04:39 2021] POST /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:04:40.132335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:40.132990 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:40.139233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:40.144572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:40.144572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:40.144572 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:40.329277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:40.338900 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b8adc8b-b4d9-429a-8eee-a9227c51a989 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.211864 Dec 25 22:04:40.339686 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4235/8437] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:40 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:41.357704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:41.358407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:41.364577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:41.365074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:41.365882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:41.366312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:41.503060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:41.511217 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4667f746-1d13-4051-93f5-8eb82e1dfa4b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.158772 Dec 25 22:04:41.511799 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4203/8438] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:41 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:42.051686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3bd04629-a74f-4620-9219-60472e9b42fa req-626cb7f5-d57f-4f86-809e-1d32f83498fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-plugged", "status": "completed", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:42.053901 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:04:42.053901 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:04:42.061846 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3bd04629-a74f-4620-9219-60472e9b42fa req-626cb7f5-d57f-4f86-809e-1d32f83498fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:42.062298 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3bd04629-a74f-4620-9219-60472e9b42fa req-626cb7f5-d57f-4f86-809e-1d32f83498fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:42.077293 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3bd04629-a74f-4620-9219-60472e9b42fa req-626cb7f5-d57f-4f86-809e-1d32f83498fe service nova] Creating event network-vif-plugged:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:04:42.084921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-3bd04629-a74f-4620-9219-60472e9b42fa req-626cb7f5-d57f-4f86-809e-1d32f83498fe service nova] Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:04:42.091708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3bd04629-a74f-4620-9219-60472e9b42fa req-626cb7f5-d57f-4f86-809e-1d32f83498fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043508 Dec 25 22:04:42.092230 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4236/8439] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:04:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:04:42.529462 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:42.529859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:42.536565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:42.541756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:42.541756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:42.541756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:42.671061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:42.679622 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d3be2a4b-944e-486c-b6f8-25f5b869c978 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.154564 Dec 25 22:04:42.680139 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4204/8440] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:42 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:43.698217 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:43.698952 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:43.706106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:43.706569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:43.707356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:43.707800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:43.846024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:43.854578 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a2e8dc6b-3bef-426b-8559-e17192aeed6c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.162098 Dec 25 22:04:43.855166 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4237/8441] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:43 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:44.872067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:44.872728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:44.879754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:44.880227 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:44.881066 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:44.881528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:45.017879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:45.026045 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2a909ea-9a50-49c1-b54d-79344822e058 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.157724 Dec 25 22:04:45.026627 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4205/8442] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:44 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:45.871888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-74e24979-5499-4c6d-9043-f6e84d63de10 req-34dc9df1-b5e4-4cd6-8e73-bd298762b4fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-unplugged", "status": "completed", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:45.874271 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:04:45.874271 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:04:45.883153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-74e24979-5499-4c6d-9043-f6e84d63de10 req-34dc9df1-b5e4-4cd6-8e73-bd298762b4fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:45.883608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-74e24979-5499-4c6d-9043-f6e84d63de10 req-34dc9df1-b5e4-4cd6-8e73-bd298762b4fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:45.897403 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-74e24979-5499-4c6d-9043-f6e84d63de10 req-34dc9df1-b5e4-4cd6-8e73-bd298762b4fe service nova] Creating event network-vif-unplugged:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:04:45.902937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [req-74e24979-5499-4c6d-9043-f6e84d63de10 req-34dc9df1-b5e4-4cd6-8e73-bd298762b4fe service nova] Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=136548) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5713}} Dec 25 22:04:45.909231 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-74e24979-5499-4c6d-9043-f6e84d63de10 req-34dc9df1-b5e4-4cd6-8e73-bd298762b4fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041557 Dec 25 22:04:45.909919 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4238/8443] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:04:45 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:04:46.043092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:46.043760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:46.050666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:46.051137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:46.051939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:46.052414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:46.188797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:46.196791 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb16bd19-14b6-4280-8b23-f16a56c9822d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.157472 Dec 25 22:04:46.197396 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4206/8444] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:46 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:47.215697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:47.216299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:47.222685 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:47.223138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:47.223941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:47.224376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:47.354185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:47.362559 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4221cda4-2ab5-45d8-8f08-af94304ff9b8 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.152331 Dec 25 22:04:47.363180 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4239/8445] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:47 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:48.379466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:48.380096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:48.387461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:48.387925 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:48.388716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:48.389192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:48.524715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:48.533581 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ecb48309-b254-440d-b2ec-33a8f6616acc tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1721 microversion: 2.1 time: 0.157814 Dec 25 22:04:48.534159 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4207/8446] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:48 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:49.550116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:49.550728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:49.557682 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:49.558138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:49.558924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:49.559365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:49.691791 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:49.699652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9a00801b-e6ac-46ee-96c6-8ef1906a79e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1714 microversion: 2.1 time: 0.153371 Dec 25 22:04:49.700223 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4240/8447] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:49 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:04:49.715705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:49.716335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:49.723098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:49.723566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:49.724357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:49.724809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:49.857990 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:49.866075 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ab08cb47-0ce3-4e55-ada8-a2239e7e8099 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1714 microversion: 2.1 time: 0.154022 Dec 25 22:04:49.866668 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4208/8448] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:49 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:49.881636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:49.882755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:49.888627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:49.889124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:49.889909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:49.890347 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:50.025920 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:50.033959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f81914da-fec3-41f2-8334-12818e0a0835 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1714 microversion: 2.1 time: 0.156110 Dec 25 22:04:50.034530 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4241/8449] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:49 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:50.049467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:50.053782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:50.055916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:50.056336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:50.057155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:50.057609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:50.082590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:04:50.393134 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-10f0e54b-b656-4436-863f-43a17ad3c2e4 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 204 len: 0 microversion: 2.1 time: 0.347001 Dec 25 22:04:50.393710 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4209/8450] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:04:50 2021] DELETE /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:04:50.401816 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:50.402434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:50.408802 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:50.409282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:50.410137 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:50.410573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:50.540736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:50.548653 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09388dbe-57fb-4a78-be84-8617d7b0c361 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1720 microversion: 2.1 time: 0.150537 Dec 25 22:04:50.549262 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4242/8451] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:50 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:51.566823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:51.567570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:51.574917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:51.575391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:51.576199 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:51.576655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:51.712064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:51.720106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7dc0d0a9-5e54-45d8-baf3-1570411cfadb tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1720 microversion: 2.1 time: 0.157418 Dec 25 22:04:51.720685 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4210/8452] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:51 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:51.961945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-57118f76-041d-406e-9e88-c01cc9ef4d47 req-d0d2640d-41d2-44a1-a067-8cd330fdb147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-plugged", "status": "completed", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:51.963894 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:04:51.963894 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:04:51.971421 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-57118f76-041d-406e-9e88-c01cc9ef4d47 req-d0d2640d-41d2-44a1-a067-8cd330fdb147 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:51.971874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-57118f76-041d-406e-9e88-c01cc9ef4d47 req-d0d2640d-41d2-44a1-a067-8cd330fdb147 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:51.983272 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-57118f76-041d-406e-9e88-c01cc9ef4d47 req-d0d2640d-41d2-44a1-a067-8cd330fdb147 service nova] Creating event network-vif-plugged:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:04:51.988236 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-57118f76-041d-406e-9e88-c01cc9ef4d47 req-d0d2640d-41d2-44a1-a067-8cd330fdb147 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030532 Dec 25 22:04:51.988829 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4243/8453] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:04:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:04:52.737603 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:52.738309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:52.745528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:52.746004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:52.746836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:52.747765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:52.847747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:52.856002 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-712aa69f-ec60-43cd-893c-d6c73100bd1c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1653 microversion: 2.1 time: 0.122461 Dec 25 22:04:52.856581 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4211/8454] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:52 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1653 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:52.967357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-55ff507d-d9f2-479f-a0c6-1e312a6fb8d2 req-f78d27d8-72ad-4af7-b69f-5e90529d83ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8771b817-fa8f-4ab3-9171-5f63652fa06d", "name": "network-vif-deleted", "tag": "c4ecf985-5253-4122-a72d-215ad1c18bd4"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:04:52.968905 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:04:52.968905 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:04:52.977143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-55ff507d-d9f2-479f-a0c6-1e312a6fb8d2 req-f78d27d8-72ad-4af7-b69f-5e90529d83ef service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:52.977599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-55ff507d-d9f2-479f-a0c6-1e312a6fb8d2 req-f78d27d8-72ad-4af7-b69f-5e90529d83ef service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:52.989557 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-55ff507d-d9f2-479f-a0c6-1e312a6fb8d2 req-f78d27d8-72ad-4af7-b69f-5e90529d83ef service nova] Creating event network-vif-deleted:c4ecf985-5253-4122-a72d-215ad1c18bd4 for instance 8771b817-fa8f-4ab3-9171-5f63652fa06d on nch1-master-1 Dec 25 22:04:52.994626 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-55ff507d-d9f2-479f-a0c6-1e312a6fb8d2 req-f78d27d8-72ad-4af7-b69f-5e90529d83ef service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032094 Dec 25 22:04:52.995290 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4244/8455] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:04:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:04:53.873569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:53.874201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:53.881235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:53.881700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:53.882517 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:53.882970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:53.916319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:53.916785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:53.917314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lazy-loading 'fault' on Instance uuid 8771b817-fa8f-4ab3-9171-5f63652fa06d {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:04:53.961297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '119465233440460aba79a1ff63865c6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e594b8d48e948b8ae34d96bebfc2a36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:04:53.969305 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3bbe08f7-eefe-4ebb-a29f-840f0d00ea79 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 200 len: 1375 microversion: 2.1 time: 0.099472 Dec 25 22:04:53.969860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4212/8456] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:53 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 1375 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:04:54.988181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:54.988909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:54.995610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:54.996065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:54.996913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:54.997312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:55.015641 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. Dec 25 22:04:55.016372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:55.017298 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cb886ab4-d827-42fe-93e1-86b991b6473b tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 404 len: 111 microversion: 2.1 time: 0.034037 Dec 25 22:04:55.017871 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4245/8457] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:54 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:55.070623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:55.071583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:55.078364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:55.078832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:55.079638 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:55.080092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:55.092721 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. Dec 25 22:04:55.093359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:55.094210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6b3ab1fb-b14c-43e1-b86b-98ffbabe229e tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.027488 Dec 25 22:04:55.094750 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4213/8458] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 22:04:55 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:59.605764 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.606271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.613068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.613527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.614310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.614755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.628918 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. Dec 25 22:04:59.629520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.630350 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9751975d-3356-4e8d-ba21-881d3e907a49 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 404 len: 111 microversion: 2.1 time: 0.028603 Dec 25 22:04:59.631024 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4246/8459] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:04:59 2021] DELETE /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:59.638636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.639259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 8771b817-fa8f-4ab3-9171-5f63652fa06d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.646346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.646820 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.647633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.648101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.661588 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. Dec 25 22:04:59.662200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 8771b817-fa8f-4ab3-9171-5f63652fa06d could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.663551 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-114d9e06-c761-4c53-b992-ad83a7f37753 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d" status: 404 len: 111 microversion: 2.1 time: 0.028156 Dec 25 22:04:59.664090 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4214/8460] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:59 2021] GET /compute/v2.1/servers/8771b817-fa8f-4ab3-9171-5f63652fa06d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:59.671788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.672291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.678317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.679658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.680453 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.680923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.694292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. Dec 25 22:04:59.697215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.697215 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a94f3942-3453-41ca-abda-0b52fa1f8157 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 404 len: 111 microversion: 2.1 time: 0.027589 Dec 25 22:04:59.697215 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4247/8461] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:04:59 2021] DELETE /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:59.703912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.704546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: 859e5e6f-804e-4c63-a56b-3a32652bb6f4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.710572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.711041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.711836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.712293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.726056 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. Dec 25 22:04:59.726649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance 859e5e6f-804e-4c63-a56b-3a32652bb6f4 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.727479 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58abd321-e461-4d8b-abd1-5e46cd17138c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4" status: 404 len: 111 microversion: 2.1 time: 0.027364 Dec 25 22:04:59.728000 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4215/8462] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:59 2021] GET /compute/v2.1/servers/859e5e6f-804e-4c63-a56b-3a32652bb6f4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 22:04:59.735853 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.736395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.742966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.743428 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.744220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.744667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.757972 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. Dec 25 22:04:59.758557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.759385 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4947196f-2689-4175-9c99-1036a4909b8d tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 404 len: 111 microversion: 2.1 time: 0.027231 Dec 25 22:04:59.759917 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4248/8463] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:04:59 2021] DELETE /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:59.767418 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.768067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: d4d4eb99-8e5d-4037-9001-8cee89aae129] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.774008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.774475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.775273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.775723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.791662 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. Dec 25 22:04:59.792265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance d4d4eb99-8e5d-4037-9001-8cee89aae129 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.793135 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb22a574-eb95-46ae-858b-48a5f6e4ef54 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129" status: 404 len: 111 microversion: 2.1 time: 0.029344 Dec 25 22:04:59.793683 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4216/8464] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:59 2021] GET /compute/v2.1/servers/d4d4eb99-8e5d-4037-9001-8cee89aae129 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 22:04:59.801401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.801904 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.808518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.809021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.809812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.810261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.823512 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. Dec 25 22:04:59.824100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.824945 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e19a2ca-dad1-4167-9e2e-887d6af0adde tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 404 len: 111 microversion: 2.1 time: 0.027270 Dec 25 22:04:59.825509 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4249/8465] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:04:59 2021] DELETE /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:04:59.832955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.833590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] [instance: e87bad1d-44d6-4e94-a7c2-1c20ca33eba8] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:04:59.839544 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.839960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.840763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:04:59.841247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:04:59.855248 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] HTTP exception thrown: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. Dec 25 22:04:59.855844 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Returning 404 to user: Instance e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:04:59.856672 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53a4b4ee-805a-43f9-be1a-bdc1ab244996 tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8" status: 404 len: 111 microversion: 2.1 time: 0.027445 Dec 25 22:04:59.857228 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4217/8466] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:04:59 2021] GET /compute/v2.1/servers/e87bad1d-44d6-4e94-a7c2-1c20ca33eba8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 22:04:59.864974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b640576f-cd80-402d-bcfe-2307c429695c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] Calling method '.version_select at 0x7fa4f73b4af0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:04:59.959084 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b640576f-cd80-402d-bcfe-2307c429695c tempest-ServerActionsTestJSON-124567319 tempest-ServerActionsTestJSON-124567319-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650957824" status: 202 len: 0 microversion: 2.1 time: 0.097606 Dec 25 22:04:59.960388 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4250/8467] 10.222.0.32 () {58 vars in 1220 bytes} [Sat Dec 25 22:04:59 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650957824 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:05:07.713352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-54562884", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "4e5a33ab-8b21-4ab5-9a7e-0c2bb0d33014"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:07.962339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] validate_networks() for [('4e5a33ab-8b21-4ab5-9a7e-0c2bb0d33014', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:05:08.298914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:05:08.299361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:05:08.299857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:05:08.300283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:05:08.300743 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:05:08.309514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:08.309978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:08.310807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:08.311258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:08.327484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Getting quotas for project 8dc9c763cc31441a9b4a70ec405bbc23. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:05:08.332467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Getting quotas for user faa994a3fd5b460883d775a94a52783a and project 8dc9c763cc31441a9b4a70ec405bbc23. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:05:08.344783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:05:08.347125 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:05:08.486497 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [89a511fe-e54e-467b-8992-8c56f50a3948] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:05:09.493922 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [89a511fe-e54e-467b-8992-8c56f50a3948] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36328. Dec 25 22:05:09.498208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8ee5540-94d3-4686-be91-2c2d370df430 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.945773 Dec 25 22:05:09.498938 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4218/8468] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:05:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:05:09.510206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-155edb41-f8cc-478e-a462-0a13238e6865 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:09.510814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-155edb41-f8cc-478e-a462-0a13238e6865 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:09.686684 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-155edb41-f8cc-478e-a462-0a13238e6865 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:09.693411 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-155edb41-f8cc-478e-a462-0a13238e6865 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1215 microversion: 2.1 time: 0.188548 Dec 25 22:05:09.694605 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4251/8469] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:09 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:10.711570 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b43e425b-3863-4fee-93ed-2ca51ccfe7c6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:10.712197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b43e425b-3863-4fee-93ed-2ca51ccfe7c6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:10.764076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b43e425b-3863-4fee-93ed-2ca51ccfe7c6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:10.770916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b43e425b-3863-4fee-93ed-2ca51ccfe7c6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1215 microversion: 2.1 time: 0.064359 Dec 25 22:05:10.771487 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4219/8470] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:10 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:05:11.787233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2ad55b0f-ab85-449d-bbc4-ac8e76f501c4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:11.787882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2ad55b0f-ab85-449d-bbc4-ac8e76f501c4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:11.839902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2ad55b0f-ab85-449d-bbc4-ac8e76f501c4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:11.846683 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2ad55b0f-ab85-449d-bbc4-ac8e76f501c4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1215 microversion: 2.1 time: 0.063238 Dec 25 22:05:11.847315 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4252/8471] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:11 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:12.863267 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a9af136f-0f79-41bd-be08-b136b4caec66 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:12.863903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a9af136f-0f79-41bd-be08-b136b4caec66 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:12.915676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a9af136f-0f79-41bd-be08-b136b4caec66 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:12.922280 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a9af136f-0f79-41bd-be08-b136b4caec66 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1215 microversion: 2.1 time: 0.062714 Dec 25 22:05:12.922840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4220/8472] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:12 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:13.939104 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:13.939639 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:13.948098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:13.948558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:13.949448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:13.949847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:14.016196 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:14.023959 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bf3fd07c-9fa6-4c7e-951c-4e06b560dd41 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1219 microversion: 2.1 time: 0.089104 Dec 25 22:05:14.024534 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4253/8473] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:13 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:15.040400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:15.041039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:15.047383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:15.047850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:15.048651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:15.049132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:15.113148 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:15.120965 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-68653574-1bb2-4487-b6a5-fab76acdf820 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1219 microversion: 2.1 time: 0.084372 Dec 25 22:05:15.121520 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4221/8474] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:15 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:16.137928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:16.138500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:16.145284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:16.145413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:16.146124 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:16.146566 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:16.217751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:16.225299 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4c27bcb7-5cee-4162-8e3a-3acc24dd335a tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1273 microversion: 2.1 time: 0.091123 Dec 25 22:05:16.226256 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4254/8475] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:16 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:17.242334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:17.242965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:17.249891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:17.250358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:17.251157 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:17.251610 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:17.438078 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-46c55b08-25e8-413e-be8b-5022633e515e req-9a99c97e-fd20-4737-9df9-0879396c7481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc1db889-b66d-4a02-9181-7d65b8693814", "tag": "8b9ca74e-5739-42e3-aa27-c4af3c843fa1"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:17.440629 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:05:17.440629 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:05:17.449252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-46c55b08-25e8-413e-be8b-5022633e515e req-9a99c97e-fd20-4737-9df9-0879396c7481 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:17.449765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-46c55b08-25e8-413e-be8b-5022633e515e req-9a99c97e-fd20-4737-9df9-0879396c7481 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:17.460127 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:17.469392 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3bf2f4e3-ae20-4e59-922b-38add768cc12 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.230839 Dec 25 22:05:17.470343 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4222/8476] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:17 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:17.475618 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-46c55b08-25e8-413e-be8b-5022633e515e req-9a99c97e-fd20-4737-9df9-0879396c7481 service nova] Creating event network-changed:8b9ca74e-5739-42e3-aa27-c4af3c843fa1 for instance cc1db889-b66d-4a02-9181-7d65b8693814 on nch1-master-1 Dec 25 22:05:17.483095 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-46c55b08-25e8-413e-be8b-5022633e515e req-9a99c97e-fd20-4737-9df9-0879396c7481 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116148 Dec 25 22:05:17.483710 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4255/8477] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:05:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:05:18.486084 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:18.486726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:18.493625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:18.494107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:18.494905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:18.495365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:18.625313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:18.633241 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-96fddb33-2b6c-43a0-957b-4b76098e0f8b tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.150306 Dec 25 22:05:18.633907 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4223/8478] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:18 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:19.651438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:19.652132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:19.658337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:19.658785 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:19.659551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:19.659986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:19.792570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:19.799934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5e4f40c1-44b6-4fb0-8211-4b4ed7630f55 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.153947 Dec 25 22:05:19.800506 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4256/8479] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:19 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:20.815835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:20.816464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:20.823283 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:20.823747 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:20.824538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:20.825015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:20.953169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:20.961122 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-242876ca-200b-439d-827a-bae9a0f1ebaf tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.148422 Dec 25 22:05:20.961697 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4224/8480] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:20 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:21.978087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:21.978712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:21.985751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:21.986211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:21.987003 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:21.987443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:22.118799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:22.126290 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-09249d78-ed1b-467c-8ecb-3bd27336054f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.152470 Dec 25 22:05:22.126877 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4257/8481] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:21 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:23.142343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:23.142982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:23.149889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:23.150364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:23.151197 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:23.151658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:23.285636 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:23.293092 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-517040b4-5484-460c-b507-7a2305df9175 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.154463 Dec 25 22:05:23.293681 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4225/8482] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:23 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:24.140257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b2fe7457-5d0f-4cab-ab25-1a17ce93bd12 req-0c725866-9074-4063-95c5-2556bb2a9d62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1db889-b66d-4a02-9181-7d65b8693814", "name": "network-vif-plugged", "status": "completed", "tag": "8b9ca74e-5739-42e3-aa27-c4af3c843fa1"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:24.141894 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:05:24.141894 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:05:24.149630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b2fe7457-5d0f-4cab-ab25-1a17ce93bd12 req-0c725866-9074-4063-95c5-2556bb2a9d62 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:24.150080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b2fe7457-5d0f-4cab-ab25-1a17ce93bd12 req-0c725866-9074-4063-95c5-2556bb2a9d62 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:24.161051 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b2fe7457-5d0f-4cab-ab25-1a17ce93bd12 req-0c725866-9074-4063-95c5-2556bb2a9d62 service nova] Creating event network-vif-plugged:8b9ca74e-5739-42e3-aa27-c4af3c843fa1 for instance cc1db889-b66d-4a02-9181-7d65b8693814 on nch1-master-1 Dec 25 22:05:24.165923 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b2fe7457-5d0f-4cab-ab25-1a17ce93bd12 req-0c725866-9074-4063-95c5-2556bb2a9d62 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029380 Dec 25 22:05:24.166507 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4258/8483] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:05:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:05:24.310163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:24.310800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:24.317671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:24.318168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:24.318973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:24.319426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:24.480970 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:24.488375 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baa12ee7-caff-4c72-8823-827e47787e93 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.182005 Dec 25 22:05:24.488967 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4226/8484] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:24 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:25.507168 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:25.508492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:25.514676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:25.518600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:25.518600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:25.518600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:25.650968 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:25.658756 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ba2174bc-de2d-4b9e-8b38-c6d136261d8e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1315 microversion: 2.1 time: 0.156615 Dec 25 22:05:25.671905 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4259/8485] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:25 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:26.674214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:26.674842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:26.682364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:26.682836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:26.683637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:26.684092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:26.812772 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:26.820174 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-734fef45-8d76-4134-b48e-43b6ec13efd6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.149797 Dec 25 22:05:26.820750 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4227/8486] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:26 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:26.873463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-353689512", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "4e5a33ab-8b21-4ab5-9a7e-0c2bb0d33014"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:26.925344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] validate_networks() for [('4e5a33ab-8b21-4ab5-9a7e-0c2bb0d33014', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:05:27.289383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:05:27.289806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:05:27.290280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:05:27.290687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:05:27.291119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:05:27.299838 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:27.300283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:27.301133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:27.301570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:27.317773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Getting quotas for project 8dc9c763cc31441a9b4a70ec405bbc23. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:05:27.323414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Getting quotas for user faa994a3fd5b460883d775a94a52783a and project 8dc9c763cc31441a9b4a70ec405bbc23. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:05:27.336486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:05:27.339680 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:05:27.458530 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c29cf9e7-c5bc-4370-b3f3-ebc0709e0d23 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588628 Dec 25 22:05:27.459165 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4260/8487] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:05:26 2021] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:05:27.469332 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7511803b-2fe2-464c-a648-865c3344d75e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:27.473946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7511803b-2fe2-464c-a648-865c3344d75e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:27.525218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7511803b-2fe2-464c-a648-865c3344d75e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:27.532150 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7511803b-2fe2-464c-a648-865c3344d75e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1216 microversion: 2.1 time: 0.066521 Dec 25 22:05:27.533107 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4228/8488] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:27 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1216 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:28.548472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:28.549388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:28.557383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:28.557837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:28.558629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:28.559098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:28.623839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:28.631334 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eeb493cb-c99a-4995-95bc-24e1034607d4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1212 microversion: 2.1 time: 0.086573 Dec 25 22:05:28.631912 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4261/8489] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:28 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1212 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:29.647954 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:29.648865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:29.656643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:29.659528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:29.659528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:29.659528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:29.729384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:29.736750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4f9414d-a6df-4ec8-8cab-4269be619833 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1274 microversion: 2.1 time: 0.092548 Dec 25 22:05:29.737368 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4229/8490] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:29 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:30.754024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:30.754669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:30.762128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:30.762611 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:30.763370 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:30.763811 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:30.823069 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-bd5d62f3-2d15-473c-979a-d6ce67260ef7 req-42022766-0417-42a2-a33d-9e72e2ea4d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25dc5da1-66b3-41e2-93f3-5f29054c88df", "tag": "229e274a-b59d-422c-af4d-a46bf417e834"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:30.825305 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:05:30.825305 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:05:30.832765 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-bd5d62f3-2d15-473c-979a-d6ce67260ef7 req-42022766-0417-42a2-a33d-9e72e2ea4d14 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:30.833321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-bd5d62f3-2d15-473c-979a-d6ce67260ef7 req-42022766-0417-42a2-a33d-9e72e2ea4d14 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:30.844456 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-bd5d62f3-2d15-473c-979a-d6ce67260ef7 req-42022766-0417-42a2-a33d-9e72e2ea4d14 service nova] Creating event network-changed:229e274a-b59d-422c-af4d-a46bf417e834 for instance 25dc5da1-66b3-41e2-93f3-5f29054c88df on nch1-master-1 Dec 25 22:05:30.849550 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-bd5d62f3-2d15-473c-979a-d6ce67260ef7 req-42022766-0417-42a2-a33d-9e72e2ea4d14 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030925 Dec 25 22:05:30.850312 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4230/8491] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:05:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:05:30.959668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:30.967194 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e76072cd-8264-42a6-b253-cf4b055fed07 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.216918 Dec 25 22:05:30.967784 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4262/8492] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:30 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:31.985039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:31.988909 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:31.992046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:31.992520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:31.993382 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:31.993874 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:32.126639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:32.134592 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a3a45f4e-2b2d-4d62-adda-706fba3b30c7 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.154519 Dec 25 22:05:32.135164 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4231/8493] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:31 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:33.151451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:33.152068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:33.158833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:33.159284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:33.160063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:33.160506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:33.288480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:33.295763 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2dfe1b88-1129-4fa8-9ed7-4d783a42b28e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.148595 Dec 25 22:05:33.296337 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4263/8494] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:33 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:34.312008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:34.312642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:34.319433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:34.320413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:34.321246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:34.321698 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:34.467790 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:34.475101 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-adb650cb-df7d-46f3-83b6-dcc31e288cf9 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.166877 Dec 25 22:05:34.475677 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4232/8495] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:34 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:35.491309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:35.491921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:35.498731 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:35.499182 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:35.499958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:35.500397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:35.634589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:35.642098 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-655601ab-7c7a-47d0-b211-fe52dca970ab tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.154417 Dec 25 22:05:35.642710 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4264/8496] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:35 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:36.659723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:36.660376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:36.668373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:36.668829 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:36.669655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:36.670098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:36.805963 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:36.813502 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0d0e84b1-0807-48e9-9f00-0989e20726f8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.157927 Dec 25 22:05:36.814080 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4233/8497] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:36 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:37.829974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:37.830592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:37.837467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:37.837919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:37.838695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:37.839133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:37.968388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:37.975801 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f9e67b1c-47b8-4189-8794-dfdf6db77510 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.149575 Dec 25 22:05:37.976385 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4265/8498] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:37 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:38.451867 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-0eb7f589-5fdb-4019-8a92-63e5281ee47f req-784d85b3-4779-46d6-9869-4a5d9444907d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25dc5da1-66b3-41e2-93f3-5f29054c88df", "name": "network-vif-plugged", "status": "completed", "tag": "229e274a-b59d-422c-af4d-a46bf417e834"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:38.454732 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:05:38.454732 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:05:38.462514 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0eb7f589-5fdb-4019-8a92-63e5281ee47f req-784d85b3-4779-46d6-9869-4a5d9444907d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:38.462991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-0eb7f589-5fdb-4019-8a92-63e5281ee47f req-784d85b3-4779-46d6-9869-4a5d9444907d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:38.475310 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-0eb7f589-5fdb-4019-8a92-63e5281ee47f req-784d85b3-4779-46d6-9869-4a5d9444907d service nova] Creating event network-vif-plugged:229e274a-b59d-422c-af4d-a46bf417e834 for instance 25dc5da1-66b3-41e2-93f3-5f29054c88df on nch1-master-1 Dec 25 22:05:38.480750 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-0eb7f589-5fdb-4019-8a92-63e5281ee47f req-784d85b3-4779-46d6-9869-4a5d9444907d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089144 Dec 25 22:05:38.481409 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4234/8499] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:05:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:05:38.992186 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:38.992795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:39.000288 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:39.000744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:39.001562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:39.002004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:39.138000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:39.145377 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5cfea800-ad68-4d3d-98b1-5f9691dfd0b6 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1316 microversion: 2.1 time: 0.156975 Dec 25 22:05:39.145967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4266/8500] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:38 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:40.162614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:40.163330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:40.169569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:40.170039 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:40.170835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:40.171292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:40.300113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:40.308079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-13e43978-6e8e-4063-9785-f98fcccac787 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1505 microversion: 2.1 time: 0.150444 Dec 25 22:05:40.308642 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4235/8501] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:40 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:40.324014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:40.324530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:40.331612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:40.332064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:40.332962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:40.333422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:40.361377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:05:40.605123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4dbc3f41-a9be-4e1f-945f-0426980fa064 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "DELETE /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 204 len: 0 microversion: 2.1 time: 0.285002 Dec 25 22:05:40.605665 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4267/8502] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:05:40 2021] DELETE /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:05:40.613376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:40.616567 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:40.620915 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:40.621387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:40.622180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:40.622716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:40.758551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:40.766266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f2d57730-fb50-48f1-ae30-dc541301b2d2 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1511 microversion: 2.1 time: 0.156583 Dec 25 22:05:40.773218 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4236/8503] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:40 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:41.783484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:41.784114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:41.790989 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:41.794381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:41.794381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:41.794381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:41.926060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:41.934047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e351c149-e5a6-4bbb-a059-833260bc114d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1511 microversion: 2.1 time: 0.154838 Dec 25 22:05:41.934646 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4268/8504] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:41 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:42.817952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e6291885-720c-48d0-a236-bebec29e3f56 req-c1f5ede9-1134-4675-b801-e674cedf1737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25dc5da1-66b3-41e2-93f3-5f29054c88df", "name": "network-vif-deleted", "tag": "229e274a-b59d-422c-af4d-a46bf417e834"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:42.819450 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:05:42.819450 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:05:42.826495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e6291885-720c-48d0-a236-bebec29e3f56 req-c1f5ede9-1134-4675-b801-e674cedf1737 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:42.826987 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e6291885-720c-48d0-a236-bebec29e3f56 req-c1f5ede9-1134-4675-b801-e674cedf1737 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:42.838525 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e6291885-720c-48d0-a236-bebec29e3f56 req-c1f5ede9-1134-4675-b801-e674cedf1737 service nova] Creating event network-vif-deleted:229e274a-b59d-422c-af4d-a46bf417e834 for instance 25dc5da1-66b3-41e2-93f3-5f29054c88df on nch1-master-1 Dec 25 22:05:42.843459 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e6291885-720c-48d0-a236-bebec29e3f56 req-c1f5ede9-1134-4675-b801-e674cedf1737 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081331 Dec 25 22:05:42.844061 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4237/8505] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:05:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:05:42.950675 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:42.951303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:42.958819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:42.959042 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:42.959703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:42.960147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:43.029016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:43.036456 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cea801c2-002c-44ab-a784-8ede28f0c300 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 200 len: 1301 microversion: 2.1 time: 0.089991 Dec 25 22:05:43.043055 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4269/8506] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:42 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:44.054768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.055470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.061921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.063866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.063866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.063866 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.076911 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] HTTP exception thrown: Instance 25dc5da1-66b3-41e2-93f3-5f29054c88df could not be found. Dec 25 22:05:44.077503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 404 to user: Instance 25dc5da1-66b3-41e2-93f3-5f29054c88df could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:44.078334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a739aa7-ba3c-41f9-a569-18275497cdfc tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 404 len: 111 microversion: 2.1 time: 0.028694 Dec 25 22:05:44.078860 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4238/8507] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:05:44.087252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.087861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.095229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.095665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.096441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.096903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.231770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:44.239211 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5daa0bc2-dce6-4e2d-85b9-7dc9d1ae7133 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.155663 Dec 25 22:05:44.239786 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4270/8508] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:44.255051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19380323-2544-4081-a0ee-5cbccf158f9d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:44.256025 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-19380323-2544-4081-a0ee-5cbccf158f9d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: e5875542-ca66-40e7-9fbd-0ff3aa6082c4] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.261627 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-19380323-2544-4081-a0ee-5cbccf158f9d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] HTTP exception thrown: Instance e5875542-ca66-40e7-9fbd-0ff3aa6082c4 could not be found. Dec 25 22:05:44.262285 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-19380323-2544-4081-a0ee-5cbccf158f9d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 404 to user: Instance e5875542-ca66-40e7-9fbd-0ff3aa6082c4 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:44.263106 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-19380323-2544-4081-a0ee-5cbccf158f9d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "POST /compute/v2.1/servers/e5875542-ca66-40e7-9fbd-0ff3aa6082c4/action" status: 404 len: 111 microversion: 2.1 time: 0.011929 Dec 25 22:05:44.263626 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4239/8509] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:05:44 2021] POST /compute/v2.1/servers/e5875542-ca66-40e7-9fbd-0ff3aa6082c4/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:05:44.271132 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.271749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.278254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.278690 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.279472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.279911 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.411593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:44.419188 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a7c04226-5d10-48f6-a4dd-6cc66e1962d0 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.151729 Dec 25 22:05:44.419852 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4271/8510] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:44.435806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.448005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.448005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.448005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.448005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.448005 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.575299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:44.582795 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eef902b4-b343-4e55-b0db-a4adf728c5eb tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.150842 Dec 25 22:05:44.583350 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4240/8511] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:44.599239 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "58187099-5712-457c-b973-df1dff13a5fb"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:44.600340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.606542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.606995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.607771 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.608212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.635494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:44.641206 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] HTTP exception thrown: Flavor 58187099-5712-457c-b973-df1dff13a5fb could not be found. Dec 25 22:05:44.641800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 400 to user: Flavor 58187099-5712-457c-b973-df1dff13a5fb could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:44.642641 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b3f57147-a5dd-4a47-9583-bef44f83943f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "POST /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814/action" status: 400 len: 107 microversion: 2.1 time: 0.047202 Dec 25 22:05:44.643217 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4272/8512] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:05:44 2021] POST /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814/action => generated 107 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 22:05:44.651191 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.652470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.658599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.659068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.659901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.660356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.793190 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:44.800519 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0d0f80a-0478-4633-a649-ce66a7c4829d tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.153044 Dec 25 22:05:44.801112 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4241/8513] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:44.817403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.818039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.824521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.824995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.825773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.826209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.955875 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:44.963929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c69f1793-3cac-4eb2-8676-17e9fc7699dd tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.149619 Dec 25 22:05:44.963929 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4273/8514] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:44.979669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53a5583c-73e8-4645-aeca-530c60cc97da tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:44.980860 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-53a5583c-73e8-4645-aeca-530c60cc97da tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:44.981728 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-53a5583c-73e8-4645-aeca-530c60cc97da tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "POST /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814/action" status: 400 len: 113 microversion: 2.1 time: 0.006438 Dec 25 22:05:44.982243 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4242/8515] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:05:44 2021] POST /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814/action => generated 113 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Dec 25 22:05:44.989416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:44.990041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:44.996384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.996831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:44.997629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:44.998067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.127019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:45.134326 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c92cbb4f-cced-4cd9-9ec8-ff24ca9e7ee3 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1504 microversion: 2.1 time: 0.148351 Dec 25 22:05:45.134889 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4274/8516] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:44 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:45.153350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:45.153873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:45.162704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.163180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.163983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.164439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.177891 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] HTTP exception thrown: Instance 25dc5da1-66b3-41e2-93f3-5f29054c88df could not be found. Dec 25 22:05:45.178495 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 404 to user: Instance 25dc5da1-66b3-41e2-93f3-5f29054c88df could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:45.179329 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e7bf3cee-a962-41df-9300-3139f4850ef4 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "DELETE /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 404 len: 111 microversion: 2.1 time: 0.029794 Dec 25 22:05:45.179895 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4243/8517] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:05:45 2021] DELETE /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:05:45.188357 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:45.189029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: 25dc5da1-66b3-41e2-93f3-5f29054c88df] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:45.204258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.204258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.204258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.204258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.210453 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] HTTP exception thrown: Instance 25dc5da1-66b3-41e2-93f3-5f29054c88df could not be found. Dec 25 22:05:45.211051 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 404 to user: Instance 25dc5da1-66b3-41e2-93f3-5f29054c88df could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:45.211892 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7fdb9c13-04be-4274-9bda-56f888a970c8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df" status: 404 len: 111 microversion: 2.1 time: 0.027308 Dec 25 22:05:45.212441 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4275/8518] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:45 2021] GET /compute/v2.1/servers/25dc5da1-66b3-41e2-93f3-5f29054c88df => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:05:45.220171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:45.220689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:45.226665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.227138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.227940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.228661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.253964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:05:45.523162 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-443a6f16-8ee1-4509-8d6d-07947ca6ecb8 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 204 len: 0 microversion: 2.1 time: 0.306331 Dec 25 22:05:45.523916 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4244/8519] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:05:45 2021] DELETE /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:05:45.532480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:45.533123 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:45.539280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.544273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.544273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:45.544273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:45.675282 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:45.682719 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1e566c14-faa6-48f7-9953-fdead97f032f tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1510 microversion: 2.1 time: 0.153931 Dec 25 22:05:45.683289 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4276/8520] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:45 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:46.700428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:46.701173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:46.708121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:46.708527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:46.709360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:46.709814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:46.842310 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:46.849734 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8d0e33f8-3fe0-45e5-8aa0-cd600da43607 tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1510 microversion: 2.1 time: 0.153977 Dec 25 22:05:46.850307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4245/8521] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:46 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:47.444604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-22f027e1-69a1-4d97-a169-843810ce4722 req-062b5965-5543-4a1b-a488-5275b4495055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc1db889-b66d-4a02-9181-7d65b8693814", "name": "network-vif-deleted", "tag": "8b9ca74e-5739-42e3-aa27-c4af3c843fa1"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:05:47.446206 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:05:47.446206 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:05:47.453700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-22f027e1-69a1-4d97-a169-843810ce4722 req-062b5965-5543-4a1b-a488-5275b4495055 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:47.454176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-22f027e1-69a1-4d97-a169-843810ce4722 req-062b5965-5543-4a1b-a488-5275b4495055 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:47.465430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-22f027e1-69a1-4d97-a169-843810ce4722 req-062b5965-5543-4a1b-a488-5275b4495055 service nova] Creating event network-vif-deleted:8b9ca74e-5739-42e3-aa27-c4af3c843fa1 for instance cc1db889-b66d-4a02-9181-7d65b8693814 on nch1-master-1 Dec 25 22:05:47.470419 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-22f027e1-69a1-4d97-a169-843810ce4722 req-062b5965-5543-4a1b-a488-5275b4495055 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029452 Dec 25 22:05:47.471017 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4277/8522] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:05:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:05:47.866685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:47.867296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:47.874523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:47.875030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:47.875886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:47.876341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:47.907118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:47.907580 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:47.908041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lazy-loading 'fault' on Instance uuid cc1db889-b66d-4a02-9181-7d65b8693814 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:05:47.947219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'faa994a3fd5b460883d775a94a52783a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dc9c763cc31441a9b4a70ec405bbc23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:05:47.954625 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f19b3609-af21-49a8-9a22-146dabf7415e tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 200 len: 1305 microversion: 2.1 time: 0.091756 Dec 25 22:05:47.955205 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4246/8523] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:47 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:05:48.972640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:05:48.973375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] [instance: cc1db889-b66d-4a02-9181-7d65b8693814] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:05:48.979893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:48.980388 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:48.981198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:05:48.981641 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:05:48.996216 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] HTTP exception thrown: Instance cc1db889-b66d-4a02-9181-7d65b8693814 could not be found. Dec 25 22:05:48.996944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] Returning 404 to user: Instance cc1db889-b66d-4a02-9181-7d65b8693814 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:05:48.997787 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-694ecfd5-73bf-4b3d-adfe-bc5411caea8c tempest-ServersNegativeTestJSON-872895558 tempest-ServersNegativeTestJSON-872895558-project] 10.222.0.32 "GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814" status: 404 len: 111 microversion: 2.1 time: 0.030117 Dec 25 22:05:48.998336 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4278/8524] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:05:48 2021] GET /compute/v2.1/servers/cc1db889-b66d-4a02-9181-7d65b8693814 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:06:40.036215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Action: 'create', calling method: .version_select at 0x7fa4fd5f2d30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1592699862"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:06:40.054584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Getting quotas for project 29cc4c1ab18949cf9fcd5658c1535162. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:06:40.060184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Getting quotas for user 102a4e79336a4125ab08f043bfb262c7 and project 29cc4c1ab18949cf9fcd5658c1535162. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:06:40.073800 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [f642f573-f303-4342-b3fc-1ae94e6cc0eb] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:06:41.080329 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [f642f573-f303-4342-b3fc-1ae94e6cc0eb] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 36794. Dec 25 22:06:41.424587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Getting quotas for project 29cc4c1ab18949cf9fcd5658c1535162. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:06:41.430325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Getting quotas for user 102a4e79336a4125ab08f043bfb262c7 and project 29cc4c1ab18949cf9fcd5658c1535162. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:06:41.445176 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f4ed0be-c9e2-431f-bde3-263cb32e6ec7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 1.412905 Dec 25 22:06:41.445771 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4247/8525] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:06:40 2021] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:41.493949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1432013599", "imageRef": "9a5ba5e2-100d-40dd-b721-2c22c802c264", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1592699862", "networks": [{"uuid": "f9b2697d-85a4-4d8c-97c8-a8a585ef90f1"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:06:41.543135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] validate_networks() for [('f9b2697d-85a4-4d8c-97c8-a8a585ef90f1', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:06:42.391869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:06:42.392296 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:06:42.392782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:06:42.393254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:06:42.394486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:06:42.407747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:42.408229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:42.409087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:42.409527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:42.433275 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Getting quotas for project 29cc4c1ab18949cf9fcd5658c1535162. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:06:42.438617 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Getting quotas for user 102a4e79336a4125ab08f043bfb262c7 and project 29cc4c1ab18949cf9fcd5658c1535162. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:06:42.453531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:06:42.455958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a5ba5e2-100d-40dd-b721-2c22c802c264',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:06:42.566567 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e37cd335-1483-43ad-a0c6-07bb70ada3e0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.076609 Dec 25 22:06:42.567972 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4279/8526] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:06:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:06:42.578537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-12fcb6f2-7889-4848-a383-a6881cd93121 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:42.579875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-12fcb6f2-7889-4848-a383-a6881cd93121 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:42.636497 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-12fcb6f2-7889-4848-a383-a6881cd93121 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:42.645033 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-12fcb6f2-7889-4848-a383-a6881cd93121 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1259 microversion: 2.1 time: 0.070944 Dec 25 22:06:42.645624 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4248/8527] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:42 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:43.664268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:43.664893 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:43.671111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:43.671562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:43.672342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:43.672776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:43.732958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:43.740504 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b14f0e3c-1c0b-48ba-9d16-53c2dc9aafdf tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1263 microversion: 2.1 time: 0.082301 Dec 25 22:06:43.746233 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4280/8528] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:43 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:06:44.757058 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:44.757701 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:44.765170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:44.765727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:44.766552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:44.767010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:44.829358 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:44.836892 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5509f92e-55d1-4fd1-af6b-3f95b872726a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1329 microversion: 2.1 time: 0.083666 Dec 25 22:06:44.837470 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4249/8529] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:44 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1329 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:45.859245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:45.859962 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:45.866792 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:45.867242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:45.868033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:45.868470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:46.014829 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:46.023400 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce513275-754d-432b-ac9c-d32acaafd86d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.168800 Dec 25 22:06:46.024332 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4281/8530] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:45 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:47.042233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:47.042868 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:47.049061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:47.049536 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:47.050350 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:47.050808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:47.209017 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:47.218240 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0fdcc130-5659-4bdd-8648-60c6a7457f32 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.180995 Dec 25 22:06:47.219209 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4250/8531] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:47 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:48.236599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:48.237259 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:48.244789 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:48.245284 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:48.246094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:48.246530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:48.387529 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:48.395708 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-19df7aa6-eefc-450e-b03e-f548a37e41d4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.162843 Dec 25 22:06:48.396516 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4282/8532] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:48 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:49.411641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:49.422508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:49.422508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:49.422508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:49.422508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:49.422508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:49.565980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:49.574179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3836d4bc-9e22-4255-97c7-60f866c2edf3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.165734 Dec 25 22:06:49.574406 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4251/8533] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:49 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:06:50.590654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:50.591261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:50.599090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:50.599556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:50.600359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:50.600799 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:50.744058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:50.752765 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-171875c0-0a0c-47b6-bedf-2ce26b6b35de tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.166050 Dec 25 22:06:50.753440 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4283/8534] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:50 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:51.770151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:51.770825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:51.777997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:51.778478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:51.779423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:51.780373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:51.931786 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:51.940424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d0ceed72-0ae1-4023-9307-f330a8dabd01 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.174019 Dec 25 22:06:51.941454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4252/8535] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:51 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:52.957233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:52.957861 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:52.966080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:52.966541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:52.967860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:52.968303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:53.110414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:53.118134 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7d3de6b-bf84-48fe-bb31-0c43b76806df tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.164622 Dec 25 22:06:53.119386 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4284/8536] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:52 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:54.134977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:54.135716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:54.142550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:54.143013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:54.143797 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:54.144360 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:54.278055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:54.285779 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9dc7151a-1382-4d7d-aca1-4c3a644fb67f tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.154544 Dec 25 22:06:54.286391 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4253/8537] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:54 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:55.304229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:55.304844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:55.316775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:55.317390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:55.318285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:55.318828 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:55.502692 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:55.510032 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e949eeca-e018-4a46-b1cf-0bd084dd210a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.209594 Dec 25 22:06:55.510619 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4285/8538] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:55 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:55.570047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-496b51cd-8ab3-481b-b024-6f1a5ae62da8 req-eec85909-5c21-4543-85f4-c159a666354d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:06:55.577949 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:06:55.577949 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:06:55.579681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-496b51cd-8ab3-481b-b024-6f1a5ae62da8 req-eec85909-5c21-4543-85f4-c159a666354d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:55.580092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-496b51cd-8ab3-481b-b024-6f1a5ae62da8 req-eec85909-5c21-4543-85f4-c159a666354d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:55.591605 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-496b51cd-8ab3-481b-b024-6f1a5ae62da8 req-eec85909-5c21-4543-85f4-c159a666354d service nova] Creating event network-changed:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:06:55.596835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-496b51cd-8ab3-481b-b024-6f1a5ae62da8 req-eec85909-5c21-4543-85f4-c159a666354d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032268 Dec 25 22:06:55.600831 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4254/8539] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:06:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:06:56.526378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:56.526999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:56.534423 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:56.534818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:56.535599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:56.536043 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:56.669902 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:56.677305 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a83862b4-9325-4c5b-b3f8-4ca32605af62 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.154664 Dec 25 22:06:56.677885 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4286/8540] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:56 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:57.696607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:57.697344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:57.704599 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:57.705106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:57.705920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:57.706380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:57.839852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:57.847862 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-66828ef3-d4e8-4894-8ed3-34f624e33cd8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.157042 Dec 25 22:06:57.848436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4255/8541] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:57 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:06:58.864670 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:06:58.865253 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:06:58.871901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:58.872350 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:58.873151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:06:58.873667 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:06:59.005647 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:06:59.013014 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-166e884b-bef4-4b1d-a246-f113c75ac779 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.152132 Dec 25 22:06:59.013588 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4287/8542] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:06:58 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:00.030715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:00.031499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:00.038412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:00.038865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:00.039661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:00.040111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:00.175101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:00.182818 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4d93d1ff-8a83-4b8b-8e26-fe1b1baea436 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.156497 Dec 25 22:07:00.183391 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4256/8543] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:00 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:01.199229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:01.199847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:01.209045 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:01.209504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:01.210289 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:01.210724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:01.344803 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:01.352652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b0bc9f81-84e6-40c2-8cdc-123497b5f3ef tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.157197 Dec 25 22:07:01.353261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4288/8544] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:01 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:02.369149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:02.370512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:02.377365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:02.377838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:02.378643 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:02.379099 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:02.507379 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:02.514709 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3f78995b-439b-4766-8401-d4d0ad579286 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.149412 Dec 25 22:07:02.515281 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4257/8545] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:02 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:02.881563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-f56df22c-fdac-4aea-a7a3-143da6afa30a req-61f7e8c3-0796-4a33-901a-ae190cfcc118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "name": "network-vif-plugged", "status": "completed", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:07:02.883567 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:07:02.883567 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:07:02.891425 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f56df22c-fdac-4aea-a7a3-143da6afa30a req-61f7e8c3-0796-4a33-901a-ae190cfcc118 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:02.891877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-f56df22c-fdac-4aea-a7a3-143da6afa30a req-61f7e8c3-0796-4a33-901a-ae190cfcc118 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:02.903123 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-f56df22c-fdac-4aea-a7a3-143da6afa30a req-61f7e8c3-0796-4a33-901a-ae190cfcc118 service nova] Creating event network-vif-plugged:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:07:02.909258 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-f56df22c-fdac-4aea-a7a3-143da6afa30a req-61f7e8c3-0796-4a33-901a-ae190cfcc118 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031522 Dec 25 22:07:02.909849 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4289/8546] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:07:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:07:03.531843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:03.532427 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:03.541529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:03.541995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:03.542800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:03.543253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:03.678808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:03.686257 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f50db34-092b-46e3-8795-439bd09e9a77 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1359 microversion: 2.1 time: 0.158790 Dec 25 22:07:03.686875 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4258/8547] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:03 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:04.703463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:04.704190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:04.711435 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:04.711886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:04.712665 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:04.713197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:04.847538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:04.855309 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-734b8761-d831-4ec1-aaed-d2ff714662bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1549 microversion: 2.1 time: 0.155935 Dec 25 22:07:04.855883 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4290/8548] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:04 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:04.871704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:04.872325 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:04.879169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:04.879633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:04.880421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:04.880864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:05.013521 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:05.020828 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b05c9d30-d690-4517-8072-9c4a49400d07 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1549 microversion: 2.1 time: 0.152883 Dec 25 22:07:05.021427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4259/8549] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:04 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:05.036608 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:05.039912 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:servers:allow_all_filters": "rule:system_reader_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:07:05.039912 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:07:05.040960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:05.045476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Searching by: {'deleted': False, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162'} {{(pid=136548) get_all /opt/stack/nova/nova/compute/api.py:2907}} Dec 25 22:07:05.047086 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:05.047541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:05.048971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:05.049419 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:05.073245 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.multi_cell_list [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=136548) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Dec 25 22:07:05.099819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f96eaca5-1655-4806-a234-712e721853bd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.067404 Dec 25 22:07:05.102974 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4291/8550] 10.222.0.32 () {58 vars in 1124 bytes} [Sat Dec 25 22:07:05 2021] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:07:05.111282 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:05.111910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:05.117922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:05.118408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:05.119275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:05.119724 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:05.248705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:05.256295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3656e624-9351-482f-9b6e-ee6680805006 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1549 microversion: 2.1 time: 0.149388 Dec 25 22:07:05.256904 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4260/8551] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:05 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:07.057302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0773704-6d3d-4e7e-b90d-d5f66c21bc65"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:07:07.058365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:07.065614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:07.066065 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:07.070018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:07.070018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:07.799729 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3e1cf7b9-8422-4207-9d5b-9ddd05020188 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746040 Dec 25 22:07:07.800376 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4292/8552] 10.222.0.32 () {60 vars in 1322 bytes} [Sat Dec 25 22:07:07 2021] POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:07:11.097525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:11.098105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:11.105263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:11.105737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:11.106542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:11.107000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:11.234019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:11.242390 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65414513-6014-436f-9358-9e73dc97f608 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1595 microversion: 2.1 time: 0.148705 Dec 25 22:07:11.242978 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4261/8553] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:11 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1595 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:13.200940 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b6b4c82c-6fa0-495b-8135-6dd70f291cc4 req-458be4f8-c595-4bb3-a2aa-25428e78c453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:07:13.202804 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:07:13.202804 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:07:13.211111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b6b4c82c-6fa0-495b-8135-6dd70f291cc4 req-458be4f8-c595-4bb3-a2aa-25428e78c453 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:13.211569 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b6b4c82c-6fa0-495b-8135-6dd70f291cc4 req-458be4f8-c595-4bb3-a2aa-25428e78c453 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:13.223868 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b6b4c82c-6fa0-495b-8135-6dd70f291cc4 req-458be4f8-c595-4bb3-a2aa-25428e78c453 service nova] Creating event network-changed:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:07:13.229278 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b6b4c82c-6fa0-495b-8135-6dd70f291cc4 req-458be4f8-c595-4bb3-a2aa-25428e78c453 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032326 Dec 25 22:07:13.231180 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4293/8554] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:07:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:07:15.543115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1648298683"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:07:15.543672 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:15.549810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:15.550284 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:15.551086 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:15.551547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:15.680013 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Adding security group 08e158aa-c909-4848-a6a6-afab5fc8093d to port 3cb0686b-4a27-45cd-bbb6-b82943cca23a Dec 25 22:07:16.081276 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cb0c2bdb-7d28-4a12-b28d-a7bfd14395dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/action" status: 202 len: 0 microversion: 2.1 time: 0.542037 Dec 25 22:07:16.082454 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4262/8555] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:07:15 2021] POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:07:16.092903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:16.097746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:16.104104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fe15fb4f-140e-4b4f-b6c2-0f1ff94957bb req-ad234075-195b-4214-b8bb-e7e11dec19fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:07:16.105855 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:07:16.105855 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:07:16.112747 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:16.113316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:16.114323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:16.115156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:16.124453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fe15fb4f-140e-4b4f-b6c2-0f1ff94957bb req-ad234075-195b-4214-b8bb-e7e11dec19fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:16.130137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fe15fb4f-140e-4b4f-b6c2-0f1ff94957bb req-ad234075-195b-4214-b8bb-e7e11dec19fe service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:16.147735 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fe15fb4f-140e-4b4f-b6c2-0f1ff94957bb req-ad234075-195b-4214-b8bb-e7e11dec19fe service nova] Creating event network-changed:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:07:16.154785 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fe15fb4f-140e-4b4f-b6c2-0f1ff94957bb req-ad234075-195b-4214-b8bb-e7e11dec19fe service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060265 Dec 25 22:07:16.156121 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4263/8556] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:07:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:07:16.390927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:16.400458 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-22f45e42-6cbd-4e79-8d92-f551bfc6bd83 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1761 microversion: 2.1 time: 0.312490 Dec 25 22:07:16.404820 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4294/8557] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:16 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1761 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:39.024398 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:07:39.025463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:39.031740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:39.032215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:39.033051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:39.033512 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:39.221835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51910e54-b34f-4de2-803f-4996fd7737e7 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/action" status: 202 len: 0 microversion: 2.1 time: 0.202276 Dec 25 22:07:39.226141 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4264/8558] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:07:39 2021] POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:07:39.231136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:39.231759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:39.240382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:39.240835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:39.241662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:39.242100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:39.458072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:39.458072 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-58ed5c8e-c8e5-4ebc-9c18-d8aad55b8316 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1753 microversion: 2.1 time: 0.229709 Dec 25 22:07:39.458072 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4295/8559] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:39 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1753 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:07:40.476172 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:40.476900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:40.483095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:40.483555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:40.484384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:40.484826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:40.630430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:40.638495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e19a0d78-5e71-40a2-aeb1-897c355585dd tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.167479 Dec 25 22:07:40.639094 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4265/8560] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:40 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:41.655499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:41.656145 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:41.663136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:41.663588 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:41.664381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:41.664819 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:41.815949 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:41.823794 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f8e74909-d132-46d7-af7c-0e23439673a2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.172121 Dec 25 22:07:41.824364 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4296/8561] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:41 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:07:42.841029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:42.841577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:42.849367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:42.850092 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:42.850892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:42.851499 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:42.997369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:43.005867 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40fb8dac-f300-413b-a66e-ddc8aa3ec134 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.168793 Dec 25 22:07:43.006434 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4266/8562] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:42 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:44.022163 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:44.023013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:44.030254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:44.030742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:44.031541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:44.032492 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:44.175817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:44.183761 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0084fc2e-17a7-4c3e-b8ed-0ab3643a9b15 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.165476 Dec 25 22:07:44.184334 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4297/8563] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:44 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:45.200801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:45.201445 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:45.207957 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:45.208422 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:45.209261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:45.209716 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:45.432983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:45.441410 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd03cd1d-3d1d-429d-870a-65ffd57b2f54 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.244703 Dec 25 22:07:45.442067 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4267/8564] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:45 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:46.458008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:46.458630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:46.464914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:46.465377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:46.466190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:46.466642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:46.610062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:46.618469 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d6c1849d-ef33-4979-bce0-bb4530d1d866 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.164726 Dec 25 22:07:46.621592 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4298/8565] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:46 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:47.635463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:47.636149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:47.643667 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:47.644139 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:47.644959 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:47.645415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:47.789896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:47.797732 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54075b8b-a10f-4b10-b8bb-9dee88746ef8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.166104 Dec 25 22:07:47.798307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4268/8566] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:47 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:48.815339 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:48.815881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:48.822740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:48.823197 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:48.823980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:48.824424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:48.973578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:48.981813 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b264583b-2af1-44b8-81ee-601ba4c471d3 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.171077 Dec 25 22:07:48.982414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4299/8567] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:48 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:49.999195 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:49.999832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:50.006671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:50.007141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:50.007944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:50.008401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:50.155055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:50.163617 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3e4776d8-4797-44f5-a8c8-b0b4755624b8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.168193 Dec 25 22:07:50.164184 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4269/8568] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:49 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:51.180479 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:51.181136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:51.188532 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:51.189029 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:51.189814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:51.190256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:51.335991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:51.343970 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-644ed241-95e9-4fb9-ac1e-f19f65109ed4 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.167504 Dec 25 22:07:51.345096 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4300/8569] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:51 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:52.361981 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:52.362612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:52.369441 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:52.369908 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:52.370712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:52.371170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:52.514225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:52.522107 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-29313049-ea4e-4315-8a78-6887486815a1 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.164361 Dec 25 22:07:52.522672 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4270/8570] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:52 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:53.538786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:53.539426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:53.546094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:53.546540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:53.547313 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:53.547748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:53.693540 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:53.701579 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-250351cf-c367-4eae-9f59-7cd1775e4ab0 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.166503 Dec 25 22:07:53.702187 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4301/8571] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:53 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:54.719966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:54.720605 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:54.727766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:54.728245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:54.729088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:54.729553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:54.874615 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:54.883456 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6c93bb63-5420-410f-a2b6-dbd8a81a01f8 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1758 microversion: 2.1 time: 0.167834 Dec 25 22:07:54.889744 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4271/8572] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:54 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:07:55.902584 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:07:55.903205 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:07:55.909889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:55.910744 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:55.911151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:07:55.911924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:07:56.064973 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:07:56.072867 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cc26e8f5-6e8f-433c-a1bd-91108eb96318 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1761 microversion: 2.1 time: 0.174193 Dec 25 22:07:56.073462 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4302/8573] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:07:55 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1761 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:08:27.665096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1648298683"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:08:27.665758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:27.671891 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:27.672367 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:27.673200 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:27.673665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:27.808266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.network.security_group_api [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Removing security group 08e158aa-c909-4848-a6a6-afab5fc8093d from port 3cb0686b-4a27-45cd-bbb6-b82943cca23a Dec 25 22:08:28.189780 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-703de2d9-a27d-4085-96d0-57027a12926a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/action" status: 202 len: 0 microversion: 2.1 time: 0.527203 Dec 25 22:08:28.191334 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4272/8574] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:08:27 2021] POST /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:08:28.200036 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a16c5caa-b56f-4c86-9781-a664f443bc9a req-fc5d1ff8-3efb-4cc8-bf9c-e904e3f2c17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:08:28.201915 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:08:28.201915 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:08:28.212372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a16c5caa-b56f-4c86-9781-a664f443bc9a req-fc5d1ff8-3efb-4cc8-bf9c-e904e3f2c17c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:28.213286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a16c5caa-b56f-4c86-9781-a664f443bc9a req-fc5d1ff8-3efb-4cc8-bf9c-e904e3f2c17c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:28.242719 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a16c5caa-b56f-4c86-9781-a664f443bc9a req-fc5d1ff8-3efb-4cc8-bf9c-e904e3f2c17c service nova] Creating event network-changed:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:08:28.251836 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a16c5caa-b56f-4c86-9781-a664f443bc9a req-fc5d1ff8-3efb-4cc8-bf9c-e904e3f2c17c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055781 Dec 25 22:08:28.253607 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4303/8575] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:08:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:08:29.631110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:29.631695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:29.637835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:29.638306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:29.639111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:29.639569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:29.721100 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lazy-loading 'services' on Instance uuid ce181d20-ef0f-41d9-acff-2b30bbd9f57b {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:08:29.896020 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d5e1e38a-8b86-4262-ab0d-9bd329c5bc8e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments/f0773704-6d3d-4e7e-b90d-d5f66c21bc65" status: 202 len: 0 microversion: 2.1 time: 0.269767 Dec 25 22:08:29.897018 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4273/8576] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 22:08:29 2021] DELETE /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments/f0773704-6d3d-4e7e-b90d-d5f66c21bc65 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:08:29.907412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:29.908707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:29.916974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:29.917430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:29.918447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:29.918921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:29.953048 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9573d5c2-9b71-43e6-ac50-3de1d111f753 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Dec 25 22:08:29.953631 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4304/8577] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 22:08:29 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:08:30.271237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-d569f235-9392-4269-98c5-374e2031f8e3 req-cb502b8a-8462-429b-8fc3-52db74879e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:08:30.273201 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:08:30.273201 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:08:30.280280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d569f235-9392-4269-98c5-374e2031f8e3 req-cb502b8a-8462-429b-8fc3-52db74879e2b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:30.280737 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-d569f235-9392-4269-98c5-374e2031f8e3 req-cb502b8a-8462-429b-8fc3-52db74879e2b service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:30.292203 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-d569f235-9392-4269-98c5-374e2031f8e3 req-cb502b8a-8462-429b-8fc3-52db74879e2b service nova] Creating event network-changed:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:08:30.297144 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-d569f235-9392-4269-98c5-374e2031f8e3 req-cb502b8a-8462-429b-8fc3-52db74879e2b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029992 Dec 25 22:08:30.298398 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4274/8578] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:08:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:08:30.964944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:30.965869 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:30.973063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:30.973847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:30.974654 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:30.975096 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:31.004619 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8af2943-37d4-4397-9aca-7e9cda94beb5 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043517 Dec 25 22:08:31.005524 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4305/8579] 10.222.0.32 () {58 vars in 1301 bytes} [Sat Dec 25 22:08:30 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Dec 25 22:08:31.018101 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:31.018622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:31.025073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:31.025576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:31.026380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:31.026830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:31.098415 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] HTTP exception thrown: Instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b is not attached to volume f0773704-6d3d-4e7e-b90d-d5f66c21bc65 Dec 25 22:08:31.099042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Returning 404 to user: Instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b is not attached to volume f0773704-6d3d-4e7e-b90d-d5f66c21bc65 {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:08:31.099919 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40ecfe5d-82f8-413c-ad42-be788672a1b2 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments/f0773704-6d3d-4e7e-b90d-d5f66c21bc65" status: 404 len: 154 microversion: 2.1 time: 0.088125 Dec 25 22:08:31.100509 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4275/8580] 10.222.0.32 () {58 vars in 1415 bytes} [Sat Dec 25 22:08:31 2021] DELETE /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b/os-volume_attachments/f0773704-6d3d-4e7e-b90d-d5f66c21bc65 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:08:35.510845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:35.511390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:35.518068 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:35.518520 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:35.519299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:35.519741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:35.546755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:08:35.889237 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e46fcf43-fc19-4a1f-b262-8fd0314a7a98 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "DELETE /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 204 len: 0 microversion: 2.1 time: 0.381637 Dec 25 22:08:35.889766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4306/8581] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:08:35 2021] DELETE /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:08:35.898291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:35.898958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:35.906545 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:35.909036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:35.909036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:35.909036 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:36.041922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:08:36.049457 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e1a9c90-09c0-45c0-bb48-3f31380b118e tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1555 microversion: 2.1 time: 0.154833 Dec 25 22:08:36.050015 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4276/8582] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:08:35 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:08:37.067722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:37.068310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:37.075175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:37.075628 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:37.076413 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:37.076849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:37.211880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:08:37.219387 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b3d8d04b-a79a-4558-95a6-fe068dba4039 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1555 microversion: 2.1 time: 0.156606 Dec 25 22:08:37.219968 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4307/8583] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:08:37 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:08:38.045484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3bdae689-fe97-43d7-b24b-44fe30597162 req-4daba610-84e6-4c4a-9e92-641ebbf10a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce181d20-ef0f-41d9-acff-2b30bbd9f57b", "name": "network-vif-deleted", "tag": "3cb0686b-4a27-45cd-bbb6-b82943cca23a"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:08:38.047019 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:08:38.047019 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:08:38.055317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3bdae689-fe97-43d7-b24b-44fe30597162 req-4daba610-84e6-4c4a-9e92-641ebbf10a0d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:38.056019 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3bdae689-fe97-43d7-b24b-44fe30597162 req-4daba610-84e6-4c4a-9e92-641ebbf10a0d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:38.066711 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3bdae689-fe97-43d7-b24b-44fe30597162 req-4daba610-84e6-4c4a-9e92-641ebbf10a0d service nova] Creating event network-vif-deleted:3cb0686b-4a27-45cd-bbb6-b82943cca23a for instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b on nch1-master-1 Dec 25 22:08:38.071570 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3bdae689-fe97-43d7-b24b-44fe30597162 req-4daba610-84e6-4c4a-9e92-641ebbf10a0d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029836 Dec 25 22:08:38.072149 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4277/8584] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:08:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:08:38.236565 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:38.237220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:38.244025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:38.244485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:38.245304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:38.245753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:38.309287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '102a4e79336a4125ab08f043bfb262c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29cc4c1ab18949cf9fcd5658c1535162', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:08:38.319537 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9427b8cd-7f4a-4d30-862e-cf87743c709d tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 200 len: 1344 microversion: 2.1 time: 0.086519 Dec 25 22:08:38.320823 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4308/8585] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:08:38 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 1344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:08:39.338297 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:39.339008 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] [instance: ce181d20-ef0f-41d9-acff-2b30bbd9f57b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:08:39.346322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:39.346826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:39.347632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:08:39.348375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:08:39.362405 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] HTTP exception thrown: Instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b could not be found. Dec 25 22:08:39.363010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Returning 404 to user: Instance ce181d20-ef0f-41d9-acff-2b30bbd9f57b could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:08:39.363887 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eb95295b-161e-4a10-ab55-74de13a8de1a tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b" status: 404 len: 111 microversion: 2.1 time: 0.030480 Dec 25 22:08:39.364418 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4278/8586] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:08:39 2021] GET /compute/v2.1/servers/ce181d20-ef0f-41d9-acff-2b30bbd9f57b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:08:39.372373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d5947b3f-9ab8-42df-bfbb-2bcc40623430 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] Calling method '.version_select at 0x7fa50076cd30>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:08:39.480003 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d5947b3f-9ab8-42df-bfbb-2bcc40623430 tempest-TestMinimumBasicScenario-655218334 tempest-TestMinimumBasicScenario-655218334-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1592699862" status: 202 len: 0 microversion: 2.1 time: 0.111286 Dec 25 22:08:39.480589 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4309/8587] 10.222.0.32 () {58 vars in 1271 bytes} [Sat Dec 25 22:08:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1592699862 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:08:51.873669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-54d39bde-09ea-418c-bcce-54cb787a0fde tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: .version_select at 0x7fa4f739e940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-368216788"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:08:51.887930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-54d39bde-09ea-418c-bcce-54cb787a0fde tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:08:51.892985 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-54d39bde-09ea-418c-bcce-54cb787a0fde tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:08:52.231473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-54d39bde-09ea-418c-bcce-54cb787a0fde tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:08:52.236419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-54d39bde-09ea-418c-bcce-54cb787a0fde tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:08:52.251049 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-54d39bde-09ea-418c-bcce-54cb787a0fde tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.533444 Dec 25 22:08:52.251658 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4279/8588] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:08:51 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:00.731511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1636700167", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "a0debcfd-9c5f-4b58-9aa9-73c10d408ae4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-368216788", "security_groups": [{"name": "tempest-secgroup-smoke-251896071"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:00.859354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] validate_networks() for [('a0debcfd-9c5f-4b58-9aa9-73c10d408ae4', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:09:01.282154 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:09:01.282580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:09:01.283345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:09:01.283758 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:09:01.284171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:09:01.293568 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:01.294018 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:01.294831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:01.295266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:01.313506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:09:01.319599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:09:01.332118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:09:01.341476 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:09:01.508125 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4276e3ba-70c7-43e6-83a6-dc7a045b16df tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780507 Dec 25 22:09:01.508789 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4310/8589] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:09:00 2021] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:09:01.520637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad9d3ec0-a34f-4029-ac97-1c311a0b695f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:01.521886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad9d3ec0-a34f-4029-ac97-1c311a0b695f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:01.591171 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad9d3ec0-a34f-4029-ac97-1c311a0b695f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:01.601021 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad9d3ec0-a34f-4029-ac97-1c311a0b695f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1266 microversion: 2.1 time: 0.084589 Dec 25 22:09:01.601021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4280/8590] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:01 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:02.616539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6dcb359b-4435-42a3-9a27-94a580d1b1f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:02.618156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6dcb359b-4435-42a3-9a27-94a580d1b1f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:02.694741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6dcb359b-4435-42a3-9a27-94a580d1b1f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:02.703348 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6dcb359b-4435-42a3-9a27-94a580d1b1f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1266 microversion: 2.1 time: 0.091553 Dec 25 22:09:02.704433 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4311/8591] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:02 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:03.720010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:03.720648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:03.728168 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:03.728682 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:03.729494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:03.729946 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:03.796665 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:03.804367 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-430a56f5-82f4-4218-bc4b-f66ed62b3c57 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1318 microversion: 2.1 time: 0.088124 Dec 25 22:09:03.804947 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4281/8592] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:03 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1318 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:04.821322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:04.829120 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:04.830650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:04.831297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:04.832303 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:04.832754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:05.087997 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:05.095514 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-70a0c3f3-69c9-4268-a6e1-fc44ca615835 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.277937 Dec 25 22:09:05.096172 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4312/8593] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:04 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:05.649104 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-10583118-39a1-41d4-8cb4-b456878de2a2 req-3fb99107-81de-4f25-b980-dcd24f18eaa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706fa658-4bc5-464f-881a-6bd1f12dd58b", "tag": "f03d06c4-87a8-4260-a49e-66327fd89042"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:05.650854 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:09:05.650854 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:09:05.660438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-10583118-39a1-41d4-8cb4-b456878de2a2 req-3fb99107-81de-4f25-b980-dcd24f18eaa5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:05.661116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-10583118-39a1-41d4-8cb4-b456878de2a2 req-3fb99107-81de-4f25-b980-dcd24f18eaa5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:05.674138 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-10583118-39a1-41d4-8cb4-b456878de2a2 req-3fb99107-81de-4f25-b980-dcd24f18eaa5 service nova] Creating event network-changed:f03d06c4-87a8-4260-a49e-66327fd89042 for instance 706fa658-4bc5-464f-881a-6bd1f12dd58b on nch1-master-1 Dec 25 22:09:05.679210 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-10583118-39a1-41d4-8cb4-b456878de2a2 req-3fb99107-81de-4f25-b980-dcd24f18eaa5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035113 Dec 25 22:09:05.680312 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4282/8594] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:09:06.115449 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:06.116097 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:06.122781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:06.123238 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:06.124024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:06.124468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:06.330501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:06.338107 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-033dd761-a33e-4fa8-84f4-580e6ffb2b16 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.227041 Dec 25 22:09:06.338716 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4313/8595] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:06 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:07.355299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:07.356046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:07.363498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:07.363966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:07.364763 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:07.365242 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:07.499557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:07.507565 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bfe5263e-dbc0-4ca6-b6ef-7b9d48cccbfa tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.156307 Dec 25 22:09:07.508154 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4283/8596] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:07 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:08.524448 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:08.525106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:08.531847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:08.532309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:08.533134 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:08.533578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:08.670994 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:08.679144 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-55c85125-1355-42d2-b7b5-d4e50ebba2d6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.158490 Dec 25 22:09:08.679717 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4314/8597] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:08 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:09.695393 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:09.696134 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:09.702910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:09.703373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:09.704178 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:09.704627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:09.838578 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:09.845907 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b85be05a-59e5-4d07-b07f-b2e7a5b7319e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.154251 Dec 25 22:09:09.846484 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4284/8598] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:09 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:10.862700 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:10.863842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:10.870634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:10.871092 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:10.871886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:10.872328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:11.005310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:11.012689 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e152b7db-1795-49ea-bbb4-cfd26db0033b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.153765 Dec 25 22:09:11.013298 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4315/8599] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:10 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:09:11.465856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-dc3f611c-f9c8-47db-804f-8b00702e5a3d req-964561dc-e3e9-4a54-9f6c-25cda8a4fd78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706fa658-4bc5-464f-881a-6bd1f12dd58b", "name": "network-vif-plugged", "status": "completed", "tag": "f03d06c4-87a8-4260-a49e-66327fd89042"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:11.467337 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:09:11.467337 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:09:11.476233 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dc3f611c-f9c8-47db-804f-8b00702e5a3d req-964561dc-e3e9-4a54-9f6c-25cda8a4fd78 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:11.476687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-dc3f611c-f9c8-47db-804f-8b00702e5a3d req-964561dc-e3e9-4a54-9f6c-25cda8a4fd78 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:11.488381 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-dc3f611c-f9c8-47db-804f-8b00702e5a3d req-964561dc-e3e9-4a54-9f6c-25cda8a4fd78 service nova] Creating event network-vif-plugged:f03d06c4-87a8-4260-a49e-66327fd89042 for instance 706fa658-4bc5-464f-881a-6bd1f12dd58b on nch1-master-1 Dec 25 22:09:11.493492 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-dc3f611c-f9c8-47db-804f-8b00702e5a3d req-964561dc-e3e9-4a54-9f6c-25cda8a4fd78 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031478 Dec 25 22:09:11.494139 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4285/8600] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:09:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:09:12.029715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:12.030335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:12.037138 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:12.037600 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:12.038384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:12.038826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:12.170436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:12.178637 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4ae16604-890a-4f24-90d3-6f732ca65a1c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1391 microversion: 2.1 time: 0.152653 Dec 25 22:09:12.179213 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4316/8601] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:12 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:13.196846 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:13.197579 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:13.204830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:13.205338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:13.206138 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:13.207173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:13.347471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:13.354879 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ffe15077-278a-4583-bc5b-a746f23bd532 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1562 microversion: 2.1 time: 0.162903 Dec 25 22:09:13.355462 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4286/8602] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:13 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:13.370917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:13.371524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:13.378954 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:13.379418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:13.380207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:13.380652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:13.511972 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:13.519360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ba1e213-14d1-4d47-8035-f7d76eb2f47e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1562 microversion: 2.1 time: 0.152267 Dec 25 22:09:13.519938 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4317/8603] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:13 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1562 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:15.384551 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:15.385215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:15.386691 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7883b036-131b-414d-b065-199a335a2b62 req-6fbcd67b-b8be-415e-8ae9-403b1fb26ef7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706fa658-4bc5-464f-881a-6bd1f12dd58b", "tag": "f03d06c4-87a8-4260-a49e-66327fd89042"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:15.388306 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:09:15.388306 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:09:15.391751 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:15.392461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:15.393531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:15.394030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:15.396558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7883b036-131b-414d-b065-199a335a2b62 req-6fbcd67b-b8be-415e-8ae9-403b1fb26ef7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:15.397039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7883b036-131b-414d-b065-199a335a2b62 req-6fbcd67b-b8be-415e-8ae9-403b1fb26ef7 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:15.408612 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7883b036-131b-414d-b065-199a335a2b62 req-6fbcd67b-b8be-415e-8ae9-403b1fb26ef7 service nova] Creating event network-changed:f03d06c4-87a8-4260-a49e-66327fd89042 for instance 706fa658-4bc5-464f-881a-6bd1f12dd58b on nch1-master-1 Dec 25 22:09:15.414819 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7883b036-131b-414d-b065-199a335a2b62 req-6fbcd67b-b8be-415e-8ae9-403b1fb26ef7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031673 Dec 25 22:09:15.415763 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4318/8604] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:09:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:09:15.591617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:15.600354 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c9541e09-16a4-4424-b9a5-584ea4f5c377 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1562 microversion: 2.1 time: 0.220073 Dec 25 22:09:15.600950 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4287/8605] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:15 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1562 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:37.294472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:37.295527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:37.301862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:37.306655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:37.306655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:37.306655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:37.354310 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86b94ce4-932f-4a4c-8c89-295c2de05dea tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action" status: 200 len: 24568 microversion: 2.1 time: 0.064862 Dec 25 22:09:37.355189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4319/8606] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:09:37 2021] POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action => generated 24568 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Dec 25 22:09:48.447746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:48.448348 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:48.454557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:48.455024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:48.455841 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:48.456291 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:48.682365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8b5dc749-4651-47ce-ad39-1dfcba23537b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action" status: 202 len: 0 microversion: 2.1 time: 0.238357 Dec 25 22:09:48.683127 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4288/8607] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:09:48 2021] POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:09:48.691734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:48.692465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:48.700232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:48.700627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:48.701481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:48.701922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:48.845821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:48.853494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-30f9aa0d-4e72-4283-8085-76757b7a184e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1686 microversion: 2.1 time: 0.165875 Dec 25 22:09:48.854069 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4320/8608] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:48 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:49.872071 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:49.872811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:49.879228 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:49.879688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:49.880519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:49.880999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:50.016349 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:50.023771 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-65c7cf5e-62e3-4499-a66e-38b8a084158c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1666 microversion: 2.1 time: 0.156663 Dec 25 22:09:50.024340 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4289/8609] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:49 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1666 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:51.112417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:51.113383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:51.121651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:51.122107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:51.122894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:51.123336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:51.171068 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3a4f1555-5806-4929-98e0-16dc916f0fa9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action" status: 200 len: 32639 microversion: 2.1 time: 0.062340 Dec 25 22:09:51.171698 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4321/8610] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:09:51 2021] POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action => generated 32639 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:09:51.182904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:51.183449 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:51.190201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:51.190664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:51.191456 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:51.191906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:51.381770 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e64f40ee-399a-4751-b80e-36e526eea20b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action" status: 202 len: 0 microversion: 2.1 time: 0.203010 Dec 25 22:09:51.383100 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4290/8611] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:09:51 2021] POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:09:51.391117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:51.391814 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:51.398805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:51.399285 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:51.400580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:51.401050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:51.541361 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:51.549056 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-374724aa-5207-4fdd-b31d-6ec6157b3562 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1673 microversion: 2.1 time: 0.162165 Dec 25 22:09:51.549869 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4322/8612] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:51 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:52.569588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:52.570301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:52.577185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:52.577647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:52.578448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:52.578900 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:52.715222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:52.721804 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f6fdd005-217b-4298-bc6e-81bc692813f1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1673 microversion: 2.1 time: 0.156876 Dec 25 22:09:52.722366 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4291/8613] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:52 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:53.738806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:53.739434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:53.746986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:53.747443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:53.748266 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:53.748709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:53.878387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:53.886463 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0e95e320-7d33-4a5c-9484-66f1136f8713 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1673 microversion: 2.1 time: 0.150905 Dec 25 22:09:53.887048 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4323/8614] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:53 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:54.903695 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:54.904257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:54.911024 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:54.911487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:54.912277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:54.912728 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:55.049446 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:55.058967 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2543fbf2-ccf7-447d-9441-b006a0d81978 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1673 microversion: 2.1 time: 0.159662 Dec 25 22:09:55.059557 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4292/8615] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:54 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:56.075982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:56.076594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:56.083330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:56.083777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:56.084551 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:56.085011 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:56.216616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:56.224253 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-94c75396-42bb-4c5c-b421-6c5346ee62cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1673 microversion: 2.1 time: 0.152102 Dec 25 22:09:56.224828 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4324/8616] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:56 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:09:57.240856 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:57.241508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:57.248832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:57.249323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:57.250113 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:57.250559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:57.384710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:57.392069 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ded23852-22bc-402f-828e-b9b04e649c3f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1681 microversion: 2.1 time: 0.154985 Dec 25 22:09:57.392633 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4293/8617] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:57 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:09:57.486057 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:57.487002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:57.493877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:57.494280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:57.495079 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:57.495525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:57.544501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-01661420-99c0-4caf-95ba-0610b5d260e9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action" status: 200 len: 38430 microversion: 2.1 time: 0.062087 Dec 25 22:09:57.545192 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4325/8618] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:09:57 2021] POST /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b/action => generated 38430 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:09:58.582177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:58.583896 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:58.590983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:58.591459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:58.592414 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:58.592907 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:58.622209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:09:58.735709 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3684025c-5f03-4987-8166-8834e756a5d5 req-cbff3d19-54fc-48ea-8915-51e0d57b6222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "706fa658-4bc5-464f-881a-6bd1f12dd58b", "tag": "f03d06c4-87a8-4260-a49e-66327fd89042"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:09:58.738797 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:09:58.738797 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:09:58.747020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3684025c-5f03-4987-8166-8834e756a5d5 req-cbff3d19-54fc-48ea-8915-51e0d57b6222 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:58.747467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3684025c-5f03-4987-8166-8834e756a5d5 req-cbff3d19-54fc-48ea-8915-51e0d57b6222 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:58.759294 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3684025c-5f03-4987-8166-8834e756a5d5 req-cbff3d19-54fc-48ea-8915-51e0d57b6222 service nova] Creating event network-changed:f03d06c4-87a8-4260-a49e-66327fd89042 for instance 706fa658-4bc5-464f-881a-6bd1f12dd58b on nch1-master-1 Dec 25 22:09:58.764384 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3684025c-5f03-4987-8166-8834e756a5d5 req-cbff3d19-54fc-48ea-8915-51e0d57b6222 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110073 Dec 25 22:09:58.765057 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4326/8619] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:09:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:09:58.887496 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2b0d3b73-32cc-4058-bd50-1d18fec063da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 204 len: 0 microversion: 2.1 time: 0.308985 Dec 25 22:09:58.888539 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4294/8620] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:09:58 2021] DELETE /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:09:58.897462 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:09:58.898164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:09:58.905069 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:58.905521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:58.906311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:09:58.906754 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:09:59.143277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:09:59.151269 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b321e979-59f3-487e-be23-268d3a5cc2e7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1687 microversion: 2.1 time: 0.258255 Dec 25 22:09:59.152967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4327/8621] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:09:58 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1687 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:00.170583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:00.171302 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:00.178055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:00.178527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:00.179323 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:00.179777 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:00.321226 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:00.328838 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-03921320-628e-42d5-86c6-aba6a05a884d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1568 microversion: 2.1 time: 0.162828 Dec 25 22:10:00.329659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4295/8622] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:00 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:00.980114 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-79dda879-8649-4df1-98fb-72c40d6721fe req-b9c077d9-50f3-4a47-9438-2398bbe597f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "706fa658-4bc5-464f-881a-6bd1f12dd58b", "name": "network-vif-deleted", "tag": "f03d06c4-87a8-4260-a49e-66327fd89042"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:00.981743 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:10:00.981743 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:10:00.989494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-79dda879-8649-4df1-98fb-72c40d6721fe req-b9c077d9-50f3-4a47-9438-2398bbe597f0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:00.994687 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-79dda879-8649-4df1-98fb-72c40d6721fe req-b9c077d9-50f3-4a47-9438-2398bbe597f0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:01.002020 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-79dda879-8649-4df1-98fb-72c40d6721fe req-b9c077d9-50f3-4a47-9438-2398bbe597f0 service nova] Creating event network-vif-deleted:f03d06c4-87a8-4260-a49e-66327fd89042 for instance 706fa658-4bc5-464f-881a-6bd1f12dd58b on nch1-master-1 Dec 25 22:10:01.006834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-79dda879-8649-4df1-98fb-72c40d6721fe req-b9c077d9-50f3-4a47-9438-2398bbe597f0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030411 Dec 25 22:10:01.007419 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4328/8623] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:10:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:10:01.349869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:01.350553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:01.358179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:01.358845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:01.359666 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:01.360116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:01.393648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:01.394116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:01.394594 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lazy-loading 'fault' on Instance uuid 706fa658-4bc5-464f-881a-6bd1f12dd58b {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:10:01.434792 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:01.443029 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5671538c-f8eb-472f-abfd-c93587128a86 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 200 len: 1356 microversion: 2.1 time: 0.097033 Dec 25 22:10:01.443909 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4296/8624] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:01 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:02.461629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:02.462325 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 706fa658-4bc5-464f-881a-6bd1f12dd58b] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:02.469574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:02.470616 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:02.470826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:02.471517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:02.484605 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] HTTP exception thrown: Instance 706fa658-4bc5-464f-881a-6bd1f12dd58b could not be found. Dec 25 22:10:02.485213 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Returning 404 to user: Instance 706fa658-4bc5-464f-881a-6bd1f12dd58b could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:10:02.486042 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eeda6dac-5e51-492b-9e54-7e90692b622c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b" status: 404 len: 111 microversion: 2.1 time: 0.029417 Dec 25 22:10:02.486570 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4329/8625] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:02 2021] GET /compute/v2.1/servers/706fa658-4bc5-464f-881a-6bd1f12dd58b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:10:06.257932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-eff344ba-dd29-4377-9e32-a1a5ef8d88d1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '.version_select at 0x7fa4f6125dc0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:06.342908 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-eff344ba-dd29-4377-9e32-a1a5ef8d88d1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-368216788" status: 202 len: 0 microversion: 2.1 time: 0.088629 Dec 25 22:10:06.343704 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4297/8626] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 22:10:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-368216788 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:10:06.371775 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81ed7e96-fee0-48ce-ac6d-bc00bcd9ecbc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: .version_select at 0x7fa4f62c6160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1704619670"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:06.386599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81ed7e96-fee0-48ce-ac6d-bc00bcd9ecbc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:10:06.392839 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81ed7e96-fee0-48ce-ac6d-bc00bcd9ecbc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:10:06.581964 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81ed7e96-fee0-48ce-ac6d-bc00bcd9ecbc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:10:06.586900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-81ed7e96-fee0-48ce-ac6d-bc00bcd9ecbc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:10:06.601621 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81ed7e96-fee0-48ce-ac6d-bc00bcd9ecbc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.234223 Dec 25 22:10:06.607596 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4330/8627] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:10:06 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:14.616585 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1698543355", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "985bc386-1b00-425e-a586-256c431886f8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1704619670", "security_groups": [{"name": "tempest-secgroup-smoke-652617790"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:14.945857 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] validate_networks() for [('985bc386-1b00-425e-a586-256c431886f8', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:10:15.464229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:10:15.464770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:10:15.465407 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:10:15.465832 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:10:15.466258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:10:15.476201 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:15.476664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:15.477660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:15.478111 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:15.497321 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:10:15.503061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:10:15.515699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:10:15.518096 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:10:15.629904 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [89a511fe-e54e-467b-8992-8c56f50a3948] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:10:16.638998 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [89a511fe-e54e-467b-8992-8c56f50a3948] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 37566. Dec 25 22:10:16.644157 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-38eafa84-9830-47e3-bd65-9d6f30cd0613 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.031384 Dec 25 22:10:16.650607 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4298/8628] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:10:14 2021] POST /compute/v2.1/servers => generated 405 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:10:16.659795 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-183c2486-8537-4e86-bbe7-c0e52f5b642d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:16.661019 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-183c2486-8537-4e86-bbe7-c0e52f5b642d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:16.789210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-183c2486-8537-4e86-bbe7-c0e52f5b642d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:16.796698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-183c2486-8537-4e86-bbe7-c0e52f5b642d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1267 microversion: 2.1 time: 0.145283 Dec 25 22:10:16.797308 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4331/8629] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:16 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:10:17.814524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:17.815224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:17.821788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:17.822265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:17.823085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:17.823547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:17.892493 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:17.902082 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7a54868-ccc1-4057-90f6-32ca99d72488 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1271 microversion: 2.1 time: 0.092369 Dec 25 22:10:17.903197 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4299/8630] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:17 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:10:18.921219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:18.925457 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:18.940264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:18.940715 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:18.941668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:18.942711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:19.046658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:19.054262 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-be4b90d7-8130-4861-8b10-04f486a4e345 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1337 microversion: 2.1 time: 0.138462 Dec 25 22:10:19.054844 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4332/8631] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:18 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1337 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:20.073211 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:20.074506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:20.087912 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:20.088392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:20.089245 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:20.089703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:20.334696 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:20.343072 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-223bc4e0-f8b0-4677-8cee-3408fca8c01a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.273470 Dec 25 22:10:20.343689 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4300/8632] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:20 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:20.535856 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9032e410-e352-4738-ae1d-b77c3272f846 req-522eea47-9366-42d4-a33d-a4a49d79c725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e279fe71-0ff9-431f-989d-1bfe4de21f11", "tag": "ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:20.538317 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:10:20.538317 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:10:20.546826 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9032e410-e352-4738-ae1d-b77c3272f846 req-522eea47-9366-42d4-a33d-a4a49d79c725 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:20.547484 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9032e410-e352-4738-ae1d-b77c3272f846 req-522eea47-9366-42d4-a33d-a4a49d79c725 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:20.565992 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9032e410-e352-4738-ae1d-b77c3272f846 req-522eea47-9366-42d4-a33d-a4a49d79c725 service nova] Creating event network-changed:ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8 for instance e279fe71-0ff9-431f-989d-1bfe4de21f11 on nch1-master-1 Dec 25 22:10:20.571030 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9032e410-e352-4738-ae1d-b77c3272f846 req-522eea47-9366-42d4-a33d-a4a49d79c725 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045930 Dec 25 22:10:20.571684 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4333/8633] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:10:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:10:21.359505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:21.360068 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:21.366702 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:21.367184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:21.367988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:21.368438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:21.502408 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:21.509789 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ed3967e-c5a0-42f4-a6ea-d9e92805b100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.154174 Dec 25 22:10:21.510351 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4301/8634] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:21 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:22.528649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:22.529451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:22.535766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:22.536225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:22.537046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:22.537494 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:22.669206 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:22.676595 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e0ee5623-f848-4c8d-9f48-d99abefe0d2a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.153484 Dec 25 22:10:22.677200 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4334/8635] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:22 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:23.693247 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:23.693801 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:23.701280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:23.701749 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:23.702546 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:23.703000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:23.834658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:23.841990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3b74b411-896b-47a5-9174-c7a71bc672ca tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.152554 Dec 25 22:10:23.842569 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4302/8636] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:23 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:24.858711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:24.859249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:24.866151 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:24.866604 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:24.867390 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:24.867830 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:25.002765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:25.010193 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-57f9ad26-df38-4639-900a-fe5119f8b5ff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.155357 Dec 25 22:10:25.010770 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4335/8637] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:24 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:26.027855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:26.028476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:26.035494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:26.035999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:26.036815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:26.037271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:26.171074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:26.178523 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-baebd7a8-5bb6-4eec-9490-3f3736db56f8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.154924 Dec 25 22:10:26.179128 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4303/8638] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:26 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:27.195147 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:27.195763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:27.202626 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:27.203085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:27.203895 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:27.204342 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:27.344474 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:27.352161 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23526885-9ba5-42e8-8133-441d64353002 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.160786 Dec 25 22:10:27.352759 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4336/8639] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:27 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:27.815838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1f5b0dd3-86df-4c89-b8cb-7161a15121e3 req-cada7bff-9f4e-40b0-a425-c8222af765d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e279fe71-0ff9-431f-989d-1bfe4de21f11", "name": "network-vif-plugged", "status": "completed", "tag": "ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:27.818134 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:10:27.818134 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:10:27.825920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1f5b0dd3-86df-4c89-b8cb-7161a15121e3 req-cada7bff-9f4e-40b0-a425-c8222af765d9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:27.826375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1f5b0dd3-86df-4c89-b8cb-7161a15121e3 req-cada7bff-9f4e-40b0-a425-c8222af765d9 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:27.837058 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1f5b0dd3-86df-4c89-b8cb-7161a15121e3 req-cada7bff-9f4e-40b0-a425-c8222af765d9 service nova] Creating event network-vif-plugged:ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8 for instance e279fe71-0ff9-431f-989d-1bfe4de21f11 on nch1-master-1 Dec 25 22:10:27.842699 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1f5b0dd3-86df-4c89-b8cb-7161a15121e3 req-cada7bff-9f4e-40b0-a425-c8222af765d9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030658 Dec 25 22:10:27.846733 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4304/8640] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:10:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:10:28.367710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:28.368319 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:28.375686 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:28.376135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:28.376927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:28.377364 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:28.518578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:28.527730 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-86aadca0-6752-4b47-bba3-031bbd2700f5 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1392 microversion: 2.1 time: 0.163680 Dec 25 22:10:28.528427 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4337/8641] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:28 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:29.546064 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:29.546773 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:29.553004 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:29.553467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:29.554253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:29.554708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:29.690746 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:29.698152 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7baa38db-5cbe-413b-8471-87b2eed025cd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1565 microversion: 2.1 time: 0.157069 Dec 25 22:10:29.699335 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4305/8642] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:29 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1565 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:29.714623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:29.715244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:29.722536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:29.725085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:29.725085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:29.725085 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:29.855741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:29.863366 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03121362-8977-4fb8-a613-06df1b88d7dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1565 microversion: 2.1 time: 0.152483 Dec 25 22:10:29.863951 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4338/8643] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:29 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1565 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:10:32.074410 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:10:32.075041 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:32.077635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-83b10a98-adca-4371-aee5-a0940c1919ad req-8cbc054c-ea68-4f77-b771-9d1e2568e978 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e279fe71-0ff9-431f-989d-1bfe4de21f11", "tag": "ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:32.079396 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:10:32.079396 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:10:32.082213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:32.082675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:32.083488 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:32.083938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:32.087765 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83b10a98-adca-4371-aee5-a0940c1919ad req-8cbc054c-ea68-4f77-b771-9d1e2568e978 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:32.088246 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83b10a98-adca-4371-aee5-a0940c1919ad req-8cbc054c-ea68-4f77-b771-9d1e2568e978 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:32.101523 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-83b10a98-adca-4371-aee5-a0940c1919ad req-8cbc054c-ea68-4f77-b771-9d1e2568e978 service nova] Creating event network-changed:ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8 for instance e279fe71-0ff9-431f-989d-1bfe4de21f11 on nch1-master-1 Dec 25 22:10:32.107572 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-83b10a98-adca-4371-aee5-a0940c1919ad req-8cbc054c-ea68-4f77-b771-9d1e2568e978 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033802 Dec 25 22:10:32.108378 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4339/8644] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:10:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:10:32.309906 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:10:32.318179 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e9dad98b-8dea-4dee-8c2c-c77d2971f970 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1565 microversion: 2.1 time: 0.247489 Dec 25 22:10:32.318908 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4306/8645] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:10:32 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1565 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:10:53.543929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:10:53.544965 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:10:53.551190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:53.551679 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:53.552454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:10:53.552930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:10:53.604791 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-02ba7315-6eaa-4f3d-9b93-d3f4bef3c011 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11/action" status: 200 len: 24574 microversion: 2.1 time: 0.065732 Dec 25 22:10:53.605684 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4340/8646] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:10:53 2021] POST /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11/action => generated 24574 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:11:04.661142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:11:04.662097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:04.668623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:04.669123 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:04.669932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:04.670387 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:04.895177 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f9bfb8d-738f-468c-9bc6-9745b52417bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11/action" status: 202 len: 0 microversion: 2.1 time: 0.237709 Dec 25 22:11:04.895828 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4307/8647] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:11:04 2021] POST /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:11:04.904261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:04.904993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:04.912441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:04.912927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:04.913722 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:04.914169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:05.078443 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:05.086583 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b80b1415-4225-474f-a77e-665494e2897e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1676 microversion: 2.1 time: 0.186398 Dec 25 22:11:05.087264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4341/8648] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:04 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1676 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:06.105620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:06.106476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:06.112930 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:06.113400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:06.114207 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:06.114661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:06.257617 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:06.265105 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bc55accb-fbc9-45ea-aa1f-345a0781c4c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.164367 Dec 25 22:11:06.265701 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4308/8649] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:06 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:07.282652 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:07.283300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:07.290834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:07.291277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:07.292060 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:07.292498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:07.426395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:07.437165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd38d4ec-ef43-4a6c-9462-0b41685e5683 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.158253 Dec 25 22:11:07.437752 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4342/8650] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:07 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:08.454542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:08.455170 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:08.461960 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:08.462435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:08.463236 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:08.463694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:08.595218 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:08.603058 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0ed5cfb5-0421-4ea0-94df-11a13f307162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.152257 Dec 25 22:11:08.603625 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4309/8651] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:08 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:09.620232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:09.620848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:09.628387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:09.628842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:09.629655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:09.630095 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:09.767202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:09.774630 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-49dbfb5c-6018-4f7b-a94b-5579214b3182 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.158189 Dec 25 22:11:09.775204 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4343/8652] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:09 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:10.791304 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:10.791983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:10.798782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:10.799921 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:10.800754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:10.801221 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:10.936046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:10.943484 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-114bd425-c980-4056-8c80-880180659209 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.155943 Dec 25 22:11:10.944053 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4310/8653] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:10 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:11.960599 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:11.961234 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:11.968049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:11.968488 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:11.969299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:11.969737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:12.108374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:12.115748 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9475d180-9cc1-44c1-aeb3-9ac25921e5f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.158876 Dec 25 22:11:12.116330 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4344/8654] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:11 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:13.132996 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:13.133608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:13.140399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:13.140892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:13.141704 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:13.142160 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:13.273330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:13.280682 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a56f3d6e-2f06-482e-a48b-d5cbf834af40 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.151411 Dec 25 22:11:13.281359 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4311/8655] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:13 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:14.296649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:14.297292 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:14.304541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:14.305033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:14.305815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:14.306254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:14.439580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:14.447092 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3206844b-fe19-4d3f-a9b2-9aac6c21465b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.154182 Dec 25 22:11:14.449729 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4345/8656] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:14 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:15.463876 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:15.464510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:15.470955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:15.471424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:15.472219 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:15.472714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:15.605076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:15.613000 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3816af97-b802-495e-8b47-a32daea77d89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.153023 Dec 25 22:11:15.613824 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4312/8657] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:15 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:16.629451 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:16.630077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:16.636445 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:16.636931 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:16.637727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:16.638167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:16.772209 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:16.779672 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-571d3c95-d596-401c-b357-fbac392afc2d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.154162 Dec 25 22:11:16.780381 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4346/8658] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:16 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:17.796837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:17.797491 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:17.804916 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:17.805389 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:17.806179 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:17.806624 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:17.941452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:17.949192 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-af3468d6-8a0c-415f-9c9e-18794b0517c8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.155982 Dec 25 22:11:17.949775 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4313/8659] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:17 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:18.966026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:18.966632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:18.974574 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:18.975023 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:18.975793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:18.976224 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:19.113530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:19.121248 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1364f841-aa28-439a-839a-8e9e4f522bb1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.158891 Dec 25 22:11:19.122083 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4347/8660] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:18 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:20.138186 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:20.138831 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:20.145836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:20.146311 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:20.147129 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:20.147589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:20.283789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:20.291343 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bb0caa2b-cee5-4802-97aa-cdc1ce1874fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.157031 Dec 25 22:11:20.291915 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4314/8661] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:20 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:21.309708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:21.310302 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:21.317534 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:21.317982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:21.318753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:21.319189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:21.457636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:21.465059 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-805406ff-67fc-4212-917d-366da17c158f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1681 microversion: 2.1 time: 0.159104 Dec 25 22:11:21.465626 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4348/8662] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:21 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:22.482016 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:22.482645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:22.489558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:22.490029 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:22.490838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:22.491296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:22.625485 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:22.633656 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3cb7d5fe-677e-4838-988a-006f2edfeecc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1684 microversion: 2.1 time: 0.155332 Dec 25 22:11:22.634418 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4315/8663] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:22 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:44.823928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:11:44.824842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:44.831694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:44.832797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:44.833689 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:44.834122 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:44.887578 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cca5270a-ef4d-4227-880e-b21a63ad3938 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11/action" status: 200 len: 69226 microversion: 2.1 time: 0.067142 Dec 25 22:11:44.888252 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4349/8664] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:11:44 2021] POST /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11/action => generated 69226 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:11:52.158501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:52.159151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:52.167030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:52.167506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:52.168339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:52.168812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:52.194538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:11:52.222229 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7c1b7df5-ca0c-4106-be6f-7e9626d3e6ba req-3a5e41e9-92b2-46b4-9801-77fbfc46acb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e279fe71-0ff9-431f-989d-1bfe4de21f11", "tag": "ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:11:52.225294 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:11:52.225294 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:11:52.235716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7c1b7df5-ca0c-4106-be6f-7e9626d3e6ba req-3a5e41e9-92b2-46b4-9801-77fbfc46acb4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:52.236426 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7c1b7df5-ca0c-4106-be6f-7e9626d3e6ba req-3a5e41e9-92b2-46b4-9801-77fbfc46acb4 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:52.247776 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7c1b7df5-ca0c-4106-be6f-7e9626d3e6ba req-3a5e41e9-92b2-46b4-9801-77fbfc46acb4 service nova] Creating event network-changed:ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8 for instance e279fe71-0ff9-431f-989d-1bfe4de21f11 on nch1-master-1 Dec 25 22:11:52.252823 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7c1b7df5-ca0c-4106-be6f-7e9626d3e6ba req-3a5e41e9-92b2-46b4-9801-77fbfc46acb4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095172 Dec 25 22:11:52.253468 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4350/8665] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:11:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:11:52.473802 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d7761d88-cc81-4a0d-bf1e-d93c8e2f1861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 204 len: 0 microversion: 2.1 time: 0.318502 Dec 25 22:11:52.474634 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4316/8666] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:11:52 2021] DELETE /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:11:52.483583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:52.484287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:52.491258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:52.491801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:52.492524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:52.493031 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:52.713808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:52.722203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-906373fd-0ef2-4807-ae9e-db38f42ca462 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1690 microversion: 2.1 time: 0.243081 Dec 25 22:11:52.723301 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4351/8667] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:52 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1690 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:53.739460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:53.740205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:53.747022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:53.747492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:53.748289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:53.748744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:53.883584 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:53.891256 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a24a35b6-a712-4f6b-82fa-8d8bfc5f7178 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1571 microversion: 2.1 time: 0.155932 Dec 25 22:11:53.891951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4317/8668] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:53 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:54.487226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-530f6e0b-21e0-4f66-8ea0-90fa1606e757 req-b96c1afc-5153-480c-9137-cef68c7fbf30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e279fe71-0ff9-431f-989d-1bfe4de21f11", "name": "network-vif-deleted", "tag": "ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:11:54.489487 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:11:54.489487 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:11:54.497098 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-530f6e0b-21e0-4f66-8ea0-90fa1606e757 req-b96c1afc-5153-480c-9137-cef68c7fbf30 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:54.497782 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-530f6e0b-21e0-4f66-8ea0-90fa1606e757 req-b96c1afc-5153-480c-9137-cef68c7fbf30 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:54.508494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-530f6e0b-21e0-4f66-8ea0-90fa1606e757 req-b96c1afc-5153-480c-9137-cef68c7fbf30 service nova] Creating event network-vif-deleted:ce9e765a-3b6f-4a29-8b1d-a3bb800ce1c8 for instance e279fe71-0ff9-431f-989d-1bfe4de21f11 on nch1-master-1 Dec 25 22:11:54.513567 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-530f6e0b-21e0-4f66-8ea0-90fa1606e757 req-b96c1afc-5153-480c-9137-cef68c7fbf30 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030149 Dec 25 22:11:54.514184 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4352/8669] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:11:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:11:54.912060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:54.912060 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:54.919259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:54.919762 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:54.920562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:54.921034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:54.951627 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:54.952088 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:54.952552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lazy-loading 'fault' on Instance uuid e279fe71-0ff9-431f-989d-1bfe4de21f11 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:11:54.993865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:11:55.001191 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6000b4af-b866-42a0-9c42-29f3a1fad4fb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 200 len: 1357 microversion: 2.1 time: 0.094447 Dec 25 22:11:55.001775 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4318/8670] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:54 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 1357 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:11:56.019261 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:11:56.020571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: e279fe71-0ff9-431f-989d-1bfe4de21f11] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:11:56.026879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:56.027335 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:56.028117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:11:56.028556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:11:56.041870 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] HTTP exception thrown: Instance e279fe71-0ff9-431f-989d-1bfe4de21f11 could not be found. Dec 25 22:11:56.042455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Returning 404 to user: Instance e279fe71-0ff9-431f-989d-1bfe4de21f11 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:11:56.043275 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33a83f93-a8bd-4c0d-8e5c-6c9ea5a2a770 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11" status: 404 len: 111 microversion: 2.1 time: 0.029048 Dec 25 22:11:56.043807 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4353/8671] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:11:56 2021] GET /compute/v2.1/servers/e279fe71-0ff9-431f-989d-1bfe4de21f11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Dec 25 22:12:00.117234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e43cba33-6f1e-414d-a98e-bf74e1f8764d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '.version_select at 0x7fa4f45024c0>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:00.204789 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e43cba33-6f1e-414d-a98e-bf74e1f8764d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1704619670" status: 202 len: 0 microversion: 2.1 time: 0.091412 Dec 25 22:12:00.205410 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4319/8672] 10.222.0.32 () {58 vars in 1283 bytes} [Sat Dec 25 22:12:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1704619670 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:12:00.233280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d625a378-84ee-40a4-b6e0-b9cda73cb555 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: .version_select at 0x7fa4f6a52e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2101092964"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:00.248592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d625a378-84ee-40a4-b6e0-b9cda73cb555 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:12:00.253502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d625a378-84ee-40a4-b6e0-b9cda73cb555 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:12:00.632978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d625a378-84ee-40a4-b6e0-b9cda73cb555 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:12:00.638021 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-d625a378-84ee-40a4-b6e0-b9cda73cb555 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:12:00.653929 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d625a378-84ee-40a4-b6e0-b9cda73cb555 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.424295 Dec 25 22:12:00.654588 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4354/8673] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:12:00 2021] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:01.485777 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:12:01.486602 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:12:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:12:08.660215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-761119728", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "af9cd4df-c7ac-412d-b4b5-82613a9b50b0"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2101092964", "security_groups": [{"name": "tempest-secgroup-smoke-529099152"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:08.815641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] validate_networks() for [('af9cd4df-c7ac-412d-b4b5-82613a9b50b0', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:12:09.278208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:12:09.278936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:12:09.279423 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:12:09.280040 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:12:09.280509 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:12:09.289997 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:09.290447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:09.291466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:09.292042 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:09.308964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:12:09.315052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:12:09.330576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:12:09.333571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:12:09.434284 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-46c4abaf-ea28-4d0b-a067-87b2bd4f467a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.784359 Dec 25 22:12:09.435111 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4320/8674] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:12:08 2021] POST /compute/v2.1/servers => generated 405 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:12:09.445797 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-081bf0a1-74dd-48d3-8e14-fe4bfc4445c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:09.446414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-081bf0a1-74dd-48d3-8e14-fe4bfc4445c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:09.507678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-081bf0a1-74dd-48d3-8e14-fe4bfc4445c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:09.514537 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-081bf0a1-74dd-48d3-8e14-fe4bfc4445c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1266 microversion: 2.1 time: 0.073357 Dec 25 22:12:09.515650 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4355/8675] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:09 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:10.532537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:10.533364 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:10.540504 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:10.541026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:10.541854 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:10.542898 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:10.612402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:10.621100 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-83d5ca1c-9ee6-40b7-8679-e2b772b69810 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1270 microversion: 2.1 time: 0.093199 Dec 25 22:12:10.623786 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4321/8676] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:10 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:11.637403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:11.638030 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:11.645661 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:11.646125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:11.646927 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:11.647381 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:11.715947 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:11.724613 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1b95d07c-bf23-4d02-9550-b6279ccc8b43 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1336 microversion: 2.1 time: 0.091193 Dec 25 22:12:11.725228 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4356/8677] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:11 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:12.741699 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:12.742335 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:12.749234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:12.749708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:12.750516 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:12.750980 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:12.986608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:12.994736 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dac3108a-e718-486e-829c-eef5434e7a50 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.256910 Dec 25 22:12:12.995324 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4322/8678] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:12 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:13.181269 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-97c20cda-1d73-4a60-a8e8-9dd76b10a0f5 req-5b891ee4-0cda-4aee-a0b5-5078cd5939da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:13.186357 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:12:13.186357 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:12:13.193382 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-97c20cda-1d73-4a60-a8e8-9dd76b10a0f5 req-5b891ee4-0cda-4aee-a0b5-5078cd5939da service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:13.193833 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-97c20cda-1d73-4a60-a8e8-9dd76b10a0f5 req-5b891ee4-0cda-4aee-a0b5-5078cd5939da service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:13.205729 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-97c20cda-1d73-4a60-a8e8-9dd76b10a0f5 req-5b891ee4-0cda-4aee-a0b5-5078cd5939da service nova] Creating event network-changed:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:12:13.210735 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-97c20cda-1d73-4a60-a8e8-9dd76b10a0f5 req-5b891ee4-0cda-4aee-a0b5-5078cd5939da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034157 Dec 25 22:12:13.211889 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4357/8679] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:12:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:12:14.015158 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:14.015917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:14.023263 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:14.023727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:14.024558 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:14.025012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:14.157198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:14.164675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-bf7a60c1-50f4-4055-8a53-878398ba0380 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.153347 Dec 25 22:12:14.165278 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4323/8680] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:14 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:15.183082 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:15.183779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:15.190273 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:15.190718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:15.191485 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:15.192601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:15.331243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:15.338606 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0d7cce86-a482-4c83-ae31-cadad758043e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.160518 Dec 25 22:12:15.339207 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4358/8681] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:15 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:16.355654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:16.356276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:16.362351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:16.362810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:16.364205 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:16.364651 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:16.494639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:16.501937 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56c329e9-f3f8-42f5-91d3-bca5a2199c60 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.150228 Dec 25 22:12:16.502506 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4324/8682] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:16 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:17.517913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:17.518559 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:17.524705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:17.527607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:17.527607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:17.527607 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:17.657477 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:17.665561 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e5b41401-f7c0-4b0a-af7a-486197c163d3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.151740 Dec 25 22:12:17.669404 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4359/8683] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:17 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:18.682343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:18.683564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:18.690331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:18.690796 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:18.692110 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:18.692559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:18.830576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:18.837878 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e323ed9f-c3c1-41d7-91db-038eccc5ec29 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.159374 Dec 25 22:12:18.838451 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4325/8684] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:18 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:19.855133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:19.855746 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:19.864523 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:19.865080 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:19.865885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:19.866327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:20.012845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:20.022723 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e379ba98-3726-48e8-865f-79ee9d85eb05 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.171310 Dec 25 22:12:20.023314 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4360/8685] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:19 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:20.528192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-df5bcb6b-1b16-4b8f-853f-92d3ea73eeff req-551bc2b2-f9b8-4986-9922-69f79edcf5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "name": "network-vif-plugged", "status": "completed", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:20.529958 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:12:20.529958 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:12:20.537149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-df5bcb6b-1b16-4b8f-853f-92d3ea73eeff req-551bc2b2-f9b8-4986-9922-69f79edcf5b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:20.537621 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-df5bcb6b-1b16-4b8f-853f-92d3ea73eeff req-551bc2b2-f9b8-4986-9922-69f79edcf5b5 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:20.550236 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-df5bcb6b-1b16-4b8f-853f-92d3ea73eeff req-551bc2b2-f9b8-4986-9922-69f79edcf5b5 service nova] Creating event network-vif-plugged:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:12:20.556010 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-df5bcb6b-1b16-4b8f-853f-92d3ea73eeff req-551bc2b2-f9b8-4986-9922-69f79edcf5b5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088936 Dec 25 22:12:20.556620 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4326/8686] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:12:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:12:21.040447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:21.041084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:21.047836 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:21.048294 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:21.049207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:21.049649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:21.181243 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:21.188494 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52627bd9-291f-4afd-8fb7-33fcc75105f0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1391 microversion: 2.1 time: 0.151767 Dec 25 22:12:21.189089 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4361/8687] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:21 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:22.206237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:22.206988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:22.213224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:22.213694 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:22.214541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:22.214964 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:22.345206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:22.353079 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56d2e5a4-c4dd-4873-9d07-6cc0615277fc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1564 microversion: 2.1 time: 0.151751 Dec 25 22:12:22.353659 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4327/8688] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:22 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:22.369094 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:22.369705 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:22.376541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:22.377028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:22.377831 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:22.378268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:22.511047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:22.518436 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-08b014e8-6461-47e4-8450-ce02b0e0b416 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1564 microversion: 2.1 time: 0.153031 Dec 25 22:12:22.519002 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4362/8689] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:22 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:24.400277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:24.401223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:24.403179 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-adb6905a-8505-4a8f-92c0-5d21404eb71f req-3c0ce3c8-3a39-4b5f-8a12-2672c5e566ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:24.405200 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:12:24.405200 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:12:24.408444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:24.409028 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:24.409922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:24.410480 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:24.413236 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-adb6905a-8505-4a8f-92c0-5d21404eb71f req-3c0ce3c8-3a39-4b5f-8a12-2672c5e566ef service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:24.413683 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-adb6905a-8505-4a8f-92c0-5d21404eb71f req-3c0ce3c8-3a39-4b5f-8a12-2672c5e566ef service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:24.424934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-adb6905a-8505-4a8f-92c0-5d21404eb71f req-3c0ce3c8-3a39-4b5f-8a12-2672c5e566ef service nova] Creating event network-changed:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:12:24.430621 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-adb6905a-8505-4a8f-92c0-5d21404eb71f req-3c0ce3c8-3a39-4b5f-8a12-2672c5e566ef service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030916 Dec 25 22:12:24.431470 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4363/8690] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:12:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:12:24.629687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:24.637473 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-650b9b2b-8270-4bb5-953d-9132cff21b66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1564 microversion: 2.1 time: 0.241417 Dec 25 22:12:24.638197 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4328/8691] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:24 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1564 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:46.233447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:46.234434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:46.241640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:46.242100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:46.242888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:46.243336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:46.292044 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c2081ee-ee09-4478-a87b-2ec62470ef30 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action" status: 200 len: 24576 microversion: 2.1 time: 0.063555 Dec 25 22:12:46.292675 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4364/8692] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:12:46 2021] POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action => generated 24576 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:12:52.646033 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:12:52.647085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:52.653222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:52.653690 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:52.654727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:52.655189 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:52.708184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:52.714439 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Old instance type m1.heat2, new instance type m1.heat {{(pid=136547) resize /opt/stack/nova/nova/compute/api.py:4097}} Dec 25 22:12:52.720843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:12:52.721312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:12:52.721809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:12:52.722237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:12:52.722668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:12:52.944164 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-24aa48ac-f2dd-40ad-8778-4ddb2c17469a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action" status: 202 len: 0 microversion: 2.1 time: 0.302517 Dec 25 22:12:52.947576 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4329/8693] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:12:52 2021] POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:12:52.954355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:52.955407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:52.963049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:52.963784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:52.965041 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:52.965178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:53.103108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:53.110809 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7f8892c8-78f9-447b-8f38-2a4b3b907f8c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1691 microversion: 2.1 time: 0.161543 Dec 25 22:12:53.111377 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4365/8694] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:52 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:54.128859 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:54.129507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:54.135502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:54.137870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:54.137870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:54.137870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:54.278063 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:54.286516 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-638caf16-74ef-4073-a32c-b31e831b02da tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1691 microversion: 2.1 time: 0.162332 Dec 25 22:12:54.287102 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4330/8695] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:54 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:55.303917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:55.304573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:55.311466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:55.313263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:55.313263 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:55.313515 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:55.551780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:55.559132 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5c2aa1c9-896d-424d-8604-4c245784c801 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1691 microversion: 2.1 time: 0.259687 Dec 25 22:12:55.559702 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4366/8696] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:55 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1691 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:56.576056 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:56.576709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:56.583496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:56.584051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:56.584754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:56.585237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:56.718126 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:56.726259 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b27912fe-bcb6-4cb6-8a9d-3d98fef064a2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.153967 Dec 25 22:12:56.726843 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4331/8697] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:56 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:57.743116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:57.743734 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:57.750408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:57.750858 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:57.751633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:57.752070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:57.886354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:57.893774 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d9145a98-67c2-437e-96ab-128ed972afff tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.154360 Dec 25 22:12:57.894340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4367/8698] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:57 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:12:58.911905 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:12:58.912528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:12:58.919271 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:58.919734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:58.920518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:12:58.920999 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:12:59.056958 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:12:59.064168 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f4f02b1d-2481-4145-8576-df8c234acd6d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.156606 Dec 25 22:12:59.064735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4332/8699] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:12:58 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:00.080945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:00.081555 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:00.100986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:00.100986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:00.100986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:00.100986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:00.222295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:00.229786 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-867c818f-23a6-4a52-94f6-e90960f0886d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.152610 Dec 25 22:13:00.230357 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4368/8700] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:00 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:13:01.246953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:01.247577 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:01.254339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:01.254804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:01.255596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:01.256047 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:01.389575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:01.396976 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e2801871-f3da-4490-993a-5a9c534c8482 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.153680 Dec 25 22:13:01.397483 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4333/8701] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:01 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:02.413511 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:02.414216 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:02.420832 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:02.421314 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:02.422090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:02.422525 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:02.555570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:02.563019 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c34e2189-844e-454f-a4f2-e23db1a79be3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.153237 Dec 25 22:13:02.568793 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4369/8702] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:02 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:03.579430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:03.580051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:03.587388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:03.587852 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:03.588641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:03.589120 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:03.722527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:03.729981 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9d17699e-fd40-478f-a83d-21fbd52603a6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.154305 Dec 25 22:13:03.730554 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4334/8703] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:03 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:04.747260 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:04.747978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:04.754866 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:04.755332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:04.756128 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:04.756573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:04.896441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:04.904047 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a3020fc9-7ea5-490f-b522-c0c9f719f1b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.160553 Dec 25 22:13:04.904634 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4370/8704] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:04 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:05.920692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:05.921459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:05.928703 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:05.929196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:05.929994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:05.930447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:06.063569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:06.071220 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84c1dcab-8418-42a3-979f-80efb9c1fd0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.154304 Dec 25 22:13:06.071794 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4335/8705] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:05 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:07.087621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:07.088244 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:07.095393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:07.095855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:07.096648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:07.097130 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:07.236433 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:07.244577 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d8c241a1-ad1f-42e1-99ff-4e4e43fec1c0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1696 microversion: 2.1 time: 0.160810 Dec 25 22:13:07.245213 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4371/8706] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:07 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:08.261914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:08.262547 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:08.269401 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:08.269877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:08.270692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:08.271149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:08.422198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:08.430380 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-61da0f8a-7872-4d80-8aeb-5b2d47357b41 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1695 microversion: 2.1 time: 0.172288 Dec 25 22:13:08.430951 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4336/8707] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:08 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:09.448651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:09.449283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:09.456105 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:09.456632 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:09.457447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:09.457882 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:09.590501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:09.598620 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ab9d072f-3e44-4b49-944a-b49fd4cd5dec tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1693 microversion: 2.1 time: 0.153816 Dec 25 22:13:09.599196 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4372/8708] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:09 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:10.616137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:10.616753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:10.623528 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:10.623991 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:10.624781 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:10.625322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:10.758927 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:10.766424 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c1e16650-5577-44f7-bc0c-63a8a17f7992 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1690 microversion: 2.1 time: 0.154633 Dec 25 22:13:10.766992 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4337/8709] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:10 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1690 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:10.786806 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:10.787444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:10.794317 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:10.794773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:10.795594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:10.796062 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:11.047901 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfe81e18-088d-4bef-b60f-90ce40993d22 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action" status: 204 len: 0 microversion: 2.1 time: 0.264740 Dec 25 22:13:11.048596 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4373/8710] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:13:10 2021] POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:13:11.056764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:11.057426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:11.063518 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:11.063982 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:11.064795 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:11.065277 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:11.228938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:11.236537 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f223cc57-9779-494f-a31d-d009e95c2f55 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1690 microversion: 2.1 time: 0.183514 Dec 25 22:13:11.237169 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4338/8711] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:11 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1690 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:11.254211 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:11.254921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:11.261452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:11.261919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:11.262728 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:11.263169 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:11.487090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:11.495087 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f266a6bb-0a03-4cc1-b7ac-fd41a7f8f232 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1690 microversion: 2.1 time: 0.245486 Dec 25 22:13:11.495670 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4374/8712] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:11 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1690 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:12.513783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:12.514779 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:12.522173 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:12.522641 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:12.523440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:12.524075 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:12.550844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-2b5d92d6-4477-49dc-b93a-ba2b2faa0ee6 req-e903af28-5a42-4153-aed9-7ac2839b5292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "name": "network-vif-unplugged", "status": "completed", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:12.552563 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:13:12.552563 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:13:12.560084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2b5d92d6-4477-49dc-b93a-ba2b2faa0ee6 req-e903af28-5a42-4153-aed9-7ac2839b5292 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:12.560531 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-2b5d92d6-4477-49dc-b93a-ba2b2faa0ee6 req-e903af28-5a42-4153-aed9-7ac2839b5292 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:12.580789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-2b5d92d6-4477-49dc-b93a-ba2b2faa0ee6 req-e903af28-5a42-4153-aed9-7ac2839b5292 service nova] Creating event network-vif-unplugged:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:13:12.580789 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-2b5d92d6-4477-49dc-b93a-ba2b2faa0ee6 req-e903af28-5a42-4153-aed9-7ac2839b5292 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032447 Dec 25 22:13:12.580789 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4375/8713] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:13:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:13:12.670309 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:12.679465 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2677ec15-29ce-40a3-a286-f987be759085 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1682 microversion: 2.1 time: 0.169796 Dec 25 22:13:12.680150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4339/8714] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:12 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:14.606913 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-56c278d5-070c-4b12-80a6-c8ad0d55bc64 req-7cdcef6a-ec27-4f1a-b49c-7c878d921047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "name": "network-vif-plugged", "status": "completed", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:14.608436 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:13:14.608436 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:13:14.616091 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-56c278d5-070c-4b12-80a6-c8ad0d55bc64 req-7cdcef6a-ec27-4f1a-b49c-7c878d921047 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:14.616544 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-56c278d5-070c-4b12-80a6-c8ad0d55bc64 req-7cdcef6a-ec27-4f1a-b49c-7c878d921047 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:14.627820 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-56c278d5-070c-4b12-80a6-c8ad0d55bc64 req-7cdcef6a-ec27-4f1a-b49c-7c878d921047 service nova] Creating event network-vif-plugged:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:13:14.633136 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-56c278d5-070c-4b12-80a6-c8ad0d55bc64 req-7cdcef6a-ec27-4f1a-b49c-7c878d921047 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031142 Dec 25 22:13:14.633744 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4376/8715] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:13:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:13:34.856936 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:34.857828 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:34.864115 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:34.864572 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:34.865416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:34.865864 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:34.917647 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9f6a9faa-002e-4ff5-b36a-8318af3fecc1 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action" status: 200 len: 24574 microversion: 2.1 time: 0.064728 Dec 25 22:13:34.918309 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4340/8716] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:13:34 2021] POST /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7/action => generated 24574 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:13:42.026867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:42.027456 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:42.028477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-fca1979d-91e2-4405-a337-5a7fbb9cfecf req-e27bdc6f-2099-4b51-98cc-ec91ece7d31a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:42.030558 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:13:42.030558 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:13:42.034081 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:42.035265 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:42.035460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:42.035903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:42.039537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fca1979d-91e2-4405-a337-5a7fbb9cfecf req-e27bdc6f-2099-4b51-98cc-ec91ece7d31a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:42.040939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-fca1979d-91e2-4405-a337-5a7fbb9cfecf req-e27bdc6f-2099-4b51-98cc-ec91ece7d31a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:42.052360 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-fca1979d-91e2-4405-a337-5a7fbb9cfecf req-e27bdc6f-2099-4b51-98cc-ec91ece7d31a service nova] Creating event network-changed:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:13:42.057825 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-fca1979d-91e2-4405-a337-5a7fbb9cfecf req-e27bdc6f-2099-4b51-98cc-ec91ece7d31a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033536 Dec 25 22:13:42.058735 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4341/8717] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:13:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:13:42.062099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:13:42.375054 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bff1570d-9227-4f23-a747-aea71bb82225 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 204 len: 0 microversion: 2.1 time: 0.353509 Dec 25 22:13:42.375723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4377/8718] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:13:42 2021] DELETE /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:13:42.384538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:42.385290 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:42.392085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:42.392565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:42.393412 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:42.393865 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:42.621939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:42.629731 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad86a429-4555-412b-b5d4-50b5b71c88b4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1688 microversion: 2.1 time: 0.249220 Dec 25 22:13:42.630673 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4342/8719] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:42 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:43.647447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:43.648157 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:43.654988 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:43.655437 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:43.656220 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:43.656662 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:43.868759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:43.876137 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-2fa5b47d-4a57-463e-b8e7-7d8a5aa71405 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1570 microversion: 2.1 time: 0.232789 Dec 25 22:13:43.876716 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4378/8720] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:43 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:44.249731 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c9ec15e8-d0ed-4132-8fee-df1f85291479 req-cdbf3625-bce4-4ed0-8c82-f28611fba0d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45c5ed4b-88d6-412f-9d9a-339e609a63a7", "name": "network-vif-deleted", "tag": "584b8f05-a311-4652-9b69-92f9ab2d42dd"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:44.251359 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:13:44.251359 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:13:44.259198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c9ec15e8-d0ed-4132-8fee-df1f85291479 req-cdbf3625-bce4-4ed0-8c82-f28611fba0d1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:44.268656 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c9ec15e8-d0ed-4132-8fee-df1f85291479 req-cdbf3625-bce4-4ed0-8c82-f28611fba0d1 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:44.270975 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c9ec15e8-d0ed-4132-8fee-df1f85291479 req-cdbf3625-bce4-4ed0-8c82-f28611fba0d1 service nova] Creating event network-vif-deleted:584b8f05-a311-4652-9b69-92f9ab2d42dd for instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 on nch1-master-1 Dec 25 22:13:44.275922 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c9ec15e8-d0ed-4132-8fee-df1f85291479 req-cdbf3625-bce4-4ed0-8c82-f28611fba0d1 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029911 Dec 25 22:13:44.276514 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4343/8721] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:13:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:13:44.892084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:44.892718 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:44.900181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:44.900631 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:44.901441 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:44.901880 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:44.932431 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:44.932945 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:44.933434 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lazy-loading 'fault' on Instance uuid 45c5ed4b-88d6-412f-9d9a-339e609a63a7 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:13:44.973883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:44.981532 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-468c8b57-8561-4960-a100-094fd1c9625b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 200 len: 1356 microversion: 2.1 time: 0.093096 Dec 25 22:13:44.982106 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4379/8722] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:44 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 1356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:13:46.005455 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:46.006239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: 45c5ed4b-88d6-412f-9d9a-339e609a63a7] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:46.012337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:46.022571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:46.022571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:46.022571 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:46.027784 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] HTTP exception thrown: Instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 could not be found. Dec 25 22:13:46.028397 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Returning 404 to user: Instance 45c5ed4b-88d6-412f-9d9a-339e609a63a7 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:13:46.029334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-44c5f6da-2543-41aa-b6f9-0e36edd22987 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7" status: 404 len: 111 microversion: 2.1 time: 0.029067 Dec 25 22:13:46.029876 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4344/8723] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:45 2021] GET /compute/v2.1/servers/45c5ed4b-88d6-412f-9d9a-339e609a63a7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:13:49.882592 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-18b1b2bd-b65e-4ffb-ab20-5f991e556bd6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '.version_select at 0x7fa4f70379d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:49.941203 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-18b1b2bd-b65e-4ffb-ab20-5f991e556bd6 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2101092964" status: 202 len: 0 microversion: 2.1 time: 0.062290 Dec 25 22:13:49.945273 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4380/8724] 10.222.0.32 () {58 vars in 1283 bytes} [Sat Dec 25 22:13:49 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2101092964 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:13:49.968834 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4912623b-742a-43ce-8618-a36dcd197503 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: .version_select at 0x7fa4f44c9c10>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1405631940"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:49.984461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4912623b-742a-43ce-8618-a36dcd197503 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:13:49.991102 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4912623b-742a-43ce-8618-a36dcd197503 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:13:50.636144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4912623b-742a-43ce-8618-a36dcd197503 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:13:50.641260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-4912623b-742a-43ce-8618-a36dcd197503 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:13:50.656177 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4912623b-742a-43ce-8618-a36dcd197503 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.691432 Dec 25 22:13:50.656990 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4345/8725] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:13:49 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:13:59.104761 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-887037773", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "ea6c6eff-eb37-43eb-adbf-e520256a7ea2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1405631940", "security_groups": [{"name": "tempest-secgroup-smoke-1796240745"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:13:59.220363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] validate_networks() for [('ea6c6eff-eb37-43eb-adbf-e520256a7ea2', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:13:59.689355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:13:59.691337 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:13:59.692496 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:13:59.693056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:13:59.693577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:13:59.702980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:59.703537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:59.704501 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:13:59.705089 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:13:59.730187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:13:59.735860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:13:59.751048 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:13:59.753644 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:13:59.914709 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f049d039-0851-4710-b137-3b38c080a337 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818720 Dec 25 22:13:59.917717 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4381/8726] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:13:59 2021] POST /compute/v2.1/servers => generated 406 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:13:59.926050 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-18277c59-1ed7-435b-b0ab-ba5ff1043e4d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:13:59.926760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-18277c59-1ed7-435b-b0ab-ba5ff1043e4d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:13:59.985901 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-18277c59-1ed7-435b-b0ab-ba5ff1043e4d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:13:59.992705 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-18277c59-1ed7-435b-b0ab-ba5ff1043e4d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1266 microversion: 2.1 time: 0.070916 Dec 25 22:13:59.993534 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4346/8727] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:13:59 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1266 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:01.010242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:01.010992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:01.018195 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:01.019164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:01.019958 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:01.020400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:01.083885 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:01.093292 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-79ca5c7f-bbd8-4b48-931f-ff68de3743ad tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1270 microversion: 2.1 time: 0.087612 Dec 25 22:14:01.101182 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4382/8728] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:01 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:02.110620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:02.111260 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:02.119634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:02.120105 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:02.121003 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:02.121467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:02.199789 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:02.207873 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5ff21684-1e46-4ff0-b857-c9770af614c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1336 microversion: 2.1 time: 0.100924 Dec 25 22:14:02.208475 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4347/8729] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:02 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:03.224762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:03.225429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:03.233034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:03.233699 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:03.234500 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:03.234944 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:03.464536 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:03.474093 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ef699a88-92e2-4a00-8dce-104868c6a492 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1392 microversion: 2.1 time: 0.253071 Dec 25 22:14:03.474692 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4383/8730] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:03 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1392 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:03.738966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-554a6e1e-5ace-454f-9b73-158ec6a9e2e3 req-8a0d778a-905a-43b2-b3b9-5669a3d7ffd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad663de-c6f3-4a91-9173-95d13cc97eb2", "tag": "bb4bbc67-34ac-42e4-852b-4061d3ac30e6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:03.738966 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:14:03.738966 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:14:03.751995 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-554a6e1e-5ace-454f-9b73-158ec6a9e2e3 req-8a0d778a-905a-43b2-b3b9-5669a3d7ffd3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:03.753503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-554a6e1e-5ace-454f-9b73-158ec6a9e2e3 req-8a0d778a-905a-43b2-b3b9-5669a3d7ffd3 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:03.766312 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-554a6e1e-5ace-454f-9b73-158ec6a9e2e3 req-8a0d778a-905a-43b2-b3b9-5669a3d7ffd3 service nova] Creating event network-changed:bb4bbc67-34ac-42e4-852b-4061d3ac30e6 for instance cad663de-c6f3-4a91-9173-95d13cc97eb2 on nch1-master-1 Dec 25 22:14:03.771833 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-554a6e1e-5ace-454f-9b73-158ec6a9e2e3 req-8a0d778a-905a-43b2-b3b9-5669a3d7ffd3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042928 Dec 25 22:14:03.772436 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4348/8731] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:14:03 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:14:04.494000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:04.494556 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:04.501322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:04.501779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:04.502660 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:04.503121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:04.641024 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:04.648897 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8c224649-a05e-4423-a117-ffffad89e6a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1392 microversion: 2.1 time: 0.158766 Dec 25 22:14:04.649479 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4384/8732] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:04 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:05.665887 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:05.666629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:05.673654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:05.674121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:05.674914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:05.675366 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:05.806671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:05.813983 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9cd908a8-0710-46c0-b2b7-b5e7e5cf9cbb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1392 microversion: 2.1 time: 0.152220 Dec 25 22:14:05.814552 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4349/8733] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:05 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:06.831865 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:06.832409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:06.839517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:06.840909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:06.840909 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:06.841583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:06.978252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:06.986260 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-99b75f7d-c9ec-4281-bf8f-9f787d4b651d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1392 microversion: 2.1 time: 0.158800 Dec 25 22:14:06.986802 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4385/8734] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:06 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:08.001595 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:08.002225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:08.009093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:08.009562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:08.010354 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:08.010809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:08.144634 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:08.151863 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c8f8ab4f-c442-408d-8199-30ecf2fa4e9c tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1392 microversion: 2.1 time: 0.154001 Dec 25 22:14:08.152427 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4350/8735] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:07 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:08.845733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-5dbc5196-fe71-4e6f-8cfe-3259dd54d330 req-e5c9a590-409a-424f-ae86-ca5a5a4a8709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad663de-c6f3-4a91-9173-95d13cc97eb2", "name": "network-vif-plugged", "status": "completed", "tag": "bb4bbc67-34ac-42e4-852b-4061d3ac30e6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:08.847984 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:14:08.847984 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:14:08.855726 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5dbc5196-fe71-4e6f-8cfe-3259dd54d330 req-e5c9a590-409a-424f-ae86-ca5a5a4a8709 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:08.856170 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-5dbc5196-fe71-4e6f-8cfe-3259dd54d330 req-e5c9a590-409a-424f-ae86-ca5a5a4a8709 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:08.867705 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-5dbc5196-fe71-4e6f-8cfe-3259dd54d330 req-e5c9a590-409a-424f-ae86-ca5a5a4a8709 service nova] Creating event network-vif-plugged:bb4bbc67-34ac-42e4-852b-4061d3ac30e6 for instance cad663de-c6f3-4a91-9173-95d13cc97eb2 on nch1-master-1 Dec 25 22:14:08.872785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-5dbc5196-fe71-4e6f-8cfe-3259dd54d330 req-e5c9a590-409a-424f-ae86-ca5a5a4a8709 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031030 Dec 25 22:14:08.873396 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4386/8736] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:14:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:14:09.168675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:09.169333 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:09.176155 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:09.176618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:09.413034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:09.413034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:09.413034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:09.413034 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5985635b-077c-47be-9eaa-f4ee2847d8c9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1392 microversion: 2.1 time: 0.158866 Dec 25 22:14:09.413034 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4351/8737] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:09 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:10.342688 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:10.343422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:10.349729 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:10.350185 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:10.350993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:10.351432 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:10.482502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:10.490450 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-367ca4eb-d4ee-49a4-b0be-99b5257e204f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1563 microversion: 2.1 time: 0.152932 Dec 25 22:14:10.491020 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4387/8738] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:10 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:10.506843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:10.507467 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:10.514119 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:10.514587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:10.515375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:10.515823 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:10.658184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:10.665613 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6f3e0659-0af0-42b5-b01f-2f7a8bb59808 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1563 microversion: 2.1 time: 0.163195 Dec 25 22:14:10.666180 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4352/8739] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:10 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1563 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:12.976074 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:12.976982 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:12.979530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-00a5be9f-a6ca-428c-95f1-bd4652c31340 req-e4c4215b-3ec2-4749-8ae0-9a3b3f630315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad663de-c6f3-4a91-9173-95d13cc97eb2", "tag": "bb4bbc67-34ac-42e4-852b-4061d3ac30e6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:12.981296 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:14:12.981296 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:14:12.984007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:12.984469 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:12.985341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:12.985937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:12.990628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-00a5be9f-a6ca-428c-95f1-bd4652c31340 req-e4c4215b-3ec2-4749-8ae0-9a3b3f630315 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:12.991165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-00a5be9f-a6ca-428c-95f1-bd4652c31340 req-e4c4215b-3ec2-4749-8ae0-9a3b3f630315 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:13.003885 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-00a5be9f-a6ca-428c-95f1-bd4652c31340 req-e4c4215b-3ec2-4749-8ae0-9a3b3f630315 service nova] Creating event network-changed:bb4bbc67-34ac-42e4-852b-4061d3ac30e6 for instance cad663de-c6f3-4a91-9173-95d13cc97eb2 on nch1-master-1 Dec 25 22:14:13.009276 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-00a5be9f-a6ca-428c-95f1-bd4652c31340 req-e4c4215b-3ec2-4749-8ae0-9a3b3f630315 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034195 Dec 25 22:14:13.010307 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4353/8740] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:14:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:14:13.215720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:13.226151 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b724c065-a30b-4692-b98d-9d320e0a97a9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1563 microversion: 2.1 time: 0.253823 Dec 25 22:14:13.226766 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4388/8741] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:12 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1563 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:34.468435 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:34.469460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:34.475653 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:34.476114 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:34.476920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:34.477380 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:34.528190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-aba61fcb-4a68-423a-a666-dbf4144a5ab3 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action" status: 200 len: 24567 microversion: 2.1 time: 0.064954 Dec 25 22:14:34.528840 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4354/8742] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:14:34 2021] POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action => generated 24567 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:14:40.963847 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-85484581-92f5-4d64-973f-502cd94b5b0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:40.970279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85484581-92f5-4d64-973f-502cd94b5b0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:40.970727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-85484581-92f5-4d64-973f-502cd94b5b0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:40.993481 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-85484581-92f5-4d64-973f-502cd94b5b0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Going to try to stop instance {{(pid=136548) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Dec 25 22:14:41.179566 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-85484581-92f5-4d64-973f-502cd94b5b0f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action" status: 202 len: 0 microversion: 2.1 time: 0.219512 Dec 25 22:14:41.180189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4389/8743] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:14:40 2021] POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:14:41.189198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:41.190879 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:41.197529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:41.198013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:41.198804 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:41.199257 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:41.338730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:41.347331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d65e84d3-d025-46fe-99ac-6d317feb1898 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.161919 Dec 25 22:14:41.348118 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4355/8744] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:41 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:42.365932 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:42.366614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:42.372934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:42.373704 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:42.374202 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:42.374638 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:42.510358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:42.517669 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-dd2ab6dc-2883-4b9c-b97d-bccac81515c2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.157214 Dec 25 22:14:42.518244 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4390/8745] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:42 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:43.534583 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:43.535882 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:43.543552 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:43.549513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:43.549513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:43.549513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:43.677163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:43.684624 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a648679-3531-4b71-ae9d-9acd5828902b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.153826 Dec 25 22:14:43.685760 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4356/8746] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:43 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:44.701087 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:44.701697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:44.708859 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:44.709338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:44.710117 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:44.710553 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:44.842328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:44.850172 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-607c626a-43c8-4c71-825a-cb9404cbbfcd tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.152811 Dec 25 22:14:44.850756 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4391/8747] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:44 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:45.867020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:45.867648 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:45.874192 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:45.874661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:45.875459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:45.875914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:46.013712 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:46.021971 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-36441a32-6bf3-436f-87bb-fcf7a32e1e98 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.158916 Dec 25 22:14:46.022705 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4357/8748] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:45 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:47.039636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:47.040203 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:47.047015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:47.047468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:47.048237 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:47.048716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:47.183133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:47.190661 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-837a6095-fd3b-416c-a06a-2aca3fc70b07 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.155021 Dec 25 22:14:47.191230 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4392/8749] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:47 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:48.206889 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:48.207507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:48.214489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:48.215015 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:48.215955 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:48.216400 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:48.351424 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:48.358792 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-dfb84e19-d4d6-4930-9306-4a44c21dfe7a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.155654 Dec 25 22:14:48.359364 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4358/8750] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:48 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:49.376280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:49.376821 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:49.384084 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:49.384538 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:49.385349 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:49.385786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:49.523926 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:49.531472 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1aacde9b-a16b-4bbe-883b-4856f9909d1b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.159062 Dec 25 22:14:49.532044 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4393/8751] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:49 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:50.549169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:50.549788 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:50.557142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:50.557613 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:50.558413 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:50.558873 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:50.694014 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:50.701423 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5a4d43a0-7722-4ac7-9b00-169a1d1b32de tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1692 microversion: 2.1 time: 0.156155 Dec 25 22:14:50.702021 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4359/8752] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:50 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:51.718391 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:51.719040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:51.725737 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:51.726190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:51.726969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:51.727408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:51.862194 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:51.870360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fc78be4e-303d-4496-9a4d-bc9ea83fa28a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1669 microversion: 2.1 time: 0.155996 Dec 25 22:14:51.870915 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4394/8753] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:51 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:52.964952 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:52.966151 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:52.973038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:52.973508 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:52.974313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:52.974771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:53.023169 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9626a5aa-3321-4649-b688-926882273100 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action" status: 200 len: 35356 microversion: 2.1 time: 0.061838 Dec 25 22:14:53.023728 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4360/8754] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:14:52 2021] POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action => generated 35356 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:14:53.034712 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0c13e28c-cd30-4ca8-aa57-1abd79a94e53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:14:53.041593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c13e28c-cd30-4ca8-aa57-1abd79a94e53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:53.042037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0c13e28c-cd30-4ca8-aa57-1abd79a94e53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:53.063756 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0c13e28c-cd30-4ca8-aa57-1abd79a94e53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Going to try to start instance {{(pid=136548) start /opt/stack/nova/nova/compute/api.py:2677}} Dec 25 22:14:53.223026 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0c13e28c-cd30-4ca8-aa57-1abd79a94e53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action" status: 202 len: 0 microversion: 2.1 time: 0.191868 Dec 25 22:14:53.223773 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4395/8755] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:14:53 2021] POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:14:53.232202 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:53.233527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:53.242145 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:53.242598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:53.243416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:53.243877 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:53.457650 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:53.465548 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-833b1fba-f2e4-4db5-a66b-1f220a950e74 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1678 microversion: 2.1 time: 0.237151 Dec 25 22:14:53.466165 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4361/8756] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:53 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:54.484106 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:54.484801 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:54.495855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:54.495855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:54.495855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:54.495855 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:54.627575 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:54.635560 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f89d763e-ecc4-4c91-8efa-8637a5b99789 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1678 microversion: 2.1 time: 0.156343 Dec 25 22:14:54.636136 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4396/8757] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:54 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:14:55.653395 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:14:55.654052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:14:55.661753 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:55.662229 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:55.663046 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:14:55.663557 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:14:55.795447 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:14:55.802815 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fc950296-6bb5-4d43-9c76-8cda9a8386cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1682 microversion: 2.1 time: 0.153532 Dec 25 22:14:55.803392 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4362/8758] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:14:55 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:17.976039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:17.977016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:17.983336 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:17.983794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:17.984580 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:17.985072 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:18.036285 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cfc4cdf6-e7d7-4b99-b9a0-5973043346cb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action" status: 200 len: 59915 microversion: 2.1 time: 0.064380 Dec 25 22:15:18.036967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4397/8759] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:15:17 2021] POST /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2/action => generated 59915 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:15:18.130441 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:15:18.130922 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:15:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:15:25.141787 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-187bafe9-c821-42fa-8b85-da47c63a1383 req-0151dffd-b986-4488-a873-454e19329d43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad663de-c6f3-4a91-9173-95d13cc97eb2", "tag": "bb4bbc67-34ac-42e4-852b-4061d3ac30e6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:25.143549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:25.144150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:25.145636 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:15:25.145636 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:15:25.151268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:25.151855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:25.152761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:25.153315 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:25.154348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-187bafe9-c821-42fa-8b85-da47c63a1383 req-0151dffd-b986-4488-a873-454e19329d43 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:25.154794 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-187bafe9-c821-42fa-8b85-da47c63a1383 req-0151dffd-b986-4488-a873-454e19329d43 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:25.167149 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-187bafe9-c821-42fa-8b85-da47c63a1383 req-0151dffd-b986-4488-a873-454e19329d43 service nova] Creating event network-changed:bb4bbc67-34ac-42e4-852b-4061d3ac30e6 for instance cad663de-c6f3-4a91-9173-95d13cc97eb2 on nch1-master-1 Dec 25 22:15:25.172962 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-187bafe9-c821-42fa-8b85-da47c63a1383 req-0151dffd-b986-4488-a873-454e19329d43 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035412 Dec 25 22:15:25.173938 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4398/8760] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:15:25 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:15:25.181487 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:15:25.510173 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-31ed332e-631a-401a-bbf7-24d3f0b4eea4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 204 len: 0 microversion: 2.1 time: 0.376571 Dec 25 22:15:25.510914 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4363/8761] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:15:25 2021] DELETE /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:15:25.520558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:25.521547 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:25.527738 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:25.528651 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:25.529304 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:25.529480 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:25.793896 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:25.802691 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3fd2f33b-17fd-4021-90cc-2f34477a1a7e tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1688 microversion: 2.1 time: 0.287286 Dec 25 22:15:25.805600 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4399/8762] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:25 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1688 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:26.819875 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:26.820582 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:26.827280 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:26.827742 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:26.828530 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:26.829002 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:27.044895 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:27.052332 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0dcddbcc-fa8d-4546-a1c9-b46271e94162 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1569 microversion: 2.1 time: 0.236488 Dec 25 22:15:27.052926 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4364/8763] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:26 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:27.866227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-07f99e7f-f570-4a38-8497-42fb19c1fb0a req-3fa24c02-22bd-43cb-b992-ba8e8095d971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad663de-c6f3-4a91-9173-95d13cc97eb2", "name": "network-vif-deleted", "tag": "bb4bbc67-34ac-42e4-852b-4061d3ac30e6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:27.867798 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:15:27.867798 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:15:27.875671 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-07f99e7f-f570-4a38-8497-42fb19c1fb0a req-3fa24c02-22bd-43cb-b992-ba8e8095d971 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:27.876121 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-07f99e7f-f570-4a38-8497-42fb19c1fb0a req-3fa24c02-22bd-43cb-b992-ba8e8095d971 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:27.887360 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-07f99e7f-f570-4a38-8497-42fb19c1fb0a req-3fa24c02-22bd-43cb-b992-ba8e8095d971 service nova] Creating event network-vif-deleted:bb4bbc67-34ac-42e4-852b-4061d3ac30e6 for instance cad663de-c6f3-4a91-9173-95d13cc97eb2 on nch1-master-1 Dec 25 22:15:27.892522 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-07f99e7f-f570-4a38-8497-42fb19c1fb0a req-3fa24c02-22bd-43cb-b992-ba8e8095d971 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Dec 25 22:15:27.893236 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4400/8764] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:15:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:15:28.069432 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:28.069977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:28.076710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:28.077222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:28.078013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:28.078463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:28.141314 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:28.149646 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8517426e-1975-4825-8e7e-bf17dc357d62 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 200 len: 1351 microversion: 2.1 time: 0.084240 Dec 25 22:15:28.150233 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4365/8765] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:28 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 1351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:29.167622 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:29.168254 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: cad663de-c6f3-4a91-9173-95d13cc97eb2] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:29.174571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:29.175027 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:29.176429 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:29.176905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:29.189987 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] HTTP exception thrown: Instance cad663de-c6f3-4a91-9173-95d13cc97eb2 could not be found. Dec 25 22:15:29.190573 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Returning 404 to user: Instance cad663de-c6f3-4a91-9173-95d13cc97eb2 could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:15:29.191430 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-52d85121-8096-43e6-b031-b755c1dcd97d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2" status: 404 len: 111 microversion: 2.1 time: 0.028797 Dec 25 22:15:29.191967 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4401/8766] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:29 2021] GET /compute/v2.1/servers/cad663de-c6f3-4a91-9173-95d13cc97eb2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:15:32.637870 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-328800ba-af55-49d5-bf0b-e6134f5877bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '.version_select at 0x7fa50054e160>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:32.712776 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-328800ba-af55-49d5-bf0b-e6134f5877bf tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1405631940" status: 202 len: 0 microversion: 2.1 time: 0.078552 Dec 25 22:15:32.713425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4366/8767] 10.222.0.32 () {58 vars in 1283 bytes} [Sat Dec 25 22:15:32 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1405631940 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:15:32.742281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-53cd1831-fe42-4073-8d50-9341feac8e67 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: .version_select at 0x7fa50054ae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-466890667"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:32.757519 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-53cd1831-fe42-4073-8d50-9341feac8e67 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:15:32.764318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-53cd1831-fe42-4073-8d50-9341feac8e67 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:15:33.172125 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-53cd1831-fe42-4073-8d50-9341feac8e67 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:15:33.177646 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-53cd1831-fe42-4073-8d50-9341feac8e67 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:15:33.191742 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-53cd1831-fe42-4073-8d50-9341feac8e67 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.453927 Dec 25 22:15:33.192348 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4402/8768] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:15:32 2021] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:41.364524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-261337952", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "networks": [{"uuid": "4f04bd40-013c-457d-b2da-401c3a9aae19"}], "key_name": "tempest-TestNetworkAdvancedServerOps-466890667", "security_groups": [{"name": "tempest-secgroup-smoke-52000553"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:41.476273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] validate_networks() for [('4f04bd40-013c-457d-b2da-401c3a9aae19', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:15:41.922851 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:15:41.923890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:15:41.924819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:15:41.929018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:15:41.929018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:15:41.937337 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:41.938700 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:41.939761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:41.940365 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:41.965513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:15:41.971855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Getting quotas for user cbd356d161184383bdcc6fb37232ca64 and project 252f592e72984919a30b8248c35228f7. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:15:41.986741 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:15:41.990766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:15:42.099331 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ad8db436-7962-4863-8625-5e5d15e80b53 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.739999 Dec 25 22:15:42.100097 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4367/8769] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:15:41 2021] POST /compute/v2.1/servers => generated 404 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:15:42.110966 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a03f3db7-feeb-4bc2-8da5-a381e7e0dadb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:42.112258 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a03f3db7-feeb-4bc2-8da5-a381e7e0dadb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:42.201044 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a03f3db7-feeb-4bc2-8da5-a381e7e0dadb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:42.208800 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a03f3db7-feeb-4bc2-8da5-a381e7e0dadb tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1265 microversion: 2.1 time: 0.102342 Dec 25 22:15:42.210574 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4403/8770] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:42 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1265 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:43.227649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:43.228213 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:43.239505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:43.239983 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:43.240809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:43.241840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:43.316369 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:43.326685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-41fa7ddc-7a45-4095-b7c8-93092ab30c08 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1269 microversion: 2.1 time: 0.102770 Dec 25 22:15:43.327272 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4368/8771] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:43 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1269 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:44.343780 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:44.344397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:44.353316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:44.355033 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:44.359774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:44.360603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:44.443167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:44.451842 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea75cc40-eff2-4f58-8c12-45c6660ae597 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1335 microversion: 2.1 time: 0.111778 Dec 25 22:15:44.452782 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4404/8772] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:44 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1335 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:45.470012 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:45.470664 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:45.477055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:45.477522 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:45.478330 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:45.478811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:45.658840 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:45.669117 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-47eadfa4-de1b-475d-84af-eab25282e0b8 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.202899 Dec 25 22:15:45.679132 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4369/8773] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:45 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:45.967384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-a1db3fa1-c218-41d8-8dda-8388cac9be36 req-c64994d0-a1e7-4d67-b2ba-5541b10d384e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c", "tag": "874c89f5-287e-42be-bf7c-ec48b51e47e6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:45.968968 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:15:45.968968 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:15:45.977000 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a1db3fa1-c218-41d8-8dda-8388cac9be36 req-c64994d0-a1e7-4d67-b2ba-5541b10d384e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:45.977455 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-a1db3fa1-c218-41d8-8dda-8388cac9be36 req-c64994d0-a1e7-4d67-b2ba-5541b10d384e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:45.989679 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-a1db3fa1-c218-41d8-8dda-8388cac9be36 req-c64994d0-a1e7-4d67-b2ba-5541b10d384e service nova] Creating event network-changed:874c89f5-287e-42be-bf7c-ec48b51e47e6 for instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c on nch1-master-1 Dec 25 22:15:45.994821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-a1db3fa1-c218-41d8-8dda-8388cac9be36 req-c64994d0-a1e7-4d67-b2ba-5541b10d384e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031506 Dec 25 22:15:45.995931 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4405/8774] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:15:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:15:46.685810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:46.686502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:46.693920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:46.694384 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:46.697537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:46.697537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:46.831604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:46.838916 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c4a93959-7bcf-4657-8915-5fcf138411dc tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.156886 Dec 25 22:15:46.839926 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4370/8775] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:46 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:47.857208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:47.857914 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:47.864894 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:47.865367 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:47.866189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:47.866627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:48.000424 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:48.007817 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eaaa5f79-ddeb-469b-9943-9ba1e503d6f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.155571 Dec 25 22:15:48.008385 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4406/8776] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:47 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:49.024472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:49.025116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:49.032322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:49.032783 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:49.033609 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:49.034061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:49.178077 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:49.186572 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8a5bda1a-5bb8-4e8e-86d7-47e47cce67db tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.166161 Dec 25 22:15:49.187163 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4371/8777] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:49 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:50.202739 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:50.203356 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:50.210845 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:50.211297 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:50.212077 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:50.212518 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:50.346912 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:50.354235 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6a297d81-e058-448a-83be-07f769753f25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.155247 Dec 25 22:15:50.354809 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4407/8778] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:50 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:51.286590 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-4f3c6f9a-35cc-4bf0-92d1-50d830dcd3c7 req-7b4a9034-af00-4fbc-8b2a-22680ee3e5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c", "name": "network-vif-plugged", "status": "completed", "tag": "874c89f5-287e-42be-bf7c-ec48b51e47e6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:51.288173 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:15:51.288173 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:15:51.296645 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4f3c6f9a-35cc-4bf0-92d1-50d830dcd3c7 req-7b4a9034-af00-4fbc-8b2a-22680ee3e5fd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:51.297188 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-4f3c6f9a-35cc-4bf0-92d1-50d830dcd3c7 req-7b4a9034-af00-4fbc-8b2a-22680ee3e5fd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:51.308507 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-4f3c6f9a-35cc-4bf0-92d1-50d830dcd3c7 req-7b4a9034-af00-4fbc-8b2a-22680ee3e5fd service nova] Creating event network-vif-plugged:874c89f5-287e-42be-bf7c-ec48b51e47e6 for instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c on nch1-master-1 Dec 25 22:15:51.313913 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-4f3c6f9a-35cc-4bf0-92d1-50d830dcd3c7 req-7b4a9034-af00-4fbc-8b2a-22680ee3e5fd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031704 Dec 25 22:15:51.314511 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4372/8779] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:15:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:15:51.370707 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:51.371454 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:51.379181 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:51.379905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:51.380935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:51.381543 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:51.552773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:51.560515 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-8cc03994-eb17-4eac-acab-073637495b1f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.193575 Dec 25 22:15:51.561071 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4408/8780] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:51 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:52.577806 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:52.578507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:52.586010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:52.586479 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:52.587268 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:52.587721 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:52.720668 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:52.728049 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ce26afe7-ff18-4f98-aaa1-c26e51a89c89 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1389 microversion: 2.1 time: 0.154363 Dec 25 22:15:52.728651 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4373/8781] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:52 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:53.744983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:53.745606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:53.752444 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:53.752936 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:53.753929 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:53.754208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:53.890323 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:53.898144 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-04e16688-06ef-4336-90eb-7bad6fd5e861 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1560 microversion: 2.1 time: 0.157370 Dec 25 22:15:53.898703 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4409/8782] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:53 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:53.914121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:53.914748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:53.921848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:53.922353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:53.923165 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:53.923622 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:54.054821 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:54.062194 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95976989-2b47-4abb-830a-94870bd52c25 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1560 microversion: 2.1 time: 0.151779 Dec 25 22:15:54.062764 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4374/8783] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:53 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:15:56.214672 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:15:56.215242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:15:56.222452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:56.223193 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:56.224587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:56.224669 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:56.273055 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b45a93e6-6018-4491-9f68-088b35b16361 req-63f0d2ce-a47f-4fb8-9c78-db0ce3fdb428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c", "tag": "874c89f5-287e-42be-bf7c-ec48b51e47e6"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:15:56.275265 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:15:56.275265 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:15:56.282376 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b45a93e6-6018-4491-9f68-088b35b16361 req-63f0d2ce-a47f-4fb8-9c78-db0ce3fdb428 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:15:56.283097 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b45a93e6-6018-4491-9f68-088b35b16361 req-63f0d2ce-a47f-4fb8-9c78-db0ce3fdb428 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:15:56.295086 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b45a93e6-6018-4491-9f68-088b35b16361 req-63f0d2ce-a47f-4fb8-9c78-db0ce3fdb428 service nova] Creating event network-changed:874c89f5-287e-42be-bf7c-ec48b51e47e6 for instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c on nch1-master-1 Dec 25 22:15:56.301327 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b45a93e6-6018-4491-9f68-088b35b16361 req-63f0d2ce-a47f-4fb8-9c78-db0ce3fdb428 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083381 Dec 25 22:15:56.302150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4375/8784] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:15:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:15:56.398526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:15:56.406246 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c76d65c3-9787-4d3b-ac03-d0c90d4b929d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1560 microversion: 2.1 time: 0.195548 Dec 25 22:15:56.407127 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4410/8785] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:15:56 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1560 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:17.638568 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:17.639739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:17.646814 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:17.650085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:17.650085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:17.650085 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:17.697577 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f5c0cbc6-505e-4f13-b794-fd066c6e8c81 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action" status: 200 len: 24569 microversion: 2.1 time: 0.063085 Dec 25 22:16:17.698261 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4376/8786] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:16:17 2021] POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action => generated 24569 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:16:24.083978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:24.084499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:24.090835 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:24.091287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:24.092058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:24.092502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:24.115724 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lazy-loading 'flavor' on Instance uuid a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:16:24.411615 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3613bfa5-8de8-4eae-ab4b-b3689a74362a tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action" status: 202 len: 0 microversion: 2.1 time: 0.331496 Dec 25 22:16:24.412264 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4411/8787] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:16:24 2021] POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:16:24.420811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:24.421553 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:24.429436 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:24.429904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:24.430709 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:24.431163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:24.568809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:24.576520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5bc86fbe-edda-4f75-b55c-3112fb698bb9 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1686 microversion: 2.1 time: 0.159783 Dec 25 22:16:24.577447 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4377/8788] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:24 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1686 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:25.595345 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:25.596055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:25.602383 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:25.602843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:25.603621 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:25.604061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:25.735879 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:25.744041 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9743e6e9-fb86-46fc-9e85-0b28c485c96b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1669 microversion: 2.1 time: 0.153705 Dec 25 22:16:25.744619 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4412/8789] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:25 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:26.835222 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:26.836194 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:26.844007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:26.844475 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:26.845303 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:26.845760 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:26.900208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-8c8e5bc7-165c-4e77-8990-cc0ec4df3fd0 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action" status: 200 len: 36137 microversion: 2.1 time: 0.069055 Dec 25 22:16:26.900836 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4378/8790] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:16:26 2021] POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action => generated 36137 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:16:26.911742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:26.912277 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:26.919110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:26.919562 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:26.920348 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:26.920784 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:27.130283 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e3557288-8260-43c3-b2d3-f526db4d8ca2 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action" status: 202 len: 0 microversion: 2.1 time: 0.221563 Dec 25 22:16:27.130853 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4413/8791] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:16:26 2021] POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:16:27.139538 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:27.144402 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:27.148306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:27.148778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:27.149618 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:27.150073 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:27.718754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:27.726831 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b0666a8d-52d4-473d-9924-b407c822da66 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1675 microversion: 2.1 time: 0.591439 Dec 25 22:16:27.727414 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4379/8792] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:27 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1675 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:16:28.748489 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:28.749225 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:28.757338 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:28.757793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:28.758613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:28.759053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:28.900166 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:28.908051 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c4e4ac25-db25-4c1a-89a6-0d92332574f7 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1675 microversion: 2.1 time: 0.166859 Dec 25 22:16:28.912189 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4414/8793] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:28 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:29.924688 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:29.925346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:29.933489 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:29.933965 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:29.934770 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:29.935235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:30.065198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:30.073347 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d9d42d78-aa8b-48f8-9b49-86e69ba16f0d tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1678 microversion: 2.1 time: 0.152279 Dec 25 22:16:30.074030 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4380/8794] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:29 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:30.164407 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:30.165440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:30.172215 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:30.172677 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:30.173508 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:30.173943 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:30.213706 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fd9235fd-f700-40b0-a845-13212dbc5f9b tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action" status: 200 len: 36137 microversion: 2.1 time: 0.052565 Dec 25 22:16:30.214532 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4415/8795] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:16:30 2021] POST /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c/action => generated 36137 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:16:31.258428 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:31.258940 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:31.261341 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-260dd328-c723-42f2-a967-93a84f0c4a08 req-0702e672-94d6-4b15-b893-8e2e6dae703d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c", "tag": "874c89f5-287e-42be-bf7c-ec48b51e47e6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:31.262838 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:16:31.262838 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:16:31.266007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:31.266477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:31.267371 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:31.267826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:31.271594 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-260dd328-c723-42f2-a967-93a84f0c4a08 req-0702e672-94d6-4b15-b893-8e2e6dae703d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:31.272047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-260dd328-c723-42f2-a967-93a84f0c4a08 req-0702e672-94d6-4b15-b893-8e2e6dae703d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:31.283859 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-260dd328-c723-42f2-a967-93a84f0c4a08 req-0702e672-94d6-4b15-b893-8e2e6dae703d service nova] Creating event network-changed:874c89f5-287e-42be-bf7c-ec48b51e47e6 for instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c on nch1-master-1 Dec 25 22:16:31.289345 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-260dd328-c723-42f2-a967-93a84f0c4a08 req-0702e672-94d6-4b15-b893-8e2e6dae703d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031948 Dec 25 22:16:31.290469 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4416/8796] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:16:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:16:31.294466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:16:31.572602 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3220baed-779c-41f1-b61c-8f5593fb021f tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 204 len: 0 microversion: 2.1 time: 0.317680 Dec 25 22:16:31.574147 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4381/8797] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:16:31 2021] DELETE /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:16:31.582541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:31.583248 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:31.592542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:31.593517 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:31.594609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:31.595590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:31.855542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:31.865470 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-0ebcf804-e57a-4e50-a7da-fa8a0216a4fe tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1684 microversion: 2.1 time: 0.286912 Dec 25 22:16:31.875907 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4417/8798] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:31 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1684 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:16:32.884258 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:32.885007 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:32.891885 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:32.892355 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:32.893196 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:32.893655 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:33.026559 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:33.034156 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4a25c34b-414b-4543-a0e9-e7c968bb89c4 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1566 microversion: 2.1 time: 0.154029 Dec 25 22:16:33.034724 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4382/8799] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:32 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:33.711108 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-7d552fcc-8a5a-4275-9f74-e5e71fb50e9c req-ef9572cf-1271-40a6-aea8-12993902e4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c", "name": "network-vif-deleted", "tag": "874c89f5-287e-42be-bf7c-ec48b51e47e6"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:33.712691 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:16:33.712691 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:16:33.721026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7d552fcc-8a5a-4275-9f74-e5e71fb50e9c req-ef9572cf-1271-40a6-aea8-12993902e4fc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:33.725232 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-7d552fcc-8a5a-4275-9f74-e5e71fb50e9c req-ef9572cf-1271-40a6-aea8-12993902e4fc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:33.731668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-7d552fcc-8a5a-4275-9f74-e5e71fb50e9c req-ef9572cf-1271-40a6-aea8-12993902e4fc service nova] Creating event network-vif-deleted:874c89f5-287e-42be-bf7c-ec48b51e47e6 for instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c on nch1-master-1 Dec 25 22:16:33.736576 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-7d552fcc-8a5a-4275-9f74-e5e71fb50e9c req-ef9572cf-1271-40a6-aea8-12993902e4fc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029803 Dec 25 22:16:33.738277 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4418/8800] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:16:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:16:34.052373 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:34.053037 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:34.060520 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:34.061013 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:34.061817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:34.062266 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:34.096026 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:34.096503 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:34.097023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lazy-loading 'fault' on Instance uuid a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:16:34.138748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbd356d161184383bdcc6fb37232ca64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '252f592e72984919a30b8248c35228f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:34.146344 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd454534-b6b2-45e4-b880-52d9e2670103 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 200 len: 1355 microversion: 2.1 time: 0.098519 Dec 25 22:16:34.146931 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4383/8801] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:34 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 1355 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:16:35.164411 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:35.165046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] [instance: a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:35.171329 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:35.171776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:35.172549 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:35.173013 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:35.186033 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] HTTP exception thrown: Instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c could not be found. Dec 25 22:16:35.186640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Returning 404 to user: Instance a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:16:35.187482 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9252259b-dc89-4038-be19-b24cac631f32 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c" status: 404 len: 111 microversion: 2.1 time: 0.028155 Dec 25 22:16:35.188005 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4419/8802] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:35 2021] GET /compute/v2.1/servers/a5c17c45-e17c-439e-a2c0-79c3e5f7ef0c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:16:38.915294 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-85d6d4c8-fece-4f38-94d4-f6a03f5ed684 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] Calling method '.version_select at 0x7fa4f44ef940>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:39.048530 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-85d6d4c8-fece-4f38-94d4-f6a03f5ed684 tempest-TestNetworkAdvancedServerOps-865338636 tempest-TestNetworkAdvancedServerOps-865338636-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-466890667" status: 202 len: 0 microversion: 2.1 time: 0.136956 Dec 25 22:16:39.049246 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4384/8803] 10.222.0.32 () {58 vars in 1280 bytes} [Sat Dec 25 22:16:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-466890667 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 22:16:53.610897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-59aa6684-1ce3-44fd-9b4e-8bef29b814c9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'create', calling method: .version_select at 0x7fa500579c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1645781095"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:53.624868 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-59aa6684-1ce3-44fd-9b4e-8bef29b814c9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:16:53.629863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-59aa6684-1ce3-44fd-9b4e-8bef29b814c9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for user 21adac3627a24f24b10c1c0023d80a69 and project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:16:54.314487 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-59aa6684-1ce3-44fd-9b4e-8bef29b814c9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:16:54.319986 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-59aa6684-1ce3-44fd-9b4e-8bef29b814c9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for user 21adac3627a24f24b10c1c0023d80a69 and project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:16:54.334045 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-59aa6684-1ce3-44fd-9b4e-8bef29b814c9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.893417 Dec 25 22:16:54.335774 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4420/8804] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:16:53 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:56.734525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1773942855", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1645781095", "security_groups": [{"name": "tempest-secgroup-smoke-349544551"}], "networks": [{"uuid": "db0de716-353d-48fe-b77e-10fa7ac25f29"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:16:56.839334 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] validate_networks() for [('db0de716-353d-48fe-b77e-10fa7ac25f29', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:16:57.233506 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:16:57.233948 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:16:57.234501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:16:57.234932 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:16:57.235361 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:16:57.245018 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:57.245498 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:57.246336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:57.246798 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:57.264569 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for project 8aefbad38c734203b2719ed40e315a78. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:16:57.270010 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for user 21adac3627a24f24b10c1c0023d80a69 and project 8aefbad38c734203b2719ed40e315a78. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:16:57.282949 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:16:57.285771 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:16:57.417569 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-72d10925-f402-4901-a642-3883da3da9d6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.686627 Dec 25 22:16:57.418255 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4385/8805] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:16:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:16:57.429427 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a00ee332-6386-4ad8-879d-e87883434f9c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:57.430093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a00ee332-6386-4ad8-879d-e87883434f9c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:57.484412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a00ee332-6386-4ad8-879d-e87883434f9c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:57.491824 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a00ee332-6386-4ad8-879d-e87883434f9c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1247 microversion: 2.1 time: 0.067725 Dec 25 22:16:57.492411 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4421/8806] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:57 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1247 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:58.508756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:58.509415 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:58.516444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:58.517057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:58.517748 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:58.518259 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:58.578011 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:58.586218 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-485d7323-8e7c-4eb6-92ca-3c6220ac8322 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1251 microversion: 2.1 time: 0.081230 Dec 25 22:16:58.586798 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4386/8807] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:58 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1251 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:16:59.604034 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:16:59.604796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:16:59.612268 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:59.612723 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:59.613698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:16:59.614143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:16:59.690355 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:16:59.700153 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ce7e31c6-d665-4710-af54-2102c172b6db tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1307 microversion: 2.1 time: 0.099649 Dec 25 22:16:59.707846 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4422/8808] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:16:59 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:00.717492 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:00.718130 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:00.725825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:00.726220 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:00.727020 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:00.727464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:00.971030 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:00.979835 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6d636399-57f4-4689-b8c8-226925540620 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.265957 Dec 25 22:17:00.990626 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4387/8809] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:00 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:01.243156 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-b1014493-c056-4acc-9a92-c9e9dac420ac req-1e1e9eb8-ca7d-4dd9-ab46-89d00f372358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:17:01.244723 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:17:01.244723 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:17:01.252110 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b1014493-c056-4acc-9a92-c9e9dac420ac req-1e1e9eb8-ca7d-4dd9-ab46-89d00f372358 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:01.252570 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-b1014493-c056-4acc-9a92-c9e9dac420ac req-1e1e9eb8-ca7d-4dd9-ab46-89d00f372358 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:01.265842 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-b1014493-c056-4acc-9a92-c9e9dac420ac req-1e1e9eb8-ca7d-4dd9-ab46-89d00f372358 service nova] Creating event network-changed:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:17:01.273065 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-b1014493-c056-4acc-9a92-c9e9dac420ac req-1e1e9eb8-ca7d-4dd9-ab46-89d00f372358 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100950 Dec 25 22:17:01.273679 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4423/8810] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:17:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:17:01.499237 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:17:01.499406 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:17:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:17:01.997768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:01.998419 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:02.005249 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:02.005729 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:02.006523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:02.006973 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:02.235276 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:02.243009 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f777b92a-b2dc-4584-8bfc-1efa7b6e0f30 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.249125 Dec 25 22:17:02.243586 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4388/8811] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:01 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:03.259815 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:03.260513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:03.267438 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:03.267887 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:03.268694 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:03.269159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:03.407924 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:03.415934 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-98e62fe2-b4f4-4456-a699-6957cfb6030e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.160195 Dec 25 22:17:03.416506 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4424/8812] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:03 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:04.432601 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:04.433265 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:04.440076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:04.440550 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:04.441385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:04.441843 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:04.570131 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:04.577469 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1e34395f-da6e-4e20-85d7-98e778a99e1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.148690 Dec 25 22:17:04.578044 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4389/8813] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:04 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:05.593610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:05.594226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:05.602650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:05.603100 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:05.603935 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:05.604372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:05.743676 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:05.751441 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d2d16b6e-a5c9-4282-8c42-24c0656187fc tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.161792 Dec 25 22:17:05.752031 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4425/8814] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:05 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:06.767835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:06.768468 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:06.775281 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:06.775756 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:06.776588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:06.777076 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:06.911353 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:06.918685 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2fa5203d-937c-4ec3-ae33-455ddd2ccd7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.154547 Dec 25 22:17:06.919265 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4390/8815] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:06 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:07.650974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-c9856b4a-f8f5-412e-b180-b32e54671a4c req-bcea3f7e-b4c2-4bfe-b63c-0315d97575cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:17:07.652749 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:17:07.652749 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:17:07.661255 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c9856b4a-f8f5-412e-b180-b32e54671a4c req-bcea3f7e-b4c2-4bfe-b63c-0315d97575cd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:07.661706 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-c9856b4a-f8f5-412e-b180-b32e54671a4c req-bcea3f7e-b4c2-4bfe-b63c-0315d97575cd service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:07.672699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-c9856b4a-f8f5-412e-b180-b32e54671a4c req-bcea3f7e-b4c2-4bfe-b63c-0315d97575cd service nova] Creating event network-vif-plugged:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:17:07.678661 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-c9856b4a-f8f5-412e-b180-b32e54671a4c req-bcea3f7e-b4c2-4bfe-b63c-0315d97575cd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031647 Dec 25 22:17:07.679228 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4426/8816] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:17:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:17:07.935827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:07.936390 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:07.943375 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:07.943849 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:07.944660 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:07.945150 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:08.086223 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:08.093793 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3ffa2e73-b71a-423f-a8e1-250aab8fffaf tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1372 microversion: 2.1 time: 0.161789 Dec 25 22:17:08.094370 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4391/8817] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:07 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:09.111708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:09.112380 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:09.120623 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:09.121133 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:09.122649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:09.122649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:09.254165 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:09.261496 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-54736817-1f5b-4898-8773-0152f0fbabd1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1557 microversion: 2.1 time: 0.154023 Dec 25 22:17:09.262066 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4427/8818] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:09 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:09.276945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:17:09.277576 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:17:09.284214 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:09.284713 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:09.285529 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:09.285978 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:09.415351 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:17:09.422612 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e4fe8105-b777-45d7-b279-786ff469fa58 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1557 microversion: 2.1 time: 0.149417 Dec 25 22:17:09.423173 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4392/8819] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:17:09 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:17:11.656159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-91d67fe4-32dd-451c-af0f-e1f1aeb046d3 req-f13502d3-4fe0-4a60-b109-d9615166fab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:17:11.657854 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:17:11.657854 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:17:11.668093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-91d67fe4-32dd-451c-af0f-e1f1aeb046d3 req-f13502d3-4fe0-4a60-b109-d9615166fab2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:17:11.668542 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-91d67fe4-32dd-451c-af0f-e1f1aeb046d3 req-f13502d3-4fe0-4a60-b109-d9615166fab2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:17:11.679659 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-91d67fe4-32dd-451c-af0f-e1f1aeb046d3 req-f13502d3-4fe0-4a60-b109-d9615166fab2 service nova] Creating event network-changed:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:17:11.685359 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-91d67fe4-32dd-451c-af0f-e1f1aeb046d3 req-f13502d3-4fe0-4a60-b109-d9615166fab2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033096 Dec 25 22:17:11.685960 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4428/8820] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:17:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:19:02.777602 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:19:02.778171 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:19:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:19:06.887996 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 22:19:06.891802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:19:06.892340 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:06.898341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:06.898803 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:06.899614 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:06.900062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:06.922074 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lazy-loading 'flavor' on Instance uuid db11646b-c236-4ea8-afc6-7542c731bfa5 {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:19:07.463208 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-16adddf7-684a-4e2f-a64d-725e25387ba8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5/action" status: 202 len: 0 microversion: 2.1 time: 0.577641 Dec 25 22:19:07.463979 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4393/8821] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:19:06 2021] POST /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:19:07.471194 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 25 22:19:07.472021 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:19:07.476002 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:07.476749 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:07.483557 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:07.484014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:07.484804 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:07.485295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:07.620009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:07.627614 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ebaaaf18-ca6b-4de1-bb77-60b608efcf9e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.158594 Dec 25 22:19:07.628181 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4429/8822] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:07 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:08.646951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:08.656034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:08.656034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:08.656034 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:08.656299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:08.656675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:08.660223 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38698. Dec 25 22:19:08.804009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:08.812306 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-34905df1-782b-47ec-a547-62b59f04f74f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.170769 Dec 25 22:19:08.812893 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4394/8823] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:08 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:09.829354 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:09.829971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:09.842742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:09.843227 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:09.844015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:09.844458 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:09.848709 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38704. Dec 25 22:19:09.849451 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 38702. Dec 25 22:19:09.978603 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:09.986698 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d7fbf721-20bd-4c68-b50a-9e9dcdabfa95 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.161135 Dec 25 22:19:09.987261 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4430/8824] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:09 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:11.002899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:11.003526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:11.010386 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:11.010848 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:11.011637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:11.012611 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:11.147830 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:11.155724 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-58102cee-43cc-46c8-86e9-7fe8dbc166f7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.156666 Dec 25 22:19:11.156292 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4395/8825] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:10 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:12.172344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:12.172980 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:12.180135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:12.180521 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:12.181334 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:12.181770 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:12.315358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:12.322704 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ee84453-17d7-4659-aa12-bb6e756636b6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.154154 Dec 25 22:19:12.323273 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4431/8826] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:12 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:13.339681 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:13.340317 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:13.347162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:13.347626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:13.348420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:13.348886 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:13.479951 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:13.487865 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec7db375-5773-47b2-8920-37fb9cdd81e4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.151978 Dec 25 22:19:13.488426 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4396/8827] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:13 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:14.505022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:14.505635 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:14.512343 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:14.512796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:14.513605 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:14.514047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:14.655921 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:14.663785 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb430912-fddf-4bc5-aa28-aea57d3b5b63 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.162561 Dec 25 22:19:14.664355 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4432/8828] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:14 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:15.680612 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:15.681343 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:15.688406 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:15.690136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:15.690136 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:15.690296 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:15.826163 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:15.833500 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e589d062-9960-4130-8206-4493f0f2df47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.156706 Dec 25 22:19:15.834317 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4397/8829] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:15 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:16.850286 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:16.850928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:16.858153 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:16.858981 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:16.859762 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:16.860198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:16.995226 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:17.003248 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-33f6663c-4d75-4e60-8a00-a21eb470ba12 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.156686 Dec 25 22:19:17.003822 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4433/8830] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:16 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:18.019892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:18.020526 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:18.027279 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:18.027740 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:18.028527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:18.029006 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:18.159067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:18.166419 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-b713e95c-99f6-4d6e-b86a-38c66636f703 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1703 microversion: 2.1 time: 0.150314 Dec 25 22:19:18.166986 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4398/8831] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:18 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1703 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:19.183309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:19.183872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:19.190558 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:19.191005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:19.191777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:19.192210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:19.322987 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:19.331003 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ea0bdd19-4d28-479e-aa67-9c444883d8a5 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1703 microversion: 2.1 time: 0.151506 Dec 25 22:19:19.338224 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4434/8832] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:19 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1703 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:20.348588 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:20.349262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:20.358836 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:20.359399 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:20.360215 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:20.361061 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:20.522505 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:20.530147 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c817816-3fd0-4969-a54f-81a50b15c00a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.185396 Dec 25 22:19:20.532301 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4399/8833] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:20 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:19:21.551590 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:21.552212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:21.560176 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:21.560854 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:21.561673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:21.562262 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:21.710233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:21.723668 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f59b0d23-a255-4f2b-9414-fd5da826aaba tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.175913 Dec 25 22:19:21.724485 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4435/8834] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:21 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:22.347802 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-789b3d39-dcb6-4c00-8651-345335ed1116 req-d54110ec-c7da-4d42-8d53-31f26831731d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:19:22.349399 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:19:22.349399 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:19:22.357470 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-789b3d39-dcb6-4c00-8651-345335ed1116 req-d54110ec-c7da-4d42-8d53-31f26831731d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:22.359899 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-789b3d39-dcb6-4c00-8651-345335ed1116 req-d54110ec-c7da-4d42-8d53-31f26831731d service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:22.375234 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-789b3d39-dcb6-4c00-8651-345335ed1116 req-d54110ec-c7da-4d42-8d53-31f26831731d service nova] Creating event network-vif-plugged:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:19:22.380190 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-789b3d39-dcb6-4c00-8651-345335ed1116 req-d54110ec-c7da-4d42-8d53-31f26831731d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115102 Dec 25 22:19:22.385777 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4400/8835] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:19:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:19:22.741393 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:22.742773 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:22.750930 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:22.751817 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:22.752850 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:22.753528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:22.920257 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:22.928501 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f00f7977-dad1-454d-a9a2-8a4ede27cd8e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.190951 Dec 25 22:19:22.930575 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4436/8836] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:22 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:23.945826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:23.947471 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:23.955673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:23.960080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:23.960080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:23.960080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:24.125477 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:24.133122 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4660dc7b-3bc1-4379-93a3-274a05b37b3c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.191393 Dec 25 22:19:24.137629 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4401/8837] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:23 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:25.167377 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:25.171001 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:25.178678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:25.179497 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:25.180848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:25.181504 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:25.343118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:25.354314 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-aa90fa7a-d8c6-4404-bfbc-e81693b1e2f4 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.201065 Dec 25 22:19:25.355205 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4437/8838] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:25 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:26.372494 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:26.373169 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:26.381299 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:26.381761 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:26.382555 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:26.383001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:26.528093 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:26.537466 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4e6014ea-ac8a-432f-aa5c-9c1fd74b8db7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.169184 Dec 25 22:19:26.538201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4402/8839] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:26 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:27.557090 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:27.559118 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:27.566460 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:27.567005 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:27.567922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:27.568463 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:27.722210 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:27.731533 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-95814e5f-1e28-4de1-a567-35e2192f8e7a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.179679 Dec 25 22:19:27.740856 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4438/8840] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:27 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:28.747969 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:28.749232 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:28.758811 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:28.759275 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:28.760109 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:28.760537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:28.924782 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:28.934628 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-40b1549f-e3d8-4b45-925e-e36d071ab329 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.190878 Dec 25 22:19:28.935402 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4403/8841] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:28 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:29.951701 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:29.952365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:29.968219 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:29.968735 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:29.969589 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:29.970028 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:30.127963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:30.138153 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-39ced276-6f0d-4bdd-8d1b-e23eb90f2c07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.190133 Dec 25 22:19:30.148268 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4439/8842] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:29 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:31.155095 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:31.155658 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:31.162513 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:31.162988 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:31.163785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:31.164239 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:31.308464 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:31.316520 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9542d423-d057-4ff6-9097-21f4a92b8f56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1698 microversion: 2.1 time: 0.165275 Dec 25 22:19:31.321129 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4404/8843] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:31 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:32.334403 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:32.335014 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:32.341732 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:32.342187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:32.342963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:32.343401 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:32.474009 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:32.482316 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-62e0809d-69b8-4ed6-ba5a-6ced71f29a8a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1680 microversion: 2.1 time: 0.151329 Dec 25 22:19:32.482920 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4440/8844] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:32 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:33.499845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:33.500472 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:33.507486 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:33.513484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:33.513484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:33.513484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:33.643072 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:33.652710 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-11028148-3ba5-4914-a428-b3429cf54ba2 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1680 microversion: 2.1 time: 0.156541 Dec 25 22:19:33.653574 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4405/8845] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:33 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:34.284937 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-718b382f-1fa2-4412-aad7-df03e666c788 req-1e2d6995-8866-48ad-aa7d-7d71aae21778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "name": "network-vif-unplugged", "status": "completed", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:19:34.286509 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:19:34.286509 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:19:34.294327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-718b382f-1fa2-4412-aad7-df03e666c788 req-1e2d6995-8866-48ad-aa7d-7d71aae21778 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:34.294776 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-718b382f-1fa2-4412-aad7-df03e666c788 req-1e2d6995-8866-48ad-aa7d-7d71aae21778 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:34.305473 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.compute.server_external_events [req-718b382f-1fa2-4412-aad7-df03e666c788 req-1e2d6995-8866-48ad-aa7d-7d71aae21778 service nova] Unable to find a host for instance db11646b-c236-4ea8-afc6-7542c731bfa5. Dropping event network-vif-unplugged {{(pid=136548) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Dec 25 22:19:34.306343 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-718b382f-1fa2-4412-aad7-df03e666c788 req-1e2d6995-8866-48ad-aa7d-7d71aae21778 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025429 Dec 25 22:19:34.306915 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4441/8846] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:19:34 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Dec 25 22:19:34.670338 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:34.670884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:34.677680 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:34.678142 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:34.678939 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:34.679388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:34.815689 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:34.823085 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fd6066de-cdad-4b5d-9497-50c9f2ae96ec tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1623 microversion: 2.1 time: 0.157223 Dec 25 22:19:34.823651 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4406/8847] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:34 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1623 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:34.839321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:19:34.841375 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:34.846993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:34.847535 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:34.848310 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:34.848751 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:35.128681 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-75633705-b8d7-47f7-8e77-9ad0905e4303 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5/action" status: 202 len: 0 microversion: 2.1 time: 0.293143 Dec 25 22:19:35.129536 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4442/8848] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:19:34 2021] POST /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Dec 25 22:19:35.137409 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:35.138799 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:35.144465 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:35.144968 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:35.145764 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:35.146209 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:35.280989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:35.289743 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2c32301-e1fe-4dd2-94e2-c53555f30f6a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1631 microversion: 2.1 time: 0.155380 Dec 25 22:19:35.290332 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4407/8849] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:35 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1631 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:36.307697 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:36.308340 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:36.315026 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:36.315483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:36.316271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:36.317025 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:36.454061 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:36.463725 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-68404974-b6cc-429a-b40f-539f150501e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1631 microversion: 2.1 time: 0.160853 Dec 25 22:19:36.464690 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4443/8850] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:36 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1631 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:37.480507 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:37.481161 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:37.487947 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:37.488444 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:37.489273 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:37.489791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:37.626313 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:37.634640 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4bfd3ebc-50bb-412f-a4af-1af79aadb69e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.157806 Dec 25 22:19:37.635105 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4408/8851] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:37 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:38.652440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:38.653103 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:38.660527 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:38.661872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:38.662886 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:38.663332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:38.812007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:38.820153 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-bc6bfa47-94f2-495c-ab20-844f63d6258d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.171752 Dec 25 22:19:38.820738 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4444/8852] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:38 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:39.839943 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:39.841208 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:39.849460 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:39.850044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:39.854884 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:39.855519 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:40.020850 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:40.029597 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4458fb94-de7c-4c4b-93a6-47bb71fbbb49 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.194560 Dec 25 22:19:40.030179 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4409/8853] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:39 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:41.047452 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:41.048067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:41.054395 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:41.054849 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:41.055629 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:41.056067 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:41.207270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:41.219018 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-24f755b6-ee76-4d51-a9d9-9d66ba57d47e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.175300 Dec 25 22:19:41.219954 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4445/8854] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:41 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:42.235630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:42.236246 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:42.243203 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:42.243678 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:42.253819 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:42.254437 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:42.401067 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:42.409019 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-02655645-b987-4d5b-b69e-32df70ad9e55 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.177064 Dec 25 22:19:42.409899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4410/8855] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:42 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:43.426221 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:43.426823 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:43.433906 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:43.434360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:43.435142 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:43.435578 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:43.583467 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:43.592865 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-03ba183f-4742-465a-837b-b6b11595e214 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.170329 Dec 25 22:19:43.594054 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4446/8856] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:43 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:44.610293 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:44.610956 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:44.617945 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:44.618416 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:44.619234 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:44.619691 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:44.760306 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:44.768064 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-7f439e84-1f21-4478-bc01-7e462bcbec8d tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.161490 Dec 25 22:19:44.777284 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4411/8857] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:44 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:45.784468 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:45.785352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:45.792666 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:45.793312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:45.794198 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:45.794716 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:45.940844 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:45.948610 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81cfc3c7-0b62-4b88-8ba0-5c5e3dc03f83 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.168377 Dec 25 22:19:45.957118 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4447/8858] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:45 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:46.968687 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:46.969542 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:46.977122 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:46.977673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:46.978575 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:46.979021 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:47.118727 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:47.126009 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1dd7ff1b-065a-4ee5-9100-283617574b11 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.163321 Dec 25 22:19:47.126594 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4412/8859] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:46 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:48.142995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:48.143637 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:48.150417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:48.150874 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:48.151656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:48.152099 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:48.300903 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:48.308736 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0271295-82c7-4d55-aeaa-70a26ac59490 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.169872 Dec 25 22:19:48.309356 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4448/8860] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:48 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:49.324808 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:49.325463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:49.332720 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:49.333466 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:49.334261 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:49.334710 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:49.469392 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:49.476836 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e3e59a8f-3f67-448b-9554-fe089c704e6c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.155833 Dec 25 22:19:49.477425 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4413/8861] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:49 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:50.493577 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:50.494212 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:50.501368 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:50.502422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:50.503242 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:50.503678 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:50.643991 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:50.651621 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d28b8c9d-2468-4a90-8fe9-2a10a2a31739 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.161800 Dec 25 22:19:50.652177 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4449/8862] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:50 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:51.669274 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:51.670845 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:51.678044 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:51.678510 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:51.679346 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:51.679791 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:51.929001 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:51.929001 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-1d54aa15-fca9-4813-82e5-7a4569ed4e13 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.170413 Dec 25 22:19:51.929001 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4414/8863] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:51 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:52.440636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-50ffaa8b-ee08-4384-9713-51de99a98461 req-c36386d9-f46a-4da8-9abc-daee66975a39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "name": "network-vif-plugged", "status": "completed", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:19:52.442223 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:19:52.442223 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:19:52.449992 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-50ffaa8b-ee08-4384-9713-51de99a98461 req-c36386d9-f46a-4da8-9abc-daee66975a39 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:52.450440 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-50ffaa8b-ee08-4384-9713-51de99a98461 req-c36386d9-f46a-4da8-9abc-daee66975a39 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:52.463784 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-50ffaa8b-ee08-4384-9713-51de99a98461 req-c36386d9-f46a-4da8-9abc-daee66975a39 service nova] Creating event network-vif-plugged:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:19:52.468834 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-50ffaa8b-ee08-4384-9713-51de99a98461 req-c36386d9-f46a-4da8-9abc-daee66975a39 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032616 Dec 25 22:19:52.469454 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4450/8864] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:19:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:19:52.945564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:52.946198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:52.953057 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:52.953525 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:52.954356 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:52.954838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:53.085692 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:53.092976 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d2ea8db9-984e-461e-a3fc-2160c7c85abb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.151086 Dec 25 22:19:53.093544 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4415/8865] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:52 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:54.110999 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:54.111736 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:54.117969 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:54.118405 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:54.119189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:54.119630 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:54.258883 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:54.266455 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-45fcde83-4bfc-4003-9bf8-df3e96186b96 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1689 microversion: 2.1 time: 0.160404 Dec 25 22:19:54.267086 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4451/8866] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:54 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:19:55.283452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:19:55.284708 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:19:55.291484 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:55.291953 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:55.292754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:19:55.293235 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:19:55.424564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:19:55.431890 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9c5aa876-dea0-4edc-9f96-f92d4a03de26 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1676 microversion: 2.1 time: 0.152277 Dec 25 22:19:55.432459 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4416/8867] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:19:55 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:07.141711 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:07.142537 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:07.148941 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:07.149483 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:07.150498 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:07.151012 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:07.178230 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:21:07.229262 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-bb92c10f-d7f9-46f1-8411-3a55762c499a req-34486fb5-2bfb-48f2-b6e2-af06bfff9a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:07.230924 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:21:07.230924 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:21:07.239059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-bb92c10f-d7f9-46f1-8411-3a55762c499a req-34486fb5-2bfb-48f2-b6e2-af06bfff9a59 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:07.239527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-bb92c10f-d7f9-46f1-8411-3a55762c499a req-34486fb5-2bfb-48f2-b6e2-af06bfff9a59 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:07.253127 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-bb92c10f-d7f9-46f1-8411-3a55762c499a req-34486fb5-2bfb-48f2-b6e2-af06bfff9a59 service nova] Creating event network-changed:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:21:07.258322 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-bb92c10f-d7f9-46f1-8411-3a55762c499a req-34486fb5-2bfb-48f2-b6e2-af06bfff9a59 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119583 Dec 25 22:21:07.258932 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4417/8868] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:21:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:21:07.461821 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-b9e3bdce-1c02-42d2-91f0-d6158d9f664a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 204 len: 0 microversion: 2.1 time: 0.325307 Dec 25 22:21:07.462747 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4452/8869] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:21:07 2021] DELETE /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:21:07.472341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:07.476051 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:07.480454 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:07.480938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:07.481835 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:07.482292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:07.749022 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:07.758102 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-95b08e4f-fbf1-40e8-941f-aeb0f379e0e3 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1682 microversion: 2.1 time: 0.290496 Dec 25 22:21:07.758689 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4418/8870] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:07 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:08.776063 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:08.776786 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:08.784808 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:08.785322 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:08.786143 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:08.786579 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:09.383486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:09.391812 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5bfb2959-96e9-404c-bb76-d5798e90eab1 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1563 microversion: 2.1 time: 0.619845 Dec 25 22:21:09.392710 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4453/8871] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:08 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1563 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:09.786838 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-3e942427-2867-4655-b7b4-0397538d9374 req-4914ef12-6ff8-4aac-ada6-46cc7af19fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db11646b-c236-4ea8-afc6-7542c731bfa5", "name": "network-vif-deleted", "tag": "3fcc8917-c1c4-4146-bdaf-cc8783ff604f"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:09.788384 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:21:09.788384 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:21:09.796216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3e942427-2867-4655-b7b4-0397538d9374 req-4914ef12-6ff8-4aac-ada6-46cc7af19fa0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:09.797826 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-3e942427-2867-4655-b7b4-0397538d9374 req-4914ef12-6ff8-4aac-ada6-46cc7af19fa0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:09.807292 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-3e942427-2867-4655-b7b4-0397538d9374 req-4914ef12-6ff8-4aac-ada6-46cc7af19fa0 service nova] Creating event network-vif-deleted:3fcc8917-c1c4-4146-bdaf-cc8783ff604f for instance db11646b-c236-4ea8-afc6-7542c731bfa5 on nch1-master-1 Dec 25 22:21:09.812324 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-3e942427-2867-4655-b7b4-0397538d9374 req-4914ef12-6ff8-4aac-ada6-46cc7af19fa0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029444 Dec 25 22:21:09.812933 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4419/8872] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:21:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:21:10.408374 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:10.409046 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:10.415075 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:10.415554 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:10.416321 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:10.416766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:10.448420 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:10.448897 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:10.449358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lazy-loading 'fault' on Instance uuid db11646b-c236-4ea8-afc6-7542c731bfa5 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:21:10.489447 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:10.497344 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-3ab85626-40ec-4364-9654-f11f94f57d56 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 200 len: 1337 microversion: 2.1 time: 0.092907 Dec 25 22:21:10.498001 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4454/8873] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:10 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 1337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:11.516994 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:11.517697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: db11646b-c236-4ea8-afc6-7542c731bfa5] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:11.524141 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:11.524628 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:11.525463 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:11.525917 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:11.538846 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] HTTP exception thrown: Instance db11646b-c236-4ea8-afc6-7542c731bfa5 could not be found. Dec 25 22:21:11.539443 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Returning 404 to user: Instance db11646b-c236-4ea8-afc6-7542c731bfa5 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:21:11.540275 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a96ad362-0abb-47d0-9d93-fbccb72ccef7 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5" status: 404 len: 111 microversion: 2.1 time: 0.028957 Dec 25 22:21:11.540806 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4420/8874] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:11 2021] GET /compute/v2.1/servers/db11646b-c236-4ea8-afc6-7542c731bfa5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:21:11.768593 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4e39772c-95d7-48a7-bcdf-9a2377b17ac6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '.version_select at 0x7fa5006f1ee0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:11.856240 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4e39772c-95d7-48a7-bcdf-9a2377b17ac6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1645781095" status: 202 len: 0 microversion: 2.1 time: 0.091445 Dec 25 22:21:11.856841 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4455/8875] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 22:21:11 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1645781095 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:21:11.879562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'create', calling method: .version_select at 0x7fa4f4507940>, body: {"keypair": {"name": "tempest-TestShelveInstance-246424182"}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:11.893774 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:21:11.898744 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for user 21adac3627a24f24b10c1c0023d80a69 and project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:21:11.911562 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [f642f573-f303-4342-b3fc-1ae94e6cc0eb] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:21:12.919512 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [f642f573-f303-4342-b3fc-1ae94e6cc0eb] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39008. Dec 25 22:21:13.162676 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:21:13.167502 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for user 21adac3627a24f24b10c1c0023d80a69 and project 8aefbad38c734203b2719ed40e315a78. Resources: {'key_pairs'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:21:13.181333 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d8dd386c-e074-4834-8010-d191e47055f6 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 1.306235 Dec 25 22:21:13.181940 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4421/8876] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:21:11 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:20.499877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-985912130", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-246424182", "security_groups": [{"name": "tempest-secgroup-smoke-1421438765"}], "networks": [{"uuid": "db0de716-353d-48fe-b77e-10fa7ac25f29"}], "block_device_mapping_v2": [{"uuid": "ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:20.616119 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] validate_networks() for [('db0de716-353d-48fe-b77e-10fa7ac25f29', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:21:20.982788 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:21:20.983178 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:21:20.983649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:21:20.984053 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:21:20.984486 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:21:20.993613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:20.994056 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:20.994892 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:20.995358 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:21.011951 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for project 8aefbad38c734203b2719ed40e315a78. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:21:21.016978 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Getting quotas for user 21adac3627a24f24b10c1c0023d80a69 and project 8aefbad38c734203b2719ed40e315a78. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:21:21.072007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:21:21.074267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecc0aa9b-79c9-4bcf-8ce0-12c1f9f72694',volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:21:21.451196 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-23d205a0-3b94-4881-bb01-7abb7950a469 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.955866 Dec 25 22:21:21.452425 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4456/8877] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:21:20 2021] POST /compute/v2.1/servers => generated 406 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:21:21.463009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-73d28660-d812-4790-9be6-226018f87d47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:21.463714 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-73d28660-d812-4790-9be6-226018f87d47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:21.522403 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-73d28660-d812-4790-9be6-226018f87d47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:21.529637 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-73d28660-d812-4790-9be6-226018f87d47 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1087 microversion: 2.1 time: 0.071213 Dec 25 22:21:21.530556 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4422/8878] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:21 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1087 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:22.548541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:22.549175 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:22.555318 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:22.555763 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:22.556541 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:22.557007 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:22.622316 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:22.630064 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-137e3bb4-c82a-4d1c-b4b6-5cc8e2df5f9f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1137 microversion: 2.1 time: 0.086888 Dec 25 22:21:22.630639 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4457/8879] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:22 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:21:23.646533 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:23.653778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:23.654458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:23.654920 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:23.655705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:23.656152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:23.714817 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:23.722266 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-c97c60ad-d266-446e-b8ff-f08944be524f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1129 microversion: 2.1 time: 0.079475 Dec 25 22:21:23.722827 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4423/8880] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:23 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1129 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:24.742779 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:24.743422 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:24.750360 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:24.750818 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:24.751613 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:24.752052 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:24.827472 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:24.836703 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-cb636dfc-0dc0-4a26-9636-bea9ad01ff37 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1203 microversion: 2.1 time: 0.097567 Dec 25 22:21:24.847092 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4458/8881] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:24 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1203 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:25.853604 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:25.854426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:25.862654 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:25.868637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:25.868637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:25.868637 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:26.055900 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-83b6f687-ae50-4c97-8b52-9a416b74bf68 req-2d458d8f-635e-4573-94ff-e9bf174193b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fe4969-12a3-4556-be99-266726acf18d", "tag": "ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:26.059936 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:21:26.059936 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:21:26.065787 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:26.071917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83b6f687-ae50-4c97-8b52-9a416b74bf68 req-2d458d8f-635e-4573-94ff-e9bf174193b0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:26.072634 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83b6f687-ae50-4c97-8b52-9a416b74bf68 req-2d458d8f-635e-4573-94ff-e9bf174193b0 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:26.076444 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-5e9b37cd-802a-404f-b093-06ae4515d267 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1271 microversion: 2.1 time: 0.226581 Dec 25 22:21:26.087725 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4424/8882] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:25 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1271 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:21:26.090702 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-83b6f687-ae50-4c97-8b52-9a416b74bf68 req-2d458d8f-635e-4573-94ff-e9bf174193b0 service nova] Creating event network-changed:ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53 for instance c0fe4969-12a3-4556-be99-266726acf18d on nch1-master-1 Dec 25 22:21:26.096640 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-83b6f687-ae50-4c97-8b52-9a416b74bf68 req-2d458d8f-635e-4573-94ff-e9bf174193b0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046469 Dec 25 22:21:26.100610 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4459/8883] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:21:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:21:27.094107 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:27.094734 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:27.102080 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:27.102548 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:27.103341 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:27.103794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:27.238255 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:27.245587 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9dd823d6-a681-4034-9e7c-9b022728f34b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.155178 Dec 25 22:21:27.246174 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4425/8884] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:27 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:28.265983 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:28.266974 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:28.274655 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:28.275116 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:28.275905 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:28.276346 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:28.415636 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:28.424188 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-ec581dc4-d889-458d-81ba-d8245961732a tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.164314 Dec 25 22:21:28.424769 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4460/8885] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:28 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:29.440537 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:29.441183 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:29.447869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:29.448331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:29.449149 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:29.449596 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:29.837357 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:29.844752 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-528911b6-7e40-4e46-bd7e-2ec966230611 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.407918 Dec 25 22:21:29.845955 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4426/8886] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:29 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:30.862917 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:30.863560 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:30.870373 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:30.870825 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:30.871609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:30.872049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:31.012037 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:31.019549 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-07ec5d11-e910-4be7-abdc-a6e0d9c48ad8 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.161009 Dec 25 22:21:31.020128 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4461/8887] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:30 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:32.036000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:32.036629 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:32.043322 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:32.043825 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:32.044589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:32.045083 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:32.176331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:32.183715 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-fe52f318-7138-409e-ae5b-4cc090f8db0b tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.151451 Dec 25 22:21:32.184275 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4427/8888] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:32 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:33.121465 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-16195efb-1349-487b-a4f1-43d10fb5bfd0 req-8e5b4983-d1e1-4515-a8e3-f45bb7abe7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fe4969-12a3-4556-be99-266726acf18d", "name": "network-vif-plugged", "status": "completed", "tag": "ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:33.123035 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:21:33.123035 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:21:33.131281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-16195efb-1349-487b-a4f1-43d10fb5bfd0 req-8e5b4983-d1e1-4515-a8e3-f45bb7abe7d8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:33.139867 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-16195efb-1349-487b-a4f1-43d10fb5bfd0 req-8e5b4983-d1e1-4515-a8e3-f45bb7abe7d8 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:33.143111 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-16195efb-1349-487b-a4f1-43d10fb5bfd0 req-8e5b4983-d1e1-4515-a8e3-f45bb7abe7d8 service nova] Creating event network-vif-plugged:ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53 for instance c0fe4969-12a3-4556-be99-266726acf18d on nch1-master-1 Dec 25 22:21:33.148075 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-16195efb-1349-487b-a4f1-43d10fb5bfd0 req-8e5b4983-d1e1-4515-a8e3-f45bb7abe7d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030357 Dec 25 22:21:33.148664 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4462/8889] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:21:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:21:33.200469 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:33.201243 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:33.208785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:33.209292 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:33.210106 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:33.210562 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:33.386144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:33.394472 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3833f88f-5e9f-4f51-96be-af12b54e5832 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.198354 Dec 25 22:21:33.395031 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4428/8890] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:33 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:34.412400 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:34.413055 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:34.419495 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:34.425008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:34.425008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:34.425008 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:34.558307 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:34.566404 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-678be06e-441b-4dfc-bd8b-70a9976a293c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1259 microversion: 2.1 time: 0.159034 Dec 25 22:21:34.566969 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4463/8891] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:34 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:35.583089 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:35.583827 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:35.590589 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:35.591052 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:35.591842 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:35.592289 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:35.728116 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:35.735569 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-77e5a6e0-5692-4bc2-8fda-566ca656af1c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1443 microversion: 2.1 time: 0.156522 Dec 25 22:21:35.736201 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4429/8892] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:35 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:35.750916 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:21:35.751530 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:21:35.758173 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:35.758633 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:35.759414 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:35.759852 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:35.889281 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:21:35.897699 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-d38f731e-d219-4cb5-b593-085c8668021c tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1443 microversion: 2.1 time: 0.150409 Dec 25 22:21:35.898279 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4464/8893] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:21:35 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:21:38.138778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-7343ad19-9658-419a-bd0d-6b65be9da5d2 req-b86c96a2-e4fd-4da1-90da-9e197fe6c749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fe4969-12a3-4556-be99-266726acf18d", "tag": "ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:21:38.140340 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:21:38.140340 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:21:38.148048 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7343ad19-9658-419a-bd0d-6b65be9da5d2 req-b86c96a2-e4fd-4da1-90da-9e197fe6c749 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:21:38.148511 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-7343ad19-9658-419a-bd0d-6b65be9da5d2 req-b86c96a2-e4fd-4da1-90da-9e197fe6c749 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:21:38.159813 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-7343ad19-9658-419a-bd0d-6b65be9da5d2 req-b86c96a2-e4fd-4da1-90da-9e197fe6c749 service nova] Creating event network-changed:ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53 for instance c0fe4969-12a3-4556-be99-266726acf18d on nch1-master-1 Dec 25 22:21:38.165171 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-7343ad19-9658-419a-bd0d-6b65be9da5d2 req-b86c96a2-e4fd-4da1-90da-9e197fe6c749 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030872 Dec 25 22:21:38.165964 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4430/8894] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:21:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:21:58.141616 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:21:58.142341 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:21:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:23:39.612586 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:23:39.613242 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:23:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:24:02.787682 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:24:02.788271 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:24:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:25:11.414158 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 22:25:11.415291 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 22:25:11.465609 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:11.466606 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:11.476928 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:11.477387 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:11.478300 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:11.478740 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:12.422980 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39324. Dec 25 22:25:12.423713 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39322. Dec 25 22:25:12.427493 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-71447d25-e691-48b6-b440-8100528a93d0 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "POST /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d/action" status: 200 len: 24571 microversion: 2.1 time: 1.015759 Dec 25 22:25:12.428159 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4465/8895] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:25:11 2021] POST /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d/action => generated 24571 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Dec 25 22:25:13.375571 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-19b74f9c-b2e1-45cd-be38-706069e60e7e req-eb74b31a-0cb1-4526-be97-09faa087e9bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0fe4969-12a3-4556-be99-266726acf18d", "tag": "ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:13.377827 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0518a7cf-b089-43ee-8b3e-9cd831685db8] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 22:25:13.379365 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Dec 25 22:25:13.383812 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:13.384411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:13.386183 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:25:13.386183 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:25:13.391858 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:13.392430 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:13.393438 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:13.394180 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:13.394659 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-19b74f9c-b2e1-45cd-be38-706069e60e7e req-eb74b31a-0cb1-4526-be97-09faa087e9bc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:13.410753 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-19b74f9c-b2e1-45cd-be38-706069e60e7e req-eb74b31a-0cb1-4526-be97-09faa087e9bc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:13.410753 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-19b74f9c-b2e1-45cd-be38-706069e60e7e req-eb74b31a-0cb1-4526-be97-09faa087e9bc service nova] Creating event network-changed:ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53 for instance c0fe4969-12a3-4556-be99-266726acf18d on nch1-master-1 Dec 25 22:25:13.412165 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-19b74f9c-b2e1-45cd-be38-706069e60e7e req-eb74b31a-0cb1-4526-be97-09faa087e9bc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040625 Dec 25 22:25:13.413025 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4466/8896] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:25:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:25:13.420913 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Going to try to terminate instance {{(pid=136547) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:25:13.713455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-cdc857d0-e102-4343-a7b5-0afc5cb52ffb tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 204 len: 0 microversion: 2.1 time: 0.344420 Dec 25 22:25:13.714905 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4431/8897] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:25:13 2021] DELETE /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:25:13.723955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:13.724664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:13.731240 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:13.731552 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:13.732344 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:13.732781 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:14.339841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:14.347570 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4f64df07-b02a-43d3-9de5-003af85f3bf9 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1567 microversion: 2.1 time: 0.628110 Dec 25 22:25:14.348228 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4467/8898] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:13 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1567 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:15.366739 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:15.367459 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:15.384081 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39342. Dec 25 22:25:15.391126 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [0518a7cf-b089-43ee-8b3e-9cd831685db8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39340. Dec 25 22:25:15.397184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:15.397184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:15.397184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:15.397184 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:15.610453 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:15.618691 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9db79f23-cc6c-4f3d-9a98-d2f663708d07 tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1449 microversion: 2.1 time: 0.256577 Dec 25 22:25:15.619255 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4432/8899] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:15 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1449 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:15.940695 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-83c6f612-57c5-444b-9c95-a744eb3b0916 req-fb58a420-56cd-401c-820c-fc165cf99fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0fe4969-12a3-4556-be99-266726acf18d", "name": "network-vif-deleted", "tag": "ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:15.942250 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:25:15.942250 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:25:15.950264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83c6f612-57c5-444b-9c95-a744eb3b0916 req-fb58a420-56cd-401c-820c-fc165cf99fc2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:15.950708 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-83c6f612-57c5-444b-9c95-a744eb3b0916 req-fb58a420-56cd-401c-820c-fc165cf99fc2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:15.964254 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-83c6f612-57c5-444b-9c95-a744eb3b0916 req-fb58a420-56cd-401c-820c-fc165cf99fc2 service nova] Creating event network-vif-deleted:ae22c8fb-bcd9-40ea-8ca9-ef380a95bc53 for instance c0fe4969-12a3-4556-be99-266726acf18d on nch1-master-1 Dec 25 22:25:15.969860 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-83c6f612-57c5-444b-9c95-a744eb3b0916 req-fb58a420-56cd-401c-820c-fc165cf99fc2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082423 Dec 25 22:25:15.970467 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4468/8900] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:25:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:25:16.636923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:16.637560 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:16.644523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:16.645241 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:16.650318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:16.650318 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:16.677458 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:16.677855 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:16.678359 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.objects.instance [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lazy-loading 'fault' on Instance uuid c0fe4969-12a3-4556-be99-266726acf18d {{(pid=136547) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:25:16.718670 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21adac3627a24f24b10c1c0023d80a69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8aefbad38c734203b2719ed40e315a78', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:16.726401 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-84e968c5-215b-4d87-8b0c-5ccc4d34bbad tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 200 len: 1223 microversion: 2.1 time: 0.093400 Dec 25 22:25:16.726963 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4433/8901] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:16 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:17.744040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:17.744759 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] [instance: c0fe4969-12a3-4556-be99-266726acf18d] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:17.751834 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:17.752280 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:17.753207 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:17.753642 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:17.767085 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.wsgi [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] HTTP exception thrown: Instance c0fe4969-12a3-4556-be99-266726acf18d could not be found. Dec 25 22:25:17.767703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Returning 404 to user: Instance c0fe4969-12a3-4556-be99-266726acf18d could not be found. {{(pid=136548) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:25:17.768556 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1df35a33-39c4-44bf-8722-84ed4785763e tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d" status: 404 len: 111 microversion: 2.1 time: 0.028738 Dec 25 22:25:17.769138 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4469/8902] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:17 2021] GET /compute/v2.1/servers/c0fe4969-12a3-4556-be99-266726acf18d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:25:18.000374 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-9fd1c45e-5e9f-4806-acc4-52905ad7de3f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] Calling method '.version_select at 0x7fa4f44cfa60>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:18.105497 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-9fd1c45e-5e9f-4806-acc4-52905ad7de3f tempest-TestShelveInstance-985658293 tempest-TestShelveInstance-985658293-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-246424182" status: 202 len: 0 microversion: 2.1 time: 0.108889 Dec 25 22:25:18.106077 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4434/8903] 10.222.0.32 () {58 vars in 1250 bytes} [Sat Dec 25 22:25:17 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-246424182 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:25:18.149428 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:25:18.149571 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:25:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:25:40.046772 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-830dcf88-f89d-46d9-bd5c-d9c2a3e7e9bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Action: 'create', calling method: .version_select at 0x7fa4f7086700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-892550964"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:40.062050 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-830dcf88-f89d-46d9-bd5c-d9c2a3e7e9bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for project 58660263f53e4173b07360be1b863c34. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:25:40.067208 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-830dcf88-f89d-46d9-bd5c-d9c2a3e7e9bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for user 47a300ee498f4ef9974ed430de68c526 and project 58660263f53e4173b07360be1b863c34. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:25:40.282881 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-830dcf88-f89d-46d9-bd5c-d9c2a3e7e9bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for project 58660263f53e4173b07360be1b863c34. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:25:40.288276 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-830dcf88-f89d-46d9-bd5c-d9c2a3e7e9bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for user 47a300ee498f4ef9974ed430de68c526 and project 58660263f53e4173b07360be1b863c34. Resources: {'key_pairs'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:25:40.302376 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-830dcf88-f89d-46d9-bd5c-d9c2a3e7e9bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.433539 Dec 25 22:25:40.302970 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4470/8904] 10.222.0.32 () {60 vars in 1157 bytes} [Sat Dec 25 22:25:39 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:42.618632 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-395669389", "imageRef": "aca914d0-5f7b-465f-a024-75efa27d7291", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-892550964", "security_groups": [{"name": "tempest-secgroup-smoke-980360451"}], "networks": [{"uuid": "5eae40be-10b6-4c8a-a45c-e220af6e3ccd"}]}} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:42.736993 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.network.neutron [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] validate_networks() for [('5eae40be-10b6-4c8a-a45c-e220af6e3ccd', None, None, None, None, None)] {{(pid=136547) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:25:43.247331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Flavor limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:25:43.247778 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Image limits 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:25:43.248483 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Flavor pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:25:43.248938 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Image pref 0:0:0 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:25:43.249527 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.virt.hardware [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136547) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:25:43.259837 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:43.260421 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:43.261554 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:43.262103 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:43.281726 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for project 58660263f53e4173b07360be1b863c34. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:25:43.288461 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.quota [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for user 47a300ee498f4ef9974ed430de68c526 and project 58660263f53e4173b07360be1b863c34. Resources: {'instances', 'ram', 'cores'} {{(pid=136547) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:25:43.302565 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Going to run 1 instances... {{(pid=136547) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:25:43.305750 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aca914d0-5f7b-465f-a024-75efa27d7291',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136547) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:25:43.430955 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ec76fe99-577a-48fe-9d6c-4b73155ee5b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.820539 Dec 25 22:25:43.432213 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4435/8905] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:25:42 2021] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:25:43.442698 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-7ce66b8d-0eec-4f6f-ac80-1d46c2f04605 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:43.443923 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-7ce66b8d-0eec-4f6f-ac80-1d46c2f04605 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:43.511774 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-7ce66b8d-0eec-4f6f-ac80-1d46c2f04605 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:43.518589 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-7ce66b8d-0eec-4f6f-ac80-1d46c2f04605 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1247 microversion: 2.1 time: 0.080055 Dec 25 22:25:43.528634 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4471/8906] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:43 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1247 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:25:44.535800 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-50a6d8ec-f90c-4c44-ba9a-867b7293eb15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:44.536452 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-50a6d8ec-f90c-4c44-ba9a-867b7293eb15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:44.589869 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-50a6d8ec-f90c-4c44-ba9a-867b7293eb15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:44.596538 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-50a6d8ec-f90c-4c44-ba9a-867b7293eb15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1247 microversion: 2.1 time: 0.064616 Dec 25 22:25:44.597134 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4436/8907] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:44 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:45.613668 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:45.614524 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:45.622820 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:45.623283 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:45.624235 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:45.624624 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:45.702247 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:45.710357 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1a74aa73-1641-4df1-b2d4-96520a6fee3c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1307 microversion: 2.1 time: 0.099961 Dec 25 22:25:45.711068 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4472/8908] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:45 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1307 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:46.728216 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:46.728853 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:46.735248 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:46.737198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:46.737198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:46.737198 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:46.897977 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:46.905574 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-f8c02aea-895b-490e-ab9b-4a92c9206b73 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1372 microversion: 2.1 time: 0.181594 Dec 25 22:25:46.906150 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4437/8909] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:46 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1372 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:47.261376 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-4bd85af3-66ec-454d-8d4e-38a43b7fde11 req-6104c050-15dd-440b-b996-f013830795f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:47.263300 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:25:47.263300 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:25:47.271793 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4bd85af3-66ec-454d-8d4e-38a43b7fde11 req-6104c050-15dd-440b-b996-f013830795f2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:47.273126 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-4bd85af3-66ec-454d-8d4e-38a43b7fde11 req-6104c050-15dd-440b-b996-f013830795f2 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:47.285103 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-4bd85af3-66ec-454d-8d4e-38a43b7fde11 req-6104c050-15dd-440b-b996-f013830795f2 service nova] Creating event network-changed:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:25:47.297404 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-4bd85af3-66ec-454d-8d4e-38a43b7fde11 req-6104c050-15dd-440b-b996-f013830795f2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040181 Dec 25 22:25:47.298024 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4473/8910] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:25:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:25:47.922890 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:47.923626 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:47.930924 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:47.931388 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:47.932181 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:47.932633 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:48.072059 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:48.079664 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2c560801-67dd-44bc-bd84-432206e2174a tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1372 microversion: 2.1 time: 0.160496 Dec 25 22:25:48.080227 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4438/8911] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:47 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:49.097271 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:49.097979 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:49.104328 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:49.104778 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:49.105583 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:49.106020 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:49.244064 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:49.255608 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-38ec5283-629f-4396-b140-87946a6e6914 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1372 microversion: 2.1 time: 0.158993 Dec 25 22:25:49.255608 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4474/8912] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:49 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:50.267903 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:50.268535 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:50.275923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:50.276391 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:50.277225 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:50.277679 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:50.419766 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:50.427247 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2f55c155-858f-43f1-ab79-a732fd81760f tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1372 microversion: 2.1 time: 0.163024 Dec 25 22:25:50.427818 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4439/8913] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:50 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:51.444658 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:51.445299 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:51.452327 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:51.452783 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:51.453601 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:51.454039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:51.585416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:51.592795 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-6eedb284-de75-4687-ab62-b4db2eaca8f7 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1372 microversion: 2.1 time: 0.151819 Dec 25 22:25:51.593390 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4475/8914] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:51 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:52.345132 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1d412271-6112-44f8-97d7-0e4c2233e584 req-270ca0f3-dda8-453b-8aba-50dd7e904325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "name": "network-vif-plugged", "status": "completed", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:52.346731 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:25:52.346731 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:25:52.353723 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1d412271-6112-44f8-97d7-0e4c2233e584 req-270ca0f3-dda8-453b-8aba-50dd7e904325 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:52.354182 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1d412271-6112-44f8-97d7-0e4c2233e584 req-270ca0f3-dda8-453b-8aba-50dd7e904325 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:52.367571 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1d412271-6112-44f8-97d7-0e4c2233e584 req-270ca0f3-dda8-453b-8aba-50dd7e904325 service nova] Creating event network-vif-plugged:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:25:52.372932 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1d412271-6112-44f8-97d7-0e4c2233e584 req-270ca0f3-dda8-453b-8aba-50dd7e904325 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090130 Dec 25 22:25:52.373639 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4440/8915] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:25:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:25:52.609901 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:52.610526 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:52.617872 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:52.618384 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:52.619171 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:52.619615 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:52.757703 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:52.765089 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-eced7c7a-3d93-4be5-8bfb-46cd0526d17d tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1372 microversion: 2.1 time: 0.158910 Dec 25 22:25:52.765662 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4476/8916] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:52 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:53.782810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:53.783630 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:53.789861 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:53.790326 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:53.791118 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:53.791564 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:53.928009 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:53.936132 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-2fe579a1-5758-4aae-88b8-6d8b994ffa75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1557 microversion: 2.1 time: 0.158298 Dec 25 22:25:53.936695 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4441/8917] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:53 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:25:53.952777 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:25:53.953416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:25:53.960112 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:53.960563 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:53.961372 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:53.961863 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:54.095960 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:25:54.103392 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-32812a00-4f54-4a02-a785-20ff74f23b15 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1557 microversion: 2.1 time: 0.154847 Dec 25 22:25:54.103961 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4477/8918] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:25:53 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:25:56.370697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-308f445a-4f47-4890-a522-0cbada21a38a req-ff113094-88fe-4805-af6b-dc248f0d844c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:25:56.372423 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:25:56.372423 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:25:56.380035 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-308f445a-4f47-4890-a522-0cbada21a38a req-ff113094-88fe-4805-af6b-dc248f0d844c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:25:56.380501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-308f445a-4f47-4890-a522-0cbada21a38a req-ff113094-88fe-4805-af6b-dc248f0d844c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:25:56.391464 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-308f445a-4f47-4890-a522-0cbada21a38a req-ff113094-88fe-4805-af6b-dc248f0d844c service nova] Creating event network-changed:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:25:56.396446 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-308f445a-4f47-4890-a522-0cbada21a38a req-ff113094-88fe-4805-af6b-dc248f0d844c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029730 Dec 25 22:25:56.397247 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4442/8919] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:25:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:27:01.514691 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:27:01.515248 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:27:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:27:51.516664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-937705943"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:27:51.517733 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:27:51.523843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:27:51.524293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:27:51.525093 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:27:51.525528 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:27:52.232241 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-9ffaacb4-95f7-4265-9510-1bd4a580bec6 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "POST /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de/action" status: 202 len: 0 microversion: 2.1 time: 0.720455 Dec 25 22:27:52.236417 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4478/8920] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:27:51 2021] POST /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de/action => generated 0 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 22:27:56.965820 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0518a7cf-b089-43ee-8b3e-9cd831685db8] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 25 22:27:56.967504 ncdv-master-1 devstack@n-api.service[136547]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] AMQP server on 10.222.0.32:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Dec 25 22:27:56.972336 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-34a28e62-080f-4345-9ac4-bee6fdb830b2 req-8f1d201e-44e2-46dc-ba74-5736cdec1f6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "name": "network-vif-plugged", "status": "completed", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:27:56.973728 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:27:56.973728 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:27:56.982686 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-34a28e62-080f-4345-9ac4-bee6fdb830b2 req-8f1d201e-44e2-46dc-ba74-5736cdec1f6a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:27:56.987098 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-34a28e62-080f-4345-9ac4-bee6fdb830b2 req-8f1d201e-44e2-46dc-ba74-5736cdec1f6a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:27:56.995127 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-34a28e62-080f-4345-9ac4-bee6fdb830b2 req-8f1d201e-44e2-46dc-ba74-5736cdec1f6a service nova] Creating event network-vif-plugged:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:27:57.001495 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-34a28e62-080f-4345-9ac4-bee6fdb830b2 req-8f1d201e-44e2-46dc-ba74-5736cdec1f6a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045662 Dec 25 22:27:57.004834 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4443/8921] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:27:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:28:07.873291 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-837230041", "imageRef": "ab2c2261-a9aa-4d42-9f3c-3257e6bf97fa", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-892550964", "security_groups": [{"name": "tempest-secgroup-smoke-980360451"}], "networks": [{"uuid": "5eae40be-10b6-4c8a-a45c-e220af6e3ccd"}]}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:28:07.979363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.network.neutron [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] validate_networks() for [('5eae40be-10b6-4c8a-a45c-e220af6e3ccd', None, None, None, None, None)] {{(pid=136548) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Dec 25 22:28:08.384862 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Flavor limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Dec 25 22:28:08.385416 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Image limits 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Dec 25 22:28:08.385922 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Flavor pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Dec 25 22:28:08.386333 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Image pref 0:0:0 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Dec 25 22:28:08.386748 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.virt.hardware [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=136548) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Dec 25 22:28:08.395365 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:08.395810 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:08.396625 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:08.397101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:08.413295 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for project 58660263f53e4173b07360be1b863c34. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:387}} Dec 25 22:28:08.418249 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.quota [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Getting quotas for user 47a300ee498f4ef9974ed430de68c526 and project 58660263f53e4173b07360be1b863c34. Resources: {'instances', 'ram', 'cores'} {{(pid=136548) _get_quotas /opt/stack/nova/nova/quota.py:377}} Dec 25 22:28:08.430513 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Going to run 1 instances... {{(pid=136548) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Dec 25 22:28:08.433040 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ab2c2261-a9aa-4d42-9f3c-3257e6bf97fa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=136548) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Dec 25 22:28:08.629457 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-234415c8-c646-40d4-bcdb-91a037609b40 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760852 Dec 25 22:28:08.630107 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4479/8922] 10.222.0.32 () {60 vars in 1146 bytes} [Sat Dec 25 22:28:07 2021] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Dec 25 22:28:08.643253 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-ccbae086-4018-4018-baef-dd9598041bad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:08.643966 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-ccbae086-4018-4018-baef-dd9598041bad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:08.661038 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [0518a7cf-b089-43ee-8b3e-9cd831685db8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39812. Dec 25 22:28:08.662650 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] [2623f2d3-8355-4ab0-96aa-0c4e1194c413] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 39814. Dec 25 22:28:08.774647 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-ccbae086-4018-4018-baef-dd9598041bad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:08.780680 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-ccbae086-4018-4018-baef-dd9598041bad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1247 microversion: 2.1 time: 0.144155 Dec 25 22:28:08.781267 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4444/8923] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:08 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1247 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:28:09.798755 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:09.799418 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:09.805664 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:09.806101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:09.806889 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:09.807330 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:09.869710 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:09.877899 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c7dc8af8-e065-4581-a31b-a15481504d46 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1243 microversion: 2.1 time: 0.084219 Dec 25 22:28:09.878707 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4480/8924] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:09 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:10.895566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:10.895566 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:10.909062 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:10.909673 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:10.910549 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:10.916574 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:11.046496 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:11.064841 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-3a9d6d41-bb8d-4dd3-b31e-6060a26eb8ab tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1305 microversion: 2.1 time: 0.168692 Dec 25 22:28:11.065690 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4445/8925] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:10 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1305 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:11.071506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-3c53f1df-6f82-4c6c-9efb-7e694069e951 req-1b42b5bd-ed2c-4d1b-a328-1e43dcfc0dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "name": "network-vif-unplugged", "status": "completed", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:28:11.073136 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:28:11.073136 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:28:11.083287 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3c53f1df-6f82-4c6c-9efb-7e694069e951 req-1b42b5bd-ed2c-4d1b-a328-1e43dcfc0dae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:11.084848 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-3c53f1df-6f82-4c6c-9efb-7e694069e951 req-1b42b5bd-ed2c-4d1b-a328-1e43dcfc0dae service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:11.097461 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-3c53f1df-6f82-4c6c-9efb-7e694069e951 req-1b42b5bd-ed2c-4d1b-a328-1e43dcfc0dae service nova] Creating event network-vif-unplugged:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:28:11.103248 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-3c53f1df-6f82-4c6c-9efb-7e694069e951 req-1b42b5bd-ed2c-4d1b-a328-1e43dcfc0dae service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036178 Dec 25 22:28:11.104102 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4481/8926] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:28:11 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:28:12.083385 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:12.084523 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:12.092607 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:12.093440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:12.095000 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:12.095675 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:12.238230 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:12.245614 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-d04494cc-cf25-4fb5-a704-3ac626423edd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.166377 Dec 25 22:28:12.246188 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4446/8927] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:12 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:13.263948 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:13.265016 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:13.271587 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:13.272049 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:13.272842 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:13.273309 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:13.415596 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:13.424544 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-a1bfb79f-e9ea-4d42-b720-8742764a382c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.165608 Dec 25 22:28:13.425783 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4482/8928] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:13 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:14.441910 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:14.442669 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:14.450339 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:14.450815 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:14.451625 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:14.452121 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:14.595989 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:14.603504 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-56e663da-5427-4045-9934-145ac2850ee9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.165300 Dec 25 22:28:14.604065 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4447/8929] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:14 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:15.621136 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:15.621805 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:15.628673 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:15.629161 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:15.629963 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:15.630409 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:15.783111 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:15.791756 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-e8b82695-f914-45f7-9863-555a172a3513 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.174192 Dec 25 22:28:15.803331 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4483/8930] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:15 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:16.810312 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:16.810944 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:16.817794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:16.818256 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:16.819307 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:16.819754 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:16.985810 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:16.993252 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-4df5a9bc-bdf5-4824-9364-3495fecd6048 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.187185 Dec 25 22:28:16.993837 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4448/8931] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:16 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:18.009934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:18.010837 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:18.019610 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:18.020279 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:18.021363 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:18.021995 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:18.167256 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:18.175111 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-305b1eec-ce0f-4dde-9ea2-74c76809de63 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.169394 Dec 25 22:28:18.175688 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4484/8932] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:18 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:19.192352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:19.193152 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:19.201251 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:19.201715 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:19.202524 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:19.202976 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:19.359431 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:19.367360 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-51f6bad2-6062-40c4-95e2-18cb452d5211 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.179518 Dec 25 22:28:19.367927 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4449/8933] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:19 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:20.383993 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:20.384656 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:20.392502 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:20.393058 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:20.393871 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:20.394312 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:20.540359 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:20.549222 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-df9b8f14-7e4b-46fe-8657-738475dbd4df tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.168914 Dec 25 22:28:20.549814 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4485/8934] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:20 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:21.566768 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:21.567411 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:21.574794 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:21.575331 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:21.576137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:21.576697 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:21.831457 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:21.838881 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-30216c48-62eb-4c6f-93b0-dfb98ce90cad tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.275856 Dec 25 22:28:21.839468 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4450/8935] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:21 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:22.294796 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [req-9a44bf01-216f-4963-919e-9c7a94236ad8 req-bd9498fc-8ef1-4951-967c-6aa6d35f310f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:28:22.297856 ncdv-master-1 devstack@n-api.service[136548]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:28:22.297856 ncdv-master-1 devstack@n-api.service[136548]: warnings.warn(msg) Dec 25 22:28:22.307267 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9a44bf01-216f-4963-919e-9c7a94236ad8 req-bd9498fc-8ef1-4951-967c-6aa6d35f310f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:22.307812 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [req-9a44bf01-216f-4963-919e-9c7a94236ad8 req-bd9498fc-8ef1-4951-967c-6aa6d35f310f service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:22.325622 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.compute.server_external_events [req-9a44bf01-216f-4963-919e-9c7a94236ad8 req-bd9498fc-8ef1-4951-967c-6aa6d35f310f service nova] Creating event network-changed:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:28:22.330595 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [req-9a44bf01-216f-4963-919e-9c7a94236ad8 req-bd9498fc-8ef1-4951-967c-6aa6d35f310f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039810 Dec 25 22:28:22.331157 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4486/8936] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:28:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:28:22.855639 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:22.856206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:22.863070 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:22.863541 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:22.864352 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:22.864822 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:23.081420 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:23.088675 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6ee93b10-f24f-4c6f-aa6e-2b3d3691e2b9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.236925 Dec 25 22:28:23.091816 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4451/8937] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:22 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:24.106470 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:24.107167 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:24.113841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:24.114293 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:24.115070 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:24.115506 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:24.253539 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:24.260933 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fb9822cc-dd77-4803-9a8f-b30543e1f7d3 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.159302 Dec 25 22:28:24.261518 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4487/8938] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:24 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:25.277501 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:25.278137 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:25.285433 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:25.285904 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:25.286705 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:25.287162 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:25.419237 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:25.427129 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-e02bb15e-8ca0-44bf-aa43-f23c3ec2afa4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.153284 Dec 25 22:28:25.429961 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4452/8939] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:25 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:26.443581 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:26.444187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:26.450925 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:26.451888 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:26.452649 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:26.453113 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:26.584561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:26.591848 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-81cf292d-39de-4b5a-9bac-0927b5e6cefd tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.152226 Dec 25 22:28:26.592414 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4488/8940] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:26 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:27.196316 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-c84ab0b5-fac7-413f-901e-ff1078671c02 req-e3f7f8dd-a1f1-4df8-b3e5-b7e7d822a997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "name": "network-vif-plugged", "status": "completed", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:28:27.197949 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:28:27.197949 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:28:27.206642 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c84ab0b5-fac7-413f-901e-ff1078671c02 req-e3f7f8dd-a1f1-4df8-b3e5-b7e7d822a997 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:27.207112 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-c84ab0b5-fac7-413f-901e-ff1078671c02 req-e3f7f8dd-a1f1-4df8-b3e5-b7e7d822a997 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:27.218455 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-c84ab0b5-fac7-413f-901e-ff1078671c02 req-e3f7f8dd-a1f1-4df8-b3e5-b7e7d822a997 service nova] Creating event network-vif-plugged:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:28:27.223323 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-c84ab0b5-fac7-413f-901e-ff1078671c02 req-e3f7f8dd-a1f1-4df8-b3e5-b7e7d822a997 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031047 Dec 25 22:28:27.223899 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4453/8941] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:28:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:28:27.608650 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:27.609311 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:27.616039 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:27.616491 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:27.617301 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:27.617741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:27.749955 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:27.757405 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-779fa575-cb1b-4e9e-9f53-caecc6eea7a9 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1372 microversion: 2.1 time: 0.152991 Dec 25 22:28:27.757976 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4489/8942] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:27 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:28.775476 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:28.776187 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:28.782344 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:28.782809 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:28.783598 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:28.784043 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:28.921144 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:28.928516 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-a7b59fc3-926c-4f78-bc65-2d89f7250f18 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1556 microversion: 2.1 time: 0.158132 Dec 25 22:28:28.929133 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4454/8943] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:28 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:28.945004 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:28:28.945620 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:28:28.953270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:28.953720 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:28.954499 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:28.954934 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:29.088164 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:28:29.095673 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f41555d8-23e5-4535-9259-0834476032bc tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1556 microversion: 2.1 time: 0.154590 Dec 25 22:28:29.096247 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4490/8944] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:28:28 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:28:31.424031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-09325d8d-8868-41ec-8205-b359a8f33fc7 req-6e775311-1d7d-411b-8407-93c26f7acafc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:28:31.425739 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:28:31.425739 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:28:31.433329 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-09325d8d-8868-41ec-8205-b359a8f33fc7 req-6e775311-1d7d-411b-8407-93c26f7acafc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:28:31.433785 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-09325d8d-8868-41ec-8205-b359a8f33fc7 req-6e775311-1d7d-411b-8407-93c26f7acafc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:28:31.444990 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-09325d8d-8868-41ec-8205-b359a8f33fc7 req-6e775311-1d7d-411b-8407-93c26f7acafc service nova] Creating event network-changed:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:28:31.450270 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-09325d8d-8868-41ec-8205-b359a8f33fc7 req-6e775311-1d7d-411b-8407-93c26f7acafc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029868 Dec 25 22:28:31.450867 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4455/8945] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:28:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:28:37.980050 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:28:37.980557 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:28:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:28:38.158129 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:28:38.158325 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:28:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:28:39.622198 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:28:39.622745 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:28:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:29:58.641362 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-450597415"}} {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:29:58.642397 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:29:58.648331 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:29:58.648809 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:29:58.649612 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:29:58.650047 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:29:59.157687 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-1d466d90-ee63-4c65-b130-2ea69fffcd55 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "POST /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33/action" status: 202 len: 0 microversion: 2.1 time: 0.520936 Dec 25 22:29:59.158404 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4491/8946] 10.222.0.32 () {60 vars in 1277 bytes} [Sat Dec 25 22:29:58 2021] POST /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Dec 25 22:30:03.822661 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-436fd927-7004-4de9-b71a-eedd83abdb01 req-099652e0-66d3-4ce9-8a21-d0fa0bf3a57e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "name": "network-vif-plugged", "status": "completed", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:30:03.825501 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:30:03.825501 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:30:03.838177 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-436fd927-7004-4de9-b71a-eedd83abdb01 req-099652e0-66d3-4ce9-8a21-d0fa0bf3a57e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:03.845372 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-436fd927-7004-4de9-b71a-eedd83abdb01 req-099652e0-66d3-4ce9-8a21-d0fa0bf3a57e service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:03.854837 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-436fd927-7004-4de9-b71a-eedd83abdb01 req-099652e0-66d3-4ce9-8a21-d0fa0bf3a57e service nova] Creating event network-vif-plugged:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:30:03.861068 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-436fd927-7004-4de9-b71a-eedd83abdb01 req-099652e0-66d3-4ce9-8a21-d0fa0bf3a57e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049385 Dec 25 22:30:03.861815 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4456/8947] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:30:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:30:15.532430 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:15.533022 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:15.536187 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:30:15.537284 ncdv-master-1 devstack@n-api.service[136548]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Dec 25 22:30:15.542561 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:15.543015 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:15.543971 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:15.544408 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:15.572366 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:30:15.595587 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-1edc6c0e-4f5c-4cf4-a961-f74ad2fc0668 req-920c2871-2c50-457d-96cd-e6a7af9435dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:30:15.597172 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:30:15.597172 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:30:15.604531 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1edc6c0e-4f5c-4cf4-a961-f74ad2fc0668 req-920c2871-2c50-457d-96cd-e6a7af9435dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:15.605031 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-1edc6c0e-4f5c-4cf4-a961-f74ad2fc0668 req-920c2871-2c50-457d-96cd-e6a7af9435dc service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:15.616453 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-1edc6c0e-4f5c-4cf4-a961-f74ad2fc0668 req-920c2871-2c50-457d-96cd-e6a7af9435dc service nova] Creating event network-changed:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:30:15.621824 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-1edc6c0e-4f5c-4cf4-a961-f74ad2fc0668 req-920c2871-2c50-457d-96cd-e6a7af9435dc service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091588 Dec 25 22:30:15.622430 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4457/8948] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:30:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:30:15.840608 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b64f6cf3-58db-4929-8c70-06005e371c3b req-65c0336a-a914-47f4-ba1b-5e5841b7c71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "name": "network-vif-unplugged", "status": "completed", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:30:15.842300 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:30:15.842300 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:30:15.850224 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b64f6cf3-58db-4929-8c70-06005e371c3b req-65c0336a-a914-47f4-ba1b-5e5841b7c71a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:15.851807 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b64f6cf3-58db-4929-8c70-06005e371c3b req-65c0336a-a914-47f4-ba1b-5e5841b7c71a service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:15.869143 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b64f6cf3-58db-4929-8c70-06005e371c3b req-65c0336a-a914-47f4-ba1b-5e5841b7c71a service nova] Creating event network-vif-unplugged:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:30:15.874137 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b64f6cf3-58db-4929-8c70-06005e371c3b req-65c0336a-a914-47f4-ba1b-5e5841b7c71a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038924 Dec 25 22:30:15.874740 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4458/8949] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:30:15 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:30:16.012723 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-4378fdef-5824-4108-b624-14483659a257 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 204 len: 0 microversion: 2.1 time: 0.480147 Dec 25 22:30:16.012723 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4492/8950] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:30:15 2021] DELETE /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:30:16.021426 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:16.029301 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:16.039206 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:16.044324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:16.044324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:16.044324 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:16.252928 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:30:16.260334 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-14a65061-2ffb-4cfa-bc64-fbf40b51f07e tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1681 microversion: 2.1 time: 0.243327 Dec 25 22:30:16.261402 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4459/8951] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:16 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1681 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Dec 25 22:30:17.278189 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:17.278877 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:17.295491 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [ff8bc889-82fc-47b9-a34b-c5ac57789aed] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 40164. Dec 25 22:30:17.297648 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:17.298135 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:17.298956 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:17.299466 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:17.303409 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] [e74c5bca-607b-4f48-b868-9f1ebefc34d3] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 40162. Dec 25 22:30:17.439412 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:30:17.447084 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-5ec37bc0-d190-4f94-b634-0c2933232d75 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1562 microversion: 2.1 time: 0.172961 Dec 25 22:30:17.447652 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4493/8952] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:17 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1562 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:30:18.050023 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b33264a8-60c4-4c03-9fad-8926c51ba228 req-aa823507-2656-4096-b367-b22c7ee70e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ffc91a5-cad8-47af-b108-a8ee57cbed33", "name": "network-vif-deleted", "tag": "23fb2f57-55e3-4c78-be91-a50312c0dc4b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:30:18.051553 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:30:18.051553 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:30:18.059210 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b33264a8-60c4-4c03-9fad-8926c51ba228 req-aa823507-2656-4096-b367-b22c7ee70e7c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:18.059671 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b33264a8-60c4-4c03-9fad-8926c51ba228 req-aa823507-2656-4096-b367-b22c7ee70e7c service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:18.071206 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b33264a8-60c4-4c03-9fad-8926c51ba228 req-aa823507-2656-4096-b367-b22c7ee70e7c service nova] Creating event network-vif-deleted:23fb2f57-55e3-4c78-be91-a50312c0dc4b for instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 on nch1-master-1 Dec 25 22:30:18.076164 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b33264a8-60c4-4c03-9fad-8926c51ba228 req-aa823507-2656-4096-b367-b22c7ee70e7c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029923 Dec 25 22:30:18.076745 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4460/8953] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:30:18.463727 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:18.464270 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:18.471158 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:18.471614 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:18.472436 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:18.472919 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:18.505352 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:18.505800 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:18.506252 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lazy-loading 'fault' on Instance uuid 1ffc91a5-cad8-47af-b108-a8ee57cbed33 {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:30:18.544766 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:30:18.552652 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-63e9736a-18c9-4505-902b-9147feaf472c tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 200 len: 1337 microversion: 2.1 time: 0.092906 Dec 25 22:30:18.553253 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4494/8954] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:18 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 1337 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:30:19.570730 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:19.571440 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 1ffc91a5-cad8-47af-b108-a8ee57cbed33] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:19.577649 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:19.578143 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:19.578933 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:19.579383 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:19.592407 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] HTTP exception thrown: Instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 could not be found. Dec 25 22:30:19.593038 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Returning 404 to user: Instance 1ffc91a5-cad8-47af-b108-a8ee57cbed33 could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:30:19.594369 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-6710879b-7fdf-4e06-9825-d51dd69cc8d4 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33" status: 404 len: 111 microversion: 2.1 time: 0.028097 Dec 25 22:30:19.594869 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4461/8955] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:19 2021] GET /compute/v2.1/servers/1ffc91a5-cad8-47af-b108-a8ee57cbed33 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:30:21.785183 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:21.785908 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:21.794101 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:21.794742 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:21.795741 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:21.796188 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:21.822404 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Going to try to terminate instance {{(pid=136548) delete /opt/stack/nova/nova/compute/api.py:2614}} Dec 25 22:30:21.851319 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-b38ebf5e-6b82-4fe6-9519-f7556824af78 req-3c7f57ad-ff60-4ff5-aa02-09f1840c1a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:30:21.852857 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:30:21.852857 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:30:21.861448 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b38ebf5e-6b82-4fe6-9519-f7556824af78 req-3c7f57ad-ff60-4ff5-aa02-09f1840c1a68 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:21.861922 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-b38ebf5e-6b82-4fe6-9519-f7556824af78 req-3c7f57ad-ff60-4ff5-aa02-09f1840c1a68 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:21.872407 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-b38ebf5e-6b82-4fe6-9519-f7556824af78 req-3c7f57ad-ff60-4ff5-aa02-09f1840c1a68 service nova] Creating event network-changed:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:30:21.878408 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-b38ebf5e-6b82-4fe6-9519-f7556824af78 req-3c7f57ad-ff60-4ff5-aa02-09f1840c1a68 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094423 Dec 25 22:30:21.879257 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4462/8956] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:30:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Dec 25 22:30:22.104986 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-c0bae88d-a741-437a-9129-c49024836dba tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "DELETE /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 204 len: 0 microversion: 2.1 time: 0.323656 Dec 25 22:30:22.105889 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4495/8957] 10.222.0.32 () {58 vars in 1238 bytes} [Sat Dec 25 22:30:21 2021] DELETE /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Dec 25 22:30:22.115288 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:22.116404 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:22.123065 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:22.123620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:22.124685 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:22.125892 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:22.346623 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.policy [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136547) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:30:22.354631 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-49ae0036-8cd8-4167-82b9-4aff469ba045 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1682 microversion: 2.1 time: 0.243653 Dec 25 22:30:22.355205 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4463/8958] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:22 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1682 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:30:23.373107 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:23.373807 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:23.381187 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:23.381640 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:23.382417 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:23.382860 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:23.521378 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:30:23.528738 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-830d6a4a-6c26-4d9d-81c2-8bf003b8c714 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1563 microversion: 2.1 time: 0.159714 Dec 25 22:30:23.529340 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4496/8959] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:23 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1563 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:30:24.148490 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [req-e3d5a829-a490-4501-8516-5948235af196 req-9fa6fd3c-a8f2-41ec-82fb-70901370b015 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "383a5351-bf67-4a86-9167-35bd959e33de", "name": "network-vif-deleted", "tag": "4c0b5387-6ba4-45ad-8869-5edf0789130b"}]} {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Dec 25 22:30:24.150149 ncdv-master-1 devstack@n-api.service[136547]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-server-external-events:create": "rule:system_admin_api" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Dec 25 22:30:24.150149 ncdv-master-1 devstack@n-api.service[136547]: warnings.warn(msg) Dec 25 22:30:24.158238 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e3d5a829-a490-4501-8516-5948235af196 req-9fa6fd3c-a8f2-41ec-82fb-70901370b015 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:24.158758 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [req-e3d5a829-a490-4501-8516-5948235af196 req-9fa6fd3c-a8f2-41ec-82fb-70901370b015 service nova] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:24.171295 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.compute.server_external_events [req-e3d5a829-a490-4501-8516-5948235af196 req-9fa6fd3c-a8f2-41ec-82fb-70901370b015 service nova] Creating event network-vif-deleted:4c0b5387-6ba4-45ad-8869-5edf0789130b for instance 383a5351-bf67-4a86-9167-35bd959e33de on nch1-master-1 Dec 25 22:30:24.176683 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [req-e3d5a829-a490-4501-8516-5948235af196 req-9fa6fd3c-a8f2-41ec-82fb-70901370b015 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032040 Dec 25 22:30:24.178495 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4464/8960] 10.222.0.32 () {64 vars in 1317 bytes} [Sat Dec 25 22:30:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Dec 25 22:30:24.545233 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:24.545841 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.compute.api [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136548) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:24.552843 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:24.553332 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:24.554184 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:24.554627 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:24.587264 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:24.587717 ncdv-master-1 devstack@n-api.service[136548]: DEBUG oslo_concurrency.lockutils [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136548) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:24.588159 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.objects.instance [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lazy-loading 'fault' on Instance uuid 383a5351-bf67-4a86-9167-35bd959e33de {{(pid=136548) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Dec 25 22:30:24.626446 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.policy [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a300ee498f4ef9974ed430de68c526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58660263f53e4173b07360be1b863c34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=136548) authorize /opt/stack/nova/nova/policy.py:199}} Dec 25 22:30:24.633648 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-f7bfcec4-5156-4c29-9693-f1537d5304ce tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 200 len: 1337 microversion: 2.1 time: 0.092107 Dec 25 22:30:24.634206 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4497/8961] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:24 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 1337 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Dec 25 22:30:25.651914 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '>' {{(pid=136547) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:25.652620 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.compute.api [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] [instance: 383a5351-bf67-4a86-9167-35bd959e33de] Fetching instance by UUID {{(pid=136547) get /opt/stack/nova/nova/compute/api.py:2865}} Dec 25 22:30:25.660185 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:25.660652 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:25.661473 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Dec 25 22:30:25.661923 ncdv-master-1 devstack@n-api.service[136547]: DEBUG oslo_concurrency.lockutils [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Lock "d522ade6-efc6-487a-a0a8-1d707c18c816" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=136547) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Dec 25 22:30:25.674880 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.wsgi [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] HTTP exception thrown: Instance 383a5351-bf67-4a86-9167-35bd959e33de could not be found. Dec 25 22:30:25.675478 ncdv-master-1 devstack@n-api.service[136547]: DEBUG nova.api.openstack.wsgi [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Returning 404 to user: Instance 383a5351-bf67-4a86-9167-35bd959e33de could not be found. {{(pid=136547) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Dec 25 22:30:25.676365 ncdv-master-1 devstack@n-api.service[136547]: INFO nova.api.openstack.requestlog [None req-0f29808b-4800-4774-b406-ddd91c226352 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de" status: 404 len: 111 microversion: 2.1 time: 0.028598 Dec 25 22:30:25.676897 ncdv-master-1 devstack@n-api.service[136547]: [pid: 136547|app: 0|req: 4465/8962] 10.222.0.32 () {58 vars in 1235 bytes} [Sat Dec 25 22:30:25 2021] GET /compute/v2.1/servers/383a5351-bf67-4a86-9167-35bd959e33de => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Dec 25 22:30:25.908190 ncdv-master-1 devstack@n-api.service[136548]: DEBUG nova.api.openstack.wsgi [None req-fcc3d9b9-b4e3-4c3b-b6d3-8aad3b5d2703 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] Calling method '.version_select at 0x7fa4f61400d0>' {{(pid=136548) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Dec 25 22:30:26.005894 ncdv-master-1 devstack@n-api.service[136548]: INFO nova.api.openstack.requestlog [None req-fcc3d9b9-b4e3-4c3b-b6d3-8aad3b5d2703 tempest-TestSnapshotPattern-698834680 tempest-TestSnapshotPattern-698834680-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-892550964" status: 202 len: 0 microversion: 2.1 time: 0.106095 Dec 25 22:30:26.006482 ncdv-master-1 devstack@n-api.service[136548]: [pid: 136548|app: 0|req: 4498/8963] 10.222.0.32 () {58 vars in 1253 bytes} [Sat Dec 25 22:30:25 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-892550964 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Dec 25 22:31:57.988218 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:31:57.988694 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:31:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:31:58.165619 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:31:58.165795 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:31:58 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:32:23.553476 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:32:23.554085 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:32:23 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:33:39.633176 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:33:39.633866 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:33:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:33:41.526687 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:33:41.527303 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:33:41 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:35:17.996429 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:35:17.996938 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:35:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:35:18.172950 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:35:18.173129 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:35:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:35:42.804189 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:35:42.804836 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:35:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:35:43.563609 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:35:43.564138 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:35:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:36:59.641594 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:36:59.642286 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:36:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:37:01.535107 ncdv-master-1 devstack@n-api.service[136548]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:37:01.535702 ncdv-master-1 devstack@n-api.service[136548]: Sat Dec 25 22:37:01 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:38:38.004337 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:38:38.004862 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:38:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Dec 25 22:38:38.180368 ncdv-master-1 devstack@n-api.service[136547]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Dec 25 22:38:38.180598 ncdv-master-1 devstack@n-api.service[136547]: Sat Dec 25 22:38:38 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!